JP4055018B2 - Imaging apparatus and method - Google Patents

Description

  The present invention relates to an imaging apparatus and method, and more particularly to an imaging apparatus and method capable of supplying image data having an optimal data amount to another apparatus.

  In recent years, an imaging device such as a digital video camera has become widespread, and a camera such as a CCD (Charge Coupled Device) mounted on the imaging device has been increased in resolution. In addition, as represented by a digital video camera with a communication function, a mobile phone having an imaging function, and the like, the multifunctionality of an imaging apparatus has been advanced.

  For example, a digital video camera having a USB (Universal Serial Bus) communication function supplies moving image data obtained by imaging a subject to other devices such as a personal computer in real time via a USB cable. be able to.

  By the way, with the increase in the resolution of the camera, the amount of moving image data obtained by imaging the subject has also increased, and when the processing capability of the supply destination device is low or the network between the devices is congested, When the communication speed is low, there is a possibility that problems such as overflow of communication processing and dropped frames of the reproduced moving image may occur.

  On the other hand, the amount of data is always reduced in advance so that the digital video camera of the supply source can normally supply moving image data even in low-speed communication by compressing the moving image data to be supplied. However, if high-speed communication is possible, this method will unnecessarily degrade the quality of the reproduced moving image.

Therefore, the first data and the second data obtained by compressing the first data are prepared. When the communication speed is high, the first data is supplied, and when the communication speed is low, the first data is supplied. There is a method of supplying second data having a smaller amount of data compared to the above data. (For example, refer to Patent Document 1).
JP 2002-99393 A (page 4-12, FIG. 4)

  However, in the method as described above, the first data and the second data corresponding to the contents and the second data having a smaller data amount than the first data must be prepared in advance. In addition, the storage area for storing the supplied data increases, and there is a problem that it is not suitable when moving image data obtained by imaging a subject is supplied in real time.

  There is also a problem that the compression rate of the prepared second image data is not necessarily a compression rate appropriate for the communication state.

  The present invention has been made in view of such a situation, and allows image data having an optimal data amount to be supplied to another apparatus.

According to a first imaging apparatus of the present invention, an imaging unit that captures an image obtained by imaging a subject as image data, and image data captured by an imaging process by the imaging unit are connected to a communication device connected via a network. The amount of image data output by the imaging unit is adjusted according to a plurality of transmission units to be transmitted, a selection unit that selects an arbitrary transmission unit from the plurality of transmission units, and a transmission unit selected by the selection unit And adjusting means.

  The plurality of transmission units may transmit image data at different communication speeds.

  The plurality of transmission means may include wireless communication means and wired communication means.

The transmission means further transmits data other than the image data, and the adjustment means adjusts to reduce the amount of image data output by the imaging means when the transmission means transmits other data. Can be.

  The image data may be moving image data, and the other data may be still image data.

  The adjusting unit may adjust the number of pixels of the image output from the imaging unit.

  Still image data can be captured by the imaging means based on a request from the communication device.

  When moving image data is transmitted to the communication device, still image data can be captured by the imaging unit based on a request from the communication device.

When still image data is being transmitted to the communication device, the adjustment unit can reduce the amount of moving image data output by the imaging unit.

According to a first imaging method of the present invention, an arbitrary transmission unit that controls transmission of image data is selected from among a plurality of transmission units that transmit image data captured by an imaging unit to a communication device connected via a network. The selection step to select, the imaging means to control, the imaging control step to adjust the data amount of the image data output by the imaging means according to the transmission unit selected in the selection step, and the data by the control of the imaging control step And a transmission control step for controlling transmission of the image data, the amount of which has been adjusted and output from the imaging means, to the communication device by the transmission unit selected in the selection step .

The transmission control step further controls transmission of data other than the image data, and the imaging control step outputs image data output by the imaging means when the transmission control step controls to transmit other data. Adjustments can be made to reduce the amount of data.

Second imaging device of the present invention includes an imaging means for capturing an image obtained by imaging a subject as image data, and compression means for compressing the image data output from the imaging means, the image data compressed by the compression means A plurality of transmission means for transmitting to a communication device connected via a network, a selection means for selecting an arbitrary transmission means from the plurality of transmission means, and a compression means according to the transmission means selected by the selection means Adjusting means for adjusting the compression rate in the compression processing by the adjusting means, and the adjusting means determines the compression rate in the compression processing by the compression means when the transmission means selected by the selection means further transmits other data other than image data. Further, it is characterized in that the data amount of the image data output by the imaging means is reduced .

According to a second imaging method of the present invention, a selection step of selecting an arbitrary transmission unit among a plurality of transmission units that transmit image data captured by an imaging unit to a communication device connected via a network, and imaging An imaging control step for controlling the means and reducing the data amount of the image data output by the imaging means when the transmission unit selected by the processing of the selection step further transmits data other than the image data; Controls the compression unit that compresses the image data output by the control unit, adjusts the compression rate in the compression process by the compression unit according to the transmission unit selected by the process of the selection step, and is further selected by the process of the selection step When the transmission unit further transmits other data other than image data, the compression control step for increasing the compression rate and the processing of the compression control step Of the image data reduction ratio is compressed been adjusted, characterized in that it comprises a transmission control step of controlling the transmission to the communication device by the transmission unit selected in the selection step.

According to a third imaging apparatus of the present invention, an imaging unit that captures an image obtained by imaging a subject as image data, a compression unit that compresses image data output from the imaging unit, and image data compressed by the compression unit A plurality of transmission means for transmitting to a communication device connected via a network, a selection means for selecting an arbitrary transmission means from the plurality of transmission means, and a compression means according to the transmission means selected by the selection means and an adjustment means for adjusting the compression ratio in the compression process by the adjustment means, when the still image data is transmitted to the communication device, to reduce the data amount of moving image data output by the image pickup means It is characterized by.
According to a third imaging method of the present invention, a selection step of selecting an arbitrary transmission unit from among a plurality of transmission units that transmit image data captured by an imaging unit to a communication apparatus connected via a network, and imaging When the still image data is transmitted to the communication device, the image pickup control step for reducing the data amount of the moving image data output by the image pickup means and the image data output by the image pickup means are compressed. A compression control step for controlling the compression unit to be controlled and adjusting the compression rate in the compression processing by the compression unit according to the transmission unit selected by the processing of the selection step, and the compression rate is adjusted by the processing of the compression control step and compressed A transmission control step for controlling transmission of the image data to the communication device by the transmission unit selected in the selection step. That.

According to a fourth imaging apparatus of the present invention, an imaging unit that captures an image obtained by imaging a subject as image data, a compression unit that compresses image data output from the imaging unit, and image data compressed by the compression unit A plurality of transmission means for transmitting to a communication device connected via a network, a selection means for selecting an arbitrary transmission means from the plurality of transmission means, and a compression means according to the transmission means selected by the selection means and an adjustment means for adjusting the compression ratio in the compression process by the adjustment means, when the still image data to the communication device is transmitted, to increase the compression ratio in the compression processing of the image data by the compression means Features.
According to a fourth imaging method of the present invention, a selection step of selecting an arbitrary transmission unit from among a plurality of transmission units that transmit image data captured by an imaging unit to a communication device connected via a network, and imaging An image pickup control step for controlling the means and capturing an image obtained by picking up the subject as image data, and a compression unit for compressing the image data output by the image pickup means, and the transmission selected by the processing of the selection step Depending on the unit, the compression rate in the compression process by the compression unit is adjusted, and when still image data is transmitted to the communication device, the compression control step for increasing the compression rate, and the process of the compression control step A transmission control step for controlling transmission of image data compressed by adjusting the compression ratio to the communication device by the transmission unit selected in the selection step. Tsu, characterized in that it comprises a flop.

Fifth imaging device of the present invention includes an imaging means for capturing an image obtained by imaging a subject as image data, and compression means for compressing the image data outputted by the imaging means, the image data compressed by the compression means According to the transmission means selected by the selection means, a plurality of transmission means for transmitting the image to a communication device connected via the network, a selection means for selecting an arbitrary transmission means from the plurality of transmission means, And adjusting means for adjusting the data amount of the image data output by the compression means and the compression ratio in the compression processing by the compression means.

According to a fifth imaging method of the present invention, a selection step of selecting an arbitrary transmission unit among a plurality of transmission units that transmit image data captured by an imaging unit to a communication device connected via a network, and imaging An imaging control step for controlling the means and adjusting the data amount of the image data output by the imaging means according to the transmission unit selected by the processing of the selection step, and a compression for compressing the image data output by the imaging means The compression control step for adjusting the compression rate in the compression processing by the compression unit according to the transmission unit selected by the processing of the selection step, and the compression rate is adjusted and compressed by the processing of the compression control step image data, characterized in that it comprises a transmission control step of controlling the transmission to the communication device by the transmission unit selected in the selection step.

In the first imaging device and method of the present invention, an arbitrary control unit that controls transmission of image data among a plurality of transmission units that transmit image data captured by an imaging unit to a communication device connected via a network. transmission unit is selected, according to the transmission unit selected, the data amount of the image data output by the imaging means is adjusted, the image data output from the imaging unit data amount is adjusted, sent to the selected The transmission to the communication device by the unit is controlled.

In the second imaging apparatus and method of the present invention, among the plurality of transmitting unit for transmitting the image data captured by the imaging means to a communication apparatus connected via the network, any of the transmitter is selected, the imaging When the means is controlled and the selected transmission unit further transmits other data other than the image data, the amount of image data output by the image pickup means is reduced, and the image data output by the image pickup means is compressed. The compression unit is controlled, the compression rate in the compression processing by the compression unit is adjusted according to the selected transmission unit , and when the selected transmission unit further transmits other data other than the image data, the compression rate And the transmission of the image data compressed with the compression ratio adjusted to the communication device by the selected transmission unit is controlled.

In the third imaging device and method of the present invention, an arbitrary transmission unit is selected from among a plurality of transmission units that transmit image data captured by the imaging unit to a communication device connected via a network, and imaging is performed. When the means is controlled and still image data is transmitted to the communication device, the data amount of the moving image data output by the imaging unit is reduced, and a compression unit that compresses the image data output by the imaging unit The compression rate in the compression processing by the compression unit is adjusted according to the selected transmission unit to be controlled, and transmission of the image data compressed by adjusting the compression rate to the communication device is controlled by the selected transmission unit Is done.
In the fourth imaging device and method of the present invention, an arbitrary transmission unit is selected from among a plurality of transmission units that transmit image data captured by the imaging unit to a communication device connected via a network, and imaging is performed. The means is controlled, an image obtained by capturing an image of the subject is captured as image data, the compression unit that compresses the image data output by the imaging unit is controlled, and compression by the compression unit is performed according to the selected transmission unit When the compression rate in the processing is adjusted and still image data is transmitted to the communication device, the compression rate is increased, and the compressed image data is compressed by adjusting the compression rate. Transmission to the communication device is controlled.
In the fifth imaging device and method of the present invention, an arbitrary control unit that controls transmission of image data among a plurality of transmission units that transmit image data captured by the imaging unit to a communication device connected via a network. transmission unit is selected, the imaging means is controlled, according to the transmission unit selected, the data amount of the image data output by the imaging means is an adjustment, the compression unit to compress the image data outputted by the imaging means The compression rate in the compression processing by the compression unit is adjusted according to the selected transmission unit to be controlled, and transmission of the image data compressed by adjusting the compression rate to the communication device is controlled by the selected transmission unit Is done.

  According to the present invention, moving image data can be supplied to another device. In particular, image data having an optimal data amount can be supplied to another device. In addition, in the imaging apparatus of the present invention, such as external factors such as communication capability, network bandwidth and traffic status of other devices which are communication counterpart devices, and transmission or reception of still images during transmission of moving images, etc. By controlling the data amount of moving image data to be transferred in accordance with the factors, it is possible to supply image data having an optimum data amount to other devices.

  FIG. 1 is a diagram illustrating a basic configuration example of a mobile phone having a camera function to which the present invention is applied.

  Light from a subject (not shown) is incident on a CCD (Charge Coupled Device) 12 through a lens unit 11 of the mobile phone 1 configured by a lens, a diaphragm mechanism, and the like, and is photoelectrically converted.

  The video signal output from the CCD 12 is supplied to a CDS circuit (Correlated Double Sampling circuit) 13. The CDS circuit 14 performs correlated double sampling on the input signal to remove noise components, and outputs the signal to an AGC circuit (Automatic Gain Control circuit) 14. After adjusting the gain of the input signal, the AGC circuit 14 outputs the signal to an A / D (Analog / Digital) converter 15. The A / D converter 15 converts the input analog signal into a digital signal and outputs it to a DSP (Digital Signal Processor) 16.

  The DSP 16 generates control signals such as AF (Auto Focus), AE (Auto Exposure), and AWB (Auto White Balance) on the basis of the input signal by the built-in image adjustment processing unit 21, and sends the control signals to the bus. The data is supplied to a CPU (Central Processing Unit) 31 through 30. Further, the DSP 16 compresses or further expands the input image signal by the built-in image compression / decompression processing unit 22. At that time, the image compression / decompression processing unit 22 performs processing while temporarily holding the video signal in the SDRAM 17 controlled by the SDRAM (Synchronous Dynamic Random Access Memory) controller 23 built in the DSP 16.

  The image data compressed by the image compression / decompression processing unit 22 is supplied to a RAM (Random Access Memory) 33 or the like via the bus 30.

  The CPU 31 controls each unit and executes various processes according to a program stored in a ROM (Read Only Memory) 32 or a program loaded from the storage unit 35 to the RAM 33. The RAM 33 also appropriately stores data necessary for the CPU 31 to execute various processes.

  The CPU 31 is also connected to an external operation input unit 34 that receives user operations. The external operation input unit 34 includes various buttons such as a shutter button and a menu button, a dial, a knob, a touch panel (none of which are shown), and the like. An instruction is received and the instruction information is supplied to the CPU 31. The CPU 31 executes various processes based on the instruction information.

  The CPU 31, ROM 32, and RAM 33 are connected to each other via the bus 30. The bus 30 also includes a flash memory 35 composed of a nonvolatile semiconductor memory, a display control unit 36 for controlling an image to be displayed on the LCD 37, a memory I / F (InterFace) 38 to which a memory card 39 and the like are mounted. , Wireless communication with a USB controller 40 for controlling a USB connector 41 to which a USB (Universal Serial Bus) cable (not shown) is connected, and other devices, for example, an image captured by the CCD 12 under the control of the CPU 31 A wireless communication unit 42 that supplies data to other devices is connected.

  The display control unit 36 includes a VRAM (Video Random Access Memory) (not shown). The display control unit 36 stores the image data fetched from the CCD 12 in the built-in VRAM, an image corresponding to the image data stored in the VRAM, and other memories (RAM 33, flash memory 35, memory I / F 38). The image corresponding to the image data stored in the memory card 39 or the like connected to is displayed on the LCD 37.

  The bus 30 is also connected to a drive 43 via an interface (not shown) as necessary, and reads from the magnetic disk 44, the optical disk 45, the magneto-optical disk 46, or the semiconductor memory 47 mounted on the drive 43. The issued computer program is installed in the RAM 33, the flash memory 35, or the like. In addition, a computer program read from the memory card 39 that is appropriately attached to the memory I / F 38 is also installed in the RAM 33, the flash memory 35, or the like as necessary.

  The CPU 31 is based on instruction information from the user input from the external operation input unit 34, control information supplied from the image adjustment processing unit 21, information obtained by executing various programs, and the like. The operation of the CDS circuit 13, the AGC circuit 14, and the A / D converter 15 is controlled.

Further, in accordance with an instruction from the user input from the external operation input unit 34, a transmission method for transmitting the obtained image data to another device is selected. That is, in the example of FIG. 1, the user can freely select from the external operation input unit 34 whether to transmit image data via the USB connector 41 or the wireless communication unit 42. The CPU 31 controls a TG (Timing Generator) 51 that controls the operation of the CCD 12 based on the selected communication method, adjusts the amount of image data captured from the CCD 12, and controls the compression of image data in the DSP 16. To do.

  Further, the CPU 31, for example, information such as a communication speed of wired communication by the USB controller 40, a communication speed of wireless communication by the wireless communication unit 42, a request supplied from a communication partner device, or an external operation input unit 34 Based on information such as the input request, the TG 51 that controls the operation of the CCD 12 is controlled to adjust the data amount of image data fetched from the CCD 12, and the image compression / decompression processing unit 22 of the DSP 16 via the bus 30. The compression rate of the image data in the compression processing by the control is controlled, and the data amount of the image data to be transferred is adjusted.

  Further, the CPU 31 controls the iris shutter driver 53 that controls the operation of the lens unit 11 to adjust the shutter speed and adjust the aperture mechanism.

  The TG 51 and the V driver 52 are connected to the CCD 12 and are controlled by the CPU 31 via the serial control bus to control the operation of the CCD 12.

  The TG 51 generates a horizontal clock signal for driving a horizontal transfer register 63 of the CCD 12 to be described later with reference to FIG. 2 and other control signals based on the control signal supplied from the CPU 31, and supplies it to the CCD 12 and the V driver 52. To do.

  The V driver 52 generates vertical control signals V1 to V8 for driving the vertical transfer registers 62-1 to 62-n of the CCD 12, as will be described later with reference to FIG. This is a vertical register driver for generating and supplying to the CCD 12.

  FIG. 2 is a schematic diagram illustrating a main configuration example of the inside of the CCD 12.

  In FIG. 2, the CCD 12 includes photodiodes 61-1-1 to 61-nm, which are solid-state imaging devices, arranged in m rows and n columns, and the photodiodes 61-1-1 to 61-n-. m is connected to the vertical transfer registers 62-1 to 62-n for each column.

  In the following, the photodiodes 61-1-1 to 61-nm are referred to as photodiodes 61 when there is no need to explain them separately. Similarly, the vertical transfer registers 62-1 to 62-n are also referred to as vertical transfer registers 62 when there is no need to explain them separately.

  That is, the photodiodes 61-1-1 to 61-1-m in the first column from the left are connected to the vertical transfer register 62-1, and the photodiodes 61-2-1 to 61-2-m in the second column are connected. Are connected to the vertical transfer register 62-2. The photodiodes in the third and subsequent columns are similarly connected to the vertical transfer register 62-2, and the photodiodes 61-n-1 to 61-nm in the nth column are connected to the vertical transfer register 62-n.

  The vertical transfer register 62-1 includes a plurality of registers, and can hold charges accumulated in the photodiodes 61-1-1 to 61-1-m to which the registers are connected. Further, the vertical transfer register 62-1 is connected to the horizontal transfer register 63, and can move the held charges one step at a time and supply them sequentially to the horizontal transfer register 63.

  Vertical control signals V1 to V8 are supplied to the CCD 12 from the V driver 52. As will be described later with reference to FIG. 3, the vertical control signals V1 to V8 are supplied to the respective registers of the vertical transfer register 62-1. Either signal is supplied. The vertical transfer register 62-1 is controlled by the vertical control signals V1 to V8, and executes processing such as charge holding and transfer described above.

  When a substrate voltage is applied by a SUB (SUBstrate) signal supplied from the V driver 52, among the connected photodiodes 61-1-1 to 61-1-m, the vertical control signals V1, 3, 5, The charges accumulated in the photodiodes designated by 7 and 7 are transferred to the vertical transfer register 62-1. The transferred charges are moved downward by one step under the control of the vertical control signals V1 to V8 and sequentially transferred to the horizontal transfer register 63.

  The vertical transfer registers 62-2 to 62-n have the same configuration as that of the vertical transfer register 62-1, and operate in the same manner, so that the description thereof is omitted.

  FIG. 3 is a schematic diagram illustrating a connection example between the vertical control signals V1 to V8 and a part of the vertical transfer register 62.

  As shown in FIG. 3, a photodiode 61 is connected to every two stages of each register constituting the vertical transfer register 62, and the vertical control signals V1, V3, V3 are connected to the register to which the photodiode 61 is connected. V5 or V7 is connected to each other, and V2, V4, V6, or V8 is connected to the other registers, respectively.

  Therefore, for example, when a predetermined signal is input to the vertical transfer register 62 from the vertical control signals V1, V3, V5, and V7, the charges accumulated in all the photodiodes 61 are transferred to the vertical transfer register 62.

  Further, for example, when only a predetermined signal is input to the register, only the vertical control signals V5 and V7, among the photodiodes 61 in which charges are stored, the vertical control signals V5 and V7 of FIG. 3A are input. 3 is transferred to the vertical transfer register 62, and the charge stored in the photodiode 61 in FIG. 3B is discharged without being transferred. That is, in this case, the electric charge accumulated in one photodiode 61 is taken in every five stages.

  Returning to FIG. 2, the horizontal transfer register 63 includes a plurality of registers, and each register holds the charge supplied from the connected vertical transfer registers 62-1 to 62-n for one photodiode. can do. Further, the horizontal transfer register 63 can move the held charges one by one and sequentially supply the charges to the outside of the CCD 12.

  Further, the horizontal transfer register 63 is connected to each register with a discharge drain and a column selection discharge gate (not shown) for selecting whether or not to discharge charges at the discharge drain. The charge to be transferred can be selected.

  When a voltage is applied to the column selection / discharge gate by the RG signal supplied from TG 51, the charges transferred from the connected vertical transfer registers 62-1 to 62-n are connected to the column selection / discharge gate. Only the charge in the column in which the discharged drain is disposed is selectively discharged. The other charges are moved one step at a time in the left direction in the figure under the control of horizontal control signals (H1 and H2) supplied from the TG 51, and sequentially transferred to the outside of the CCD 12.

  As described above, the CPU 31 controls the TG 51 to control the CCD 12 and adjust the amount of image data to be captured.

  FIG. 4 is a schematic diagram showing an example of a state of communication using USB.

  In USB communication, a terminal that performs communication is divided into a host side that controls communication and a device side that is a communication partner.

  On the host side, the client software 71 executed in the CPU 31 or the like in FIG. 1 instructs communication to the USB system software 72 executed in the USB controller 40 in FIG. 1, and the USB system software 72 is a physical interface. The communication via the USB bus I / F 73 is controlled.

  On the other hand, on the device side, the function 74 that is a function unique to the device instructs the USB logical device 75 to communicate, and the USB logical device 75 performs communication via the USB bus I / F 76 that is a physical interface. Control.

  That is, the client software 71 and the function 74 execute processes related to each other based on information exchanged by USB communication, and the USB system software 72 and the USB logical device 75 control the USB communication to request the requested information. Are exchanged via the USB bus I / Fs 73 and 76.

  The USB controller 40 in FIG. 1 is compatible with USB version 2.0, which is a communication standard, and performs communication at a maximum transfer rate of 480 Mbps. In addition, the USB controller 40 is compatible with the USB version 1.1 of the other device connected to the USB connector 41 via the USB cable, and the maximum transfer speed is 12 Mbps or 1.5 Mbps. In this case, communication is performed in accordance with the transfer rate. The information is supplied to the CPU 31, and the CPU 31 adjusts the amount of image data captured from the CCD 12 and adjusts the compression rate of the image data based on the information.

  Further, as will be described later, the USB controller 40 measures an actual transfer rate that varies depending on various loads and supplies the information to the CPU 31. Based on the information, the CPU 31 adjusts the amount of image data captured from the CCD 12 and adjusts the compression rate of the image data.

  FIG. 5 is a diagram illustrating a detailed configuration example of the wireless communication unit 42 of FIG.

  The antenna 81 receives radio waves from other devices, supplies the received signals to the selector 82, and supplies signals from the selector 82 to other devices by radio waves. The selector 82 demodulates the signal received from the antenna 81 by, for example, a CDMA (Code Division Multiple Access) system and supplies the demodulated signal obtained as a result to the down converter 83.

  The down converter 83 converts the frequency of the carrier wave of the acquired demodulated signal into a low frequency and supplies the demodulated signal to the reception I / F 84. The reception I / F 84 performs processing such as A / D conversion processing on the acquired demodulated signal, and supplies the digital signal to the baseband signal processing 85.

  The baseband signal processing unit 85 extracts received data by performing packet processing, error signal processing, and the like from the digital signal acquired from the reception I / F 84 based on the standard, and supplies the received data to the bus 30 or via the bus 30. The control signal or the like is added to the acquired data, and the data is supplied to the transmission I / F 86.

  The transmission I / F 86 converts the acquired digital signal into an analog signal and supplies the analog signal to the power amplifier 87. In the power amplifier 87, the transmission signal whose output has been increased is output from the antenna 81 via the selector 82.

  Note that the maximum communication speed in the wireless communication unit 42 varies depending on the communication carrier, the communication standard, and the like.

  In addition, the wireless communication unit 42 changes the transfer speed to a communicable speed according to the maximum communication speed of the communication device that is the communication partner. The information is supplied to the CPU 31, and the CPU 31 adjusts the amount of image data captured from the CCD 12 and adjusts the compression rate of the image data based on the information.

  Further, as will be described later, the wireless communication unit 42 measures an actual transfer rate that varies depending on various loads and supplies the information to the CPU 31. Based on the information, the CPU 31 adjusts the amount of image data captured from the CCD 12 and adjusts the compression rate of the image data.

  Next, a case where the CPU 31 adjusts the data amount of image data captured from the CCD 12 according to the maximum communication speed of the communication device connected via the USB connector 41 will be described. FIG. 6 is a schematic diagram showing a configuration example of a system that transfers and displays image data captured by the mobile phone 1 of FIG. 1 to another device via a USB cable.

  In FIG. 6A, the mobile phone 1 is connected to a PDA (Personal Digital Assistants) 91 via a USB cable 92 connected to a USB connector 41 provided at the bottom of the mobile phone 1 in the figure. In the figure, the moving image data obtained by photoelectrically converting the incident light incident on the CCD 12 in FIG. 1 through the lens unit 11 provided in the upper left part of the mobile phone 1 is controlled by the CPU 31 to correspond. The moving image is displayed on the LCD 37 provided at the upper front of the mobile phone 1 in the figure, and is also supplied to the PDA 91 via the USB cable 92, and displayed on the display unit provided on the front of the PDA 91 in the figure. Is done.

  The lens unit 11, the LCD 37, and the USB connector 41 may be provided at a location other than those described above of the mobile phone 1.

  In the case of FIG. 6A, assuming that the maximum transfer rate of the PDA 91 is 1.5 Mbps, the communication rate between the mobile phone 1 and the PDA 91 is 1.5 Mbps at the maximum. That is, even if the mobile phone 1 has a communication capability of a maximum communication speed of 480 Mbps, the maximum communication speed between these devices corresponds to the communication capability of the PDA 91 whose maximum communication speed is slower than that of the mobile phone 1.

  Therefore, in this case, the CPU 31 of the mobile phone 1 determines that the maximum possible communication speed in communication with the PDA 91 is slow, and controls the data amount of moving image data captured by the CCD 12 to be small. As a result, moving image data with a small amount of data is transferred to the PDA 91, and a low-quality moving image 93 with low image quality is displayed on the display unit of the PDA 91. That is, the CPU 31 controls the CCD 12 to reduce the amount of image data to be captured so that the data amount can be normally transferred at the communication speed set by the USB controller 40 according to the maximum communication speed of the PDA 91. . As described above, the mobile phone 1 can supply the moving image data to the PDA 1 without causing an overflow, a frame drop, or the like even with USB communication with a maximum transfer rate of 1.5 Mbps.

  Further, as shown in FIG. 6B, when the maximum transfer rate of the PDA 91 is 480 Mbps, that is, when normal transfer is possible even if the amount of image data to be transferred is large, the CPU 31 moves the moving image captured by the CCD 12. Control is performed so as not to reduce the amount of data, and the captured moving image data is supplied to the PDA 91. As a result, a high-quality moving image 94 with high image quality is displayed on the display unit of the PDA 91.

  As described above, the CPU 31 controls the CCD 12 according to the processing capability of the apparatus to which the moving image data is supplied, and adjusts the amount of moving image data to be captured.

  Specifically, the CPU 31 acquires data supply destination information from the USB controller 40, selects a mode for determining the image quality of moving image data to be captured based on the information, and controls the CCD 12 and the like according to the mode. Then, the moving image data with the adjusted data amount is taken in, and the moving image data is supplied to the PDA 91 via the USB cable 92.

  Next, a mode setting process related to moving image data capture by the CPU 31 in the case shown in FIG. 6 will be described with reference to the flowchart of FIG.

  When the imaging process is started based on a user instruction or the like, the CPU 31 first requests the device information of the PDA 91 including information on the capability relating to transfer of moving image data to the USB controller 40 in step S1, It is determined whether or not it has been acquired from the USB controller 40.

  If it is determined that the data has been acquired from the USB controller 40, the CPU 31 determines in step S2 based on the acquired device information that the modes relating to moving image data capture in the CCD 12 are two modes prepared in advance. Is selected and set from the high image quality mode for transferring the image data and the low image quality mode for transferring the image data having a smaller data amount than in the high image quality mode. CPU31 which set the mode advances a process to step S3.

  If it is determined in step S1 that the device information has not been acquired, the CPU 31 skips step S2 and proceeds to step S3.

  In step S3, the CPU 31 determines whether or not to end the mode setting process. If it is determined not to end the process, the CPU 31 returns the process to step S1 and repeats the subsequent processes.

  If it is determined that the mode setting process is to be ended, the CPU 31 advances the process to step S4, performs the end process, and ends the mode setting process.

  As described above, the CPU 31 that has determined the mode relating to moving image capture next executes the image capture control processing. The image capturing control process will be described with reference to the flowchart of FIG.

  In step S21, the CPU 31 determines whether or not the current moving image capturing mode is the high image quality mode. If it is determined that the mode is the high image quality mode, the CPU 31 controls the CCD 12 and TG 51 in FIG. 1 to capture the image signals of all pixels and generate high quality moving image data in step S22.

  When the first field of the moving image is extracted in the high image quality mode, the charges accumulated in the photodiode 61 corresponding to the vertical control signals V3 and V7 shown in FIG. 3 are transferred to the vertical transfer register 62, and the image When the second field is extracted, charges accumulated in the photodiode 61 corresponding to the vertical control signals V1 and V5 are transferred to the vertical transfer register 62. As described above, the CPU 31 controls the TG 51 so that the CCD 12 takes in charges from all the photodiodes 61 and outputs moving image data for one frame.

  When the process of step S22 ends, the CPU 31 advances the process to step S24.

  If it is determined in step S21 that the current moving image capturing mode is not the high image quality mode (the low image quality mode), the CPU 31 proceeds to step S23 to control the CCD 12 and TG 51 in FIG. The image signal of some pixels is taken in, and low-quality moving image data is generated.

  When the charge for one frame is extracted in the low image quality mode, only the charges accumulated in the photodiode 61 (the photodiode A in FIG. 3) corresponding to the vertical control signals V5 and V7 shown in FIG. It is transferred to the transfer register 62. As a result, as shown in FIG. 9, the amount of data in the vertical direction is reduced to 1/5.

  The CCD 12 uses a primary color filter in which R (Red), G (Green), and B (Blue) filters are arranged in a Bayer pattern from incident light. As shown in FIG. The photodiode from which the charge corresponding to the G signal is extracted, and the photodiode from which the charge corresponding to the B signal is extracted in the horizontal direction in the figure, and the photodiode from which the charge corresponding to the R signal is extracted The photodiodes from which charges corresponding to the G signals are extracted are alternately arranged in the vertical direction in the figure with rows adjacent in the horizontal direction in the figure.

  That is, the first row from the top in the figure is a row where photodiodes from which charges corresponding to the G signal are extracted and photodiodes from which charges corresponding to the B signal are extracted are adjacent to each other. The second row is a row where a photodiode from which a charge corresponding to the R signal is extracted and a photodiode from which a charge corresponding to the G signal is extracted are adjacent.

  In the low image quality mode, the charge in the row A of FIG. 9 is taken in the photodiode 61 configured as described above, and the amount of data in the vertical direction is reduced to 1/5.

  As described above, the charges transferred to the vertical transfer register 62 are transferred to the horizontal transfer register 63 one by one as described above. At this time, the horizontal transfer register 63 is controlled by the RG signal supplied from the TG 51 to the CCD 12 and discharges charges other than those in a predetermined column. For example, the horizontal transfer register 63 leaves charges every five columns based on the control of the RG signal, and discharges the charges in the four columns between them through the drain. By operating the horizontal transfer register in this way, the amount of data in the horizontal direction is reduced to one fifth.

As described above, the CPU 31 takes in charges from some photodiodes of the CCD 12 and generates moving image data for one frame.

  Returning to FIG. 8, when the process of step S23 is completed, the CPU 31 advances the process to step S24.

  In step S24, the CPU 31 determines whether or not to end the image capturing control process. When it determines with not complete | finishing yet, CPU31 returns a process to step S21, and repeats the process after it.

  If it is determined in step S24 that the image capture control process is to be terminated based on user input or the like, the CPU 31 performs a termination process in step S25, and terminates the image capture control process.

  The CPU 31 can supply the moving image data captured as described above to the USB controller 40 and the like, and can supply the moving image data to the PDA 91 via the USB cable 92. Thereby, the mobile phone 1 can supply the moving image data to the PDA 91 without causing an overflow or a frame drop. Note that the method for reading from the photodiode 61 is not limited to the above-described method, and any method may be used as long as the amount of charge read according to the image quality mode is controlled.

  Further, when supplying the captured moving image data, the CPU 31 may compress the image data and then supply it to the PDA 1. In this case, the compression rate can be changed according to the communication speed, that is, according to the moving image capturing mode. At this time, as described above, the amount of charge read from the CCD 12 does not change according to the image quality mode.

  The image data compression processing by the CPU 31 will be described with reference to the flowchart of FIG.

  In step S41, the CPU 31 determines whether or not the current mode is the high image quality mode. If it is determined that the current mode is the high image quality mode, in step S42, the CPU 31 obtains high-quality moving image data with the first compression rate. Then, the process proceeds to step S44.

  If it is determined in step S41 that the current mode is not the high image quality mode (ie, the low image quality mode), the CPU 31 performs the second compression, which is a compression rate higher than the first compression rate, in step S43. The low-quality moving image data is compressed depending on the rate, and the process proceeds to step S44.

  In step S44, if the CPU 31 determines whether or not to end the image data compression processing and determines not to end the processing, the CPU 31 returns the processing to step S41 and repeats the subsequent processing.

  If it is determined in step S44 that the image data compression process is to be terminated for some reason, the CPU 31 terminates the image data compression process after performing the termination process in step S45.

  As described above, the CPU 31 can compress the captured moving image data at a compression rate corresponding to the moving image capturing mode, supply it to the USB controller 40 and the like, and supply it to the PDA 91 via the USB cable 92. . Thereby, the mobile phone 1 can supply the moving image data to the PDA 91 without causing an overflow or a frame drop.

  Further, a new embodiment combining the above-described embodiments can be considered. That is, as is normally considered, the charge amount read from the CCD 12 is increased in the high image quality mode (high-speed transfer is possible), and the charge is read out from the CCD 12 in the low image quality mode (only low-speed transfer is possible). To reduce the amount of compression. In addition, when priority is given to compression processing, the charge amount read from the CCD 12 is reduced in the high image quality mode (high-speed transfer is possible), and the CCD 12 is used for low compression or in the low image quality mode (only low-speed transfer is possible). Increase the amount of charge to be read out and compress it at a high level.

  In the above description, the moving image capturing mode is changed according to the information on the communication speed of the PDA 91 that is the moving image data supply destination. For example, as shown in FIG. Is connected via a network 101 typified by a LAN (Local Area Network) or the Internet, the moving image capture mode is adjusted according to the communication band, traffic state, etc. of the network 101. Also good. For example, in the initial stage of establishment of communication between devices, the determination of the traffic state is performed until a response issued from the communication partner is obtained in response to a command issued to know the communication partner or the communication capability of the communication partner. Judged by counting time.

  For example, as shown in FIG. 11A, when the network 101A is a broadband network or is not congested, that is, when high-speed communication is possible, the CPU 31 of the mobile phone 1 sets the moving image capturing mode to high. In the image quality mode, high-quality moving image data is generated and supplied to the PDA 91. The PDA 91 displays a high-quality moving image 94 corresponding to the acquired high-quality moving image data on the display unit.

  For example, as shown in FIG. 11B, when the network 101B is a narrow-band network or is congested, that is, when high-speed communication is impossible, the CPU 31 of the mobile phone 1 The image capturing mode is set to the low image quality mode, moving image data with low image quality and a small amount of data is generated, and supplied to the PDA 91. The PDA 91 displays a low-quality moving image 93 corresponding to the acquired low-quality moving image data on the display unit.

  Next, the mode setting process in the above case will be described with reference to the flowchart of FIG.

  First, the CPU 31 controls the USB controller 40 to generate communication information including information on the current communication speed and the like, and obtains it via the bus 30. In step S61, the CPU 31 determines whether or not the communication information has been acquired. If the CPU 31 determines that the communication information has been acquired, in step S62, the CPU 31 sets a mode related to moving image capture based on the acquired communication information, and step S63. Proceed with the process.

  If it is determined in step S61 that the communication information has not been acquired, the CPU 31 skips the process of step S62 and advances the process to step S63.

  In step S63, the CPU 31 determines whether or not to end the mode setting process. If it is determined to end, the CPU 31 returns the process to step S61 and repeats the subsequent processes.

  On the other hand, when it is determined that the mode setting process is to be terminated based on the user instruction or the like, the CPU 31 advances the process to step S64, performs the termination process, and then terminates the mode setting process.

  As described above, the CPU 31 can set a mode related to moving image capture according to the current communication speed of the USB controller 40. As a result, even when the traffic status of the network 101 connected to the PDA 91 to which the moving image data is supplied changes, the moving image data can be normally supplied to the PDA 91, and the PDA 91 overflows. A moving image corresponding to the supplied moving image data can be displayed without causing frame dropping or the like.

  In the above description, the case where the network 101 exists between the mobile phone 1 that supplies the moving image data and the PDA 91 that acquires the moving image data has been described. A communication device capable of communicating with the portable telephone 1 and the PDA 91 may be used.

  In addition to the cases described above, the CPU 31 may set a mode related to moving image capture based on an instruction from the PDA 91 to which moving image data is supplied.

  A mode setting process in the case of setting a moving image capturing mode based on a request on the moving image data receiver side will be described with reference to a flowchart of FIG.

  In step S81, the CPU 31 controls the USB controller 40 to determine whether or not an image quality designation request has been acquired from the PDA 91. If the CPU 31 determines that it has been acquired, in step S82, based on the acquired image quality designation request, The mode setting relating to moving image capture is updated, and the process proceeds to step S83.

  If it is determined in step S81 that an image quality designation request has not been acquired from the PDA 91, the CPU 31 omits the process of step S82 and proceeds to step S83.

  In step S83, the CPU 31 controls the USB controller 40 to determine whether or not a designation release request has been acquired from the PDA 91. If it is determined that it has been acquired, in step S84, the CPU 31 updates the mode updated by the process in step S82. The setting is returned to the original, and the process proceeds to step S85.

  If it is determined in step S83 that the designation release request has not been acquired, the CPU 31 skips the process of step S84 and advances the process to step S85.

  In step S85, the CPU 31 determines whether or not to end the mode setting process. If it is determined that the mode setting process is not to be ended, the CPU 31 returns the process to step S81 and repeats the subsequent processes.

  On the other hand, when it is determined that the mode setting process is to be ended based on the user's instruction or the like, the CPU 31 ends the mode setting process after performing the end process in step S86.

  That is, when the CPU 31 acquires an image quality designation request from the PDA 91 that is the supply destination of the moving image data, the CPU 31 fixes the requested mode until the designation release request is obtained, and gives priority to setting based on other conditions. Then, when acquiring the designation cancellation request, the CPU 31 returns the mode setting to the mode before acquiring the image quality designation request.

  As described above, the CPU 31 can set a mode related to moving image capture based on a request from the PDA 91 side. Thereby, for example, the user of the PDA 91 can specify the image quality of the moving image while confirming the moving image displayed on the display unit.

  In addition, as shown in FIG. 14A, the mobile phone 1 uses the wireless communication unit 42 to exchange moving image data with another mobile phone by wireless communication, as shown in FIG. 14B. It is also possible to supply moving image data to the PDA 91 connected to the USB connector 41. At this time, for example, as shown in FIG. 14A, in the case of wireless communication using the wireless communication unit 42, the maximum communication speed is 9600 bps, and as shown in FIG. 14B, in the case of wired communication using a USB controller, The maximum communication speed is 480 Mbps.

  As described above, the communication speed may change depending on the communication unit to be used, and the CPU 31 may set the mode according to the communication unit used to supply moving image data.

  For example, as shown in FIG. 14A, incident light incident through the lens unit 11 provided in the upper left part of the mobile phone 1A having the same configuration as that of the mobile phone 1 and operating similarly is photoelectrically generated in the CCD 12. When the moving image data obtained by the conversion is supplied to a mobile phone 1B having the same configuration as that of the mobile phone 1 and using the wireless communication with the maximum communication speed of 9600 bps, the CPU 31 of the mobile phone 1A is used. Sets the mode relating to moving image capture to the low image quality mode.

  When moving image data with a small amount of data is captured based on the set low image quality mode, the CPU 31 of the mobile phone 1A provides a low-quality moving image corresponding to the moving image data on the front surface of the mobile phone 1A. The moving image data is displayed on the display 37, and the moving image data is supplied to the wireless communication unit 42 and transferred to the mobile phone 1B via the antenna 81 provided in the upper right portion of the mobile phone 1A.

  When the CPU 31 of the mobile phone 1B acquires the transmitted moving image data via the antenna 81 provided in the upper right part of the mobile phone 1B, the corresponding low-quality moving image 93 is provided on the front surface of the mobile phone 1B. Displayed on the display 37.

  Further, for example, as shown in FIG. 14B, moving image data obtained by photoelectrically converting incident light incident through a lens unit 11 provided at the upper left portion of the mobile phone 1 in a CCD 12 When supplying to the PDA 91 using USB communication at a speed of 480 Mbps, the CPU 31 of the mobile phone 1 sets the mode relating to moving image capture to the high image quality mode.

  When moving image data with a small amount of data is captured based on the set high image quality mode, the CPU 31 of the mobile phone 1 provides a high-quality moving image corresponding to the moving image data on the front surface of the mobile phone 1. The moving image data is displayed on the display 37, and the moving image data is supplied to the USB controller 40 and transferred to the PDA 91 via the USB cable 92 connected to the USB connector 41 provided at the lower part of the mobile phone 1.

  When acquiring the moving image data, the PDA 91 displays the corresponding high-quality moving image 94 on the display.

  The mode setting process in the above case will be described with reference to the flowchart of FIG.

  First, in step S101, the CPU 31 controls the USB controller 40 and the wireless communication unit 42, acquires information on communication capability from each, and determines whether or not the communication unit to be used is capable of high-speed communication. If it is determined that high-speed communication is possible, the CPU 31 sets the high image quality mode in step S102 and ends the mode setting process. If it is determined in step S101 that high-speed communication is impossible, the CPU 31 sets a low image quality mode in step S103 and ends the mode setting process.

  As described above, the CPU 31 can set a mode related to moving image capture according to the capability of the communication unit to be used.

  Further, as shown in FIG. 16A, the CPU 31 may be able to capture a still image with a predetermined image quality in the CCD 12 based on a request from the PDA 91 for acquiring moving image data. At that time, since it is not necessary to transfer the still image in real time, it can be transferred normally even if there is a large amount of data. Therefore, the still image is captured in a preset mode regardless of the current mode related to moving image capture. You may be able to. That is, even when a moving image is currently transferred in the low image quality mode, if the still image shooting mode of the mobile phone 1 is set in the high image quality shooting mode, the still image is captured based on the setting information. be able to.

  With reference to the flowchart of FIG. 17, a mode setting process when a still image is captured in the high image quality mode based on a request from the PDA 91 will be described.

  First, in step S121, the CPU 31 controls the USB controller 40 to determine whether a still image capture instruction has been acquired, and waits until it is determined that it has been acquired.

  If it is determined that it has been acquired, the CPU 31 advances the processing to step S122 and sets the image quality mode. In step S123, the CPU 31 controls the CCD 12 to determine whether still image data has been acquired, and waits until it is determined that it has been acquired.

  When the CCD 12 determines that the still image has been captured and the still image data has been acquired, the CPU 31 advances the process to step S124, restores the setting changed to the high image quality mode, ends the still image capture process, Resumes moving image capture.

  In step S125, the CPU 31 determines whether or not to end the mode setting process. If the CPU 31 determines not to end the process, the process returns to step S121 and the subsequent processes are repeated.

  If it is determined that the mode setting process is to be ended, the CPU 31 performs an end process in step S126 and ends the mode setting process.

  As described above, the CPU 31 can acquire still image data corresponding to a high-quality still image based on a request from the PDA 91 regardless of the current mode for moving image capture.

  The acquired still image data may be further supplied to the PDA 91 on the basis of a request from the PDA 91 and a still image 111 corresponding to the display unit of the PDA 91 may be displayed as shown in FIG. 16B. Since the maximum transfer speed of moving image data is reduced during still image data transfer, the CPU 31 of the mobile phone 1 changes the mode related to moving image capture to the low image quality mode. At that time, a low-quality moving image 93 is displayed on the display unit of the PDA 91 together with the captured high-quality still image 111. Then, when the transfer of all the still image data is completed, the CPU 31 restores the mode relating to moving image capture.

  A mode setting process when transferring still image data will be described with reference to the flowchart of FIG.

  First, in step S141, the CPU 31 determines whether a still image transfer instruction has been acquired, and waits until it is determined that it has been acquired. If it is determined that it has been acquired, the CPU 31 advances the processing to step S142, sets the mode relating to moving image capture to the low image quality mode, controls the USB controller 40, and starts the transfer of still image data.

  In step S143, the CPU 31 determines whether or not the still image transfer process has ended, and waits until it is determined that the transfer has ended. If it is determined that the still image transfer process has ended, the CPU 31 advances the process to step S144 to restore the mode setting relating to moving image capture set to the low image quality mode.

  Then, in step S145, the CPU 31 determines whether or not to end. If it is determined not to end, the CPU 31 returns the process to step S141 and repeats the subsequent processes. If it is determined in step S145 that the process is to be terminated, the CPU 31 performs a termination process in step S146 and then terminates the mode setting process.

  As described above, the CPU 31 of the mobile phone 1 can capture a still image and supply the still image data to the PDA 91 based on a request from the PDA 91.

  The communication device connected to the mobile phone 1 may be other than the PDA 91. For example, as shown in FIG. 19, two mobile phones 1 (mobile phones 1A and 1B) and the PDA 91 are connected to a LAN or You may make it connect via the network 120 represented by the internet.

  In the example shown in FIG. 19, a still image is captured by the mobile phone 1A, and the still image data is supplied to the PDA 91 via the network 120 and stored in a built-in storage unit (still images 111A and 111B). . Also, a moving image is captured by the mobile phone 1B, the moving image data is supplied to the PDA 91 via the network 120, and a moving image 112 corresponding to the moving image data is displayed on the display unit. The PDA 91 distributes still images 111A and 111B acquired from the mobile phone 1A and stored in the built-in storage unit to the mobile phone 1B via the network 120. In the mobile phone 1B, the mobile phone 1A Thus, still images 111A and 111B supplied to the PDA 91 can be confirmed.

  An example of the processing flow of each device in such a case will be described with reference to the timing chart of FIG.

  First, in step S181, the mobile phone 1B sets the mode relating to moving image capture to the high image quality mode, and in step S182, starts generation and transfer of moving image data. In response to this processing, the PDA 91 starts receiving moving image data transferred from the mobile phone 1B in step S171.

  In addition, the cellular phone 1A performs imaging processing in step S161, generates still image data, and starts transfer of still image data in step S162. In response to this processing, the PDA 91 starts receiving still image data transferred from the mobile phone 1A in step S172.

  In step S172, the PDA 91 that has started reception of still image data notifies the mobile phone 1B of reception start of still image data in step S173. When the cellular phone 1B acquires the notification in step S183, in step S184, the cellular phone 1B sets the mode related to moving image capture to the low image quality mode. Thereafter, in the mobile phone 1B, moving image data with a small amount of data corresponding to a low-quality moving image is generated and transferred to the PDA 91.

  In step S174, the PDA 91 starts distributing the received still image data to the mobile phone 1B. With this process, the cellular phone 1B starts receiving still image data distributed from the PDA 91 in step S185.

  When all the still image data is transferred to the PDA 91, the cellular phone 1A ends the transfer of the still image data and notifies the PDA 91 in step S163.

  When acquiring the notification in step S175, the PDA 91 notifies the mobile phone 1B that the reception of the still image data is completed in step S176. The mobile phone 1B acquires the notification in step S186.

  When the PDA 91 distributes all the still image data to the mobile phone 1B, the PDA 91 ends the distribution of the still image data and notifies the mobile phone 1B in step S177.

  When acquiring the notification in step S187, the cellular phone 1B determines that the traffic on the network 120 has decreased due to the notification and the notification acquired in step S186. Set to.

  As described above, the cellular phone 1 </ b> B can supply moving image data having an optimal data amount to the PDA 91.

  In the above description, the CCD is used as the imaging device of the mobile phone 1. However, the present invention is not limited to this. For example, a CMOS (Complementary Metal Oxide Semiconductor) sensor may be used.

  FIG. 21 is a diagram illustrating a configuration example of a CMOS sensor.

  In FIG. 21, the CMOS sensor includes a photoelectric conversion element such as a photodiode, an amplification MOS (Metal Oxide Semiconductor) transistor that reads and amplifies the accumulated charge of the element, a selection MOS transistor that activates the amplification MOS transistor, and the like. The pixels 121-11 to 121-33 having the above are arranged in 3 rows and 3 columns.

  These pixels 121-11 to 121-33 are connected to vertical output lines Vsig 124-1 to 124-3 and are selected by the control signals VSEL 123-1 to 123-3 output from the shift register 122. The electric charge accumulated in the pixels of the line is output to the vertical output line. The vertical shift register 122 outputs control signals VSEL 123-1 to 123-3 based on the control of the V driver 52 outside the CMOS sensor, as in the case of the CCD 12 described with reference to FIGS.

  The charges for each horizontal line output to the vertical output line are stored in the storage units 125-1 to 125-3 having storage capacitors. When the switches 126-1 to 126-3 selected by the control signal output from the horizontal shift register 127 are turned on, the charges accumulated in the accumulation unit connected to the switches are read to the output line VH. And supplied to the integrator 128. As in the case of the CCD 12 described with reference to FIGS. 1 to 3, the horizontal shift register 127 supplies a control signal to the switches 126-1 to 126-3 based on the control of the TG 51 outside the CMOS sensor.

  Therefore, as in the case of the CCD 12, the CPU 31 controls the vertical shift register 122 and the horizontal shift register 127 of the CMOS sensor via the TG 51 and the V driver 52, and extracts pixels according to the mode related to moving image capture. Can be selected.

  That is, as shown in FIG. 22, the CPU 31 is a CMOS sensor in which pixels corresponding to any of R, G, or B are arranged in a Bayer pattern, as in the case of the CCD 12 shown in FIG. Accordingly, it is possible to select pixels from which charges are extracted at predetermined intervals, such as extracting only the circled pixels in the drawing, and reduce the data amount of the generated image data.

  As a result, as in the case of the CCD 12, the CPU 31 can set a mode related to moving image capture based on a communication speed, a request from a communication partner, and the like, and generate moving image data having a data amount corresponding to the mode. Therefore, moving image data having an appropriate amount of data can be supplied.

  In the above, the CMOS sensor has been described as having the photoregisters 121-11 to 121-33 arranged in 3 rows and 3 columns. However, the present invention is not limited to this, and the number of photoregisters may be any number. .

  As described above, the cellular phone 1 to which the present invention is applied is an external factor due to the external conditions of the cellular phone 1, such as the communication capability of another device that is a communication counterpart device, and the network bandwidth and traffic state. Image data with an optimal amount of data by controlling the amount of moving image data to be transferred according to internal factors in the imaging apparatus of the present invention, such as transmission / reception of still images during transmission of moving images Can be supplied to other devices.

  At this time, the data amount of the image data may be determined according to a predetermined program, or may be determined as needed depending on the transmission speed at which the image data is transmitted and the bandwidth of the network. In the former case, for example, all pixels are read in the case of USB, and thinning out is read in the case of wireless. In the latter case, for example, the available bandwidth of the network is monitored by transmitting a packet such as a PING packet to the other device at regular intervals and measuring the time when the response from the other device returns. The optimum thinning rate (compression rate) of image data is determined from the bandwidth and communication speed.

  Note that the factor for controlling the data amount of the transfer image data may be other than those described above. For example, the factor may be controlled by the load status of the CPU 31 of the mobile phone 1.

  In addition, although it demonstrated using the mobile telephone 1 which has a camera function above, it has not only this but a camera function and a communication function, such as PDA which has a camera function, a personal computer, a digital camera with a communication function, etc., for example. Any electronic device can be used.

  Further, the mobile phone 1 has been described as having two communication functions of the USB control unit 40 and the wireless communication unit 42. However, the present invention is not limited to this, and the mobile phone 1 may be provided with one communication function, or three or more. You may make it prepare.

  Further, the communication function may be wired communication or wireless communication. Further, in the case of wired communication, in addition to USB, for example, IEEE 1394, SCSI, IEEE 802.3 using Ethernet (registered trademark), or other communication standards may be used. There may be. In addition, in the case of wireless communication, short-distance wireless communication such as IEEE802.11x, Bluetooth, and IrDA using infrared rays may be used in addition to communication via a telephone line via a communication carrier.

  In the above, the case where the device for acquiring moving image data is the PDA 91 has been described. However, the present invention is not limited to this, and for example, a mobile phone, a digital video camera, a television receiver, etc. It can be widely applied to electronic devices.

  Furthermore, in the above, a plurality of conditions have been individually described as the mode setting conditions in the mode setting process. However, the present invention is not limited to this, and the above-described plurality of conditions are combined and applied simultaneously. The mode may be set.

  The series of processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a recording medium in a general-purpose personal computer or the like.

  As shown in FIG. 1, recording media that are installed in a computer and record a program executable by the computer include a magnetic disk 44 (including a flexible disk), an optical disk 45 (CD-ROM (Compact Disc- Package media, such as Read Only Memory (DVD) (including Digital Versatile Disc), magneto-optical disk 46 (including MD (Mini-Disc) (registered trademark)), or semiconductor memory 47, or programs temporarily Or it is comprised by ROM32, flash memory 35, etc. which are recorded permanently. Program recording to recording media uses wired or wireless communication media such as public network, local area network, network such as the Internet, digital satellite broadcasting, etc. via interfaces such as routers and modems as necessary. Done.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  The present invention can be applied to an imaging apparatus.

It is a figure showing the basic structural example of the mobile telephone which has a camera function to which this invention is applied. It is a schematic diagram which shows the main structural examples inside CCD of FIG. FIG. 3 is a schematic diagram illustrating an example of connection between the vertical control signals V1 to V8 of FIG. 2 and a part of a vertical transfer register. It is a schematic diagram which shows the example of the mode of communication using USB. It is a figure which shows the detailed structural example of the radio | wireless communication part of FIG. It is a schematic diagram which shows the structural example of the system which displays the image data imaged with the mobile telephone of FIG. It is a flowchart explaining the mode setting process regarding moving image data acquisition in FIG. It is a flowchart explaining an image capturing control process. It is a schematic diagram which shows a mode that the data amount of image data is reduced. It is a flowchart explaining an image data compression process. It is a schematic diagram which shows the other structural example of the system which displays the image data imaged with the mobile telephone of FIG. It is a flowchart explaining the mode setting process in the case of FIG. It is a flowchart explaining the mode setting process in the case of setting a moving image capture mode based on a request on the receiver side of moving image data. It is a schematic diagram which shows the further another structural example of the system which displays the image data imaged with the mobile telephone of FIG. It is a flowchart explaining the mode setting process in the case of FIG. It is a schematic diagram which shows the further another structural example of the system which displays the image data imaged with the mobile telephone of FIG. FIG. 17 is a flowchart for describing mode setting processing when a still image is captured in a high image quality mode based on a request from the PDA in FIG. 16. FIG. 17 is a flowchart for describing mode setting processing when transferring still image data in the case of FIG. 16. FIG. It is a schematic diagram which shows the further another structural example of the system which displays the image data imaged with the mobile telephone of FIG. FIG. 20 is a timing chart illustrating an example of a processing flow of each device in the case of FIG. 19. FIG. It is a figure which shows the structural example of a CMOS sensor. It is a schematic diagram which shows a mode that the data amount of image data is reduced using the CMOS sensor of FIG.

Explanation of symbols

  12 CCD, 22 image compression / decompression processing unit, 31 CPU, 40 USB controller, 41 USB connector, 42 wireless communication unit, 51 TG, 52 V driver, 62-1 to 62-n vertical transfer register, 63 horizontal transfer register, 91 PDA, 93 low quality video, 94 high quality video, 101 network, 111 still image

Claims (19)

Imaging means for capturing an image obtained by imaging a subject as image data;
A plurality of transmission means for transmitting the image data captured by the imaging processing by the imaging means to a communication device connected via a network;
Selection means for selecting an arbitrary transmission means from the plurality of transmission means;
In response to said selected transmission unit by the selection means, the image pickup apparatus characterized by comprising adjustment means for adjusting the data amount of the image data outputted by the imaging means. The imaging apparatus according to claim 1, wherein the plurality of transmission units transmit the image data at different communication speeds. The imaging apparatus according to claim 1, wherein the plurality of transmission units include a wireless communication unit and a wired communication unit. The transmission means further transmits data other than the image data,
The imaging apparatus according to claim 1, wherein the adjustment unit performs adjustment to reduce a data amount of image data output from the imaging unit when the transmission unit transmits the other data. The imaging apparatus according to claim 4, wherein the image data is moving image data, and the other data is still image data. The imaging apparatus according to claim 1, wherein the adjustment unit adjusts the number of pixels of an image output from the imaging unit. The imaging apparatus according to claim 1, wherein still image data is captured by the imaging unit based on a request from the communication apparatus. The imaging according to claim 1, wherein when moving image data is transmitted to the communication device, still image data is captured by the imaging unit based on a request from the communication device. apparatus. When quiescent image data is transmitted to the communication device, the adjusting means, claims, characterized in that, characterized in that to reduce the data amount of moving image data output by said image pickup means The imaging apparatus according to 1. A selection step of selecting an arbitrary transmission unit that controls transmission of the image data from among a plurality of transmission units that transmit image data captured by the imaging unit to a communication device connected via a network;
Controlling said imaging means, in response to the transmission unit selected in said selecting step, an imaging control step of adjusting the data amount of the image data outputted by the imaging means,
A transmission control step for controlling transmission of the image data, which has been adjusted by the control of the imaging control step and output from the imaging means, to the communication device by the transmission unit selected in the selection step ; An imaging method comprising: The transmission control step further controls transmission of data other than the image data,
The imaging control step performs an adjustment to reduce a data amount of the image data output by the imaging unit when the transmission control step controls to transmit the other data. Item 11. The imaging method according to Item 10. Imaging means for capturing an image obtained by imaging a subject as image data;
Compression means for compressing the image data output from the imaging means ;
A plurality of transmission means for transmitting the image data compressed by the compression means to a communication device connected via a network;
Selection means for selecting an arbitrary transmission means from the plurality of transmission means;
Adjusting means for adjusting the compression rate in the compression processing by the compression means according to the transmission means selected by the selection means , and
The adjustment unit increases the compression rate in the compression processing by the compression unit when the transmission unit selected by the selection unit further transmits data other than the image data, and is further output by the imaging unit. Reduce the amount of image data
Imaging device, characterized in that. A selection step of selecting an arbitrary transmission unit among a plurality of transmission units that transmit image data captured by the imaging unit to a communication device connected via a network;
Imaging that controls the imaging means and reduces the data amount of the image data output by the imaging means when the transmission unit selected by the processing of the selection step further transmits other data other than the image data Control steps;
Control a compression unit that compresses the image data output by the imaging means, adjust the compression rate in the compression process by the compression unit according to the transmission unit selected by the process of the selection step, A compression control step for increasing the compression rate when the transmission unit selected by the processing of the selection step further transmits data other than the image data; and
Characterized in that it comprises a transmission control step of controlling transmission of the of the image data compression rate is compressed is controlled by processing in the compression control step, to the communication device by the transmission unit selected in said selecting step An imaging method. Imaging means for capturing an image obtained by imaging a subject as image data;
Compression means for compressing the image data output from the imaging means;
A plurality of transmission means for transmitting the image data compressed by the compression means to a communication device connected via a network;
Selection means for selecting an arbitrary transmission means from the plurality of transmission means;
Adjusting means for adjusting a compression rate in the compression processing by the compression means according to the transmission means selected by the selection means;
With
Said adjustment means, said communication when the device relative to the still image data is being transmitted, it characterized imaging device to reduce the data amount of moving image data output by the imaging means. A selection step of selecting an arbitrary transmission unit among a plurality of transmission units that transmit image data captured by the imaging unit to a communication device connected via a network;
An imaging control step of controlling the imaging means and reducing the data amount of moving image data output by the imaging means when still image data is transmitted to the communication device;
A compression control step of controlling a compression unit that compresses the image data output by the imaging unit, and adjusting a compression rate in the compression process by the compression unit according to the transmission unit selected by the process of the selection step; ,
A transmission control step for controlling transmission of the image data compressed by adjusting the compression rate by the processing of the compression control step to the communication device by the transmission unit selected in the selection step;
An imaging method comprising: Imaging means for capturing an image obtained by imaging a subject as image data;
Compression means for compressing the image data output from the imaging means;
A plurality of transmission means for transmitting the image data compressed by the compression means to a communication device connected via a network;
Selection means for selecting an arbitrary transmission means from the plurality of transmission means;
Adjusting means for adjusting a compression rate in the compression processing by the compression means according to the transmission means selected by the selection means;
Equipped with _a,
It said adjustment means, when said still image data is transmitted to the communication device, to that imaging device, characterized in that to increase the compression ratio in the compression processing of the image data by the compression means. A selection step of selecting an arbitrary transmission unit among a plurality of transmission units that transmit image data captured by the imaging unit to a communication device connected via a network;
An imaging control step of controlling the imaging means and capturing an image obtained by imaging a subject as image data;
Control a compression unit that compresses the image data output by the imaging means, adjust the compression rate in the compression process by the compression unit according to the transmission unit selected by the process of the selection step, A compression control step for increasing the compression rate when still image data is being transmitted to the communication device;
A transmission control step for controlling transmission of the image data compressed by adjusting the compression rate by the processing of the compression control step to the communication device by the transmission unit selected in the selection step;
An imaging method comprising: Imaging means for capturing an image obtained by imaging a subject as image data;
Compression means for compressing the image data output by the imaging means ;
A plurality of transmission means for transmitting the image data compressed by the compression means to a communication device connected via a network;
Selection means for selecting an arbitrary transmission means from the plurality of transmission means;
And adjusting means for adjusting the data amount of the image data output by the imaging means and the compression rate in the compression processing by the compression means in accordance with the transmission means selected by the selection means. Imaging device. A selection step of selecting an arbitrary transmission unit among a plurality of transmission units that transmit image data captured by the imaging unit to a communication device connected via a network;
An imaging control step of controlling the imaging means and adjusting a data amount of the image data output by the imaging means according to a transmission unit selected by the processing of the selection step;
A compression control step of controlling a compression unit that compresses the image data output by the imaging unit, and adjusting a compression rate in the compression process by the compression unit according to the transmission unit selected by the process of the selection step; ,
A transmission control step of controlling transmission of the image data compressed by adjusting the compression rate by the processing of the compression control step to the communication device by the transmission unit selected in the selection step. An imaging method.

Images