Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
  • H04N1/00281—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal
  • H04N1/00283—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal with a television apparatus
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
  • H04N2201/0008—Connection or combination of a still picture apparatus with another apparatus
  • H04N2201/0065—Converting image data to a format usable by the connected apparatus or vice versa
  • H04N2201/0067—Converting to still picture data

Definitions

• the present invention pertains to moving picture and still picture video cameras.
• a conventional "camcorder" or moving picture camera typically includes a charge
• CCD complementary metal-oxide-semiconductor
• CCD's may soon be replaced by CMOS photosensors, such as disclosed in R. Nixon, S. Kemeny, B. Pain, C. Staller & E. Fossum, 256 x 256 CMOS Active Pixel Sensor Camera-
• Such cameras and camcorders have circuitry for sequentially capturing pictures at a rate of 60 fields per second, 30 frames per second or some other rate.
• Such outputted video signals typically contain an analog version of each individual picture and are produced according to some standard such as NTSC, PAL, S-Video, etc.
• the camcorder also typically has an analog audio signal output for outputting an analog audio signal.
• Cameras are also available which instead, or in addition, simply output the sequence of pictures of the moving picture signal as a digital bitstream.
• Frame capture cards exist that can be installed into personal computers.
• a frame capture card has a video input capable of receiving an analog video signal.
• the frame capture card can capture digital moving picture video.
• frame capture cards suffer from a number of disadvantages as described in co-pending U.S. Patent Application Serial Number 08/708,388.
• most computers are not provided with a frame capture card.
• a user with a portable camera must carry the correct
• a second kind of camera currently available is a digital still camera.
• This camera also has a CCD for converting light images to electrical signals.
• a single picture may be captured at a time and stored in digital form on a flash memory card resident in the digital still camera.
• Some digital still cameras also contain compressors, such as JPEG compatible compressors, for reducing the amount of data necessary to store the captured picture.
• the digital still cameras generally also have an interface for downloading captured pictures to a computer for further processing, such as image enhancement, printing, etc.
• One digital still camera manufactured by CasioTM also has an interface for receiving a picture from a computer and for outputting a composite signal displaying the still picture. The composite video signal thus formed may be outputted onto a standard monitor.
• Some digital still cameras (such as available from CasioTM) also contain an LCD display for displaying the captured pictures stored therein. Another digital still camera
• the resolution of digital still cameras is typically 640x480 and cost approximately
• a second disadvantage of digital still cameras is that no universal interface is provided for connecting the camera to a computer.
• KodakTM 's DC-40TM has a cable that can connect to either the modem port or the printer port of a MacintoshTM compatible computer.
• a second adaptor cable is needed to connect the DC-40TM to a PC compatible computer.
• the download time is also very lengthy; to download 48 compressed 640x480 pixel images can take approximately 15 minutes.
• an adaptor for a moving picture video camera includes an input for receiving a moving picture video signal from a moving picture video camera.
• the adaptor also includes a compressor connected to the input to extract a selected picture from the moving picture video signal and to compress the extracted picture.
• a bidirectional serial interface is connected to the compressor to serially
• the adaptor allows an ordinary analog
• the adaptor includes a housing having a volume that is less than or equal to the volume of the camera and which can attach directly to the camera.
• the adaptor may be attached via a video cable connected to the video output of the camera and the input of the adaptor.
• an adaptor is provided for converting analog moving picture video signals to digital form.
• the adaptor has an input for receiving an analog video signal.
• An analog to digital converter is provided for converting the analog video signal to a digital video signal.
• the adaptor also has a compressor connected to the analog to digital converter for compressing the digital video signal, in real-time, to produce a compressed moving picture video signal.
• the adaptor has a bidirectional serial interface connected to the compressor, for receiving data from an external device and for outputting the compressed moving picture video signal to the external device.
• the bidirectional interface receives instructions from the external device (which may be a personal computer) interspersed with the outputted compressed moving picture video signal for varying a compression of the compressor.
• the compressor responds to these commands by varying the compression of the digital video signal in accordance with each received instruction.
• the bidirectional interface receives, interspersed with a downloaded/outputted compressed moving picture video or still picture signal, an uploaded compressed still picture or moving picture video signal from the external device
• FIG 1 shows a digital moving and still picture capture adaptor for a moving picture video camera according to an embodiment of the invention.
• FIG 2 shows a host computer according to an embodiment of the invention that communicates with the adaptor of FIG 1.
• FIG 1 shows a still picture adaptor 300 for an analog or digital moving picture camera 10 or 20, respectively, according to an embodiment of the invention.
• the adaptor 300 is small and is contained in a housing that has a smaller volume than a camcorder 10 with which it can be used.
• the housing of the adaptor 300 is designed to attach directly to the housing of the camcorder 10.
• the adaptor 300 is designed to work with camcorders 10 of various shapes and sizes and need not connect directly to the camcorder 10 housing.
• the adaptor 300 can also be installed within the housing of the camcorder 10 for suitable camcorder designs.
• a composite NTSC, PAL, S-video, etc. video signal is outputted from
• a composite signal typically includes an analog color video
• the monochrome signal M contains analog luminance information interspersed
• the video decoder 305 separates the M, Q and I component signals from the composite signal.
• the video decoder 305 recovers the luminance Y and chrominance signals C r and C b or the signals R, G and B from the M, Q and I signals, but discards the control signals, e.g., the horizontal and vertical blanking pulses.
• the received signals are converted to digital form, e.g., by sampling, to produce digital picture signals.
• the video decoder 305 recovers a sequence of digital picture signals (stripped of their carrier signals and control signals) in digital form.
• the recovered pictures are outputted from the video decoder 305 to a multiplexer
• the adaptor 300 also has a second input 302 for receiving a moving picture signal from a digital camera 20 in digital form.
• the digital moving picture signal received from the second input 302 is fed to a second input of the multiplexer 310.
• the multiplexer 310 selects either the digital picture signal generated by the video decoder 305 or the digital picture signal received from the second input 302 of the adaptor 300.
• the multiplexer 310 outputs the selected moving picture signal to the video processor 330 via a video bus or V-bus.
• the video processor 330 illustratively may be a model W9962TM video compressor/decompressor distributed by Winbond Systems LaboratoryTM, located in San Jose, California.
• the video processor 330 receives the moving picture signal outputted from the multiplexer 310.
• a select signal which may be externally generated (e.g., from a push button switch on the adaptor 300 or from an attached host computer 120), or internally generated by the video processor
• the video processor 330 extracts a selected picture from the moving picture signal.
• the selected picture is illustratively stored in frame buffer 350 which may be formed from
• a moving picture signal is outputted from the multiplexer 310 to the video processor 330.
• this moving picture signal is also outputted to either an attached LCD display 30 or via video encoder 370 to a television monitor 35 (as described in greater detail below).
• the video processor 330 outputs the picture via a DRAM bus or D-bus to the frame buffer 350.
• Each successive picture illustratively overwrites the preceding picture of the moving picture signal in the frame buffer 350.
• the video processor 330 compresses the picture in the frame buffer 350, e.g., in real-time, and can transfer the compressed picture to, for example, the non-volatile buffer 360.
• the video processor 330 is a programmable processor which supports video compression and decompression according to a variety of still and moving picture formats including JPEG, MPEG, MPEG-2, H.263, etc. As described in greater detail below, the
• the compressed picture has a reduced storage capacity. For instance, suppose the original picture has 525 lines x 352 columns of pixels. Such a picture may be converter to 640
• the storage requirement can be reduced significantly (depending on the picture and various selectable parameters). For example, good image quality can be reduced significantly (depending on the picture and various selectable parameters). For example, good image quality can be reduced significantly (depending on the picture and various selectable parameters). For example, good image quality can be reduced significantly (depending on the picture and various selectable parameters). For example, good image quality can be reduced significantly (depending on the picture and various selectable parameters). For example, good image quality can be used.
• the video processor 330 may store an extracted picture in an optional nonvolatile buffer 360, which may be constructed from flash memories situated on a removable flash card. Illustratively, to conserve space, the picture is compressed prior to storage.
• the extracted picture may be outputted from the video processor 330 to an RF module 355.
• the RF module 355 illustratively modulates the picture onto a carrier signal and transmits the modulated signal to a remote receiver. Such an RF module 355 can be used in a video teleconferencing system.
• the receiver may be part of a video conferencing codec which receives the transmitted video signal and transmits the video signal via a telephone network to a remote station.
• the video signal is decoded and displayed on the remote monitor station.
• the adaptor 300 provides greater mobility for the camera used in a teleconference since the camera is not tethered to the codec or other equipment. Again, the picture is advantageously compressed prior to output to the RF module 355 to conserve communication bandwidth.
• the extracted picture can also be outputted via an interface 340 to an external device, such as a host computer 120 (FIG 2).
• the interface 340 is a Universal Serial Bus (USB) hub as described in Open HCI, Universal Serial Bus Specification v.1.0, Jan. 19, 1996.
• USB hub 340 is described in greater detail in copending U.S. Patent Application Serial Number 08/708,388 and is therefore only briefly described herein.
• the USB hub 340 is a bidirectional serial interface which
• USB “hubs” can be connected in a tree configuration.
• FIG. 3 An advantage of the USB hub 340 is its ability to support bidirectional transfers.
• pictures can be downloaded, processed by the host computer 120 and then uploaded to the video processor 330.
• the video processor 330 is capable of decompressing the uploaded pictures.
• the uploaded pictures can be stored in the nonvolatile buffer 360, stored on mass storage device 60, modulated and transmitted via modulator 355, decompressed and outputted via the V-bus to the video encoder 370, or directly outputted to LCD monitor 30.
• commands/instructions for varying the compression by the video processor 330 or for controlling other circuitry of the adaptor can be uploaded from the host computer 120 via the USB hub 340.
• Uploaded data e.g., pictures or commands/instructions
• transfers from the host computer 120 to the video processor 330 via the USB hub 340 are interspersed amongst downloaded data (e.g., compressed pictures) transfers from the video processor 330 to the host computer via the USB hub 340.
• the video processor 330 is also illustratively capable of performing moving picture capture and compression in real-time according to one of a number of compression standards such as H.261, H.262, H.263, MPEG, MPEG-2, motion JPEG, etc.
• compression standard such as H.261, H.262, H.263, MPEG, MPEG-2, motion JPEG, etc.
• parameters thereof or optional encoding techniques may be selected/programmed by commands received from the host computer 120 via the USB hub 340 or from the non
• the video processor 330 if the video processor 330 is not capable of compressing and/or outputting a compressed moving picture video signal at the full picture rate of the inputted moving picture video signal.
• the outputted compressed moving picture signal can be outputted to the same devices as the still pictures, i.e., to the video encoder 370 (after decompression), the frame buffer 350, the non-volatile buffer 360, the RF module 355 and the USB hub 340.
• the host computer 120 can transmit commands/instructions for varying the compression of the compressed moving picture video signal or a second still picture or moving picture video signal, interspersed amongst transfers of compressed moving picture video signal
• the compressed moving pictures may be outputted from the video processor 330 to a high bandwidth and mass storage device 60 via an interface such as a SCSI port 380.
• high bandwidth, mass storage devices include hard disk drives, read- writable compact disks (CD-R) and writable DVD ' s (formerly known as "digital video disks").
• CD-R read- writable compact disks
• writable DVD ' s previously known as "digital video disks"
• the SCSI port 380 supports bidirectional transfer of information, and thus compressed (still or) moving pictures and/or instructions or commands can also be retrieved from the mass storage device via the SCSI port 380 into the video processor 330.
• the video encoder 370 receives either moving pictures outputted form the
• the video encoder 370 contains a digital to analog converter for converting the digital pictures to analog form.
• the analog picture signals are converted to appropriate signals M, Q I and appropriate control signals (e.g., vertical and horizontal blanking pulses) are inserted into the signal M.
• the M, Q and I signals are then combined together to produce a composite video signal in, for example, NTSC, PAL, etc., form.
• the adaptor 300 may also have an audio input 303 for receiving a digital audio signal fed from the camcorder 10.
• a second audio input 304 may also be provided for receiving an analog audio signal from a second audio device, such as a microphone 40.
• the analog audio signals received from the audio inputs 303 and 304 are fed to an analog multiplexer 315.
• the multiplexer 315 selects one of the two analog audio signals for output to an analog to digital converter 320.
• the analog to digital converter 320 samples the selected audio signal and outputs a digital audio signal onto the audio bus or A-bus.
• the audio processor 335 receives the digital audio signal from the A-bus.
• audio processor 335 is capable of processing the audio signals in a variety of manners including filtering the digital audio signals, compressing the digital audio signals, etc.
• the audio processor 335 also has a USB hub 345 connected to the USB hub 340. This enables the audio processor 335 to communicate with the host computer 120 and the video processor 330 in a bidirectional fashion. Thus, audio signals may be downloaded to the video processor 330 and/or host computer 120 or uploaded from the video processor 330
• the audio processor 335 receives instructions or commands from, or transmits instructions or
• the audio processor 335 is connected via a second port to the video processor 330 for direct bidirectional communication therewith.
• the audio processor 335 is also connected to the non-volatile buffer 360 and can both read information, e.g., audio clips, commands, etc., from, and write information to, the non-volatile buffer 360.
• the audio processor 330 is illustratively connected to the RF module 355 and can output audio signals thereto for modulation onto a carrier for transmission to a receiver.
• the audio processor 335 can operate contemporaneously with, or independently of, the video processor 330. Thus, for example, both compressed audio and pictures can be simultaneously modulated onto a carrier signal and transmitted from the module 355 to a remote station.
• the audio processor 335 can decompress audio signals and output them via the A- bus.
• the outputted digital signals, provided either from the audio processor 335 or from the ADC 320 are received at a digital to analog converter 325.
• the digital to analog converter 325 recovers an analog audio signal from the received digital audio signal.
• the recovered audio signal may then be outputted, e.g., to a loudspeaker 50.
• the adaptor 300 has a power supply 375 in the form of a battery pack (with a NiCd, NiMH, Li ion, etc. battery). As shown, the power supply 375 is connected to a power management circuit 365.
• the power management circuit 365 is for managing the consumption of power by the circuitry of the adaptor 300 so as to conserve power.
• the power management circuit 365 outputs power supply voltages to each circuit, such as the video decoder 305, video multiplexer 310, analog multiplexer 315, analog to digital
• the power management circuit 375 only delivers power to those circuits that need it and powers down those circuits that are inactive and therefore do not need power.
• the power management circuit 375 receives control signals from the video processor 330 or audio processor 335 indicating which circuits should remain active and should receive power, and which should be inactive and should be powered-down.
• the video processor 330 and the audio processor 335 can communicate with external devices, such as the host computer 120 or the non-volatile buffer 360 (which illustratively is formed on a removable medium, such as a flash card). This can be done for several reasons, such as to store still pictures, moving pictures, audio clips, instructions or commands or to retrieve previously stored pictures, moving picture video clips, audio clips, instructions or commands.
• instructions or commands can be uploaded to the video processor 330 and/or audio processor 335 for performing a particular kind of compression, for selecting either the compressed still operating mode or the compressed moving picture operating mode, for varying a parameter, etc.
• the adaptor 300 can receive such instructions or commands from an appropriate non- volatile memory 360 flash card inserted into the adaptor. Note that this enables production of a basic
• adaptor 300 with basic certain capabilities yet permits upgrading/expansion of capabilities by obtaining the appropriate flash memory card or software executing on the host computer 120.
• the basic adaptor 300 can be provided with both still and moving picture capability, e.g., using JPEG and
• H.263 and additional flash memory cards or software may be available with MPEG-2 compression capability.
• Instructions uploaded to the video processor 330 or audio processor 335 from the non- volatile buffer 360 or the host 120 illustratively are stored in registers of the video processor 330 or audio processor 335, respectively.
• the host computer 120 or non-volatile buffer 360 can provide commands and instructions for producing one or more photographic effects. For instance, by appropriate programming of the video processor 330, the extracted picture can be filtered prior to compression. Filtering prior to compression tends to produce pictures with higher quality.
• the host computer 120 and/or non- volatile buffer 360 can provide instructions for operating virtually any of the circuits 305, 310, 315, 320, 325, 340, 345, 350, 355, 360, 365, 370 and/or 380.
• the host computer 120 or non-volatile buffer 360 can provide instructions for selecting a particular
• the host computer system 120 illustratively includes a cpu bus 122, a system bus 124 (e.g., a PCI bus) and an I/O expansion bus 126 (e.g., as ISA bus).
• a cpu bus 122 Connected to the cpu bus 122 is at least one processor 128 and a "north" bridge or memory controller 130.
• the north bridge 130 connects a cache 132 and a main memory 134 to the processors 128 on the cpu bus 122.
• the north bridge 130 also enables data transfers between devices on
• system bus 124 and the memories 132 and 134 or the processors 128. Also connected
• a graphics adapter 136 to the system bus 124 is a graphics adapter 136.
• a display monitor 138 may be connected to the graphics adapter 136.
• an Ethernet adapter 160 may be connected to the system bus 124.
• a disk memory 140 and interface such as an IDE interface, a modem 158, and input devices 142 such as keyboard 144 and mouse 146. (Alternatively, the keyboard 144 and mouse 146 may also be connected to the USB hub 150.)
• a south bridge 148 or I/O bridge Also connected between the system bus 124 and the I/O expansion bus 126 is a south bridge 148 or I/O bridge.
• the south bridge 148 enables data transfers between devices on the I/O expansion bus 126, such as modem 158, and devices on the USB 200 or devices on the system bus 124.
• the south bridge 148 also includes a USB hub 150.
• the USB hub 150 has one or more serial ports 152 that are connected to standard USB compliant connectors 154 to which a connection may be made totally externally to the housing 156 of the computer system.
• USB hubs 150, 340 and 345 and cables 119 form the USB bus 200.
• the USB hubs 340, 345 and 150 have both transmit and receive circuitry enabling bidirectional transfer of data on the USB 200. Other peripherals may also be connected to the USB 200.
• the bandwidth of the USB 200 is shared in a time division multiplexed fashion.
• a picture or compressed moving picture video signal downloaded from the adaptor 300 is transmitted from the USB hub 340 to the USB hub 150. From there, the picture
• the graphics adapter 136 illustratively includes a drawing processor capable of decompressing the picture or compressed moving picture video signal and displaying it on the display monitor 138.
• the picture or compressed moving picture video signal may be transferred from the south bridge 148 via system bus 124 and north bridge 130 to one of the memories 132 or 134.
• the processor 128 accesses the compressed still picture or moving picture video signal data and decompresses it.
• the decompressed still or moving picture data may then be transferred to the graphics adaptor 136 for display on the display monitor 138.
• the processor 128 or drawing processor of the graphics adaptor 136 may perform various kinds of processing on the decompressed picture or moving pictures, such as filtering, cut and paste, zoom, image warping, etc. To that end, the processor 128 illustratively executes suitable image processing software, such as AdobeTM PhotoshopTM. After processing the downloaded picture or moving pictures, the processor 128 (or drawing processor of the graphics adaptor 136) illustratively compresses the picture or moving pictures. The compressed, processed picture or moving picture video signal is then uploaded via the USB 200 (in a reverse path as in the download transfer) to the USB hub 340 of the video processor 330. In addition, a previously stored, or artificially generated, picture or compressed moving picture video signal contained in the host computer 120, e.g., in the hard disk 140, may be uploaded to the adaptor 300 in a similar fashion.
• suitable image processing software such as AdobeTM PhotoshopTM.
• Similar downloading and uploading may be performed on compressed audio clips.
• a compressed audio clip is transferred from USB hub 345 to
• USB hub 340 to USB hub 150, to south bridge 148, to system bus 124 and to graphics adaptor 136.
• the graphics adaptor 136 illustratively has an audio decompressor which
• the audio decompresses the audio and reproduces the audio on a loudspeaker (e.g., of the display monitor 138).
• the audio is first transferred to one of the memories 132 or 134 and decompressed by the processor 128.
• the decompressed audio is then transferred to the graphics adaptor 136. Processing may be performed on the decompressed audio such as filtering, cutting and pasting, etc.
• a drawing processor of the graphics adaptor 136, or the processor 128 illustratively first compresses the audio.
• the audio is then uploaded via south bridge 148, USB hub 150, USB hub 340 and USB hub 345 to the audio processor 335. Note that previously stored, or artificially generated, audio can also be uploaded to the adaptor 300 in a like fashion.
• the processor 128 can also download commands/instructions from, or upload commands/instructions to, the adaptor 300 using a similar data path as for the pictures and audio clips.
• the uploaded/downloaded commands/instructions are interspersed amongst the uploaded/downloaded pictures and audio clips (within the serial bidirectional bit stream carried on USB 200) in a time division multiplexed fashion. This provides several options.
• the processor 128 can upload instructions/commands for selecting a kind of compression or for varying a parameter of that selected compression.
• the video processor 330 and the audio processor 335 advantageously are programmable processors containing a memory for storing parameters and instructions. The uploading of instructions/commands can therefore be used to effect a software upgrade to the adaptor 300.
• the processor 128 can examine data/parameters stored in various memories and registers of the audio processor 335 and video processor 330. This enables the processor 128 to "auto-sense" or automatically determine exactly which compression technique and which selectable options and parameters were used to generate compressed images. For example, the same hardware can be used to perform both moving picture or still picture capture and compression depending on

Applications Claiming Priority (3)

Publications (2)

Family

ID=25157724

Family Applications (1)

Country Status (6)

Families Citing this family (2)

Citations (4)

Family Cites Families (7)

• 1998
  • 1998-01-21 JP JP53210098A patent/JP2001509979A/ja active Pending
  • 1998-01-21 AU AU60335/98A patent/AU6033598A/en not_active Abandoned
  • 1998-01-21 CA CA002278810A patent/CA2278810A1/en not_active Abandoned
  • 1998-01-21 KR KR1019997006855A patent/KR20000070607A/ko not_active Application Discontinuation
  • 1998-01-21 WO PCT/US1998/001087 patent/WO1998033316A2/en not_active Application Discontinuation
  • 1998-01-21 EP EP98903605A patent/EP0956699A4/de not_active Withdrawn

Patent Citations (4)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events