WO2007075000A1 - Dispositif d'imagerie et procédé de transfert de signal d'image - Google Patents

Dispositif d'imagerie et procédé de transfert de signal d'image Download PDF

Info

Publication number
WO2007075000A1
WO2007075000A1 PCT/KR2006/005612 KR2006005612W WO2007075000A1 WO 2007075000 A1 WO2007075000 A1 WO 2007075000A1 KR 2006005612 W KR2006005612 W KR 2006005612W WO 2007075000 A1 WO2007075000 A1 WO 2007075000A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
image
image signal
signal
memory
Prior art date
Application number
PCT/KR2006/005612
Other languages
English (en)
Inventor
Jong-Sik Jeong
Original Assignee
Mtekvision Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mtekvision Co., Ltd. filed Critical Mtekvision Co., Ltd.
Publication of WO2007075000A1 publication Critical patent/WO2007075000A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N2007/145—Handheld terminals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/7921—Processing of colour television signals in connection with recording for more than one processing mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • H04N9/8047—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction using transform coding

Definitions

  • the present invention is directed to an imaging device, more specifically to an
  • imaging device for selectively transferring an image signal (e.g. YUV data or encoded
  • portable terminals refer to portable terminals
  • Portable terminals include
  • PDA personal digital assistants
  • the mobile communication terminal is essentially a device designed to enable
  • FIG. 1 shows a block diagram of a conventional mobile communication
  • the high frequency processing unit 110 processes a high frequency signal
  • the analog-to-digital converter 115 converts an analog signal, outputted from
  • the high frequency processing unit 110 to a digital signal and sends to the processing
  • the digital-to-analog converter 120 converts a digital signal, outputted from
  • the processing unit 125 controls the general operation of the mobile
  • the processing unit 125 can comprise a central processing unit (CPU) or a micro-controller.
  • the power supply 130 supplies electric power required for operating the vehicle
  • the power supply 130 can be coupled to, for example
  • an external power source or a battery.
  • the key input 135 generates key data for, for example, setting various parameters
  • the main memory 140 stores an operating system and a variety of data of the
  • the main memory 140 can be, for example, a
  • the display 145 displays the operation status of the mobile communication
  • terminal 100 related information (e.g. data and time) and an external image
  • the camera 150 photographs an external image (a photographic subject), and
  • the image processing unit 155 processes the external image photographed by the camera
  • the image processing unit 155 can perform functions such as color interpolation,
  • the image processing unit 155 can include an image sensor, an image signal processor
  • the support memory 160 stores the external image processed by the image
  • the support memory 160 can be an SRAM (Static RAM) or an
  • SDRAM Serial DRAM
  • the mobile communication terminal 100 having a camera
  • a function is equipped with a plurality of processing units (that is, a main processor and
  • the processing unit 125 for controlling general functions of the
  • Each processing unit is structured to be coupled with
  • the main processor can be a baseband chip.
  • the application processor can take different forms and quantity depending on
  • the application processor for controlling the camera function can process
  • controlling the movie file playback function can process functions such as video file
  • controlling the music file playback function can process functions such as audio file
  • the portable terminal can also comprise an application
  • processors for controlling games.
  • Each of these processors has an individual memory for controlling
  • FIG. 2 is a coupling structure between a processor and a memory in accordance
  • a main processor 210 basically has two buses.
  • the bus refers to a common-purpose electric path used for transmitting
  • the bus includes a line for information, which represents an
  • One bus is an MP (main processor)-AP (application processor) bus forming a MP (main processor)-AP (application processor) bus forming a MP (main processor)-AP (application processor) bus forming a MP (main processor)-AP (application processor) bus forming a MP (main processor)-AP (application processor) bus forming a MP (main processor)-AP (application processor) bus forming a MP (main processor)-AP (application processor) bus forming a
  • MP-MM main memory
  • the M-NV memory 220 is a nonvolatile memory
  • the M-VO memory 225 is a
  • the MP-MM bus can be classified into a first bus, which is coupled to
  • the M-NV memory 220 and a second bus, which is coupled to the M-VO memory 225.
  • the M-NV memory 220 and the M-VO memory 225 are embodied as one chip by
  • the application processor 215 is coupled to the main processor 210 through the
  • MP-AP bus and a second volatile memory 245 through an AP-AM (application
  • the A-VO memory 245 is a volatile memory. Also, the application
  • processor 215 is coupled to the display 145 and the image sensor 240 through additional buses.
  • each of the main processor 210 and the application processor 215 is equipped with a
  • main processor 210 displays data (e.g.
  • processor 210 must read respective data and transfer the read data to the application
  • the application processor 215 processes (e.g.
  • application processor 215 can store the respective data in the A-VO 245 and read the
  • application processor 215 uses the AP-AM bus to access the A-VO memory 245.
  • application processor 215 accesses the A-VO memory 245 to process data received
  • the present invention provides an
  • the present invention also provides an imaging device and an image signal
  • the present invention also provides an imaging device and an image signal
  • the present invention also provides an imaging device and an image signal generating method thereof that can maximize the efficiency of storing and processing
  • the present invention provides an imaging device and an image
  • an aspect of the present invention features an
  • image signal processor generating an image signal and a digital processing device
  • a device includes a main processor; a memory, where a storage area is partitioned into n
  • n being a natural number
  • the image signal is the encoded image data.
  • the application processor can have a multimedia data input unit, storing the
  • the memory and the application processor can be coupled to each other
  • the control signal which determines the type of the signal processor, can be
  • ISP image processor
  • a first input unit being inputted with the raw data
  • a second unit receiving a
  • control signal which instructs to generate an image signal of a particular type from a
  • a YUV data generating unit generating YUV data by using the raw data and outputting the YUV data
  • an encoding unit generating encoded image data
  • the control signal which determines the type of the signal processor, can be
  • an image signal e.g. YUV data or encoded data
  • generating method of a digital processing device includes an image sensor generating
  • a camera module generating an image signal corresponding to
  • the generated image signal the image signal being YUV data generated by use of the
  • processor determining the type of the image signal by using a control signal received
  • image signal is the YUV data and storing the generated encoded image data in the
  • control signal which determines the type of the signal processor, can be
  • the memory and the application processor can be coupled to each other
  • FIG. 1 is a block diagram illustrating a conventional mobile communication
  • FIG. 2 illustrates a coupling structure between a processor and a memory in
  • FIG. 3 illustrates a linking structure between each processor in accordance with
  • FIG. 4 is a flow chart illustrating a method of outputting various image signals
  • FIG. 5 is a flow chart illustrating a method of processing an inputted image
  • digital appliances such as the mobile communication terminal, PDA, portable multimedia player (PMP), MP3 player, digital camera, digital television, audio
  • the portable terminal will be
  • processors or elements having a memory shared by a plurality of processors or elements.
  • FIG. 3 illustrates a linking structure between each processor in accordance with
  • camera module 305 and the application processor 215 is a multimedia processor for
  • an image signal e.g. YUV data or encoded image data
  • the shared memory 310 coupled to the application processor
  • the shared memory 310 is shared by each element of the application processor 215 (e.g.
  • controller 255 controls the multimedia processing unit 260 and an image sealer 265).
  • the storage area of the shared memory 310 can be partitioned into n partitioned blocks, n being a natural number.
  • the use for each partitioned block can be
  • a first partitioned block can be predetermined for each of
  • a second partitioned block can be
  • a third partitioned block can be predetermined to store image
  • a preview mode i.e. a previewing state before photographing a
  • partitioned blocks completes storing a first part of the data, the other partitioned block
  • the shared memory 310 is coupled to the main processor 210 and used for
  • a particular partitioned block can be assigned for the data
  • the shared memory 310 further has an access port.
  • partitioned block for the data transmission is restricted to be accessed by a plurality of
  • processors at the same time.
  • image signal processor (ISP) 330 or the application processor 215 can generate data
  • the ISP 330 can be preset to perform encoding process. If the setting mode
  • the application processor 215 can be
  • the ISP 330 must have a
  • processing module for generating encoded data by use of YUV data (or RGB data), in
  • the ISP 330 can further include an input unit, which is inputted with raw data,
  • an image signal i.e. YUV data or encoded
  • the application processor 215 also must integrally or individually have
  • interface means that can receive not only YUV data but also encoded image data from
  • the camera module 305 This is because since the YUV data has a signal wave type in which only valid data is successively inputted, but the encoded data has another signal
  • the application processor 215 of the present invention is
  • an MP-AP bus e.g. a host interface
  • shared memory 310 having two ports through a first SM (shared memory) bus and a
  • the application processor 215 processes an image signal inputted
  • the application processor 215 further processes multimedia data stored in the
  • the application processor 215 includes an interface unit 250, a controller 255,
  • a multimedia processing unit 260 an image sealer 265, a priority control unit 325, a
  • first SM control unit 315 and a second SM control unit.
  • the interface unit 250 communicates data (e.g. a control signal) between the
  • processor 215 performs corresponding processing operation.
  • the controller 255 controls the operation of the application processor 215 by a
  • the controller 255 controls the operation of the application processor 215; reads data
  • the controller 255 can access a
  • partitioned block i.e. one of n partitioned blocks into which the shared
  • n being a natural number
  • the controller 255 can be a
  • MCU microcontroller
  • the multimedia processing unit 260 accesses a particular partitioned block of
  • the shared memory 310 through the first SM control unit 315 or the second SM control
  • the multimedia processing unit 260 reads image data (e.g. YUV data)
  • multimedia processing unit 260 can store the processed data in a storage area of the
  • the main processor 210 transfers data to the application processor
  • M-NV memory 220 or M-VO memory 225 coupled M-NV memory 220 or M-VO memory 225 through the MP-AP bus, and the other method is to store the data in a particular partitioned block and then to transfer
  • the main processor 210 To use the latter method, the main processor 210 must be
  • the image sealer 265 receives a data recognizing signal (e.g. a first recognizing
  • the image scalier 265 stores the image signal (i.e. the
  • the image sealer 265 processes
  • the image signal i.e. the YUV data
  • the image sealer 265 performs a preset imaging processing (e.g. generates a
  • the data processed by the image sealer 265 is stored in the shared
  • the image signal is stored in accordance with the control of the controller 255.
  • the data recognizing signal can be inputted into the controller 255.
  • the controller 255 which receives the data recognizing signal, can control the operation
  • the image sealer 265 of the present invention is merely one embodiment of an
  • the image signal e.g. YUV data or encoded image data
  • multimedia data input unit that needs to store multimedia data (e.g. image data and/or
  • the illustrated multimedia processing unit 260 is merely one
  • multimedia data processing unit that processes multimedia data stored in the shared
  • the priority control unit 325 determines the priority in response to a request for
  • the priority control unit 325 can permit the image signal (e.g. YUV data for a preview mode, shooting a movie file and generating
  • the priority control unit 325 can control the second SM control unit 320 such
  • the SM control unit 315 and the second SM control unit 320 controls elements
  • the first SM control unit 315 or the second SM control unit 320 which
  • the storage space of the partitioned block is used up.
  • the present invention can permit a plurality of elements to
  • FIG. 3 can be realized as a single chip.
  • a plurality of processors including the main processor 210 and the application
  • processors and at least a memory can be embodied as one chip.
  • FIG. 4 is a flow chart illustrating a method of outputting various image signals
  • FIG. 5 is a flow chart illustrating a method of processing an inputted image signal of the
  • the ISP 330 of the present invention includes a processing
  • YUV data or RGB data
  • RGB data a conventional processing module for converting RGB data to YUV data
  • the ISP 330 or the application processor 215 can generate the encoded data.
  • processor 210 (or a controller equipped in the main processor 210) informs the ISP 330
  • the application processor 215 can be preset to perform encoding process.
  • the data recognizing signal can have
  • the ISP 330 In a step represented by 415, the ISP 330 generates YUV data by using raw
  • the YUV data can be classified into high
  • resolution YUV data for generating encoded image data, and low resolution YUV data
  • the ISP 330 determines whether the data
  • recognizing signal received from the main processor 210 is a first data recognizing
  • step represented by 420 can be performed
  • the ISP 330 If the data recognizing signal is the first data recognizing signal, the ISP 330
  • the ISP If the data recognizing signal is not the first data recognizing signal, the ISP
  • image signal i.e. YUV data or encoded image data
  • FIG. 5 is a diagrammatic representation of FIG. 5.
  • the data recognizing circuit 210 receives a data recognizing signal from the main processor 210.
  • the data recognizing circuit 210 receives a data recognizing signal from the main processor 210.
  • the controller 255 can be inputted into the image sealer 265 or the controller 255.
  • the data recognizing signal can be communicated through an MP-AP bus for example.
  • the application processor 215 receives an image
  • the image signal from the camera module 305.
  • the image signal will be received through the
  • the application processor 215 determines whether
  • the data recognizing signal received from the main processor 210 is a second data
  • the step represented by 520 can be performed together in the step
  • the data recognizing signal is the second data recognizing signal
  • application processor 215 generates encoded image data (i.e. compressed data) by using
  • the received image signal i.e. YUV data
  • the received image signal i.e. YUV data
  • the generation of the compressed data can be
  • the image signal received for the processing of the multimedia processing unit 260 can be any image signal received for the processing of the multimedia processing unit 260 .
  • the data recognizing signal is not the first data recognizing signal
  • application processor 215 stores the received image signal (i.e. encoded image data) in
  • the present invention can minimize the time delay in the
  • the present invention can also guarantee the image continuity due to
  • the present invention can also allow a main processor to quickly transfer data
  • the present invention can also maximize the efficiency of storing and
  • processing data by allowing each of plural elements, requested to process or process the
  • the present invention can prevent data loss by removing the time

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

L'invention concerne un dispositif d'imagerie et le procédé associé de production de signal d'image. Un module caméra produit sélectivement des données YUV ou des données d'image codées à partir d'un capteur d'image selon le signal de commande d'un processeur principal. L'invention permet de mettre en oeuvre un traitement de données d'image de haute qualité en temps réel.
PCT/KR2006/005612 2005-12-26 2006-12-21 Dispositif d'imagerie et procédé de transfert de signal d'image WO2007075000A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020050129736A KR100663380B1 (ko) 2005-12-26 2005-12-26 촬상 장치 및 영상 신호 생성 방법
KR10-2005-0129736 2005-12-26

Publications (1)

Publication Number Publication Date
WO2007075000A1 true WO2007075000A1 (fr) 2007-07-05

Family

ID=37866580

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2006/005612 WO2007075000A1 (fr) 2005-12-26 2006-12-21 Dispositif d'imagerie et procédé de transfert de signal d'image

Country Status (2)

Country Link
KR (1) KR100663380B1 (fr)
WO (1) WO2007075000A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9628679B2 (en) 2008-12-29 2017-04-18 Red.Com, Inc. Modular motion camera
US9712728B2 (en) 2008-12-29 2017-07-18 Red.Com, Inc. Modular digital camera for use with multiple recording modules
US10116776B2 (en) 2015-12-14 2018-10-30 Red.Com, Llc Modular digital camera and cellular phone
US10271031B2 (en) 2014-04-04 2019-04-23 Red.Com, Llc Broadcast module for a digital camera

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SG172802A1 (en) * 2008-12-29 2011-08-29 Red Com Inc Modular digital camera
US9681028B2 (en) 2013-03-15 2017-06-13 Red.Com, Inc. Digital camera with wireless connectivity

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6137946A (en) * 1997-04-04 2000-10-24 Sony Corporation Picture editing apparatus and method using virtual buffer estimation
US6522830B2 (en) * 1993-11-30 2003-02-18 Canon Kabushiki Kaisha Image pickup apparatus
US6798418B1 (en) * 2000-05-24 2004-09-28 Advanced Micro Devices, Inc. Graphics subsystem including a RAMDAC IC with digital video storage interface for connection to a graphics bus

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6522830B2 (en) * 1993-11-30 2003-02-18 Canon Kabushiki Kaisha Image pickup apparatus
US6137946A (en) * 1997-04-04 2000-10-24 Sony Corporation Picture editing apparatus and method using virtual buffer estimation
US6798418B1 (en) * 2000-05-24 2004-09-28 Advanced Micro Devices, Inc. Graphics subsystem including a RAMDAC IC with digital video storage interface for connection to a graphics bus

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9628679B2 (en) 2008-12-29 2017-04-18 Red.Com, Inc. Modular motion camera
US9712728B2 (en) 2008-12-29 2017-07-18 Red.Com, Inc. Modular digital camera for use with multiple recording modules
US10271031B2 (en) 2014-04-04 2019-04-23 Red.Com, Llc Broadcast module for a digital camera
US10116776B2 (en) 2015-12-14 2018-10-30 Red.Com, Llc Modular digital camera and cellular phone
US11165895B2 (en) 2015-12-14 2021-11-02 Red.Com, Llc Modular digital camera and cellular phone

Also Published As

Publication number Publication date
KR100663380B1 (ko) 2007-01-02

Similar Documents

Publication Publication Date Title
US7587524B2 (en) Camera interface and method using DMA unit to flip or rotate a digital image
WO2006101292A1 (fr) Blocs partitionnes variables en memoire partagee
WO2007075000A1 (fr) Dispositif d'imagerie et procédé de transfert de signal d'image
US8151136B2 (en) Method and device for correcting code data error
US7545416B2 (en) Image processing device and camera including CPU which determines whether processing performed using external memory
KR100728650B1 (ko) 복수 경로를 통한 다중 분할된 메모리 공유 방법 및 장치
KR100731969B1 (ko) 복수 경로를 통한 메모리 공유 방법 및 장치
KR100592106B1 (ko) 개별 메모리 접근 허용 방법 및 장치
US20090043970A1 (en) Device having shared memory and method for providing access status information by shared memory
KR100736902B1 (ko) 복수의 프로세서에 의한 메모리 공유 방법 및 장치
JP2001238189A (ja) 画像処理装置及び該装置における動作制御方法
US20080158364A1 (en) Image Processing Device and Data Processing Method
US7675545B2 (en) Camera module having image processing procedure and method for integrating the same with host
US20100002099A1 (en) Method and apparatus for sharing memory
KR100715522B1 (ko) 카메라 컨트롤 장치, 영상 데이터 표시 장치 및 그 방법
KR100658588B1 (ko) 메모리 공유 시스템 및 그 방법
KR100909025B1 (ko) 복수의 프로세서에 의한 메모리 공유 방법 및 메모리 공유구조를 가지는 휴대형 단말기
KR100592109B1 (ko) 공유 메모리의 분할 영역의 다중 억세스 제어 방법 및 공유메모리를 가지는 휴대형 단말기
KR100658591B1 (ko) 공유 메모리를 이용한 디스플레이 제어 방법 및 장치
KR100888427B1 (ko) 공유 메모리를 구비한 디지털 처리 장치 및 데이터 출력방법
WO2007021154A1 (fr) Partage de memoire par une pluralite de processeurs
JP2000010685A (ja) 画像入出力装置およびその画像入出力装置用ケーブル
JPH08292927A (ja) 情報処理装置
JP2002218539A (ja) 画像処理用集積回路
JP2000125234A (ja) 携帯型情報記憶装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06835316

Country of ref document: EP

Kind code of ref document: A1