WO2008065843A1 - Dispositif mobile de prise d'image avec fonction zoom, traitement d'image, procédé d'affichage et programme - Google Patents
Dispositif mobile de prise d'image avec fonction zoom, traitement d'image, procédé d'affichage et programme Download PDFInfo
- Publication number
- WO2008065843A1 WO2008065843A1 PCT/JP2007/071138 JP2007071138W WO2008065843A1 WO 2008065843 A1 WO2008065843 A1 WO 2008065843A1 JP 2007071138 W JP2007071138 W JP 2007071138W WO 2008065843 A1 WO2008065843 A1 WO 2008065843A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- processing
- data
- image data
- camera
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
Definitions
- the present invention relates to a moving image photographing device with a zoom function, a moving image image processing and display method, and a program, and in particular, a technique for processing abnormal images that occur during zoom switching processing for a photographing device equipped with a zoom function.
- a technique for processing abnormal images that occur during zoom switching processing for a photographing device equipped with a zoom function is about.
- Patent Document 1 Japanese Unexamined Patent Publication No. 2006-157191
- the present invention was invented in view of the above problems, and the user is not aware of abnormal images! / A moving image photographing apparatus with a zoom function, which realizes image display at low cost, and moving images Image processing and display method and program.
- the first moving image photographing apparatus with a zoom function is a moving image photographing apparatus with a zoom function, and when an image abnormality occurs due to zoom switching processing, an image of a frame immediately before the abnormality occurs. Having display control means for displaying data until image abnormality is recovered It is characterized by.
- the second moving image photographing apparatus with a zoom function according to the present invention is the first moving image photographing apparatus with a zoom function according to the present invention, wherein the display control means performs zooming from the start to the end of the zoom switching process.
- the image data of the frame output from the camera is displayed before the switching process is started.
- a third moving image photographing apparatus with a zoom function according to the present invention is an output from a camera from the start to the end of zoom switching processing in the second moving image photographing apparatus with a zoom function according to the present invention. It has a price image generation means for generating price image data in place of the image data.
- a fourth moving image photographing apparatus with a zoom function according to the present invention is the moving image photographing apparatus with a zoom function according to the third aspect of the present invention, in which image data output from a camera or substitute image data is imaged. It has the image processing means to process, It is characterized by the above-mentioned.
- a fifth moving image capturing device with a zoom function according to the present invention is the camera according to the fourth moving image capturing device with a zoom function according to the present invention, when an image abnormality occurs or when the zoom switching process starts and ends.
- the image data or the substitute image data output from is either a black image data with a data value of 0 or a white image data with a data value of 1.
- the first image processing and display method of the present invention is a moving image image processing and display method during zoom switching processing.
- zoom switching processing When an image abnormality occurs due to zoom switching processing, a frame immediately before the abnormality occurs is displayed. The image is displayed until the image is recovered.
- the second image processing and display method of the present invention is the first image processing and display method of the present invention that is output from the camera before the start of the zoom switching process from the start to the end of the zoom switching process.
- the image data of the frame thus displayed is displayed, and the image data output from the camera is subjected to image processing.
- the third image processing and display method of the present invention replaces the image data output from the camera from the start to the end of the zoom switching process in the first image processing and display method of the present invention. Generates substitute image data, displays the frame image data output from the camera before the zoom switching process from the start to the end of the zoom switching process, and The image processing is performed on the substitute image data from the start to the end of the conversion process.
- the fourth image processing and display method of the present invention is the same as that of the second image processing and display method of the present invention, which is output from the camera when an image abnormality occurs or when zoom switching processing starts and ends.
- the image data is characterized in that the data is a black image data having a data value of 0 or a white image data having a data value of 1.
- the fifth image processing and display method of the present invention is the same as the third image processing and display method of the present invention that is output from the camera when an image abnormality occurs or when zoom switching processing starts and ends.
- the alternative image data is either black image data having a data value of 0 or white image data having a data value of 1.
- a first program of the present invention is a program for image processing and display processing of a moving image during zoom switching processing.
- an image abnormality occurs due to zoom switching processing
- an image of a frame immediately before the occurrence of the abnormality is recorded.
- the information processing apparatus is caused to execute a process of displaying the image until the image is recovered.
- the second program of the present invention displays image data of a frame output from the camera before the start of the zoom switching process from the start to the end of the zoom switching process in the first program of the present invention. It is characterized by causing the information processing apparatus to execute processing and processing to perform image processing on image data output from the camera.
- a third program of the present invention is a process according to the first program of the present invention for generating a substitute image data in place of the image data output from the camera from the start to the end of the zoom switching process. Processing to display image data of frames output from the camera before the start of zoom switching processing from the start to the end of zoom switching processing, and processing of image processing of alternative image data from the start to the end of zoom switching processing And the information processing device is executed.
- the fourth program of the present invention is the second program of the present invention, wherein the image data output from the camera when an image abnormality occurs or when the zoom switching process starts and ends has a data value of 0. It is either black image data or white image data with a data value of 1.
- the fifth program of the present invention is the same as the third program of the present invention, wherein an image abnormality occurs.
- the substitute image data output from the camera at the start or end of the zoom switching process is either a black image data with a data value of 0 or a white image data with a data value of 1.
- the present invention when moving images with a photographing device, for example, in zoom switching such as digital zoom, when several abnormal images in the middle of switching are discharged by the camera, display data and video are displayed. A separate process is performed on the encoding data.
- the data in the display unit is not updated, the display is stopped at the normal image before the abnormal image, and the abnormal image is not displayed on the display unit.
- the camera output data is set to all “0”, for example, and is output as black image data to the moving image processing unit and the display data buffer via the camera data buffer.
- the black image data input to the moving image processing unit is encoded.
- the black image data input to the display data buffer is not output to the display unit during the abnormal frame transmission period, and after returning to a normal image, the data stored in the display data buffer is continuously transferred to the display unit at high speed. By transferring and overwriting the latest data, drawing is performed so that the user is not aware of abnormal images.
- the present invention provides a technique that prevents the user from being aware of abnormal images that are discharged when zooming during shooting.
- the present invention has the following effects.
- the first effect is to create video data that does not include abnormal images by replacing abnormal image data with black screen data for cameras that cannot prevent the occurrence of abnormal images during zoom switching during movie shooting.
- the display unit stops updating the image during the zoom switching process period so that only normal image data is displayed, and the abnormal data at the time of zoom switching is reflected in the recorded data and display data without any hardware treatment. Can be processed without causing the user to be aware of abnormal images.
- the second effect is that a processing circuit for interpolating abnormal images is not required, and it is not necessary to provide a large-capacity buffer, so that a system can be constructed at low cost.
- FIG. 1 shows a main part of the configuration of a mobile phone as a mobile terminal device provided with a moving image capturing device with a zoom function according to an embodiment of the present invention.
- a mobile phone includes a camera unit 10 having an image sensor, a key operation unit 11 for a user to input zoom switching processing at the time of moving image shooting, a CPU 12 for controlling each unit, A camera data buffer 13 for storing image data, a display unit 14 for displaying captured images, a moving image processing unit 15 for encoding image data sent from the camera data buffer 13 into video data, A display data buffer 16 in which image data to be displayed on the display unit 14 is stored.
- the image data taken by the camera unit 10 is output to the camera data buffer 13 (D1) and temporarily held.
- the image data output from the camera data buffer 13 is input as display data to the display data buffer 16 (D2) and held.
- the image data output from the camera data buffer 13 is input to the moving image processing unit 15 (D3), and the moving image processing unit 15 encodes the video data.
- the camera unit 10 outputs image data of a black image whose data values are all 0 during an abnormal image.
- the CPU 12 when zoom switching processing is input from the key operation unit 11 (11), the CPU 12 outputs to the data buffer 16 an instruction to stop data output from the display data buffer 16 to the display unit 14 ( 12). Also, the data update of the display unit 14 is stopped (13).
- FIG. 2 is an operation flowchart of display image processing during zoom switching processing during recording in the mobile phone according to the first embodiment.
- the abnormal image discharge time during zoom switching processing is known in advance after the zoom switch key is pressed during movie shooting, and that time is stored in a timer by the CPU. It shall be.
- Step 100 When the zoom switch key is pressed during moving image shooting (Step 100), the CPU 12 causes the display arrangement unit 14 to stop updating the display image (Step 101). After stopping, measurement by a timer that measures the period during which an abnormal image is output is started (Step 102). The camera 10 performs zoom switching processing according to an instruction from the CPU 12 (Step 103). Black image data with a data value of '0' is output from the camera being processed (Step 104) and input to the force data buffer 13 (Step 105).
- the display image data is stored in the display data buffer 16 until the abnormal image discharge time ends, but the display unit 14 does not update the image data but updates the previous image data (Step 106). Is displayed (Step 107).
- Step 108 When the time measured by the timer reaches the abnormal image discharge time (Step 108), the display 14 data is updated again (Step 109), and the latest image data stored in the display data buffer 16 is displayed. The data is continuously transferred to section 14 and overwritten with the latest data (Step 110). Then, the display unit 14 displays the image data transferred from the display data buffer 16 (Step 111).
- FIG. 3 is an operation flowchart of the moving image processing in zoom switching at the time of recording in the mobile phone according to the first embodiment.
- the same processing as the processing of the display image at the time of zoom switching at the time of recording described above is denoted by the same step number, and detailed description thereof is omitted.
- Step 100 the same operation is performed from when the zoom switch key is pressed during movie shooting (Step 100) until the image data of the black image whose image data value is "0" is input to the camera data buffer 13 (Step 105). It is.
- the image data of the black image input to the camera data buffer 13 is input to the moving image processing unit 15 (Step 200). Then, the moving image processing unit 15 performs video encoding processing on the image data of the black image (Step 201).
- Step 108 the moving image processing unit 15 performs video encoding processing on the image data of the black image, and after the abnormal image discharge time ends, normal image data is video encoded.
- Step 202 the moving image processing unit 15 performs video encoding processing on the image data of the black image, and after the abnormal image discharge time ends, normal image data is video encoded.
- the force S triggered by pressing of the zoom switching key is not limited to this, and the discharge of an abnormal image or the image of a black image is not limited thereto. Data discharge may be detected and used as a trigger to start processing.
- the end of zoom switching processing is detected by measuring the number of frames.
- the end of the discharge of abnormal image or black image data is not limited to this. Then, this may be used as a trigger for the end of processing.
- the force using black image data instead of the abnormal image is not limited to this, and may be white image image data having a data value of 1 ”.
- FIG. 4 is a diagram for explaining the processing of seven image frame periods before and after an abnormal image during zoom switching processing. In the following explanation, it takes 2 frames from the time the zoom switch key is pressed for the time required for the zoom switch process.
- NG indicates an abnormal frame
- B indicates a black image frame
- n (n is an integer)” indicates a normal frame.
- the camera unit 10 outputs a normal image.
- a normal image is encoded, and the normal image is also displayed on the display unit 14.
- the image data of the black image output from the camera unit 10 is encoded during the period of the 4th frame and the 5th frame.
- the display unit 14 displays a normal 3st frame image just before the 4st frame and 5st frame periods according to instructions from the CPU 12. The data is stopped and the output data from the camera data buffer 13 is stored in the display data buffer 16.
- the display unit 14 resumes data update, overwrites the latest 6st frame image data stored in the display data buffer 16, and updates the 6st frame image data. Display an image.
- the moving image processing unit 15 encodes normal image data of 6st frame and 7st frame.
- a device has been devised when the abnormal screen cannot be replaced with black image data within 10 copies of the 1S camera.
- the image data value is converted to “0” to generate black image data, and the black image data is subjected to moving image processing.
- the conversion of black image data may be performed by the moving image processing unit 15, or a conversion unit for converting to a black image may be provided in the preceding stage of the moving image processing unit 15.
- the conversion process can be performed by software or by hardware.
- FIG. 5 is an operational flowchart of display image processing and moving image processing at the time of zoom switching during recording in the mobile phone according to the second embodiment.
- the same processes as those in the first embodiment described above are denoted by the same step numbers, and the detailed description thereof is omitted.
- Step 100 the same operation is performed from when the zoom switching key is pressed during movie shooting (Step 100) until the image data of the black image whose image data value is “0” is input to the camera data buffer 13 (Step 105). It is.
- the moving image processing unit 15 uses the camera data buffer. The data value of the image data output from 13 is converted to 0 (Step 301), and then video encoding is performed (Step 201).
- the zoom switching process when image data output from the camera data buffer 13 is input to the display data buffer 16 (Steps 300 and 106), the image data input to the camera data buffer 13 is The display image data is stored in the display data buffer 16 until the abnormal image discharge time ends, and the display unit 14 displays the previous image data without updating the image data. (St ep 107).
- Step 108 When the measurement time of the timer reaches the abnormal image discharge time (Step 108), the data in the display unit 14 is updated again (Step 109), and the latest image data stored in the display data buffer 16 is displayed. The data is continuously transferred to section 14 and overwritten with the latest data (Step 110). Then, the display unit 14 displays the image data transferred from the display data buffer 16 (Step 111).
- Power S can be.
- control operation in the embodiment described above can be executed by hardware, software, or a combined configuration of both.
- software processing it is possible to install a program that records the processing sequence in the memory of a computer incorporated in the dedicated hardware and execute it, or to execute various processes.
- the program can be installed and executed on a general purpose computer.
- This program can be recorded in advance on, for example, a hard disk or ROM (Read Only Memory) as a recording medium.
- the program is a floppy (registered) (Trademark) disc, CD—ROM (Compact Disc Read Only Memory), MO (Magneto optical) disc, DVD (Digital Versatile Disc), magnetic disc, semiconductor memory, and other removable recording media, temporarily or permanently Can be stored (recorded) automatically.
- a removable recording medium can be provided as so-called package software.
- the program can be transferred wirelessly from the download site to the computer, or wired to the computer via a network such as a LAN (Local Area Network) or the Internet.
- the computer can receive the transferred program and install it on a recording medium such as a built-in hard disk.
- the media transmission / reception system including the transmission-side media transmission / reception device and the reception-side media transmission / reception device described in the above embodiment may be configured as a logical set of a plurality of devices, It is also possible to construct such that functions are mixed.
- FIG. 1 is a diagram showing a main part of a configuration of a mobile phone as a mobile terminal device including a moving image capturing device with a zoom function according to an embodiment of the present invention.
- FIG. 2 is an operation flowchart of display image processing at the time of zoom switching at the time of recording in the cellular phone according to the first embodiment.
- FIG. 3 is an operation flowchart of moving image processing at the time of zoom switching at the time of recording in the mobile phone according to the first embodiment.
- FIG. 4 is a diagram for explaining processing of seven image frame periods before and after an abnormal image at zoom switching processing.
- FIG. 5 is an operation flowchart of display image processing and moving image processing at the time of zoom switching at the time of recording in the mobile phone according to the second embodiment. Explanation of symbols
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008546921A JP5212110B2 (ja) | 2006-11-28 | 2007-10-30 | ズーム機能付き動画像撮影装置、画像処理及び表示方法とプログラム |
EP07830872A EP2099213A4 (en) | 2006-11-28 | 2007-10-30 | MOBILE IMAGE SENSING DEVICE WITH ZOOM FUNCTION, IMAGE PROCESSING, DISPLAY METHOD, AND PROGRAM |
US12/514,769 US20100026848A1 (en) | 2006-11-28 | 2007-10-30 | Moving picture imaging apparatus with zoom function, image processing and display method and program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006-319506 | 2006-11-28 | ||
JP2006319506 | 2006-11-28 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2008065843A1 true WO2008065843A1 (fr) | 2008-06-05 |
Family
ID=39467639
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2007/071138 WO2008065843A1 (fr) | 2006-11-28 | 2007-10-30 | Dispositif mobile de prise d'image avec fonction zoom, traitement d'image, procédé d'affichage et programme |
Country Status (5)
Country | Link |
---|---|
US (1) | US20100026848A1 (ja) |
EP (1) | EP2099213A4 (ja) |
JP (1) | JP5212110B2 (ja) |
CN (1) | CN101563914A (ja) |
WO (1) | WO2008065843A1 (ja) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5414357B2 (ja) * | 2009-05-20 | 2014-02-12 | キヤノン株式会社 | 撮像装置および再生装置 |
WO2017000313A1 (zh) * | 2015-07-02 | 2017-01-05 | 深圳市大疆创新科技有限公司 | 图像处理系统、图像数据处理方法、装置及相关设备 |
TWI788734B (zh) | 2020-11-25 | 2023-01-01 | 瑞昱半導體股份有限公司 | 視訊處理方法及視訊處理器 |
CN114584718A (zh) * | 2020-12-02 | 2022-06-03 | 瑞昱半导体股份有限公司 | 视频处理方法及视频处理器 |
CN115442586A (zh) * | 2021-06-01 | 2022-12-06 | Oppo广东移动通信有限公司 | 图像处理芯片及应用于图像处理芯片的异常处理方法 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09191435A (ja) * | 1996-01-09 | 1997-07-22 | Sharp Corp | 映像機器の白信号発生装置 |
JP2002314868A (ja) * | 2001-04-13 | 2002-10-25 | Olympus Optical Co Ltd | 撮像装置 |
JP2005101729A (ja) * | 2003-09-22 | 2005-04-14 | Fujinon Corp | ズーム機能付きデジタルカメラ |
JP2006157191A (ja) | 2004-11-26 | 2006-06-15 | Fuji Photo Film Co Ltd | 携帯通信端末、撮影ズーム方法及び表示ズーム方法 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100462915B1 (ko) * | 1995-12-11 | 2005-08-05 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | 비디오및/또는오디오신호의마킹방법및장치,마킹된비디오신호검출방법및장치,비디오또는오디오신호및저장매체 |
US6181364B1 (en) * | 1997-05-16 | 2001-01-30 | United Video Properties, Inc. | System for filtering content from videos |
US6317166B1 (en) * | 1998-08-31 | 2001-11-13 | Immersive Media Company | Synchronization frame generator for multichannel imaging system |
US6763067B2 (en) * | 2000-10-10 | 2004-07-13 | Sarnoff Corporation | Rate control for bitstream re-encoding |
JP4497761B2 (ja) * | 2001-07-18 | 2010-07-07 | キヤノン株式会社 | 画像処理装置及びインデックス作成方法 |
JP4443354B2 (ja) * | 2004-09-07 | 2010-03-31 | パナソニック株式会社 | 映像信号処理回路および撮像装置 |
KR101156115B1 (ko) * | 2005-05-18 | 2012-06-21 | 삼성전자주식회사 | 디지털 영상 처리 장치의 제어 방법 |
-
2007
- 2007-10-30 JP JP2008546921A patent/JP5212110B2/ja not_active Expired - Fee Related
- 2007-10-30 EP EP07830872A patent/EP2099213A4/en not_active Withdrawn
- 2007-10-30 WO PCT/JP2007/071138 patent/WO2008065843A1/ja active Application Filing
- 2007-10-30 CN CNA2007800443953A patent/CN101563914A/zh active Pending
- 2007-10-30 US US12/514,769 patent/US20100026848A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09191435A (ja) * | 1996-01-09 | 1997-07-22 | Sharp Corp | 映像機器の白信号発生装置 |
JP2002314868A (ja) * | 2001-04-13 | 2002-10-25 | Olympus Optical Co Ltd | 撮像装置 |
JP2005101729A (ja) * | 2003-09-22 | 2005-04-14 | Fujinon Corp | ズーム機能付きデジタルカメラ |
JP2006157191A (ja) | 2004-11-26 | 2006-06-15 | Fuji Photo Film Co Ltd | 携帯通信端末、撮影ズーム方法及び表示ズーム方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP2099213A4 |
Also Published As
Publication number | Publication date |
---|---|
EP2099213A4 (en) | 2011-02-16 |
US20100026848A1 (en) | 2010-02-04 |
CN101563914A (zh) | 2009-10-21 |
JP5212110B2 (ja) | 2013-06-19 |
EP2099213A1 (en) | 2009-09-09 |
JPWO2008065843A1 (ja) | 2010-03-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7518639B2 (en) | Electronic still camera that provides a storable continuous frame count and a continuous shooting rate of frames | |
WO2008065843A1 (fr) | Dispositif mobile de prise d'image avec fonction zoom, traitement d'image, procédé d'affichage et programme | |
JP2006345338A (ja) | 撮像装置および撮像方法 | |
JP2012084968A (ja) | デジタルカメラ | |
EP2219382A1 (en) | Image coder, video camera, integrated circuit, and image coding method | |
JP2004120178A (ja) | 映像記録装置 | |
JP5115619B2 (ja) | 撮像装置、撮像制御方法及びプログラム | |
TWI420899B (zh) | 影像處理裝置和方法及記錄媒體 | |
US20140125841A1 (en) | Imaging device, method of capturing image, and program product for capturing image | |
JP2012084973A (ja) | デジタルカメラ | |
JPWO2007145032A1 (ja) | 画像処理回路、携帯端末およびセンサ制御方法 | |
JP2007067708A (ja) | 撮像装置およびその画像生成方法 | |
JP2007174626A (ja) | 監視機能を有するdvdレコーダ | |
US20150350593A1 (en) | Moving Image Data Playback Apparatus Which Controls Moving Image Data Playback, And Imaging Apparatus | |
JP4630530B2 (ja) | 動画記録装置、電子カメラ及びプログラム | |
JP2017163307A (ja) | 撮像システム並びに撮像装置及びその制御方法 | |
JP2000299813A (ja) | 電子撮像装置 | |
US7999853B2 (en) | Moving image reproducing apparatus and processing method therefor | |
JP2008245146A (ja) | 撮像装置、撮像装置の制御方法 | |
EP4311219A1 (en) | Image processing device, image processing method, and program | |
JP2011244294A (ja) | 画像処理装置 | |
JP2018207424A (ja) | 情報転送装置 | |
KR100861286B1 (ko) | 휴대용 단말기 및 휴대용 단말기의 대체 화면 전송방법 | |
JP2006262128A (ja) | デジタルカメラ | |
JP2004260471A (ja) | 電子カメラ、及び電子カメラの起動方法、プログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200780044395.3 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07830872 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2008546921 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007830872 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12514769 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |