CN103139465A - System and method for providing panoramic image - Google Patents

System and method for providing panoramic image Download PDF

Info

Publication number
CN103139465A
CN103139465A CN2012104302124A CN201210430212A CN103139465A CN 103139465 A CN103139465 A CN 103139465A CN 2012104302124 A CN2012104302124 A CN 2012104302124A CN 201210430212 A CN201210430212 A CN 201210430212A CN 103139465 A CN103139465 A CN 103139465A
Authority
CN
China
Prior art keywords
panoramic picture
stored
frames images
impact
storage section
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012104302124A
Other languages
Chinese (zh)
Inventor
周硕荣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hyundai Mobis Co Ltd
Original Assignee
Hyundai Mobis Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hyundai Mobis Co Ltd filed Critical Hyundai Mobis Co Ltd
Publication of CN103139465A publication Critical patent/CN103139465A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62D—MOTOR VEHICLES; TRAILERS
    • B62D41/00—Fittings for identifying vehicles in case of collision; Fittings for marking or recording collision areas

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a system and a method for providing a panoramic image. According to the system and the method, images of cameras on the front, rear, right and left sides of a vehicle are synthesized into a panoramic image and displayed on a screen, and the panoramic image can be rotated or partially amplified on the basis of user input, such that if the vehicle is impacted, camera images of the impacted position before and after the impact time point can be stored. The panoramic image can be rotated or partially amplified on the basis of user input, and can be provided as evidence for the traffic accident.

Description

Panoramic picture provides system and method thereof
Technical field
The present invention relates to take the system that vehicle-surroundings provides picture, relate in particular to the system that utilizes the also synthetic image of a plurality of video cameras shooting vehicle-surroundings of installing on vehicle and panoramic picture is provided.
Background technology
Utilize a plurality of video cameras of installing on vehicle to take vehicle-surroundings, will be from the synthetic frame of the frames images that each video camera obtains, for public technology, wherein the invention of vehicle-surroundings image display device is disclosed for No. 2007-158426 by Japanese Laid-Open Patent with the technology that shows panoramic picture on picture.Disclose a plurality of images that will show vehicle-surroundings in this publication and combined and convert a panoramic picture to, and will show the display unit of the vehicle-surroundings that the doubling of the image of vehicle appearance shows.But it is exactly the panorama that can only provide fixing that also there is a kind of defective in this known technology.
Summary of the invention
The object of the present invention is to provide panoramic picture, and the technical scheme that can support panoramic picture rotation and specific part enlarging function is provided.Can preserve the technical scheme of the image of the part that vehicle is impacted when the present invention also aims to provide the collision happens accident.
For reaching described purpose, the present invention proposes a kind of panoramic picture system is provided, and comprising: a plurality of video cameras, take vehicle-surroundings; Memory, the output map frame of the described a plurality of video cameras of storage; Image processing part is with the synthetic panoramic picture of a plurality of frames images of the described video camera that stores on described memory; Display part shows described synthetic panoramic picture; Control part, according to user's input, the panoramic picture of the described demonstration of rotation perhaps amplifies the some frames images in the described frames images that consists of described panoramic picture.Described image processing part generates described panoramic picture after a frames images in a plurality of frames images of described a plurality of video cameras is halved.
Described panoramic picture provides system also to comprise: image storage section stores described panoramic picture.
Described panoramic picture provides system also to comprise: impulse detection section, detect the impact of described vehicle.Described control part will be stored into described image storage section with the corresponding camera review of impact site that detects.Described control part is stored into described image storage section with described this camera review, and will be stored in a plurality of image models of described this video camera of described memory before the described time point that is detected impact and be stored into described image storage section from a plurality of frames images that the described time point that impact detected begins again to be stored within certain hour described this video camera of described memory.
On the other hand, the present invention also proposes a kind of panoramic picture supplying method, and implementation step comprises: the synthetic panoramic picture of output map frame that will take a plurality of video cameras of vehicle-surroundings; Show described synthetic panoramic picture on picture; According to user's input, the panoramic picture of the described demonstration of rotation perhaps amplifies the some frames images in the described a plurality of frames images that consist of described panoramic picture.
Described panoramic picture supplying method, implementation step also comprises: whether judge described vehicular impact;
The described vehicle of judged result judgement has impact, the camera review of the described impact site of shooting in described a plurality of video cameras is stored into image storage section, and will has been stored in a plurality of frames images of described this video camera of described memory before the described time point that is detected impact and has been stored into described image storage section from the described time point that is detected impact begins again to be stored in described memory to certain hour a plurality of frames images of described this video camera.
The invention has the advantages that: utilize as input units such as touch-screens and implement the panoramic picture rotation, and can only amplify the image of specific part.And before and after occuring during collision happens to impact, the camera review at impact position is preserved, thereby the image that can be used as the traffic accident evidence is provided.
Description of drawings
Fig. 1 is that the panoramic picture of one embodiment of the invention provides system construction drawing;
Fig. 2 means the figure of the frames images input of each video camera;
Fig. 3 is the reference figure that the panoramic picture of explanation one embodiment of the invention generates;
Fig. 4 be the explanation one embodiment of the invention the camera review frame in the rear frames images binary with reference to figure;
Fig. 5 is the first reference figure of the panoramic picture rotation of explanation one embodiment of the invention;
Fig. 6 is the second reference figure of the panoramic picture rotation of explanation one embodiment of the invention;
Fig. 7 is that the part of the panoramic picture of one embodiment of the invention is amplified explanation with reference to figure;
Fig. 8 preserve when being the detection vehicular impact of explanation one embodiment of the invention frames images with reference to figure;
Fig. 9 is stored in the frames images schematic diagram of image storage section when being the detection vehicle detection of one embodiment of the invention;
Figure 10 is the flow chart of the panoramic picture supplying method of one embodiment of the invention.
In figure:
100: input part 200: display part
300: the place ahead video camera 310: the rear video camera
320: left side camera 330: the right side video camera
400: memory 500: image processing part
600: control part 700: image storage section
800: impulse detection section.
Embodiment
For the purpose, technical scheme and the advantage that make the embodiment of the present invention clearer, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the preferred embodiment of the present invention is clearly and completely described, so that those of ordinary skill in the art understands and implements based on the embodiment in the present invention.
Fig. 1 is that the panoramic picture of one embodiment of the invention provides system construction drawing.In Fig. 1, panoramic picture provides system to comprise input part 100, display part 200, a plurality of video camera 300,310,320,330, memory 400, image processing part 500 and control part 600.Further illustrate, panoramic picture provides system can also comprise image storage section 700.Illustrate further, panoramic picture provides system can also comprise impulse detection section 800.Input part 100 is that display part 200 is common output devices of output image for the common input unit of user's input.In an embodiment, input part 100 and display part 200 are the touch-screens that can support input and output.A plurality of video cameras 300,310,320,330 are assemblied in the mutual diverse location of vehicle, and vehicle-surroundings is implemented to take.Provide altogether four video cameras as example in Fig. 1, namely take the left side camera 320 of the place ahead video camera 300 of vehicle front, the rear video camera 310 of taking rear view of vehicle, shooting vehicle left side and the right side video camera 330 of taking the vehicle right side.Memory 400 is buffer storage of interim store images frame.In an embodiment, memory 400 possesses the storage area and is used for interim four frames images that store each video camera.
Image processing part 500 is processors of processing input picture.Image processing part 500 is implemented the image of the synthetic frames images of a plurality of frames images is processed.Image processing part 500 can be implemented the image processing that colour filter array interpolation (color filter array interpolation), color matrices (color matrix), colour correction (color correction), color enhancement (color enhancement) etc. are intended to improve image quality in addition.Control part 600 is whole system to be implemented the controller of control.Image storage section 700 is memories of store images, can be flash memory.Image storage section 700 can store panoramic picture.Preferably, panoramic picture is compressed storage.Impulse detection section 800 is comprised of a plurality of shock transducers that detect vehicular impact.In an embodiment, impulse detection section 800 by the frontal impact transducers that detect the vehicle frontal impact, detect the vehicle rear impact the rear impact transducer, detect the left side shock transducer that vehicle left side impacts and detect the right side shock transducer that the vehicle right side impacts and form.
The below provides the operation embodiment of system to describe to panoramic picture.The place ahead video camera 300 and rear video camera 310, left side camera 320 and right side video camera 330 continue to output to control part 600 with the frames images of taking as shown in Figure 2.Control part 600 will be stored into memory 400 from the frames images of each video camera input temporarily.This memory 400 can store four frames images of each video camera temporarily.The frames images (for example four Frame #1) of each video camera that control part 600 will be stored into the same time point of memory 400 is sent to image processing part 500.The frames images that four frames images that image processing part 500 will transmit are each video camera is synthesized a frames images generating panorama image.In an embodiment, synthetic frames images generating panorama image after image processing part 500 is halved the some frames images in four frames images.Its example is seen Fig. 3.Can confirm from Fig. 3, rear frames images (Back Frame) is by second-class left rear side frames images (Back-L Frame) and right rear side frames images (Back-R Frame) the synthetic frames images afterwards that is divided into.In the bisection mode, image processing part 500 supposes that horizontal pixel (horizontal pixel) specification of rear frames images is M as shown in Figure 4, halves take the M/2 point as benchmark.
Control part 600 is that the panoramic picture that image processing part 500 generates is outputed to display part 200.Control part 600 is supported panoramic picture rotation and the part enlarging function that display part 200 shows.For example, according to user's input mode, panoramic picture rotation or an amplification part that control part 600 shows display part 200.As shown in Fig. 5 (a), the user is displaced downwardly to image right with the state of the place ahead image in the panoramic picture of finger touch display part 200, and as shown in Fig. 5 (b), left-side images is positioned at the centre position, and is shifted length by length onto the right side.From the angle of control part 600, as shown in Figure 6, first identify the coordinate of the finger of inputting on picture, the mobile place of monitoring finger coordinate then makes the panoramic picture rotation when finger moves to setting regions.In Fig. 6, with (M, N) → (M+M/4, N), this coordinate has been made illustration.Finger is moved to the left to the coordinate time of having set from central authorities, image right is positioned at centre in the same way.If the user double-clicks the preferred coordinates of having set of some frames images in special time, 600 of control parts are presented at display part 200 with this image.For example, as shown in Fig. 7 (b), click the coordinate of twice (M, N) in user 500ms, as Fig. 7 (b), only the place ahead image is shown enlarged in display part 200.
On the other hand, impact detected by impulse detection section 800, control part 600 is stored into image storage section 700 with the frames images of the corresponding video camera of impact site that detects.For example, impact detected by the left side shock transducer, control part 600 is stored into image storage section 700 with the frames images of the interim left side camera 320 that stores on memory 400.in an embodiment, control part 600 will be stored in a plurality of frames images in left side of memory 400 and be stored into image storage section 700 from a plurality of frames images in left side that the time that impact detected begins again to be stored in memory 400, as shown in Figure 8, if the Frame #N of left side camera 320 input time point detects impact, control part 600 as shown in Figure 9, the Frame #N-4 of memory 400 will be stored in temporarily, Frame #N-3, Frame #N-2, Frame #N-1 is stored into image storage section 700, and will begin again to be stored in the Frame #N of memory 400 from the time point that impact detected temporarily, Frame #N+1, Frame #N+2, Frame #N+3 is stored into image storage section 700.
Figure 10 is the flow chart of the panoramic picture supplying method of one embodiment of the invention.Control part 600 will be stored into memory 400(S100 from the frames images of a plurality of video cameras 300,310,320,330 inputs).For the time that is stored into memory 400, can set by the user and change.The frames images of same time point that control part 600 will be stored in each video camera of memory 400 is sent to image processing part 500, and image processing part 500 is with the synthetic frames images generating panorama image (S150) of the frames images of each video camera.Control part 600 is presented at the panoramic picture that generates on the picture of display part 200 (S200).
After this control part 600 judgements have no user to touch input (S250).If there is the user to touch input, control part 600 is identified the coordinate (S300) that this inputs the place.This coordinate identification judgement of control part 600 use has no user to input (S350) within certain hour again, and in other words, control part 600 is to confirm whether to double-click.If the input of double-click is arranged, control part 600 will be shown enlarged in display part 200(S400 with this corresponding camera review frame of coordinate of double-clicking the place).What confirm in the S350 step is not to double-click but drag input, control part 600 monitorings this drag input (S450).Control part 600 confirms that by monitoring input stops the coordinate of time point, correspondingly makes therewith the panoramic picture rotation (S500) that shows on display part 200.
On the other hand, whether control part 600 judgements detect impact, if judgement detects impact, confirm the vehicle position (S550) of generation impact (S600).And can partly confirm by shock transducer.Control part 600 will be stored into the image storage 400(S650 of section with the corresponding camera review frame of impact site of confirming).In S650, a plurality of frames images in left side that the time point that control part 600 will be stored in as mentioned above a plurality of frames images in left side of memory 400 and be detected impact begins again to be stored in memory 400 are stored into image storage section 700.
Above embodiment only in order to technical scheme of the present invention to be described, is not intended to limit; Although with reference to previous embodiment, the present invention is had been described in detail, those of ordinary skill in the art is to be understood that: it still can be modified to the described technical scheme of aforementioned each embodiment, perhaps part technical characterictic wherein is equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution break away from the scope of the described technical scheme of various embodiments of the present invention.

Claims (7)

1. panoramic picture provides system, it is characterized in that, comprising:
A plurality of video cameras are taken vehicle-surroundings;
Memory, the output map frame of the described a plurality of video cameras of storage;
Image processing part is with the synthetic panoramic picture of a plurality of frames images of the described video camera that stores on described memory;
Display part shows described synthetic panoramic picture;
Control part according to user's input, rotates the panoramic picture that described display part shows, perhaps amplifies the some frames images in the described a plurality of frames images that consist of described panoramic picture.
2. panoramic picture according to claim 1 provides system, it is characterized in that,
Described image processing part generates described panoramic picture after a frames images in a plurality of frames images of described a plurality of video cameras is halved.
3. panoramic picture according to claim 1 provides system, it is characterized in that, also comprises:
Image storage section stores described panoramic picture.
4. panoramic picture according to claim 3 provides system, it is characterized in that, also comprises:
The impact of described vehicle detects in impulse detection section;
Described control part will be stored into the corresponding camera review of impact site that impulse detection section is detected described image storage section.
5. panoramic picture according to claim 4 provides system, it is characterized in that,
Described control part is stored into described image storage section with described this camera review, and will be stored in a plurality of image models of described this video camera of described memory before the described time point that is detected impact and be stored into described image storage section from a plurality of frames images that the described time point that impact detected begins again to be stored within certain hour described this video camera of described memory.
6. a panoramic picture supplying method, is characterized in that, implementation step comprises:
The synthetic panoramic picture of output map frame of a plurality of video cameras of vehicle-surroundings will be taken;
Show described synthetic panoramic picture on picture;
According to user's input, the panoramic picture of the described demonstration of rotation perhaps amplifies the some frames images in the described a plurality of frames images that consist of described panoramic picture.
7. panoramic picture supplying method according to claim 6, is characterized in that, implementation step also comprises:
Whether judge described vehicular impact;
The described vehicle of judged result judgement has impact, the camera review of the shooting impact site in described a plurality of video cameras is stored into image storage section, and will be detected a plurality of frames images of described this video camera of being stored in described memory before the time point of impact and be stored into described image storage section from the described time point that is detected impact begins again to be stored in described memory to certain hour a plurality of frames images of described this video camera.
CN2012104302124A 2011-11-21 2012-11-01 System and method for providing panoramic image Pending CN103139465A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2011-0121678 2011-11-21
KR1020110121678A KR20130055967A (en) 2011-11-21 2011-11-21 System for providing panoramic image and method thereof

Publications (1)

Publication Number Publication Date
CN103139465A true CN103139465A (en) 2013-06-05

Family

ID=48498722

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012104302124A Pending CN103139465A (en) 2011-11-21 2012-11-01 System and method for providing panoramic image

Country Status (2)

Country Link
KR (1) KR20130055967A (en)
CN (1) CN103139465A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104243805A (en) * 2013-06-20 2014-12-24 Lg电子株式会社 Mobile terminal and method of controlling the mobile terminal
CN105069853A (en) * 2015-08-20 2015-11-18 南京安通杰科技实业有限公司 Method for analyzing traffic accidents
CN106240456A (en) * 2015-06-09 2016-12-21 Lg电子株式会社 Driver assistance and control method thereof

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104842871A (en) * 2014-02-13 2015-08-19 徐志川 Automotive electronic rearview system and technical scheme
KR101657673B1 (en) 2015-04-30 2016-09-22 주식회사 와이즈오토모티브 Apparatus and method for generating panorama view
KR102536945B1 (en) 2016-08-30 2023-05-25 삼성전자주식회사 Image display apparatus and operating method for the same
CN106828357A (en) * 2016-12-22 2017-06-13 深圳市车生活科技有限公司 A kind of vehicle-mounted data detection method and device based on serial communication

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1240323A (en) * 1998-05-29 2000-01-05 日本电气株式会社 Video camera interface, video camera control method and computer program products
JP2007158426A (en) * 2005-11-30 2007-06-21 Alpine Electronics Inc Vehicle periphery image display device
CN101052112A (en) * 2007-04-24 2007-10-10 赵凤济 Video frequency image circulation storage device and method
CN102087656A (en) * 2009-12-07 2011-06-08 鸿富锦精密工业（深圳）有限公司 Method for circularly displaying pictures in electronic device
CN102117611A (en) * 2009-12-31 2011-07-06 鸿富锦精密工业（深圳）有限公司 Method for realizing circular display of pictures in electronic device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1240323A (en) * 1998-05-29 2000-01-05 日本电气株式会社 Video camera interface, video camera control method and computer program products
JP2007158426A (en) * 2005-11-30 2007-06-21 Alpine Electronics Inc Vehicle periphery image display device
CN101052112A (en) * 2007-04-24 2007-10-10 赵凤济 Video frequency image circulation storage device and method
CN102087656A (en) * 2009-12-07 2011-06-08 鸿富锦精密工业（深圳）有限公司 Method for circularly displaying pictures in electronic device
CN102117611A (en) * 2009-12-31 2011-07-06 鸿富锦精密工业（深圳）有限公司 Method for realizing circular display of pictures in electronic device

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104243805A (en) * 2013-06-20 2014-12-24 Lg电子株式会社 Mobile terminal and method of controlling the mobile terminal
US9609209B2 (en) 2013-06-20 2017-03-28 Lg Electronics Inc. Mobile terminal and method of controlling the mobile terminal
CN104243805B (en) * 2013-06-20 2017-10-20 Lg电子株式会社 The method of mobile terminal and control mobile terminal
CN106240456A (en) * 2015-06-09 2016-12-21 Lg电子株式会社 Driver assistance and control method thereof
CN106240456B (en) * 2015-06-09 2018-12-18 Lg电子株式会社 Driver assistance and its control method
US10377309B2 (en) 2015-06-09 2019-08-13 Lg Electronics Inc. Driver assistance apparatus and control method for the same
CN105069853A (en) * 2015-08-20 2015-11-18 南京安通杰科技实业有限公司 Method for analyzing traffic accidents

Also Published As

Publication number Publication date
KR20130055967A (en) 2013-05-29

Similar Documents

Publication Publication Date Title
CN103139465A (en) System and method for providing panoramic image
CN107021015B (en) System and method for image processing
US10007853B2 (en) Image generation device for monitoring surroundings of vehicle
US10358090B2 (en) Vehicle imaging device, vehicle imaging display system, and vehicle
US10195996B2 (en) Image display method and system of vehicle rearview mirrors
US20090121851A1 (en) Vehicle-Periphery Image Generating Apparatus and Method of Correcting Distortion of a Vehicle-Periphery Image
US10902622B2 (en) Method and device for generating a view around a vehicle for a vehicle
JP2013110712A5 (en)
JP2009017020A (en) Image processor and method for generating display image
CN105472317B (en) Periphery monitoring apparatus and surroundings monitoring system
JP5090496B2 (en) Image generating apparatus and operation support system
KR101198206B1 (en) System for providing image around vehicle with portable terminal and method thereof
KR101964864B1 (en) Distortion Correction Method of Around View Image of Vehicle
KR101436445B1 (en) Method for displaying image around the vehicle
KR20100005971A (en) A vehicle around view monitorring system
JP2010252015A (en) Image composition device, image composition method and program
US20190050959A1 (en) Machine surround view system and method for generating 3-dimensional composite surround view using same
JP4889360B2 (en) In-vehicle image display device
JP2013073514A (en) Image generation method, image generation device and operation support system
JP7029350B2 (en) Image processing device and image processing method
JP2012147308A (en) Image processing apparatus, image display system, and image processing method
CN102595029A (en) Integrated bird's-eye view reversing camera and method for displaying bird's-eye view image thereof
US20050030380A1 (en) Image providing apparatus, field-of-view changing method, and computer program product for changing field-of-view
JP2013126167A (en) Vehicle periphery monitoring device
JP2020136715A5 (en)

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20130605

WD01 Invention patent application deemed withdrawn after publication