CN107370963A

CN107370963A - Image processing method, image processing apparatus and electronic equipment

Info

Publication number: CN107370963A
Application number: CN201710748575.5A
Authority: CN
Inventors: 李江涛; 韩建辉
Original assignee: Beijing Horizon Information Technology Co Ltd
Current assignee: Beijing Horizon Information Technology Co Ltd
Priority date: 2017-08-28
Filing date: 2017-08-28
Publication date: 2017-11-21
Anticipated expiration: 2037-08-28
Also published as: CN107370963B

Abstract

Disclose a kind of image processing method, image processing apparatus and electronic equipment.Described image processing method includes：Subject is imaged to obtain initial pictures, the initial pictures comprise at least the Part I image with the first brightness and the Part II image with the second brightness, the Part I image has at least part identical picture material with the Part II image, and first brightness is different from second brightness；The initial pictures are at least divided into Part I image and Part II image；And the Part I image and the Part II image are synthesized to obtain composograph, the composograph has HDR relative to the identical picture material.Therefore, can be the image with HDR by the processing of the single image with different luminance parts of single shot.

Description

Image processing method, image processing apparatus and electronic equipment

Technical field

Present invention relates in general to image processing field, and it particularly relates at a kind of image processing method, image Manage device and electronic equipment.

Background technology

HDR (HDR) shooting has been used widely now, and it is used to compensate for most of digital image-formings and passed The limited dynamic range of sensor.The dynamic range of photo refers to the brightness range between most dark color and most bright color, Tone range can be represented in the lump.Specifically, in the outdoor scene under bright daylight, shadow region to most bright highlight regions Brightness range considerably beyond digital camera capturing ability.If the exposure settings deviation dash area of camera, highlight regions Will be excessively quick-fried, turn into the pure white of no details.Conversely speaking, if the exposure settings deviation highlight regions of camera, shadow part Black color lump will be become by dividing.

High dynamic range images compare common image, can provide higher dynamic range and more image details. Generally, the normal image of different time for exposure is obtained first, then they are synthesized to final HDR image again.Namely Say, HDR photos incorporate the multiple pictures under same scene, and such as 2 or more, every photo is set using different exposures Put.Can not be by the dynamic of single exposure realization to create by the dark portion details and under exposed highlights details that synthesize overexposure Scope.

However, in the prior art, the HDR being achieved in that is not real-time, and due to needing multiexposure, multiple exposure to synthesize, shooting fortune The ghost of different exposure time is had during animal body (or camera/capture apparatus is moving in itself) (because HDR is to clap several Photo is synthesized, if so shooting object moved between first and second camera lens, the effect finally synthesized Can cause to occur motion parts are fuzzy or ghost image), and have no idea to be used for video recording.

Therefore, it is necessary to improved image procossing scheme.

The content of the invention

In order to solve the above-mentioned technical problem, it is proposed that the application.Embodiments herein provides a kind of image processing method Method, image processing apparatus and electronic equipment, the processing of the single image with different luminance parts of single shot can be by it Image with HDR.

According to the one side of the application, there is provided a kind of image processing method, including：Subject is imaged to obtain just Beginning image, the initial pictures comprise at least the Part I image with the first brightness and the Part II with the second brightness Image, the Part I image have at least part identical picture material, and described first with the Part II image Brightness is different from second brightness；The initial pictures are at least divided into Part I image and Part II image；With And the Part I image and the Part II image are synthesized to obtain composograph, the composograph is relative There is HDR in the identical picture material.

According to the another aspect of the application, there is provided a kind of image processing apparatus, including：Capturing images unit, for pair Subject imaging to obtain initial pictures, the initial pictures comprise at least Part I image with the first brightness and with The Part II image of second brightness, the Part I image have at least part identical figure with the Part II image As content, and first brightness is different from second brightness；Image segmentation unit, for the initial pictures at least to be drawn It is divided into Part I image and Part II image；And image composing unit, for the Part I image and described Part II image is synthesized to obtain composograph, and the composograph has height relative to the identical picture material Dynamic range.

According to the another aspect of the application, there is provided a kind of imaging device, including：Camera lens；At image as described above Manage device.

According to the another further aspect of the application, there is provided a kind of electronic equipment, including：Processor；And memory, described Computer program instructions are stored with memory, the computer program instructions cause the place when being run by the processor Manage device and perform image processing method as described above.

According to the another aspect of the application, there is provided a kind of computer-readable recording medium, be stored thereon with computer journey Sequence instructs, and the computer program instructions cause computing device image procossing as described above when being run by processor Method.

Compared with prior art, using the image processing method according to the embodiment of the present application, image processing apparatus and electronics Equipment, subject can be imaged to obtain initial pictures, the initial pictures comprise at least first with the first brightness Partial image and the Part II image with the second brightness, the Part I image have at least with the Part II image Part identical picture material, and first brightness is different from second brightness；The initial pictures are at least divided into Part I image and Part II image；And the Part I image and the Part II image are synthesized with Composograph is obtained, the composograph has HDR in the overlapping region.It thus provides can be by single The processing of the single image with different luminance parts of shooting is image processing method, the image of the image with HDR Processing unit and electronic equipment, so as to do veritably real-time HDR shootings, cmos sensor ginseng is all adjusted without exposure every time Number, is suitable for HDR videos, is adapted to HDR monitoring scene applications.

Brief description of the drawings

The embodiment of the present application is described in more detail in conjunction with the accompanying drawings, the above-mentioned and other purposes of the application, Feature and advantage will be apparent.Accompanying drawing is used for providing further understanding the embodiment of the present application, and forms explanation A part for book, it is used to explain the application together with the embodiment of the present application, does not form the limitation to the application.In the accompanying drawings, Identical reference number typically represents same parts or step.

Fig. 1 illustrates the schematic diagram of the optics according to the embodiment of the present application；

Fig. 2 is the schematic diagram being fixed on according to the optics of the embodiment of the present application on the camera lens of imaging device；

Fig. 3 is the schematic diagram of the visual field formed according to the optics of the embodiment of the present application；

Fig. 4 is the schematic diagram relative to camera lens according to the visual field that the optics of the embodiment of the present application is formed；

Fig. 5 is the schematic diagram according to the speculum with transmission film of the embodiment of the present application；

Fig. 6 is the imaging process schematic diagram according to the embodiment of the present application；

Fig. 7 A and Fig. 7 B are diagrams to be shown according to the determination mode of mirror size in the optics of the embodiment of the present application It is intended to；

Fig. 8 illustrates the indicative flowchart of the image processing method according to the embodiment of the present application；

Fig. 9 is the schematic diagram according to the initial pictures of the image processing method of the embodiment of the present application；

Figure 10 A and Figure 10 B are the schematic diagrames of the initial image segmentation in the image processing method according to the embodiment of the present application；

Figure 11 is the schematic diagram of the image mirrors split after splitting in the image processing method according to the embodiment of the present application；

Figure 12 is the schematic diagram of the image synthesis in the image processing method according to the embodiment of the present application；

Figure 13 illustrates the schematic block diagram of the image processing apparatus according to the embodiment of the present application；

Figure 14 illustrates the schematic diagram of the imaging system according to the embodiment of the present application；

Figure 15 illustrates the block diagram of the electronic equipment according to the embodiment of the present application.

Embodiment

Below, the example embodiment according to the application will be described in detail by referring to the drawings.Obviously, described embodiment is only Only it is the part of the embodiment of the application, rather than the whole embodiments of the application, it should be appreciated that the application is not by described herein The limitation of example embodiment.

Application general introduction

As described above, HDR of the prior art is not real-time implementation, but multiexposure, multiple exposure is needed to synthesize, shooting motion The ghost of different exposure time is had during object, and has no idea to be used for video recording.

In view of the above-mentioned problems, the basic conception of the application is to propose a kind of image processing method, image processing apparatus and electricity Sub- equipment, its image shot is the single image for including multiple regions with different brightness, so as to being wrapped in single image Multiple regions of the identical subject with different brightness included are divided and synthesized, to obtain the figure with HDR Picture.

After the general principle of the application is described, carry out the specific various non-limits for introducing the application below with reference to the accompanying drawings Property embodiment processed.

The general introduction of image processing method

Included according to the image processing method of the embodiment of the present application：Subject is imaged to obtain initial pictures, it is described first Beginning image comprises at least the Part I image with the first brightness and the Part II image with the second brightness, and described first Parts of images has at least part identical picture material with the Part II image, and first brightness is different from described Second brightness；The initial pictures are at least divided into Part I image and Part II image；And to described first Partial image and the Part II image are synthesized to obtain composograph, and the composograph is relative to the identical figure As content has HDR.

By the image processing method according to the embodiment of the present application, can obtain including having different from each other first respectively The initial pictures of the Part I image and Part II image of brightness and the second brightness, wherein, the Part I image and The picture material of two parts of images is at least partly identical.Therefore, by the way that the initial pictures obtained are divided into Part I figure Picture and Part II image are simultaneously synthesized, and in the composograph, have difference in Part I image and Part II image The identical picture material of brightness synthesizes the image section with HDR.

So, by the image processing method according to the embodiment of the present application, initial pictures are being obtained to subject imaging In contain the identical picture material with different brightness, also, due to Part I image and Part II image be What same time shooting obtained, wherein identical picture material is identical in addition to luminance difference therebetween.Therefore, conjunction is passed through Into Part I image and Part II image, completely real-time HDR parts are obtained in synthesized image, it is achieved thereby that The real-time HDR shootings of image.

Here, in the image processing method according to the embodiment of the present application, can be obtained by a variety of methods including dividing The first brightness that Ju You be not different from each other and the Part I image of the second brightness and the initial pictures of Part II image.Example Such as, in an example, subject can be carried out by fly's-eye lens according to the image processing method of the embodiment of the present application Imaging.Specifically, the multiple images of subject can be obtained simultaneously to subject imaging by fly's-eye lens, and passes through setting The transmissivity of multiple lens in fly's-eye lens is different from each other, it is possible to which obtaining includes the list in multiple regions with different brightness Width image, even if also, the picture material of the parts of images in this multiple region is not identical, and it is at least partly identical 's.

In addition, in the image processing method according to the embodiment of the present application, can be obtained using specific optics Including having the Part I image of the first brightness and the second brightness and the initial graph of Part II image different from each other respectively Picture.

In an example, the optics includes：Housing, it is described including at least the first inner surface and the second inner surface First inner surface and second inner surface extend in a first direction and parallel to each other；First speculum, it is arranged on described first On inner surface and there is the first reflectivity；With, the second speculum, it is arranged on second inner surface and with described the One reflectivity.

The housing by optics can be included by being imaged with the optics to subject, in the image obtained The regional transmission of transmission and the reflector space reflected by the first speculum and the second speculum.Here, it is evident that regional transmission The reflected image of transmission image and reflector space at least has part identical picture material.Also, due to the first speculum and Second speculum has the first reflectivity so that the brightness of transmission image and reflected image is different, for example, the brightness of transmission image More than the brightness of reflected image.So, by the way that the image obtained is divided into transmission image and reflected image and synthesized, so that it may To obtain the composograph that there is HDR relative to identical picture material in transmission image and reflected image.According to this The optics of application embodiment will be described in further detail below.

Exemplary optics device

Fig. 1 illustrates the schematic diagram of the optics according to the embodiment of the present application.As shown in figure 1, implemented according to the application The optics 100 of example includes housing 110, and the housing 110 comprises at least the first inner surface 111 and the second inner surface 112, and the One inner surface 111 and the second inner surface 112 extend in a first direction and parallel to each other.For example, in the first inner surface 111 and second Surface 112 can in the horizontal direction or vertical direction extension, and perpendicular to depth direction horizontally and vertically In there is certain yardstick.

First speculum is further comprised according to the optics 100 of the embodiment of the present application, is arranged on the first inner surface 111 Go up and there is the first reflectivity；With the second speculum, it is arranged on the second inner surface 112 and there is first reflectivity.

For example, the housing 110 can have first end and the second end.Subject is carried out in optics 100 in use When imaging or viewing, first end can be towards subject towards camera lens or human eye, the second end.

So, can be in first end shape according to the optics of the embodiment of the present application by the way that the second end is aligned into subject Into the transmission image of the subject, and further by means of the first speculum being arranged on the first inner surface 111 and setting The second speculum on the second inner surface 112, two reflected images of the subject can be formed in first end, so as to follow-up It can be combined with transmission image, the single image for including multiple regions with different brightness be formed, in order to image procossing (example Such as, synthesize HDR image or detected for parallax).

Further, as shown in figure 1, housing 110 further comprises the 3rd inner surface 113 and the 4th inner surface 114, the 3rd The inner surface 114 of inner surface 113 and the 4th extends and parallel to each other in a second direction, and first direction and the second direction are each other Vertically.For example, the 3rd inner surface 113 and the 4th inner surface 114 can vertically or horizontal direction extension, and vertical There is certain yardstick in depth direction both vertically and horizontally.First inner surface 111, the second inner surface 112nd, the 3rd inner surface 113 and the 4th inner surface 114 may be constructed rectangular shape.That is, according to the embodiment of the present application Four inner surfaces 111,112,113 and 114 of housing 110 of optics 100 be respectively rectangular shape, and with housing 110 Center line for axle distinguish face it is symmetrical.

For example, in practice, the housing 110 can be formed as having long square tube shape, as shown in figure 1, the long square tube shape The cross sectional shape of the housing of shape is also rectangle.Here, although it will be understood by those skilled in the art that in Fig. 1, by four The shape on surface is accordingly to be regarded as rectangle, but its shape can also be square.For example, the first inner surface parallel to each other and The shape of two inner surfaces can be square, or, the shape of the 3rd inner surface parallel to each other and the 4th inner surface can be Square, or the first inner surface to the 4th inner surface is square.Correspondingly, according to the shape of four inner surfaces, the length The section of the housing of square tube shape can also be rectangle or square.For example, the length of four inner surfaces in the first direction Degree can be equal to each other with length in a second direction, so that the section of the housing of the long square tube shape is square.Enter One step, four inner surfaces can be square, so that the section of the housing of the long square tube shape is square.Cause This, in the optics 100 according to the embodiment of the present application, the long square tube shape of the housing 110 is likewise covered by the housing 110 and is The situation of square cylinder shape.In addition, in embodiments herein, four inner surfaces for only requiring the housing 110 are in cuboid Shape or square shape, and its outer surface depends on different industrial designs, can be any shapes, such as cylinder Shape, prismatic, taper etc..

Fixed component is further comprised according to the optics of the embodiment of the present application, for fixing the optics and imaging Position relationship between the camera lens of equipment so that the center line of housing and the centerline collineation of camera lens.

For example, the fixed component can be formed in any mechanical structure such as the screw thread of first end opening, hinge, it is used for Mechanical structure corresponding on camera lens, which is formed, to be mechanically connected.In addition, the fixed component can also be independently of optics and mirror The mechanical structure of head, such as single fixture or support etc., as long as it can be used in optics being accurately located at camera lens It is upper.

Fig. 2 is the schematic diagram being fixed on according to the optics of the embodiment of the present application on the camera lens of imaging device.Such as Fig. 2 institutes Show, in order to ensure to pass through by the transmission image of the housing of the optics and the reflected image formed by the speculum on inner surface It is imaged by camera lens by imaging device, the center line of the housing of optics and the centerline collineation of camera lens, so that optics device The housing of part and the alignment lenses of imaging device.So, it can be located at what is be imaged by imaging device by the transmission image of housing The center of single image, and two reflected images formed by two speculums on inner surface can be respectively positioned at being set by imaging The both sides of the single image of standby imaging.Also, depending on the position that speculum is set, formed by the speculum on inner surface anti- The both sides up and down of the single image by imaging device imaging can be located at by penetrating image, or positioned at its left and right sides.

Also, as shown in Fig. 2 that is, should according to the housing of the optics of the embodiment of the present application towards the first end of camera lens The inner edge of housing substantially can have a preset distance with the plane of camera lens.Here, it will be understood by those skilled in the art that should The inner edge of the housing of optics can continue to the direction extension towards camera lens, for example, reaching and the planar registration of camera lens Degree.In addition, the housing can further extend in the direction towards imaging device, then the part extended on the inside of lens plane Substantially can not be by reflecting via lens imaging.Therefore, in the optics according to the embodiment of the present application, if to obtain With transmission image identical reflected image, then need to be defined the size of shell inner surface upper reflector.

That is, in the optics according to the embodiment of the present application, the first speculum and the second speculum have extremely Few first size, and the first size causes the first speculum and the second speculum to cover regarding for camera lens in a second direction respectively The a quarter of field.

As described above, when the first inner surface and the second inner surface extend along horizontal direction as shown in Figure 1, first is anti- Penetrate upper inside surface 111 and lower inner surface 112 that mirror and the second speculum are located at housing respectively.In this case, via The reflected image that first speculum and the second speculum are formed also is located at the upper side and lower side of transmission image.So in order to The first size with transmission image identical reflected image, the first speculum of setting and the second speculum is obtained, to cause first Speculum and the second speculum cover a quarter of the visual field of camera lens in vertical direction as shown in Figure 1 respectively.So, by The half of the visual field of camera lens is accounted in transmission image, and the upper lateral reflection obtained is reflected by the first speculum and the second speculum Image and downside reflected image account for a quarter of the visual field of camera lens respectively.Upside reflected image and downside reflected image are by spelling After conjunction, it can obtain and transmission image identical reflected image.

Equally, when the first inner surface and the second inner surface extend along vertical direction as shown in Figure 1, the first speculum It is located at the left inner surface 113 and right side inner surface 114 of housing respectively with the second speculum.In this case, via first The reflected image that speculum and the second speculum are formed also is located at the left side and right side of transmission image.So in order to obtain With transmission image identical reflected image, the first size of the first speculum of setting and the second speculum, to cause the first reflection Mirror and the second speculum cover a quarter of the visual field of camera lens in horizontal direction as shown in Figure 1 respectively.So, due to saturating The half that image accounts for the visual field of camera lens is penetrated, and the left side reflected image obtained is reflected by the first speculum and the second speculum Account for a quarter of the visual field of camera lens respectively with right side reflected image.Left side reflected image and right side reflected image pass through split Afterwards, can obtain and transmission image identical reflected image.

Certainly, it will be understood by those skilled in the art that under some application scenarios, must not necessarily may obtain and transmission plot As identical reflected image, and only need transmission image identical with reflected image part.Therefore, in such situation Under, also avoid the need for speculum size meet above-mentioned covering camera lens visual field a quarter condition.Similarly, via first The size for the reflected image that speculum and the second speculum are formed also be not necessarily required it is identical, therefore, in this case, Also avoiding the need for the first speculum and the second speculum all has identical size, but can be of different sizes.

In addition, if reflected image has the redundancy of transmission image, for example the size of reflected image is more than transmission plot The half of the size of picture, so as to which the reflected image after split has the image information repeated.It is possible to by anti- Image is penetrated to be cut, come obtain with transmission image identical reflected image, therefore, the first speculum and the second speculum are at least The first size of a quarter with the visual field that can cover camera lens, that is to say, that the first speculum and the second speculum Size can also be more than the first size.

Although also, those skilled in the art are further appreciated that in the description of the embodiment of the present application, have used transmission plot The statement of picture and reflected image, the transmission image and reflected image substantially belong to the single image being imaged by optics Different zones.Therefore, no matter above description or below in the description done, transmission image and reflected image are not intended to referring to Single image, and refer to the different images region in single image, i.e. there is the parts of images of different brightness.

Alternatively or cumulatively, can be included according to the optical lens of the embodiment of the present application：3rd speculum, it is arranged on On three inner surfaces and there is the second reflectivity, second reflectivity is different from first reflectivity；With, the 4th speculum, if Put on the 4th inner surface and there is the second reflectivity.

Also, the 3rd speculum and the 4th speculum at least have the second size, and second size causes the 3rd reflection Mirror and the 4th speculum cover a quarter of the visual field of camera lens in a first direction respectively.

Here, the 3rd speculum and the 4th speculum are anti-all with the first of the foregoing description in specific setting and operation principle Penetrate mirror and the second speculum is similar, simply set-up mode is different, for example, in the first speculum and the second speculum in the horizontal direction In the case of extension, the 3rd speculum and the 4th speculum are extends in the vertical direction；And in the first speculum and the second speculum In the case of being extends in the vertical direction, the 3rd speculum and the 4th speculum are horizontally extending.

In addition, in the optics according to the embodiment of the present application, if only needing to form transmission image and having and this One reflected image of transmission image difference brightness, then can only have a pair of speculums, such as the first speculum and second anti- Penetrate mirror.Relatively, if necessary to form transmission image and with two reflected images with the transmission image difference brightness, then need Two pairs of speculums, such as the first speculum and the second speculum and the 3rd speculum and the 4th speculum are used simultaneously.

Also, the first reflectivity and the 3rd speculum and the 4th speculum due to the first speculum and the second speculum Second reflectivity is different, the brightness of the first reflected image formed by the first speculum and the second speculum also with the 3rd speculum It is different with the brightness for the image that the 4th speculum is formed.So, according to the optics of the embodiment of the present application can be formed including Independent image with different brightness, so that again via corresponding image procossing, the HDR functions or above-mentioned for imaging device Binocular stereo imaging function.

Fig. 3 is the schematic diagram of the visual field formed according to the optics of the embodiment of the present application.In fig. 3, it is assumed that camera lens (shell The first end of body) direction outside paper, and subject (the second end of housing) direction in paper.As shown in figure 3, pass through basis The housing of the cuboid inner surface of the optics of the embodiment of the present application, camera lens are actually used in the visual field of direct imaging from housing Among transmission, for transmission imaging, and around the visual field, in the horizontal direction and the vertical direction, respectively by speculum A quarter is covered, for catoptric imaging.

Fig. 4 is the schematic diagram relative to camera lens according to the visual field that the optics of the embodiment of the present application is formed.Fig. 4 is substantially It is identical with Fig. 3, camera lens (first end of housing) direction in paper is only assumed that, and subject (the second end of housing) is in paper Outer direction, and depict relation of the visual field relative to camera lens.As shown in figure 4, optics includes the first speculum 120, second Speculum 130, the 3rd speculum 140 and the 4th speculum 150, and camera lens is located in the transmission visual field that optics is formed Centre, that is to say, that the center line of housing and the centerline collineation of camera lens.

For example, in the optics according to the embodiment of the present application, only with the first speculum and the second speculum In the case of, the first reflectivity for example can be 66%.

Also, in above-mentioned optics, in the optics according to the embodiment of the present application, using the first speculum In the case of the second speculum, and the 3rd speculum and the 4th speculum, for example, the first reflectivity can be 66%, and Second reflectivity can be 33%.

Here, it will be understood by those skilled in the art that the numerical value of above-mentioned first reflectivity and the second reflectivity is only example, Other specific reflectivity values can also be used according to the optics of the embodiment of the present application.Preferably, for image procossing It is convenient, when needing to form transmission image and there is two width reflected image of different brightness, the transmission image and two width reflectograms The brightness value of picture may be constructed arithmetic progression.Can be considered as 1 accordingly, due to the reflectivity of transmission image, then the first reflectivity, Second reflectivity and 1 also forms arithmetic progression.

In addition, in order to realize the first reflectivity of the first speculum and the second speculum, and the 3rd speculum and the 4th Second reflectivity of speculum, various ways can be used.

For example, can be directly with the material with the first reflectivity, such as the glass of the reflectivity with less than total reflection Material makes the minute surface of the first speculum and the second speculum, and with the second reflective materials make the 3rd speculum and The minute surface of 4th speculum.

Further, it is also possible to obtained by the way of the plated film on the level crossing for realizing total reflection with the first reflectivity First speculum and the second speculum, and the 3rd speculum and the 4th speculum with the second reflectivity.

Specifically, in the optics according to the embodiment of the present application, the first speculum includes the first level crossing and set The first transmission film being placed on the surface of the first level crossing, and first transmission film has the first transmissivity, first transmissivity It is associated with first reflectivity；Second speculum includes the second level crossing and be arranged on the surface of second level crossing the Two transmission films, and second transmission film has the first transmissivity.

Fig. 5 is the schematic diagram according to the speculum with transmission film of the embodiment of the present application.As shown in figure 5, speculum 200 Including level crossing 201 and the pellicle 202 being arranged on the surface of level crossing 201.

Here, on the surface of level crossing set transmission film in the case of, light when being reflected via speculum actually By transmission film twice.That is, incident light first passes around transmission film and incided on level crossing, after being reflected via level crossing again Transmission film can be passed through.Therefore, in the case where realizing identical reflectivity, the transmissivity of transmission film should be square of reflectivity Root.

That is, in the optics according to the embodiment of the present application, corresponding to 66% the first reflectivity, first is saturating The rate of penetrating is

Similarly, in the optics according to the embodiment of the present application, the 3rd speculum includes the 3rd level crossing and setting The 3rd transmission film on the surface of the 3rd level crossing, and the 3rd transmission film has the second transmissivity, second transmissivity is with being somebody's turn to do Second reflectivity is associated；The 4th for including fourth plane mirror with the 4th speculum and being arranged on the surface of fourth plane mirror is saturating Film is penetrated, and the 4th transmission film has the second transmissivity.

Also, in the optics according to the embodiment of the present application, corresponding to 66% the first reflectivity, the first transmissivity ForAnd it is corresponding to 33% the second reflectivity, the second transmissivity

Here, with including the first level crossing and the first transmission film above for the first speculum, the second speculum includes The second level crossing and the second transmission film explanation it is similar, the 3rd speculum includes the 3rd level crossing and the 3rd transmission film, and 4th speculum includes fourth plane mirror and the 4th transmission film.Also, with above for the first transmission film and the second transmission film Explanation with the first transmissivity is similar, and the 3rd transmission film and the 4th transmission film have the second transmissivity.Therefore, in order to avoid superfluous It is remaining no longer to carry out repeated description.

Fig. 6 is the imaging process schematic diagram according to the embodiment of the present application.As shown in fig. 6, the speculum with pellicle 301 300 are arranged on the thing side of stationary lens group 310, and the imaging light being transmitted through and the light process reflected by speculum 300 Stationary lens group 310 is projected on cmos image sensor 320, to form image.In figure 6, for convenience's sake, only show Upper and lower a pair of speculums, but in actual applications, in addition to a pair of speculums above and below use, a left side can also be used A pair of speculums on the right side use both above-mentioned simultaneously.

As described above, in order to realize that horizontally extending speculum covers camera lens at four points of visual field of vertical direction One of, and/or the speculum that is extends in the vertical direction covers a quarter of the visual field of camera lens in the horizontal direction, it is necessary to limit Determine the size of speculum in the horizontal direction or being extends in the vertical direction.Hereinafter, the one of the calculating of mirror size will be provided Individual example.

First, it is limited in the optics according to the embodiment of the present application, first direction corresponds to the photosensitive of imaging device The length direction of chip, and second direction corresponds to the width of the sensitive chip of imaging device.

Generally, when imaging device is under general operation pattern and (gripped by level), the length direction of sensitive chip is For horizontal direction, and the width of sensitive chip is vertical direction.But because imaging device might not be all with level Gesture operation, that is to say, that imaging device may also be operated (by vertically gripping) with perpendicular attitude.Therefore, according to the application In the optics of embodiment, illustrate the computational methods of mirror size according to the length direction and width of sensitive chip, And not with horizontally and vertically.

This is also in that the shape of the visual field of camera lens is substantially the shape based on sensitive chip.That is, feeling In the case of optical chip is rectangular, the shape of the image of formation is also rectangle, and correspondingly, the visual field of camera lens is also rectangular Shape.And in the case where sensitive chip is square, the shape of the image of formation is also square, correspondingly, the visual field of camera lens And square.

Moreover, as noted previously, as a pair of speculums being parallel to each other need cover respective direction on visual field four/ One, the size of speculum is also associated with the shape of sensitive chip.That is, the rectangular shape that four speculums surround The cross sectional shape of housing is substantially consistent with the shape of sensitive chip.

Fig. 7 A and Fig. 7 B are diagrams to be shown according to the determination mode of mirror size in the optics of the embodiment of the present application It is intended to.Wherein, Fig. 7 A show optics relative to camera lens arrangement and mirror size special parameter definition side Formula.As shown in Figure 7 A, it is assumed that housing four inner surfaces be respectively disposed with two-by-two in opposite inner face the first speculum and Second speculum and the 3rd speculum and the 4th speculum.For example, each speculum is since the edge at the second end of housing Arrangement, and extend towards the direction of first end.

The first size of speculum and the second size are respectively defined as h in the length of side on lens plane₁And h₂, It is designated generally as h in figure, and by the length of side of the first size of speculum and the second size in the section parallel to lens plane It is respectively defined as L and W.That is, first size and the second size are the rectangles that a length of side is h and another side a length of L or W.Can be with Understand, L is parallel to the length of side on the length direction of sensitive chip, and W is parallel on the width of sensitive chip The length of side.

Also, Fig. 7 B show the signal relative to the imaging of imaging device according to the optics of the embodiment of the present application Figure.For the speculum extended on the length direction parallel to sensitive chip, its length of side L is determined flat Whether row can cover in the speculum extended on the width of sensitive chip on the length direction parallel to sensitive chip The a quarter of the visual field of camera lens (vice versa).Therefore, as shown in Figure 7 B, consider the camera lens of imaging device described photosensitive Visual angle on the length direction of chip, for convenience of description, here depicted as horizontal view angle, it is necessary to meet left mirrored portion V_L's Length=right mirrored portion V_RLength=see-through area V length half.Also, regional transmission V length is such as Length of side L shown in Fig. 7 A, and regional transmission V width is length of side W as shown in Figure 7 A.

Due to the shape for the speculum that the shape of regional transmission as shown in Figure 7 B actually extends in the horizontal direction, Therefore the top of the regional transmission is with following parallel, and equal length.Therefore, principle is divided based on Fig. 7 B and using parallel lines etc., It is recognised that in the optics of the embodiment of the present application, the length of side of the first size on the direction perpendicular to lens plane h₁As below equation represents：

h₁=d

Wherein, d is in the camera lens from first speculum and second speculum adjacent to one end of the camera lens Center line on subpoint to the photocentre of the camera lens distance.Here, the photocentre of camera lens refers to camera lens as shown in Figure 6 The optical centre of lens group 310.Specifically, if lens group only includes a piece of lens, then be exactly the centre bit of the lens Put.And if lens group includes multi-disc lens, then refer to the equivalent center for the lens group that this multi-disc lens is formed.

Also, length of side L of the first size on the length direction parallel to sensitive chip such as below equation represents：

Wherein, Y₁It is visual angle of the imaging device on the length direction of sensitive chip.

Also, in above-mentioned optics, length of side h of second size on the direction perpendicular to lens plane₂Such as with Lower formula represents：

h₂=h₁=d.

Also, length of side W of second size on the length direction parallel to sensitive chip such as below equation represents：

Wherein, r is the length-width ratio of the sensitive chip of the imaging device.For example, the length-width ratio of the sensitive chip is usually 4:3 Or 16:9.

In addition, unlike situation as described above, the visual angle can also be width of the imaging device in sensitive chip Visual angle on direction.For example, when under the horizontal attitude in imaging device, the visual angle that is vertically oriented.That is, described first Direction corresponds to the width of the sensitive chip of the imaging device, and the second direction corresponds to the imaging device The length direction of sensitive chip.

Therefore, in the optics according to the embodiment of the present application, the first size is perpendicular to the direction of lens plane On length of side h₁As below equation represents：

h₁=d

Wherein, d is in the camera lens from first speculum and second speculum adjacent to one end of the camera lens Center line on subpoint to the photocentre of the camera lens distance.

Also, length of side W of the first size on the width parallel to sensitive chip such as below equation represents：

Wherein, Y₂It is visual angle of the imaging device on the width of sensitive chip.

h₂=h₁=d.

Also, length of side L of second size on the length direction parallel to sensitive chip such as below equation represents：

L=W × r

Wherein, r is the length-width ratio of the sensitive chip of the imaging device.

In addition, it will be understood by those skilled in the art that aforesaid way is to calculate the length and width of housing section In one after, such as the length-width ratio of sensitive chip calculates another.But equally can the difference based on imaging device Visual angle on the length and width direction of sensitive chip, calculates both length and widths of housing section.

Therefore, the determination mode of the size of above-described speculum is only example, it will be understood by those skilled in the art that Only need to ensure that the size of speculum to cover a quarter of the visual field of camera lens in the corresponding direction, can use other manner The size of speculum is determined, the embodiment of the present application is not intended to this progress any restrictions.

Here, it will be understood by those skilled in the art that in the optics of the embodiment of the present application, in order to form transmission plot Picture and with transmission image identical reflected image, it is necessary to be defined to the size of speculum still, to the size of speculum The size that restriction is not necessarily required to speculum is identical with the size of the inner surface of housing.As described above, housing is towards camera lens Inner edge (first end) can extend further towards the direction of camera lens, and for example formed as the fixed component fixed to camera lens.But It is that, based on the light path as shown in figure 7 above B, the outer rim at second end of the housing away from camera lens preferably flushes with the outer rim of speculum, So as to be unlikely to influence light path.Certainly, if shell itself is to use transparent material, such as glass to be made, then will not have Above-mentioned limitation.

In addition, as described above, speculum at least has the size determined in the manner described above.But the size of speculum is same Sample can further expand.For example, by taking light path as shown in Figure 7 B as an example, when speculum extends downwardly, left mirrored portion VL Length and right mirrored portion VR length also can correspondingly extend, so as to the half more than regional transmission V length.So, generation Reflected image will produce redundancy relative to transmission image, can be obtained by way of cutting anti-with transmission image identical Penetrate image.

Also, in the optics of the embodiment of the present application, as described above, fixed component is arranged on housing towards camera lens First end and removably coupled with camera lens.

In addition, in the optics of the embodiment of the present application, in order to ensure imaging effect, it is desirable to pass through all light of housing Line is incided on sensitive chip via camera lens, so as to for being imaged.It is therefore preferred that coupled in the fixed component and camera lens In the case of together, the light that housing is entered by the housing the second end relative with first end will not be let out by the first end Reveal beyond camera lens, there is the close property of light.

Example images processing method

Fig. 8 illustrates the indicative flowchart of the image processing method according to the embodiment of the present application.As shown in figure 8, according to The image processing method of the embodiment of the present application includes：S410, subject is imaged to obtain initial pictures, the initial pictures are extremely It is few to include the Part I image with the first brightness and the Part II image with the second brightness, the Part I image There is at least part identical picture material with the Part II image, and first brightness is bright different from described second Degree；S420, the initial pictures are at least divided into Part I image and Part II image；And S430, to described A part of image and the Part II image are synthesized to obtain composograph, and the composograph is relative to described identical Picture material there is HDR.

Also, as described above, in the image processing method according to the embodiment of the present application, subject is imaged to obtain just Beginning, image S410 included：Subject is imaged to obtain initial pictures with optics, the optics includes：Housing, at least Including the first inner surface and the second inner surface, first inner surface and second inner surface extend in a first direction and each other It is parallel；First speculum, it is arranged on first inner surface and there is the first reflectivity；With the second speculum, be arranged on On second inner surface and there is first reflectivity.Here, according to the optics of the embodiment of the present application Had been described in detail above in conjunction with Fig. 1 to Fig. 7 B, the image processing method using the optics is further described below The other side of method.It should be noted that in embodiments herein, however it is not limited to using above-mentioned shown in Fig. 1 to Fig. 7 B Optics is imaged, but can also use other optics (for example, fly's-eye lens), as long as it can pass through list Secondary imaging obtains the single image for including multiple regions with different brightness.

In the image processing method according to the embodiment of the present application, subject is imaged to obtain initial graph with optics As including：Predetermined exposure parameter is determined according to global light-metering and/or the first reflectivity；And based on predetermined exposure parameter with optics Device is imaged to subject to obtain initial pictures.

Here, it is high dynamic in order to obtain when being imaged using the above-mentioned optics according to the embodiment of the present application to subject State range image, it is thus necessary to determine that predetermined exposure parameter, to cause the transmission image overexposure by housing direct imaging, and via The reflected image of speculum catoptric imaging is under-exposure.So, when synthesizing transmission image and reflected image, it is possible to pass through synthesis The dark portion details of overexposure and under exposed highlights details in the prior art can not be by the dynamics of single exposure realization to create Scope, so as to obtain the high dynamic range images for the details that can retain brightness and dark portion simultaneously.

In an example, in the image processing method according to the embodiment of the present application, initial pictures are at least divided into Part I image and Part II image S420 include：Initial pictures are at least divided into the first luminance picture and the second brightness Image, first luminance picture is as Part I image；With mirror image processing and split are carried out to second luminance picture to obtain Obtain the Part II image.

As described above, by the optics according to the embodiment of the present application, can be in the transmission image transmitted by housing Both sides, such as the upper side and lower side, or left side and right side form reflected image.Also, formed in the both sides of transmission image Reflected image is in mirror.Therefore, during initial pictures are divided, can not be obtained by directly cutting initial pictures The Part I image and Part II image, but need that initial pictures first are divided into first according to the brightness of different zones Luminance picture and the second luminance picture.Wherein, first luminance picture corresponds to transmission image, therefore can be directly as first Parts of images.And second luminance picture corresponds to reflected image, it is therefore desirable to the second luminance picture carry out mirror image processing and Split, to obtain Part II image.

According to one embodiment, in the image processing method according to the embodiment of the present application, initial pictures are at least divided Include for the first luminance picture and the second luminance picture：Based on optics and its chi of the first inner surface or the second inner surface Initial pictures are at least divided into the first luminance picture and the second luminance picture by very little relation.

In the image processing method according to the embodiment of the present application, by with optics as described above to subject In the case of being shot so as to obtain initial pictures, due to the transmission image in initial pictures and reflected image and optics Structure it is corresponding, therefore, can be according to the physical dimension of optics, to be divided to initial pictures.For example, as before Fig. 3 shown in, the centre of the initial pictures of formation is transmission image, and its up and down and/or left and right sides be reflected image, Ratio shared by reflected image and transmission image determines according to the first inner surface relative to the overall size relationship of optics.By It can be obtained in optics and its size of the first inner surface or the second inner surface simply by measurement, also can phase Answer ground that initial pictures are divided into the transmission image with the first brightness and the reflected image with the second brightness.This no matter for Reflected image is located at the both sides up and down of transmission image, or reflected image be located at the left and right sides of transmission image situation it is suitable With.

, can also be in assembling camera lens and optics because the parameter of camera lens may be different under a more complicated scene During device, distorted in advance caused by demarcation processing camera lens and speculum, so, can be according to advance demarcation in above-mentioned steps Position correspondence relation initial pictures are divided.

According to another embodiment, in the image processing method according to the embodiment of the present application, initial pictures are at least divided Include for the first luminance picture and the second luminance picture：Brightness identification is carried out to initial pictures, with based on the first brightness and second Initial pictures are at least divided into the first luminance picture and the second luminance picture by brightness.

In addition, in the image processing method according to the embodiment of the present application, image division can also be carried out according to brightness.Such as Upper described, because transmission image has the first brightness, and reflected image has the second brightness, and the brightness that transmission image is overall Overall brightness is all uniform with reflected image.By carrying out brightness identification to initial pictures, can there will be the first brightness Region division be out used as the first luminance picture, i.e. transmission image, and using the region division with the second brightness come out as Second luminance picture, i.e. reflected image.

Therefore, it will be understood by those skilled in the art that in the image processing method according to the embodiment of the present application, can adopt The initial pictures of acquisition are divided with various ways, the embodiment of the present application is not intended to this progress any restrictions.

In an example, in the image processing method according to the embodiment of the present application, to the Part I image and The Part II image is synthesized to be included with obtaining composograph S430：It is determined that used for generating the composograph Weight coefficient；And the weight coefficient is used, to each in the Part I image and the Part II image Pixel is weighted synthesis.

It is, for example, possible to use the shading value of benchmark shading value image determines above-mentioned weight coefficient, the benchmark shading value figure Seem to create the benchmark needed for HDR image the figure that uses as synthesis low-luminosity picture and high-brghtness picture images are determined how Picture.Alternatively, can also be by carrying out scene analysis to initial pictures to determine the core objective of imaging, and according to core objective Imaging effect in the composite image determines above-mentioned weight coefficient.Alternatively, n (n is positive integer) individual parts of images be present In the case of, simply each it can also will be arranged to 1/n in n weight coefficient.

According to further embodiment, in above-mentioned image processing method, the initial pictures further comprise having the The Part III image of three brightness, and the 3rd brightness is different from first brightness or second brightness；By described in Initial pictures, which are at least divided into Part I image and Part II image S420, to be included：The initial pictures are divided into first Parts of images, Part II image and Part III image；The Part I image and the Part II image are carried out Synthesis is included with obtaining composograph S430：To the Part I image, the Part II image and the Part III Image is synthesized to obtain composograph.

According to one embodiment, the housing of the optics further comprises the 3rd inner surface and the 4th inner surface, institute State the 3rd inner surface and the 4th inner surface extends in a second direction and parallel to each other, the second direction and the first party Vertical to each other, first inner surface, the second inner surface, the 3rd inner surface and the 4th inner surface form rectangular shape；With And the optics further comprises：3rd speculum, it is arranged on the 3rd inner surface and there is the second reflectivity, Second reflectivity is different from first reflectivity；With the 4th speculum, be arranged on the 4th inner surface and have There is second reflectivity.

Before in the explanation of optics it has been noted that can be at it according to the optics of the embodiment of the present application There is speculum on two relative inner surfaces, speculum can also be provided with four inner surfaces.So, can obtain Include the single image in the region with three different brightness.Also, by dividing the image, can obtain three has respectively The image of different brightness, so as to synthesize to obtain having the image of HDR.

Here, it will be understood by those skilled in the art that the place of the single image on the region including three different brightness Reason mode is essentially identical previously with regards to the processing mode of the single image in the region including two different brightness, in order to avoid superfluous It is remaining just to repeat no more.

Image processing effect

Fig. 9 illustrates the schematic diagram of the initial pictures of the image processing method according to the embodiment of the present application.As shown in figure 9, In the case where four inner surfaces of the housing of optics are respectively provided with speculum, due to the reflex of four speculums, figure Picture is symmetrical according to minute surface line of demarcation, has actually get 3 width complete images, i.e. middle transmission image, and being respectively at Side and the parts of images of downside, and the parts of images in left side and right side.Also, the reflectivity due to left and right speculum with it is upper The reflectivity of lower speculum is different, for example, its plated film degree of transmission is different, top and the bottom image has not with left-right parts image Same brightness level.

As described above, during actual imaging, exposure parameter is used according to the anti-of global light-metering or mirror portion The brightness of image is penetrated to determine.So, the field of view portion led directly to during shooting without mirror-reflection, i.e. transmission image can partially bright mistake Exposure, each several part image is partially dark under-exposure up and down.

Next, image segmentation is carried out to the initial pictures of acquisition, as shown in figs. 10 a and 10b.Figure 10 A and Figure 10 B scheme The schematic diagram of the initial image segmentation in the image processing method according to the embodiment of the present application is shown.Here, people in the art Member is it is appreciated that in image as shown in Figure 9, and the part at four angles in the image is actually by mirror imager institute The redundancy section of formation, therefore, in the image segmentation process of reality, it is only necessary to retaining transmission image as shown in Figure 10 A just Top and underface, and the image of directly to the left and directly to the right.That is, in image cropping, can be only in accordance with saturating The rectangular shape of image is penetrated, cuts corresponding four rectangular images in its four direction up and down, while remove position Redundancy section in four angles.After cutting, image as shown in Figure 10 B is obtained, is left reflection minor respectively from left to right Reflected image, right reflection mirror reflected image, upper reflector reflected image, lower speculum reflected image and transmission image.

Figure 11 is the schematic diagram of the image mirrors split after splitting in the image processing method according to the embodiment of the present application.Such as It is by the brightness stitched together after mirror image of the image of the left and right sides as shown in Figure 10 B respectively from left to right shown in Figure 11 Minimum image, by the image of the both sides up and down as shown in Figure 10 B medium image of brightness stitched together after mirror image and directly The brightness highest image of transmission, Same Scene is directed to so as to obtain three width, but uses the image of different depth of exposures.

Figure 12 is the schematic diagram of the image synthesis in the image processing method according to the embodiment of the present application.As shown in figure 12, Obtain for Same Scene but use different depth of exposures three width images (as shown in bottom, its order and phase in Figure 11 After together), the weighting that three width images can be carried out according to the position correspondence relation demarcated in advance synthesizes, by synthesizing master image The dark portion details of overexposure and under exposed highlights details can not be realized by single exposure in the prior art to create to have Dynamic range HDR image (as shown in top).

So, because physically three width images are all in same Time Exposure, it is not necessary to exposure all adjusts camera parameter every time, Thus video record can be carried out according to normal frame rate, can be used in the HDR synthesis of video monitoring scene.Additionally, due to three width figures As coming from same light source and use hardware synchronization, if the object shot, which moves, (or holds camera/capture apparatus Moving), fuzzy in the technology that is synthesized of several photos or again can be avoided in different time exposure shooting completely Shadow.

Therefore, the image processing method of the embodiment of the present application was realized in the same time, used same cmos sensor The image of the upper different brightness that Same Scene is gathered by single exposure simultaneously synthesizes high dynamic range images.

Also, the image processing method of the embodiment of the present application with cmos sensor without repairing in itself to imaging device Change, can compatible present hardware monitoring equipment.

Also, the image processing method of the embodiment of the present application can cause imaging device to carry out veritably real-time HDR shootings, Without exposing all regulation cmos sensor parameters every time, it is suitable for HDR videos, and be adapted to HDR monitoring scene applications.

In addition, the image processing method of the embodiment of the present application can cause imaging device to be used to clap in higher dynamic range According to, even if shooting motion object when also will not obscure and produce ghost image.

Further, do not need double CMOS even more using the imaging device of the image processing method of the embodiment of the present application CMOS, so as to realize the real-time HDR of three ranks with lower cost.

Example images processing unit

Below, the image processing apparatus according to the embodiment of the present application will be described with reference to Figure 13.

Figure 13 illustrates the schematic block diagram of the image processing apparatus according to the embodiment of the present application.

As shown in figure 13, included according to the image processing apparatus 500 of the embodiment of the present application：Capturing images unit 510, is used for Subject is imaged to obtain initial pictures, the initial pictures comprise at least Part I image and tool with the first brightness There is the Part II image of the second brightness, the Part I image has at least part identical with the Part II image Picture material, and first brightness is different from second brightness；Image segmentation unit 520, for by the initial pictures At least it is divided into Part I image and Part II image；And image composing unit 530, for the Part I figure Picture and the Part II image are synthesized to obtain composograph, and the composograph is relative in the identical image Container has HDR.

In one example, described image acquisition unit 510 is used for true according to global light-metering and/or first reflectivity Determine predetermined exposure parameter；It is and described first to obtain to subject imaging with the optics based on the predetermined exposure parameter Beginning image.

In one example, described image cutting unit 520 is used to the initial pictures being at least divided into the first brightness Image and the second luminance picture, first luminance picture is as Part I image；With, to second luminance picture carry out Mirror image processing and split are to obtain the Part II image.

In one example, described image cutting unit 520 is used for based on the optics and its first reflection The initial pictures are at least divided into first luminance picture and described by the size relationship of mirror or second speculum Second luminance picture.

In one example, described image cutting unit 520 be used for the initial pictures carry out brightness identification, with based on The initial pictures are at least divided into first luminance picture and described second by first brightness and second brightness Luminance picture.

In one example, described image synthesis unit 530 is used to determine to be used to generate used in the composograph Weight coefficient；And the weight coefficient is used, to each picture in the Part I image and the Part II image Element is weighted synthesis.

In one example, the initial pictures that described image acquisition unit 510 obtains further comprise thering is the 3rd The Part III image of brightness, and the 3rd brightness is different from first brightness or second brightness；Described image Cutting unit 520 is used to the initial pictures being divided into Part I image, Part II image and Part III image；With And described image synthesis unit 530 is used for the Part I image, the Part II image and the Part III figure As being synthesized to obtain composograph.

Here, it will be understood by those skilled in the art that other details according to the image processing apparatus of the embodiment of the present application Previously with regards to the relevant details described in the image processing method according to the embodiment of the present application can, in order to avoid redundancy just not Repeat again.

Exemplary imaging device

Below, it is described with reference to Figure 14 the imaging system according to the embodiment of the present application.

Figure 14 is the schematic diagram according to the imaging system of the embodiment of the present application.

As shown in figure 14, according to the imaging system 600 of the embodiment of the present application include optics 610 as described above and into As equipment 620, the imaging device 620 includes camera lens 621, for the optics 610 via camera lens 621 to subject into Picture.

The concrete function and annexation of unit and module in the optics 610 are had been described above with reference to figure 1 It is described in detail to Fig. 7 B (reference 611 to 615 in Figure 14 correspond respectively in Fig. 1 110 to 114), and because This, will omit its repeated description herein.

In one example, driving part is further comprised according to the imaging system of the embodiment of the present application, with the optics device Part mechanically connects, in response to receiving the first trigger signal, the mobile optics, with cause the imaging device not by Directly subject is imaged via camera lens in the optics, and in response to receiving the second trigger signal, movement should Optics, to cause the imaging device to be imaged by means of the optics via camera lens to subject.

Specifically, according to the optics of the embodiment of the present application in order to realize including multiple regions with different brightness Single image, substantially sacrifice sum of all pixels.Therefore, in the imaging system according to the embodiment of the present application, further wrap Include the driving part of the function for being turned on or off optics.

Here, the driving part can be in response to the trigger signal that receives so that imaging device is by means of the optics device Part is imaged via camera lens to subject, or directly subject is imaged via camera lens without the help of the optics.Here, The trigger signal can be triggered manually by user, can also the automatic identification function based on scene, to determine the need for The optics realizes more rich imaging effect.So, can obtain between total number of pixels and abundant imaging effect Balance.

Also, in the imaging system according to the embodiment of the present application, concrete configuration and the drive of the driving part are not limited Move the mode of the optics.For example, the driving part can by outside the visual field of optics integral translation to camera lens, so as to So that imaging device is directly imaged without the help of the optics via camera lens to subject.Or the driving part may be used also To drive the four of the housing of the optics surfaces, at the second end, outwards expansion is with an angle, in lotus shape so that each Surface is all outside the visual field of camera lens.

In one example, the imaging device is monitoring camera.

It can be realized according to the image processing apparatus 500 of the embodiment of the present application in the imaging device 620, in addition, image Processing unit 500 can also be the stand-alone device independent with imaging device 620.

In one example, according to the image processing apparatus 500 of the embodiment of the present application can be used as software module and/ Or hardware module and be integrated into the imaging device 620.For example, the image processing apparatus 500 can be the behaviour of the imaging device Make a software module in system, or can be directed to the application program that the imaging device is developed；Certainly, should Image processing apparatus 500 equally can be one of numerous hardware modules of the imaging device.

Alternatively, in another example, the image processing apparatus 500 and the imaging device 620 can also be discrete set It is standby, and the image processing apparatus 500 can be connected to the imaging device by wired and or wireless network, and according to about Fixed data format transmits interactive information.

Example electronic device

Below, it is described with reference to Figure 15 the electronic equipment according to the embodiment of the present application.

As shown in figure 15, electronic equipment 700 includes one or more processors 710 and memory 720.

Processor 710 can be CPU (CPU) or have data-handling capacity and/or instruction execution capability Other forms processing unit, and can be with the other assemblies in control electronics 700 to perform desired function.

Memory 720 can include one or more computer program products, and the computer program product can include Various forms of computer-readable recording mediums, such as volatile memory and/or nonvolatile memory.The volatibility is deposited Reservoir is such as can include random access memory (RAM) and/or cache memory (cache).It is described non-volatile Memory is such as can include read-only storage (ROM), hard disk, flash memory.Can be with the computer-readable recording medium One or more computer program instructions are stored, processor 710 can run described program instruction, to realize sheet described above The image processing method and/or other desired functions of each embodiment of application.In the computer-readable storage medium The various contents such as initial pictures, each several part image, composograph can also be stored in matter.

In one example, electronic equipment 700 can also include：Input unit 730 and output device 740, these components Interconnected by bindiny mechanism's (not shown) of bus system and/or other forms.

For example, when the electronic equipment is stand-alone device, the input unit 730 can be communication network connector, be used for Gathered input signal is received from imaging device.

In addition, the input equipment 730 can also include such as keyboard, mouse etc..

The output device 740 can export various information to outside, such as show and set to imaging device or other images The high dynamic range images of standby output synthesis.The output equipment 740 can include for example display, loudspeaker, printer and Communication network and its remote output devices that are connected etc..

Certainly, to put it more simply, illustrate only one in component relevant with the application in the electronic equipment 700 in Figure 15 A bit, the component of such as bus, input/output interface etc. is eliminated.In addition, according to concrete application situation, electronic equipment 700 can also include any other appropriate component.

Illustrative computer program product and computer-readable recording medium

In addition to the above method and equipment, embodiments herein can also be computer program product, and it includes meter Calculation machine programmed instruction, the computer program instructions cause that described computing device this specification is above-mentioned when being run by processor The step in the sound localization method according to the various embodiments of the application described in " illustrative methods " part.

The computer program product can be used to hold with any combination of one or more programming languages to write The program code of row the embodiment of the present application operation, described program design language include object oriented program language, such as Java, C++ etc., in addition to conventional procedural programming language, such as " C " language or similar programming language.Journey Sequence code can perform fully on the user computing device, partly perform on a user device, independent as one soft Part bag performs, part performs or completely in remote computing device on a remote computing on the user computing device for part Or performed on server.

In addition, embodiments herein can also be computer-readable recording medium, it is stored thereon with computer program and refers to Order, the computer program instructions cause above-mentioned " the exemplary side of described computing device this specification when being run by processor The step in the sound localization method according to the various embodiments of the application described in method " part.

The computer-readable recording medium can use any combination of one or more computer-readable recording mediums.Computer-readable recording medium can To be readable signal medium or readable storage medium storing program for executing.Readable storage medium storing program for executing can for example include but is not limited to electricity, magnetic, light, electricity Magnetic, the system of infrared ray or semiconductor, device or device, or any combination above.Readable storage medium storing program for executing is more specifically Example (non exhaustive list) includes：Electrical connection, portable disc with one or more wires, hard disk, random access memory Device (RAM), read-only storage (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc Read-only storage (CD-ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.

The general principle of the application is described above in association with specific embodiment, however, it is desirable to, it is noted that in this application The advantages of referring to, advantage, effect etc. are only exemplary rather than limiting, it is impossible to which it is the application to think these advantages, advantage, effect etc. Each embodiment is prerequisite.In addition, detail disclosed above is merely to the effect of example and the work readily appreciated With, and it is unrestricted, above-mentioned details is not intended to limit the application as that must be realized using above-mentioned concrete details.

The device that is related in the application, device, equipment, the block diagram of system only illustratively the example of property and are not intended to It is required that or hint must be attached in the way of square frame illustrates, arrange, configure.As it would be recognized by those skilled in the art that , it can connect, arrange by any-mode, configuring these devices, device, equipment, system.Such as " comprising ", "comprising", " tool Have " etc. word be open vocabulary, refer to " including but is not limited to ", and can be with its used interchangeably.Vocabulary used herein above "or" and " and " refer to vocabulary "and/or", and can be with its used interchangeably, unless it is not such that context, which is explicitly indicated,.Here made Vocabulary " such as " refers to phrase " such as, but not limited to ", and can be with its used interchangeably.

It may also be noted that in device, apparatus and method in the application, each part or each step are to decompose And/or reconfigure.These decompose and/or reconfigured the equivalents that should be regarded as the application.

The above description of disclosed aspect is provided so that any person skilled in the art can make or use this Application.Various modifications in terms of these are readily apparent to those skilled in the art, and defined herein General Principle can apply to other aspect without departing from scope of the present application.Therefore, the application is not intended to be limited to Aspect shown in this, but according to the widest range consistent with the feature of principle disclosed herein and novelty.

In order to which purpose of illustration and description has been presented for above description.In addition, this description is not intended to the reality of the application Apply example and be restricted to form disclosed herein.Although already discussed above multiple exemplary aspects and embodiment, this area skill Art personnel will be recognized that its some modifications, modification, change, addition and sub-portfolio.

Claims

1. a kind of image processing method, including：

Subject is imaged to obtain initial pictures, the initial pictures comprise at least the Part I image with the first brightness With the Part II image with the second brightness, the Part I image has at least part phase with the Part II image Same picture material, and first brightness is different from second brightness；

The initial pictures are at least divided into Part I image and Part II image；And

The Part I image and the Part II image are synthesized to obtain composograph, the composograph phase There is HDR for the identical picture material.

2. image processing method as claimed in claim 1, wherein, subject is imaged to be included with obtaining initial pictures：

Subject is imaged to obtain initial pictures with optics, the optics includes：

Housing, including at least the first inner surface and the second inner surface, first inner surface and second inner surface are along first Direction extension is simultaneously parallel to each other；

First speculum, it is arranged on first inner surface and there is the first reflectivity；With

Second speculum, it is arranged on second inner surface and there is first reflectivity.

3. image processing method as claimed in claim 2, wherein, subject is imaged to obtain initial pictures with optics Including：

Predetermined exposure parameter is determined according to global light-metering and/or first reflectivity；And

Subject is imaged to obtain the initial pictures with the optics based on the predetermined exposure parameter.

4. image processing method as claimed in claim 2, wherein, the initial pictures are at least divided into Part I image Include with Part II image：

The initial pictures are at least divided into the first luminance picture and the second luminance picture, first luminance picture is as A part of image；With

Mirror image processing and split are carried out to second luminance picture to obtain the Part II image.

5. image processing method as claimed in claim 4, wherein, the initial pictures are at least divided into the first luminance picture Include with the second luminance picture：

Will be described initial based on the optics and its size relationship of first speculum or second speculum Image is at least divided into first luminance picture and second luminance picture.

6. image processing method as claimed in claim 5, wherein, first speculum and second speculum at least have There is first size, the first size causes first speculum and second speculum to cover in a second direction respectively The a quarter of the visual field of the camera lens, the second direction and the first direction are perpendicular to one another.

7. image processing method as claimed in claim 4, wherein, the initial pictures are at least divided into the first luminance picture Include with the second luminance picture：

Brightness identification is carried out to the initial pictures, with based on first brightness and second brightness by the initial pictures At least it is divided into first luminance picture and second luminance picture.

8. image processing method as claimed in claim 1, wherein, to the Part I image and the Part II image Synthesized is included with obtaining composograph：

It is determined that for generating weight coefficient used in the composograph；And

Using the weight coefficient, each pixel in the Part I image and the Part II image is weighted Synthesis.

9. image processing method as claimed in claim 2, wherein,

The initial pictures further comprise the Part III image with the 3rd brightness, and the 3rd brightness is different from described First brightness or second brightness；

The initial pictures are at least divided into Part I image and Part II image includes：

The initial pictures are divided into Part I image, Part II image and Part III image；

The Part I image and the Part II image are synthesized to be included with obtaining composograph：

The Part I image, the Part II image and the Part III image are synthesized to obtain composite diagram Picture.

10. image processing method as claimed in claim 9, wherein,

The housing of the optics further comprises the 3rd inner surface and the 4th inner surface, the 3rd inner surface and described Four inner surfaces extend and parallel to each other in a second direction, and the second direction and the first direction are perpendicular to one another, and described first Inner surface, the second inner surface, the 3rd inner surface and the 4th inner surface form rectangular shape；And

The optics further comprises：

3rd speculum, it is arranged on the 3rd inner surface and there is the second reflectivity, second reflectivity is different from First reflectivity；With

4th speculum, it is arranged on the 4th inner surface and there is second reflectivity.

11. image processing method as claimed in claim 10, wherein,

First speculum and second speculum at least have first size, and the first size make it that described first is anti- Penetrate mirror and second speculum cover in this second direction respectively the camera lens visual field a quarter；With

3rd speculum and the 4th speculum at least have the second size, and second size make it that the described 3rd is anti- Penetrate mirror and the 4th speculum cover in said first direction respectively the camera lens visual field a quarter.

12. image processing method as claimed in claim 11, wherein,

First speculum includes the first level crossing and the first transmission film being arranged on the surface of first level crossing, and First transmission film has the first transmissivity, and first transmissivity is associated with first reflectivity；

Second speculum includes the second level crossing and the second transmission film being arranged on the surface of second level crossing, and Second transmission film has first transmissivity；

3rd speculum includes the 3rd level crossing and the 3rd transmission film being arranged on the surface of the 3rd level crossing, and 3rd transmission film has the second transmissivity, and second transmissivity is associated with second reflectivity；With

4th speculum includes fourth plane mirror and the 4th transmission film being arranged on the surface of the fourth plane mirror, and 4th transmission film has second transmissivity.

13. a kind of image processing apparatus, including：

Capturing images unit, for being imaged to subject to obtain initial pictures, the initial pictures, which comprise at least, has first The Part I image of brightness and the Part II image with the second brightness, the Part I image and the Part II Image has at least part identical picture material, and first brightness is different from second brightness；

Image segmentation unit, for the initial pictures to be at least divided into Part I image and Part II image；And

Image composing unit, for being synthesized the Part I image and the Part II image to obtain composite diagram Picture, the composograph have HDR relative to the identical picture material.

14. a kind of imaging device, including：

Camera lens；With

Image processing apparatus as claimed in claim 13.

15. a kind of electronic equipment, including：

Processor；And

Memory, computer program instructions are stored with the memory, the computer program instructions are by the processing Device causes image processing method of the computing device as described in any one in claim 1-12 when running.

16. a kind of computer-readable recording medium, computer program instructions are stored thereon with, the computer program instructions are in quilt Processor causes image processing method of the computing device as described in any one in claim 1-12 when running.