CN106131397A - A kind of method that multi-medium data shows and electronic equipment - Google Patents

A kind of method that multi-medium data shows and electronic equipment Download PDF

Info

Publication number
CN106131397A
CN106131397A CN201610465724.2A CN201610465724A CN106131397A CN 106131397 A CN106131397 A CN 106131397A CN 201610465724 A CN201610465724 A CN 201610465724A CN 106131397 A CN106131397 A CN 106131397A
Authority
CN
China
Prior art keywords
photographic head
medium data
data
auxiliary
auxiliary photographic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610465724.2A
Other languages
Chinese (zh)
Inventor
周泽平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN201610465724.2A priority Critical patent/CN106131397A/en
Publication of CN106131397A publication Critical patent/CN106131397A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

The invention provides method and electronic equipment that a kind of multi-medium data shows, the method comprise the steps that acquisition the first multi-medium data and the second multi-medium data, the optical zoom multiple of described auxiliary photographic head is more than the optical zoom multiple of described main photographic head；Described first multi-medium data is play in multimedia play interface；When detecting that described first multi-medium data is specified the amplifieroperation in region by user, from described second multi-medium data, extract the destination multimedia data corresponding with described appointment region；Show described destination multimedia data.The present invention is so that amplifying the multi-medium data checked is that focusing multiple is bigger, the higher data of resolution, it is to avoid amplifies and checks the pixel loss caused, it is ensured that amplifies the quality checking data.

Description

A kind of method that multi-medium data shows and electronic equipment
Technical field
The present invention relates to multimedia-data procession field, particularly relate to a kind of method that multi-medium data shows and electronics sets Standby.
Background technology
Another of cam lens focuses on zoom capabilities, and so-called zoom capabilities includes optical zoom (optical Zoom) with Digital Zoom (digital zoom) two kinds.Distant objects is amplified during shooting although both contribute to looking in the distance, but It is after only optical zoom can support image subject imaging, increases more pixel, allow main body not only become big, the most relative Apparent, and Digital Zoom is the amplification that the amplification by the later stage realizes image, the biggest Digital Zoom can make image serious Impaired, the most even because amplification is the highest, and it is hard to tell captured picture.
In field of video monitoring, the video file that current monitoring system preserves is all the optical zoom of fixing multiple, Such as, the video recorded according to normal 1 Zoom Lens.When video playback, certain local in video can be carried out Amplification is checked, but this amplification can only be amplified by the way of Digital Zoom, therefore, once needs to look into video amplifier Seeing, pixel loss causes quality can not be guaranteed, and monitoring effect is had a greatly reduced quality.
Summary of the invention
The embodiment of the present invention provides a kind of method that show of multi-medium data and electronic equipment, looks into video amplifier with solution Video pixel loss, the problem that video quality can not be guaranteed when seeing.
First aspect, it is provided that a kind of method that multi-medium data shows, described method is applied in electronic equipment, described Method includes:
Obtaining the first multi-medium data and the second multi-medium data, wherein, described first multi-medium data is main for using Photographic head shoots for using multiple auxiliary photographic head respectively for the data specifying photographed scene to shoot, described second multi-medium data The local scene of described appointment photographed scene is after obtaining the multiple middle multi-medium data of correspondence, many to the plurality of centre Media data carries out the data that split obtains；The optical zoom multiple of described auxiliary photographic head becomes more than the optics of described main photographic head Burnt multiple；
Described first multi-medium data is play in multimedia play interface；
When detecting that described first multi-medium data is specified the amplifieroperation in region by user, from described matchmaker more than second Volume data is extracted the destination multimedia data corresponding with described appointment region；
Show described destination multimedia data.
Second aspect, it is provided that a kind of electronic equipment, including:
Multi-medium data acquisition module, for obtaining the first multi-medium data and the second multi-medium data, wherein, described First multi-medium data is to use main photographic head for the data specifying photographed scene to shoot, and described second multi-medium data is for adopting Shoot the local scene of described appointment photographed scene with multiple auxiliary photographic head respectively, obtain the multiple middle multi-medium data of correspondence After, the plurality of middle multi-medium data is carried out the data that split obtains；The optical zoom multiple of described auxiliary photographic head is big Optical zoom multiple in described main photographic head；
Multi-medium data playing module, obtains for playing described multi-medium data acquisition module in multimedia play interface The first multi-medium data taken；
Multi-medium data extraction module, for detect that described multi-medium data playing module is play by user first Multi-medium data specify region amplifieroperation time, from described multi-medium data acquisition module obtain the second multi-medium data The destination multimedia data that middle extraction is corresponding with described appointment region；
Destination multimedia data disaply moudle, for showing the destination multimedia that described multi-medium data extraction module extracts Data.
So, in the embodiment of the present invention, use main photographic head to shoot the first multi-medium data, and use multiple zoom magnification Multiple centres that the auxiliary photographic head shooting bigger than the zoom magnification of main photographic head specifies the local scene of photographed scene to obtain correspondence Multiple middle multi-medium datas subsequently, are pieced together the second multi-medium data, then check the first multimedia number by multi-medium data During according to, when the local location of the first multi-medium data is performed amplifieroperation, can be from resolution higher second The destination multimedia data obtaining this amplifieroperation in multi-medium data corresponding show, so that amplify the many matchmakers checked Volume data is that focusing multiple is bigger, the higher data of resolution, it is to avoid amplifies and checks the pixel loss caused, it is ensured that amplifies Check the quality of data.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below by institute in the description to the embodiment of the present invention The accompanying drawing used is needed to be briefly described, it should be apparent that, the accompanying drawing in describing below is only some enforcements of the present invention Example, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to according to these accompanying drawings Obtain other accompanying drawing.
Fig. 1 is the flow chart of the method that a kind of multi-medium data of first embodiment of the invention shows；
Fig. 2 is the flow chart of the method that a kind of multi-medium data of second embodiment of the invention shows；
Fig. 3 is the camera array cross sectional representation of second embodiment of the invention；
Fig. 4 is the photographic head relations of distribution schematic diagram of second embodiment of the invention；
Fig. 5 is the calibration schematic diagram of second embodiment of the invention；
Fig. 6 is the block diagram of a kind of electronic equipment of one embodiment of the invention；
Fig. 7 is the block diagram of the angle calibration system module in the electronic equipment embodiment of the present invention；
Fig. 8 is the block diagram of the calibration submodule in the electronic equipment embodiment of the present invention；
Fig. 9 is the block diagram of the synthesis module in the electronic equipment embodiment of the present invention；
Figure 10 is the block diagram of the multi-medium data extraction module in the electronic equipment embodiment of the present invention；
Figure 11 is the block diagram of the electronic equipment of another embodiment of the present invention；
Figure 12 is the structural representation of the electronic equipment of another embodiment of the present invention.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Describe, it is clear that described embodiment is a part of embodiment of the present invention rather than whole embodiments wholely.Based on this Embodiment in bright, the every other enforcement that those of ordinary skill in the art are obtained under not making creative work premise Example, broadly falls into the scope of protection of the invention.
First embodiment
With reference to Fig. 1, it is shown that the flow chart of the method that a kind of multi-medium data of one embodiment of the invention shows, permissible Comprise the steps:
Step 101, obtains the first multi-medium data and the second multi-medium data.
In embodiments of the present invention, the first multi-medium data can be to use main photographic head for specifying photographed scene shooting Data.Second multi-medium data can be to use multiple auxiliary photographic head to shoot the local scene specifying photographed scene respectively, After corresponding multiple middle multi-medium data, the plurality of middle multi-medium data is carried out the data that split obtains.
First multi-medium data or the second multi-medium data can include video data or view data, and the present invention implements This is not restricted by example.
In the embodiment of the present invention, main photographic head is one, and auxiliary photographic head is multiple, and wherein, main photographic head is used for shooting entirety Photographed scene, auxiliary photographic head is used for shooting local photographed scene.Therefore, main photographic head is referred to as overall situation photographic head, auxiliary takes the photograph As head is referred to as local cameras.
In embodiments of the present invention, the optical zoom multiple of auxiliary photographic head is more than the optical zoom multiple of main photographic head, then The resolution of the second multi-medium data is more than the first multi-medium data.
Step 102, plays described first multi-medium data in multimedia play interface.
After obtaining the first multi-medium data, electronic equipment can play in current multimedia play interface this One multi-medium data.Such as, when the first multi-medium data is video data, can play in current video broadcast interface should Video data.Or, when the first multi-medium data is view data, this image can be shown in present image browser interface Data.
Step 103, when detecting that described first multi-medium data is specified the amplifieroperation in region by user, from described Second multi-medium data extracts the destination multimedia data corresponding with described appointment region.
During playing video data or display view data, when detecting that user is to this video data or picture number According to appointment region perform amplifieroperation time, then can obtain from high-resolution second multi-medium data and this appointment region Corresponding destination multimedia data, i.e. obtain from high-resolution second multi-medium data apparent better quality for Specify video data or the view data in region, as destination multimedia data.
Step 104, shows described destination multimedia data.
After getting destination multimedia data, this destination multimedia can be shown in current multimedia play interface Data.
In embodiments of the present invention, use main photographic head to shoot the first multi-medium data, and use multiple zoom magnification ratio Multiple centres that the auxiliary photographic head shooting that the zoom magnification of main photographic head is big specifies the local scene of photographed scene to obtain correspondence are many Multiple middle multi-medium datas subsequently, are pieced together the second multi-medium data, then check the first multi-medium data by media data During, when the local location of the first multi-medium data is performed amplifieroperation, can be from resolution higher more than second The destination multimedia data obtaining this regional area in media data corresponding show, so that amplify the multimedia checked Data are that focusing multiple is bigger, the higher data of resolution, it is to avoid amplify and check the pixel loss caused, it is ensured that amplify Check the quality of data.
Second embodiment
With reference to Fig. 2, it is shown that the flow chart of the method that a kind of multi-medium data of another embodiment of the present invention shows, this Inventive embodiments can apply to monitoring system, smart mobile phone, flat board, palm PC (Personal Digital Assistant, PDA), photographing unit etc. have in the electronic equipment of photographic head, further, this electronic equipment can also include showing Display screen, wherein, the photographic head in electronic equipment is taken pictures for realization, camera function, and display screen is for realizing shooting picture Or the preview function of video, i.e. shown in real time by the picture of absorption current to photographic head, for user's preview, thus Reach the effect of view finder.
In embodiments of the present invention, photographic head can include main photographic head and multiple auxiliary photographic head, wherein, main photographic head May be used for shooting and specify the overall image of photographed scene, therefore, main photographic head is referred to as overall situation photographic head.Auxiliary shooting Head may be used for shooting and specifies the image of local scene in photographed scene, and therefore, auxiliary photographic head is referred to as local cameras.
The optical zoom multiple of this auxiliary photographic head is more than the optical zoom multiple of this main photographic head, in the one side of being preferable to carry out In formula, this main photographic head can be a Zoom Lens photographic head, and the plurality of auxiliary photographic head can be more than a Zoom Lens Photographic head, such as, the plurality of auxiliary photographic head can be standard varifocal photographic head module or for the varifocal photographic head of focal length (standard varifocal photographic head module and the difference on optical zoom of the focal length varifocal photographic head module, be mainly reflected in module The multiple that the former can amplify is big less than the latter, and such as the former maximum may accomplish 3 Zoom Lens, and the latter then may maximum do To 12 Zoom Lens).
In a preferred embodiment, the plurality of auxiliary photographic head can be arranged in rectangular array, and this main photographic head exists Outside this rectangular array and adjacent with this rectangular array.With reference to shown in the camera array cross sectional representation shown in Fig. 3, many Individual auxiliary photographic head 302 can be arranged in the rectangular array of 4*3, and (this is corresponding with the sensor devices of photographic head, the sense of photographic head Optical device is also rectangle, and length-width ratio is 4:3), main photographic head 301 is outside this rectangular array and adjacent with this rectangular array.
It should be noted that when receiving shooting instruction or the record command of user, main photographic head and multiple auxiliary take the photograph As head can be simultaneously to specifying photographed scene to shoot or record, the shooting of the most main photographic head is overall photographed scene, The shooting of auxiliary photographic head is photographed scene locally.
The embodiment of the present invention may include steps of:
Step 201, is 1 Zoom Lens by the Focussing of main photographic head, and respectively by the focal length of multiple auxiliary photographic head Adjust to default optical zoom multiple.
Specifically, before sending shooting instruction or record command, first user can set main photographic head and take the photograph with auxiliary Optical zoom multiple as head.In a preferred embodiment, the focal length of main photographic head can be set to 1 times of optics by user Zoom, and respectively the focal length of multiple auxiliary photographic head is set to the optical zoom multiple preset.
And the optical zoom multiple preset of auxiliary photographic head be exactly when broadcasting video or image, user is to video or image A certain local carries out optical zoom and amplifies the multiple checked.
It should be noted that user can the optical zoom multiple of this auxiliary photographic head of on-demand setting, but due to optical zoom Multiple is proportionate with photographic head number, and therefore, this optical zoom multiple should not arrange excessive, and multiple is the biggest, needs the most Auxiliary photographic head processes.Such as, auxiliary photographic head shoots appointment photographed scene according to two times of focal lengths, and in object distance, (object is to camera lens Distance) identical in the case of, two times of focal length photographic head visual angles are little relative to one times of focal length photographic head, and the picture of absorption is the least. The photographic head of each two times of focal lengths is only responsible for the absorption of a certain local in present filming scene, is such as the 1/ of this photographed scene 100, then there are 100 two times of focal length photographic head to take in simultaneously, thus can guarantee that whole photographed scene is taken in enter, i.e. two During times focal length, 100 auxiliary photographic head can completely be taken in whole photographed scene, now, if being three by two times of Focussings Times focal length, in the case of the quantity of auxiliary photographic head is fixing, the camera lens of each auxiliary photographic head can only take in whole photographed scene 1/150, the camera lens of these 100 auxiliary photographic head can only take in the 100/150 of whole photographed scene altogether, also differs from 50 auxiliary photographic head Camera lens.Therefore, when the auxiliary photographic head number of equipment is fixed, its optical zoom multiple just has maximum, and the optics that user sets becomes Burnt multiple should be less than the maximum of this optical zoom multiple.
In practice, when the optical zoom multiple of the auxiliary photographic head of user setup, electronic equipment can be by this optical zoom The maximum of multiple is prompted to user, and the optical zoom multiple pointing out user to set not can exceed that this optical zoom multiple is Big value.Such as, according to the quantity of the auxiliary photographic head of current electronic device, limit the maximum of optical zoom multiple as 4 times, then may be used Not can exceed that 4 times of focal lengths with the optical zoom multiple that prompting user sets.
In addition, it is necessary to explanation, after the optical zoom multiple setting auxiliary photographic head, this optical zoom multiple The optical zoom multiple of all auxiliary photographic head being applicable to all auxiliary photographic head, i.e. current electronic device is all consistent.Or, In another scene, user can also set optical zoom multiple, the embodiment of the present invention pair respectively for each auxiliary photographic head This is not restricted.
After user sets the optical zoom multiple of each photographic head, when starting recorded video or shooting image, Main photographic head can be kept 1 Zoom Lens by electronic equipment, and direction faces toward the appointment photographed scene of dead ahead, and, by institute There is a Focussing optical zoom multiple to this setting of auxiliary photographic head, and the direction of all auxiliary photographic head is adjusted to faces Specify the direction of photographed scene.
Step 202, carries out angular deflection calibration to auxiliary photographic head each in the plurality of auxiliary photographic head.
After completing the optical zoom adjustment of all photographic head in step 201, can be further to all auxiliary photographic head In each auxiliary photographic head carry out angular deflection calibration.
In one embodiment, in the following way each auxiliary photographic head can be carried out angular deflection calibration: obtain The preview screen region that main photographic head gathers for appointment photographed scene, and, the quantity of auxiliary photographic head；By this preview screen district Territory is divided into the preview screen region, local of the appointment size of the quantity respective amount with auxiliary photographic head；It is respectively multiple auxiliary shootings In Tou, each auxiliary photographic head distributes the preview screen region, local of a correspondence position；For each auxiliary photographic head, based on distribution The locally center in preview screen region, carries out angular deflection calibration.
Specifically, owing to main photographic head is for shooting the overall scenario specifying photographed scene, therefore, main photographic head can Gather the preview screen region of whole appointment photographed scene.Further, owing to the quantity of photographic head auxiliary in electronic equipment is fixing, Therefore, it can the definite quantity obtaining auxiliary photographic head.
Subsequently, the preview screen region specifying photographed scene of main camera collection can be divided into and auxiliary photographic head The preview screen region, local of the appointment size of quantity respective amount, and in the most multiple auxiliary photographic head, each auxiliary photographic head divides Join the preview screen region, local (i.e. local scene) of a correspondence position.Such as, such as the photographic head relations of distribution schematic diagram institute of Fig. 4 Showing, current device has 12 auxiliary photographic head, then be divided in the preview screen region specifying photographed scene of main camera collection Preview screen region, 12 local, the lower right corner is the camera array of the embodiment of the present invention, and it is that 4x3 auxiliary photographic head adds one again Individual main photographic head.The upper left corner is an appointment photographed scene that will take in, and length-width ratio is 4:3, according to the quantity of auxiliary photographic head (12), can be divided into the preview screen region, 4x3 local of formed objects, and be that each auxiliary photographic head distributes a pair Answering the preview screen region, local of position, every solid line drawn from auxiliary photographic head points to specifies the local photographed scene pre- Picture area of looking at is exactly the one-to-one correspondence showing auxiliary photographic head with preview screen region, local.
In practice, owing to when initializing, whole photographic head are all just front to be specified photographed scene, now, If taking an intermediate image with the preview screen region, local that all of auxiliary photographic head is just corresponding respectively, and auxiliary take the photograph all As the intermediate image of head shooting pieces together, it is not necessary to complete one secondary scene can be pieced together, because auxiliary photographic head is all greater than one Zoom Lens, the angle of visual field is little relative to one times of zoom lens, and the scene of absorption is the least.If calibrated without angular deflection, The image of rear synthesis is exactly the image of overlapping region.Based on this, in embodiments of the present invention, right for the distribution of each auxiliary photographic head After the preview screen region, local answered, correspondence can be carried out based on the center in the preview screen region, local distributed The angular deflection calibration of auxiliary photographic head.
In one embodiment, can the centre bit in preview screen region, local based on distribution in the following way Putting, the angular deflection of the auxiliary photographic head carrying out correspondence is calibrated: the center in preview screen region, described local based on distribution, Judge that described auxiliary photographic head is the need of carrying out angular deflection calibration；If described auxiliary photographic head needs to carry out angular deflection calibration, Then obtain the diagonal intersection point of described rectangular array, be set as O point；Obtain the camera lens center of circle of auxiliary photographic head the most to be calibrated, It is set as P point；The yawing moment of described auxiliary photographic head is defined as the direction of the directed line segment of OP；Side by described directed line segment Need the angle carrying out calibrating as described auxiliary photographic head to the angle offset relative to Z axis.
In implementing, if with all auxiliary photographic head respectively with regard to the center bat in corresponding preview screen region, local Next intermediate image, and all intermediate images are synthesized first image, just specify scene to take with main photographic head simultaneously One the second image；First image and the second image are contrasted, if these two picture registrations are completely the same, then it represents that auxiliary take the photograph As head is made without angular deflection calibration.Otherwise, if these two images can not be completely superposed, then it represents that auxiliary photographic head need into Row angular deflection is calibrated.
In one embodiment, as shown in the calibration schematic diagram of Fig. 5, if auxiliary photographic head needs to carry out angular deflection school First standard, then can determine the diagonal intersection point of the rectangular array that these all auxiliary photographic head form, it is assumed that this point is O point, then The camera lens center of circle of auxiliary photographic head the most to be calibrated is set as P point, and the direction of the directed line segment of OP is corresponding as this O point The yawing moment of auxiliary photographic head, then the direction of the directed line segment that angle is this OP that this auxiliary photographic head needs to carry out to calibrate is relative In the angle of Z axis skew, subsequently, deflection calibration can be carried out according to this angle.The angular deflection of other auxiliary photographic head is calibrated also It it is similar operations.
It should be noted that for the accuracy improving calibration, above-mentioned angular deflection calibration may need to carry out repeatedly, directly The second image that the first image pieced together to the intermediate image of multiple auxiliary photographic head shooting and main photographic head shoot is completely superposed Unanimously, this angle calibration system just completes.
Step 203, controls described main photographic head and shoots described appointment photographed scene, it is thus achieved that the first multi-medium data；And, Control the plurality of auxiliary photographic head and shoot the corresponding local scene of described appointment photographed scene respectively, it is thus achieved that the many matchmakers in multiple centres Volume data.
After the angular deflection completing auxiliary photographic head is calibrated, it is auxiliary with all that electronic equipment can control main photographic head simultaneously Appointment photographed scene is shot by photographic head.
Concrete, electronic equipment can control main photographic head to specifying photographed scene to carry out overall situation shooting, thus obtains the One multi-medium data.Wherein, this first multi-medium data can include video data or view data, and the embodiment of the present invention is to this It is not construed as limiting.
Meanwhile, electronic equipment in can also controlling all auxiliary photographic head each auxiliary photographic head shoot respectively correspondence local pre- Look at picture area, to obtain corresponding multiple middle multi-medium data.
Such as, if auxiliary photographic head is used for shooting image, then this middle multi-medium data is intermediate image；If this auxiliary photographic head For recorded video, then this middle multi-medium data is intermediate video data.
In implementing, the plurality of middle multi-medium data can be saved in preset buffer memory district.
Step 204, carries out synthesis process by the plurality of middle multi-medium data, generates described second multi-medium data.
After obtaining multiple middle multi-medium data, the plurality of middle multi-medium data in relief area can be closed One-tenth processes, to generate the second multi-medium data.
In a kind of preferred embodiment of the embodiment of the present invention, can be in the following way by multiple middle multi-medium datas Carry out synthesis process, to generate the second multi-medium data: obtain the background image of described middle multi-medium data respectively；Count respectively Calculate the global alignment parameter of described auxiliary photographic head；Based on described global alignment parameter, complete the spelling of described middle multi-medium data Connect, generate the second multi-medium data.
Concrete, in order to eliminate the impact of multimode background and moving target, can obtain first with gauss hybrid models To the background image of each middle multi-medium data, as a kind of example, number K of Gauss model can be set to 5, and threshold value T sets Being 0.7, length of window L is set to 200, and primary standard difference σ is set to 20.
Subsequently, respectively each background image can be carried out SIFT (Scale-invariant feature Transform, scale invariant feature is changed) detection of characteristic point and coupling, and utilize RANSAC (RANdom Sample Consensus, it is according to one group of sample data set comprising abnormal data, calculates the mathematical model parameter of data, obtains The algorithm of effective sample data) algorithm elimination exterior point therein.Impact in view of the measurement error of alignment procedures, it is also possible to profit Calculating homography matrix with the symmetrical transmission error of feature point pairs, this object function can be expressed as:
∑[d(xi, H-1x′i)2+d(x′i, Hxi)2]；
In above formula, the 1st transmission error representing present frame, the 2nd transmission error representing former frame；Table Showing the ith feature point pair of former frame and present frame, H represents the projective transformation of two width images.
Auxiliary photographic head a fairly large number of in the case of, global optimization approach can be used to eliminate the accumulation of error, and obtain The global alignment parameter of each auxiliary photographic head.Owing to global approach amount of calculation is bigger, frame-to-therefore can be used Mosaic (frame is to panorama sketch) method calculates the global alignment parameter of each auxiliary photographic head.For example, it is assumed that there are 4 auxiliary photographic head Background image Ci(i=1 ..., 4).First one of them background image is chosen (such as Ci) as reference frame, and C2It is registered to C1, Thus generate an interim stitching image M.Then background image C3It is directed at M, and utilizes C3M is updated.Right C4Same method is used to process, such that it is able to obtain the alignment parameter of all background images.
Homography matrix between each auxiliary photographic head, once it is determined that the most no longer change, utilizes these global alignment parameters Each middle multi-medium data is projected in global coordinate system, it is possible to they are synthesized the second multi-medium data.
It should be noted that the above-mentioned mode that middle multi-medium data is carried out synthesis process is only the embodiment of the present invention A kind of example, this area adopts and middle multi-medium data carries out synthesis in other ways processes and be all possible, and the present invention is real Execute example this is not restricted.
It should be noted that the resolution of this second multi-medium data is different along with the difference of optical zoom multiple, light Learn zoom magnification the biggest, then the resolution of the second multi-medium data is the biggest.And dividing of its resolution ratio the first multi-medium data Resolution is big.
Step 205, obtains described first multi-medium data and the second multi-medium data.
According to above-mentioned steps 201-step 204, the first multi-medium data and the second multi-medium data can be generated, with After, in step 205, electronic equipment can obtain this first multi-medium data and the second multi-medium data.
Step 206, plays described first multi-medium data in multimedia play interface.
After all photographic head complete shooting or record, can be using the first multi-medium data as playing or the version of display This, play in current multimedia play interface or show this first multi-medium data.
Step 207, when detecting that described first multi-medium data is specified the amplifieroperation in region by user, from described Second multi-medium data extracts the destination multimedia data corresponding with described appointment region.
During the broadcasting of the first multi-medium data or showing, if user wants to refer to this first multi-medium data certain Determine region to be amplified checking, then user can perform amplifieroperation to this appointment region, as a kind of example, this amplifieroperation Can be double click operation, click selected operation etc., this be not construed as limiting by the embodiment of the present invention.
When electronic equipment detects that this first multi-medium data is specified the amplifieroperation in region by user, first obtain The positional information that this appointment region is corresponding, is then based on this positional information, extracts and believe with this position from the second multi-medium data The multi-medium data that breath is corresponding, as destination multimedia data.
In implementing, the method for many general can be used to obtain and to specify positional information corresponding to region, such as, can To use JavaScript to obtain the position of click, after mouse click event being detected, obtained by event.clientX Take abscissa, and, obtain vertical coordinate by event.clientY.And for example, can be with in Windows API GetCursorPos obtains mouse position, is then converted to the coordinate of present procedure with ScreenToClient.The present invention implements The concrete mode obtaining positional information is not construed as limiting by example.
Step 208, shows described destination multimedia data.
After obtaining destination multimedia data, can play in current multimedia play interface or show this target Multi-medium data.
After destination multimedia data playback or display complete, can come back in the first multi-medium data, continue Play in this first multi-medium data immediately following the data after the positional information that appointment region is corresponding.
In embodiments of the present invention, when user want the first multi-medium data is carried out partial enlargement check time, amplification Destination multimedia data are owing to resolution is more than the first multi-medium data so that the data pixels of amplifier section is not lost, and keeps away Exempt to amplify and checked the problem causing Quality Down, it is ensured that amplified the quality of the data checked.
It should be noted that for embodiment of the method, in order to be briefly described, therefore it is all expressed as a series of action group Closing, but those skilled in the art should know, the embodiment of the present application is not limited by described sequence of movement, because depending on According to the embodiment of the present application, some step can use other orders or carry out simultaneously.Secondly, those skilled in the art also should Knowing, embodiment described in this description belongs to preferred embodiment, and involved action not necessarily the application implements Necessary to example.
3rd embodiment
Fig. 6 is the block diagram of a kind of electronic equipment of one embodiment of the invention.Electronic equipment 600 shown in Fig. 6 can wrap Including a main photographic head (not shown) and multiple auxiliary photographic head (not shown), described electronic equipment 600 is all right Including multi-medium data acquisition module 605, multi-medium data playing module 606, multi-medium data extraction module 607 and target Multi-medium data display module 608.
Multi-medium data acquisition module 605, for obtaining the first multi-medium data and the second multi-medium data.
Wherein, described first multi-medium data is to use main photographic head for the data specifying photographed scene shooting.Described Second multi-medium data is the local scene using multiple auxiliary photographic head to shoot described appointment photographed scene respectively, obtains correspondence After multiple middle multi-medium datas, the plurality of middle multi-medium data is carried out the data that split obtains.
The optical zoom multiple of described auxiliary photographic head is more than the optical zoom multiple of described main photographic head.
Multi-medium data playing module 606, obtains mould for playing described multi-medium data in multimedia play interface The first multi-medium data that block obtains；
Multi-medium data extraction module 607, for detecting what described multi-medium data playing module was play by user First multi-medium data specify region amplifieroperation time, from described multi-medium data acquisition module obtain the second multimedia The destination multimedia data that extracting data is corresponding with described appointment region；
Destination multimedia data disaply moudle 608, for showing that the target that described multi-medium data extraction module extracts is many Media data.
In a kind of preferred embodiment of the embodiment of the present invention, the plurality of auxiliary photographic head is arranged in rectangular array, described Main photographic head is outside described rectangular array and adjacent with described rectangular array.
In a kind of preferred embodiment of the embodiment of the present invention, described main photographic head is a Zoom Lens photographic head, institute Stating auxiliary photographic head is the photographic head more than a Zoom Lens.
In a kind of preferred embodiment of the embodiment of the present invention, with reference to shown in Fig. 6, this electronic equipment 600 can also include Such as lower module:
Focussing module 601, being used for the Focussing of described main photographic head is 1 Zoom Lens, and respectively by institute State the Focussing of multiple auxiliary photographic head to the optical zoom multiple preset；
Angle calibration system module 602, each in the multiple auxiliary photographic head after adjusting described Focussing module auxiliary takes the photograph As head carries out angular deflection calibration；
Taking module 603, for controlling, the main photographic head shooting after described Focussing module adjusts is described specifies shooting Scene, it is thus achieved that the first multi-medium data；And, control the multiple auxiliary photographic head after described angle calibration system modular calibration and shoot respectively The corresponding local scene of described appointment photographed scene, it is thus achieved that multiple middle multi-medium datas；
Synthesis module 604, carries out synthesis process for the multiple middle multi-medium data obtained by described taking module, raw Become described second multi-medium data.
In a kind of preferred embodiment of the embodiment of the present invention, with reference to the block diagram of the angle calibration system module shown in Fig. 7, described Angle calibration system module 602 can include following submodule further:
Data acquisition submodule 6021, for obtaining the preview that described main photographic head gathers for described appointment photographed scene Picture area, and, the quantity of described auxiliary photographic head；
Region divide submodule 6022, for by described data acquisition submodule obtain preview screen region be divided into The preview screen region, local of the appointment size of the quantity respective amount of described auxiliary photographic head；
Region distribution sub module 6023, in the most the plurality of auxiliary photographic head, each auxiliary photographic head distribution one is corresponding The preview screen region, described local of position；
Calibration submodule 6024, for for each described auxiliary photographic head, based on the distribution of described region distribution sub module The center in preview screen region, described local, carries out angular deflection calibration.
In a kind of preferred embodiment of the embodiment of the present invention, the block diagram of the calibration submodule with reference to shown in Fig. 8, described Calibration submodule 6024 can include further such as lower unit:
Judging unit 60241, for the center in preview screen region, described local based on distribution, it is judged that described auxiliary Photographic head is the need of carrying out angular deflection calibration.
Diagonal intersection point determines unit 60242, for judging that described auxiliary photographic head needs to carry out angle at described judging unit During degree deflection calibration, obtain the diagonal intersection point of described rectangular array, be set as O point.
The center of circle determines unit 60243, for obtaining the camera lens center of circle of auxiliary photographic head the most to be calibrated, is set as P point.
Yawing moment determines unit 60244, for the yawing moment of described auxiliary photographic head is defined as the directed line segment of OP Direction.
Deflection angle determines unit 60245, for angle that the direction of described directed line segment is offset relative to Z axis as Described auxiliary photographic head needs the angle carrying out calibrating.
In a kind of preferred embodiment of the embodiment of the present invention, with reference to the block diagram of the synthesis module shown in Fig. 9, described synthesis Module 604 can include further such as lower unit:
Background image obtains submodule 6041, for obtaining the background image of described middle multi-medium data respectively.
Global alignment parameter acquiring submodule 6042, for calculating the global alignment parameter of described auxiliary photographic head respectively.
Splicing submodule 6043, for joining based on the described global alignment calculated global alignment of parameter acquiring submodule Number, completes the splicing of described middle multi-medium data, generates the second multi-medium data.
In a kind of preferred embodiment of the embodiment of the present invention, with reference to the frame of the multi-medium data extraction module shown in Figure 10 Figure, described multi-medium data extraction module 607 can include following submodule further:
Position determines submodule 6071, for when detecting that described first multi-medium data is specified putting of region by user When operating greatly, obtain the positional information that described appointment region is corresponding.
Multi-medium data obtains submodule 6072, determines with described position for extracting from described second multi-medium data Multi-medium data corresponding to positional information that submodule obtains, as destination multimedia data.
In a kind of preferred embodiment of the embodiment of the present invention, described first multi-medium data or described second multimedia number According to including view data or video data.
Electronic equipment 600 is capable of each process that in the embodiment of the method for Fig. 1 and Fig. 2, electronic equipment realizes, for keeping away Exempt to repeat, repeat no more here.
In embodiments of the present invention, electronic equipment 600 uses multi-medium data acquisition module 605 to obtain the first multimedia number According to this and the second multi-medium data, wherein, the first multi-medium data is to use main photographic head for specifying photographed scene shooting Data, the second multi-medium data is the local scene using multiple auxiliary photographic head to shoot described appointment photographed scene respectively, obtains After corresponding multiple middle multi-medium data, the plurality of middle multi-medium data is carried out the data that split obtains, and, The optical zoom multiple of described auxiliary photographic head is more than the optical zoom multiple of described main photographic head.Subsequently, multi-medium data is used Playing module 606 plays the first multi-medium data in current multimedia play interface, in playing process, uses multimedia Data extraction module 607 detects that described first multi-medium data is specified the amplifieroperation in region by user, and is detecting During amplifieroperation, from described second multi-medium data, extract the destination multimedia data corresponding with described appointment region；And, Destination multimedia data disaply moudle 608 is used to show this destination multimedia data.So that amplify the multimedia number checked According to being that focusing multiple is bigger, the higher data of resolution, it is to avoid amplify and check the pixel loss caused, it is ensured that amplify and check The quality of data.
4th embodiment
Figure 11 is the block diagram of the electronic equipment of another embodiment of the present invention.Electronic equipment 1100 shown in Figure 11 includes: At least one processor 1101, memorizer 1102, at least one network interface 1104 and user interface 1103, camera assembly 1106.Each assembly in electronic equipment 1100 is coupled by bus system 1105.It is understood that bus system 1105 is used In the connection communication realized between these assemblies.Bus system 1105, in addition to including data/address bus, also includes power bus, control Bus processed and status signal bus in addition.But for the sake of understanding explanation, in fig. 11 various buses are all designated as bus system 1105, camera assembly 1106 includes a main photographic head and multiple auxiliary photographic head, and the plurality of auxiliary photographic head is arranged in rectangle battle array Row, described first photographic head is outside described rectangular array and adjacent with described rectangular array；And, it is preferable that described master takes the photograph As head is a Zoom Lens photographic head, described auxiliary photographic head is the photographic head more than a Zoom Lens.
Wherein, user interface 1103 can include display, keyboard or pointing device (such as, mouse, trace ball (trackball), touch-sensitive plate or touch screen etc..
The memorizer 1102 being appreciated that in the embodiment of the present invention can be volatile memory or non-volatile memories Device, maybe can include volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read only memory (Read-OnlyMemory, ROM), programmable read only memory (ProgrammableROM, PROM), erasable programmable are read-only Memorizer (ErasablePROM, EPROM), Electrically Erasable Read Only Memory (ElectricallyEPROM, EEPROM) Or flash memory.Volatile memory can be random access memory (RandomAccessMemory, RAM), and it is used as outside high Speed caching.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static RAM (StaticRAM, SRAM), dynamic random access memory (DynamicRAM, DRAM), Synchronous Dynamic Random Access Memory (SynchronousDRAM, SDRAM), double data speed synchronous dynamic RAM (DoubleDataRate SDRAM, DDRSDRAM), enhancement mode Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links Dynamic random access memory (SynchlinkDRAM, SLDRAM) and direct rambus random access memory (DirectRambusRAM, DRRAM).The memorizer 1102 of system and method that the embodiment of the present invention describes be intended to include but not It is limited to these and the memorizer of other applicable type any.
In some embodiments, memorizer 1102 stores following element, executable module or data structure, or Their subset of person, or their superset: operating system 11021 and application program 11022.
Wherein, operating system 11021, comprise various system program, such as ccf layer, core library layer, driving layer etc., be used for Realize various basic business and process hardware based task.Application program 11022, comprises various application program, such as according to Camera application program, media player (MediaPlayer), browser (Browser) etc., be used for realizing various applied business. The program realizing embodiment of the present invention method may be embodied in application program 11022.
In embodiments of the present invention, by calling program or the instruction of memorizer 1102 storage, concrete, can be application The program stored in program 11022 or instruction, processor 1101 is for obtaining the first multi-medium data and the second multimedia number According to；Described first multi-medium data is play in present multimedia broadcast interface；When detecting that user is to described first multimedia During the amplifieroperation specifying region of data, from described second multi-medium data, extract the target corresponding with described appointment region Multi-medium data；Showing described destination multimedia data, wherein, described first multi-medium data is for using main photographic head for finger Determining the data of photographed scene shooting, described second multi-medium data is clapped for using multiple auxiliary photographic head to shoot described appointment respectively Take the photograph the local scene of scene, after obtaining the multiple middle multi-medium data of correspondence, the plurality of middle multi-medium data is entered The data that row split obtains；The optical zoom multiple of described auxiliary photographic head is more than the optical zoom multiple of described main photographic head.
The method that the invention described above embodiment discloses can apply in processor 1101, or real by processor 1101 Existing.Processor 1101 is probably a kind of IC chip, has the disposal ability of signal.During realizing, said method Each step can be completed by the instruction of the integrated logic circuit of the hardware in processor 1101 or software form.Above-mentioned Processor 1101 can be general processor, digital signal processor (DigitalSignalProcessor, DSP), special collection Become circuit (ApplicationSpecific IntegratedCircuit, ASIC), ready-made programmable gate array (FieldProgrammableGateArray, FPGA) or other PLDs, discrete gate or transistor logic Device, discrete hardware components.Can realize or perform disclosed each method, step and the box in the embodiment of the present invention Figure.The processor etc. that general processor can be microprocessor or this processor can also be any routine.In conjunction with the present invention The step of the method disclosed in embodiment can be embodied directly in hardware decoding processor and perform, or uses decoding processor In hardware and software module combination execution complete.Software module may be located at random access memory, and flash memory, read only memory can In the storage medium that this areas such as program read-only memory or electrically erasable programmable memorizer, depositor are ripe.This storage Medium is positioned at memorizer 1102, and processor 1101 reads the information in memorizer 1102, completes said method in conjunction with its hardware Step.
It is understood that the embodiment of the present invention describe these embodiments can use hardware, software, firmware, middleware, Microcode or a combination thereof realize.Realizing for hardware, processing unit can be implemented in one or more special IC (ApplicationSpecificIntegratedCircuits, ASIC), digital signal processor (DigitalSignalProcessing, DSP), digital signal processing appts (DSPDevice, DSPD), programmable logic device (ProgrammableLogicDevice, PLD), field programmable gate array (Field-ProgrammableGateArray, FPGA), general processor, controller, microcontroller, microprocessor, for performing other electronics list of herein described function In unit or a combination thereof.
Software is realized, can come by performing the module (such as process, function etc.) of function described in the embodiment of the present invention Realize the technology described in the embodiment of the present invention.Software code is storable in performing in memorizer and by processor.Memorizer can Within a processor or to realize outside processor.
Alternatively, processor 1101 is additionally operable to: be 1 Zoom Lens by the Focussing of described main photographic head, and respectively By the Focussing of the plurality of auxiliary photographic head to the optical zoom multiple preset；Auxiliary take the photograph each in the plurality of auxiliary photographic head As head carries out angular deflection calibration；Control described main photographic head and shoot described appointment photographed scene, it is thus achieved that the first multi-medium data； And, control the plurality of auxiliary photographic head and shoot the corresponding local scene of described appointment photographed scene respectively, it is thus achieved that Duo Gezhong Between multi-medium data；The plurality of middle multi-medium data is carried out synthesis process, generates described second multi-medium data.
Alternatively, processor 1101 is additionally operable to: obtain described main photographic head for described appointment photographed scene gather pre- Look at picture area, and, the quantity of described auxiliary photographic head；Described preview screen region is divided into and the number of described auxiliary photographic head The preview screen region, local of the appointment size of amount respective amount；It is respectively each auxiliary photographic head in the plurality of auxiliary photographic head to divide Join the preview screen region, described local of a correspondence position；For each described auxiliary photographic head, described local based on distribution is pre- Look at the center of picture area, carry out angular deflection calibration.
Alternatively, processor 1101 is additionally operable to: the center in preview screen region, described local based on distribution, it is judged that Described auxiliary photographic head is the need of carrying out angular deflection calibration；If described auxiliary photographic head needs to carry out angular deflection calibration, then obtain Take the diagonal intersection point of described rectangular array, be set as O point；Obtain the camera lens center of circle of auxiliary photographic head the most to be calibrated, set For P point；The yawing moment of described auxiliary photographic head is defined as the direction of the directed line segment of OP；By the direction phase of described directed line segment Angle for Z axis skew needs to carry out, as described auxiliary photographic head, the angle calibrated.
Alternatively, processor 1101 is additionally operable to: obtain the background image of described middle multi-medium data respectively；Calculate respectively The global alignment parameter of described auxiliary photographic head；Based on described global alignment parameter, complete the splicing of described middle multi-medium data, Generate the second multi-medium data.
Alternatively, processor 1101 is additionally operable to: when detecting that described first multi-medium data is specified region by user During amplifieroperation, obtain the positional information that described appointment region is corresponding；Extract and institute's rheme from described second multi-medium data The multi-medium data that confidence breath is corresponding, as destination multimedia data.
Alternatively, described first multi-medium data or described second multi-medium data include view data or video data.
Electronic equipment 1100 is capable of each process that in previous embodiment, electronic equipment realizes, for avoiding repeating, this In repeat no more.
In embodiments of the present invention, electronic equipment uses main photographic head to shoot the first multi-medium data, and uses multiple change The auxiliary photographic head shooting that burnt multiple is bigger than the zoom magnification of main photographic head specifies the local scene of photographed scene to obtain the many of correspondence Multiple middle multi-medium datas subsequently, are pieced together the second multi-medium data, then check more than first by individual middle multi-medium data During media data, when the local location of the first multi-medium data is performed amplifieroperation, can be higher from resolution The second multi-medium data in obtain this amplifieroperation corresponding destination multimedia data show so that amplify check Multi-medium data be focusing multiple is bigger, the higher data of resolution, it is to avoid amplify and check the pixel loss caused, it is ensured that Amplify the quality checking data.
5th embodiment
Figure 12 is the structural representation of the electronic equipment of another embodiment of the present invention.Specifically, the electronics in Figure 12 sets Standby 1200 can be monitoring system, mobile phone, panel computer, personal digital assistant (PersonalDigitalAssistant, Or vehicle-mounted computer etc. PDA).
Electronic equipment 1200 in Figure 12 includes radio frequency (RadioFrequency, RF) circuit 1210, memorizer 1220, defeated Enter unit 1230, display unit 1240, processor 1260, voicefrequency circuit 1270, WiFi (WirelessFidelity) module 1280, power supply 1290 and camera assembly 1212.
Wherein, input block 1230 can be used for receiving numeral or the character information of user's input, and generation sets with electronics The user setup of standby 1200 and function control relevant signal input.Specifically, in the embodiment of the present invention, this input block 1230 can include contact panel 1231.Contact panel 1231, also referred to as touch screen, can collect user and thereon or neighbouring touch Touch operation (such as user uses any applicable object such as finger, stylus or adnexa operation on contact panel 1231), and Corresponding attachment means is driven according to formula set in advance.Optionally, contact panel 1231 can include touch detecting apparatus and Two parts of touch controller.Wherein, the touch orientation of touch detecting apparatus detection user, and detect the letter that touch operation brings Number, transmit a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and is converted into Contact coordinate, then give this processor 1260, and order that processor 1260 sends can be received and performed.Furthermore, it is possible to The polytypes such as resistance-type, condenser type, infrared ray and surface acoustic wave are used to realize contact panel 1231.Except contact panel 1231, input block 1230 can also include other input equipments 1232, and other input equipments 1232 can include but not limited to One or many in physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, action bars etc. Kind.
Wherein, display unit 1240 can be used for showing the information inputted by user or the information being supplied to user and electronics The various menu interfaces of equipment 1200.Display unit 1240 can include display floater 1241, optionally, can use LCD or have The forms such as machine light emitting diode (OrganicLight-EmittingDiode, OLED) configure display floater 1241.
It should be noted that contact panel 1231 can cover display floater 1241, formed and touch display screen, when this touch display screen Detect thereon or after neighbouring touch operation, send processor 1260 to determine the type of touch event, with post processing Device 1260 provides corresponding visual output according to the type of touch event on touch display screen.
Touch display screen and include Application Program Interface viewing area and conventional control viewing area.This Application Program Interface viewing area And the arrangement mode of this conventional control viewing area does not limit, can be arranged above and below, left-right situs etc. can be distinguished two and show Show the arrangement mode in district.This Application Program Interface viewing area is displayed for the interface of application program.Each interface is permissible The interface elements such as the icon and/or the widget desktop control that comprise at least one application program.This Application Program Interface viewing area It can also be the empty interface not comprising any content.This conventional control viewing area is for showing the control that utilization rate is higher, such as, The application icons etc. such as settings button, interface numbering, scroll bar, phone directory icon.
Camera assembly 1212 includes a main photographic head and multiple auxiliary photographic head, and wherein, the plurality of auxiliary photographic head is arranged in Rectangular array, described first photographic head is outside described rectangular array and adjacent with described rectangular array.And, it is preferable that should Main photographic head is a Zoom Lens photographic head, and the plurality of auxiliary photographic head is the photographic head more than a Zoom Lens.
Wherein processor 1260 is the control centre of electronic equipment 1200, utilizes various interface and the whole mobile phone of connection Various piece, be stored in the software program in first memory 1221 and/or module by running or performing, and call and deposit Storage data in second memory 522, perform the various functions of electronic equipment 1200 and process data, thus to electronic equipment 1200 carry out integral monitoring.Optionally, processor 1260 can include one or more processing unit.
In embodiments of the present invention, by call the software program and/or module stored in this first memory 1221 and/ Or the data in this second memory 1222, processor 1260 is for obtaining the first multi-medium data and the second multimedia number According to；Described first multi-medium data is play in multimedia play interface；When detecting that user is to described first multi-medium data The amplifieroperation specifying region time, from described second multi-medium data, extract the target many matchmaker corresponding with described appointment region Volume data；Showing described destination multimedia data, wherein, described first multi-medium data is clapped for specifying for using main photographic head Taking the photograph the data of scene capture, described second multi-medium data shoots described appointment photographed scene respectively for using multiple auxiliary photographic head Local scene, obtain correspondence multiple middle multi-medium data after, the plurality of middle multi-medium data is carried out split The data obtained；The optical zoom multiple of described auxiliary photographic head is more than the optical zoom multiple of described main photographic head.
Alternatively, processor 1260 is additionally operable to: be 1 Zoom Lens by the Focussing of described main photographic head, and respectively By the Focussing of the plurality of auxiliary photographic head to the optical zoom multiple preset；Auxiliary take the photograph each in the plurality of auxiliary photographic head As head carries out angular deflection calibration；Control described main photographic head and shoot described appointment photographed scene, it is thus achieved that the first multi-medium data； And, control the plurality of auxiliary photographic head and shoot the corresponding local scene of described appointment photographed scene respectively, it is thus achieved that Duo Gezhong Between multi-medium data；The plurality of middle multi-medium data is carried out synthesis process, generates described second multi-medium data.
Alternatively, processor 1260 is additionally operable to: obtain described main photographic head for described appointment photographed scene gather pre- Look at picture area, and, the quantity of described auxiliary photographic head；Described preview screen region is divided into and the number of described auxiliary photographic head The preview screen region, local of the appointment size of amount respective amount；It is respectively each auxiliary photographic head in the plurality of auxiliary photographic head to divide Join the preview screen region, described local of a correspondence position；For each described auxiliary photographic head, described local based on distribution is pre- Look at the center of picture area, carry out angular deflection calibration.
Alternatively, processor 1260 is additionally operable to: the center in preview screen region, described local based on distribution, it is judged that Described auxiliary photographic head is the need of carrying out angular deflection calibration；If described auxiliary photographic head needs to carry out angular deflection calibration, then obtain Take the diagonal intersection point of described rectangular array, be set as O point；Obtain the camera lens center of circle of auxiliary photographic head the most to be calibrated, set For P point；The yawing moment of described auxiliary photographic head is defined as the direction of the directed line segment of OP；By the direction phase of described directed line segment Angle for Z axis skew needs to carry out, as described auxiliary photographic head, the angle calibrated.
Alternatively, processor 1260 is additionally operable to: obtain the background image of described middle multi-medium data respectively；Calculate respectively The global alignment parameter of described auxiliary photographic head；Based on described global alignment parameter, complete the spelling of described middle multi-medium data Connect, generate the second multi-medium data.
Alternatively, processor 1260 is additionally operable to: when detecting that described first multi-medium data is specified region by user During amplifieroperation, obtain the positional information that described appointment region is corresponding；Extract and institute's rheme from described second multi-medium data The multi-medium data that confidence breath is corresponding, as destination multimedia data.
Alternatively, described first multi-medium data or described second multi-medium data include view data or video data.
Visible, in embodiments of the present invention, electronic equipment uses main photographic head to shoot the first multi-medium data, and uses many The auxiliary photographic head shooting that individual zoom magnification is bigger than the zoom magnification of main photographic head specifies the local scene of photographed scene to obtain correspondence Multiple middle multi-medium data, subsequently, multiple middle multi-medium datas are pieced together the second multi-medium data, then check During one multi-medium data, when the local location of the first multi-medium data is performed amplifieroperation, can be from resolution The destination multimedia data obtaining this amplifieroperation in higher second multi-medium data corresponding show, so that amplify The multi-medium data checked is that focusing multiple is bigger, the higher data of resolution, it is to avoid amplifies and checks the pixel loss caused, Ensure that and amplify the quality checking data.
Those of ordinary skill in the art are it is to be appreciated that combine that the disclosed embodiments in the embodiment of the present invention describe is each The unit of example and algorithm steps, it is possible to being implemented in combination in of electronic hardware or computer software and electronic hardware.These Function performs with hardware or software mode actually, depends on application-specific and the design constraint of technical scheme.Specialty Technical staff specifically should can be used for using different methods to realize described function to each, but this realization should not Think beyond the scope of this invention.
Those skilled in the art is it can be understood that arrive, for convenience and simplicity of description, the system of foregoing description, The specific works process of device and unit, is referred to the corresponding process in preceding method embodiment, does not repeats them here.
In embodiment provided herein, it should be understood that disclosed apparatus and method, can be passed through other Mode realizes.Such as, device embodiment described above is only schematically, such as, the division of described unit, it is only A kind of logic function divides, actual can have when realizing other dividing mode, the most multiple unit or assembly can in conjunction with or Person is desirably integrated into another system, or some features can be ignored, or does not performs.Another point, shown or discussed is mutual Between coupling direct-coupling or communication connection can be the INDIRECT COUPLING by some interfaces, device or unit or communication Connect, can be electrical, machinery or other form.
The described unit illustrated as separating component can be or may not be physically separate, shows as unit The parts shown can be or may not be physical location, i.e. may be located at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected according to the actual needs to realize the mesh of the present embodiment scheme 's.
It addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it is also possible to It is that unit is individually physically present, it is also possible to two or more unit are integrated in a unit.
If described function is using the form realization of SFU software functional unit and as independent production marketing or use, permissible It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is the most in other words The part contributing prior art or the part of this technical scheme can embody with the form of software product, this meter Calculation machine software product is stored in a storage medium, including some instructions with so that a computer equipment (can be individual People's computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention. And aforesaid storage medium includes: USB flash disk, portable hard drive, ROM, RAM, magnetic disc or CD etc. are various can store program code Medium.
The above, the only detailed description of the invention of the present invention, but protection scope of the present invention is not limited thereto, and any Those familiar with the art, in the technical scope that the invention discloses, can readily occur in change or replace, should contain Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with scope of the claims.

Claims (18)

1. the method that a multi-medium data shows, it is characterised in that including:
Obtaining the first multi-medium data and the second multi-medium data, wherein, described first multi-medium data is for using main shooting The scalp acupuncture data to specifying photographed scene to shoot, described second multi-medium data is described for using multiple auxiliary photographic head to shoot respectively Specify the local scene of photographed scene, after obtaining the multiple middle multi-medium data of correspondence, to the plurality of middle multimedia Data carry out the data that split obtains；The optical zoom multiple of described auxiliary photographic head is more than the optical zoom times of described main photographic head Number；
Described first multi-medium data is play in multimedia play interface；
When detecting that described first multi-medium data is specified the amplifieroperation in region by user, from described second multimedia number According to the destination multimedia data that middle extraction is corresponding with described appointment region；
Show described destination multimedia data.
Method the most according to claim 1, it is characterised in that the plurality of auxiliary photographic head is arranged in rectangular array, described Main photographic head is outside described rectangular array and adjacent with described rectangular array.
Method the most according to claim 1 and 2, it is characterised in that described main photographic head is a Zoom Lens photographic head, Described auxiliary photographic head is the photographic head more than a Zoom Lens.
Method the most according to claim 2, it is characterised in that described acquisition the first multi-medium data and matchmaker more than second Before the step of volume data, described method also includes:
It is 1 Zoom Lens by the Focussing of described main photographic head, and respectively by the Focussing of the plurality of auxiliary photographic head To the optical zoom multiple preset；
Auxiliary photographic head each in the plurality of auxiliary photographic head is carried out angular deflection calibration；
Control described main photographic head and shoot described appointment photographed scene, it is thus achieved that the first multi-medium data；And, control the plurality of Auxiliary photographic head shoots the corresponding local scene of described appointment photographed scene respectively, it is thus achieved that multiple middle multi-medium datas；
The plurality of middle multi-medium data is carried out synthesis process, generates described second multi-medium data.
Method the most according to claim 4, it is characterised in that described to auxiliary photographic head each in the plurality of auxiliary photographic head Carry out the step of angular deflection calibration, including:
Obtain the preview screen region that described main photographic head gathers for described appointment photographed scene, and, described auxiliary photographic head Quantity；
Described preview screen region is divided into the local preview of the appointment size of quantity respective amount with described auxiliary photographic head Picture area；
It is respectively each auxiliary photographic head in the plurality of auxiliary photographic head and distributes the preview screen region, described local of a correspondence position；
For each described auxiliary photographic head, the center in preview screen region, described local based on distribution, carry out angle inclined Transfer to another school standard.
Method the most according to claim 5, it is characterised in that described for each described auxiliary photographic head, based on distribution The center in preview screen region, described local, carries out the step of angular deflection calibration, including:
The center in preview screen region, described local based on distribution, it is judged that described auxiliary photographic head is the need of carrying out angle Deflection calibration；
If described auxiliary photographic head needs to carry out angular deflection calibration, then obtain the diagonal intersection point of described rectangular array, be set as O Point；
Obtain the camera lens center of circle of auxiliary photographic head the most to be calibrated, be set as P point；
The yawing moment of described auxiliary photographic head is defined as the direction of the directed line segment of OP；
The angle offset relative to Z axis in the direction of described directed line segment needs, as described auxiliary photographic head, the angle that carries out calibrating Degree.
7. according to the method described in claim 4,5 or 6, it is characterised in that described the plurality of middle multi-medium data is entered Row synthesis processes, and generates the step of described second multi-medium data, including:
Obtain the background image of described middle multi-medium data respectively；
Calculate the global alignment parameter of described auxiliary photographic head respectively；
Based on described global alignment parameter, complete the splicing of described middle multi-medium data, generate the second multi-medium data.
Method the most according to claim 1, it is characterised in that described when detecting that user is to described first multi-medium data The amplifieroperation specifying region time, from described second multi-medium data, extract the target many matchmaker corresponding with described appointment region The step of volume data, including:
When detecting that described first multi-medium data is specified the amplifieroperation in region by user, obtain described appointment region pair The positional information answered；
The multi-medium data corresponding with described positional information is extracted, as destination multimedia number from described second multi-medium data According to.
9. according to the method described in claim 1,2,4,5,6 or 8, it is characterised in that described first multi-medium data or described Second multi-medium data includes view data or video data.
10. an electronic equipment, it is characterised in that including:
Multi-medium data acquisition module, for obtaining the first multi-medium data and the second multi-medium data, wherein, described first Multi-medium data is to use main photographic head for the data specifying photographed scene to shoot, and described second multi-medium data is many for using Individual auxiliary photographic head shoots the local scene of described appointment photographed scene respectively, obtain correspondence multiple middle multi-medium data with After, the plurality of middle multi-medium data is carried out the data that split obtains；The optical zoom multiple of described auxiliary photographic head is more than The optical zoom multiple of described main photographic head；
Multi-medium data playing module, for playing what described multi-medium data acquisition module obtained in multimedia play interface First multi-medium data；
Multi-medium data extraction module, for the matchmaker more than first detecting that described multi-medium data playing module is play by user Volume data specify region amplifieroperation time, from described multi-medium data acquisition module obtain the second multi-medium data carry Take the destination multimedia data corresponding with described appointment region；
Destination multimedia data disaply moudle, for showing the destination multimedia number that described multi-medium data extraction module extracts According to.
11. electronic equipments according to claim 10, it is characterised in that the plurality of auxiliary photographic head is arranged in rectangle battle array Row, described main photographic head is outside described rectangular array and adjacent with described rectangular array.
12. according to the electronic equipment described in claim 10 or 11, it is characterised in that described main photographic head is a Zoom Lens Photographic head, described auxiliary photographic head is the photographic head more than a Zoom Lens.
13. electronic equipments according to claim 11, it is characterised in that described electronic equipment also includes:
Focussing module, being used for the Focussing of described main photographic head is 1 Zoom Lens, and respectively by the plurality of auxiliary The Focussing of photographic head is to the optical zoom multiple preset；
Angle calibration system module, in the multiple auxiliary photographic head after adjusting described Focussing module, each auxiliary photographic head is carried out Angular deflection is calibrated；
Taking module, shoots described appointment photographed scene for controlling the main photographic head after described Focussing module adjusts, obtains Obtain the first multi-medium data；And, control the multiple auxiliary photographic head after described angle calibration system modular calibration and shoot described finger respectively Determine the corresponding local scene of photographed scene, it is thus achieved that multiple middle multi-medium datas；
Synthesis module, the multiple middle multi-medium data for being obtained by described taking module carries out synthesis process, generates described Second multi-medium data.
14. electronic equipments according to claim 13, it is characterised in that described angle calibration system module includes:
Data acquisition submodule, for obtaining the preview screen district that described main photographic head gathers for described appointment photographed scene Territory, and, the quantity of described auxiliary photographic head；
Region divides submodule, auxiliary takes the photograph with described for being divided in the preview screen region that described data acquisition submodule obtains The preview screen region, local of the appointment size of the quantity respective amount of picture head；
Region distribution sub module, in the most the plurality of auxiliary photographic head, each auxiliary photographic head distributes the institute of a correspondence position State preview screen region, local；
Calibration submodule, for for each described auxiliary photographic head, described local based on the distribution of described region distribution sub module The center in preview screen region, carries out angular deflection calibration.
15. electronic equipments according to claim 14, it is characterised in that described calibration submodule includes:
Judging unit, for the center in preview screen region, described local based on distribution, it is judged that described auxiliary photographic head is No needs carries out angular deflection calibration；
Diagonal intersection point determines unit, for judging that described auxiliary photographic head needs to carry out angular deflection calibration at described judging unit Time, obtain the diagonal intersection point of described rectangular array, be set as O point；
The center of circle determines unit, for obtaining the camera lens center of circle of auxiliary photographic head the most to be calibrated, is set as P point；
Yawing moment determines unit, for the yawing moment of described auxiliary photographic head is defined as the direction of the directed line segment of OP；
Deflection angle determines unit, auxiliary takes the photograph as described for the angle that the direction of described directed line segment offset relative to Z axis As head needs to carry out the angle calibrated.
16. according to the electronic equipment described in claim 13,14 or 15, it is characterised in that described synthesis module includes:
Background image obtains submodule, for obtaining the background image of described middle multi-medium data respectively；
Global alignment parameter acquiring submodule, for calculating the global alignment parameter of described auxiliary photographic head respectively；
Splicing submodule, for based on described global alignment parameter acquiring submodule calculated global alignment parameter, completes The splicing of described middle multi-medium data, generates the second multi-medium data.
17. electronic equipments according to claim 10, it is characterised in that described multi-medium data extraction module includes:
Position determines submodule, for when detect user to described first multi-medium data specify region amplifieroperation Time, obtain the positional information that described appointment region is corresponding；
Multi-medium data obtains submodule, determines that submodule obtains for extracting from described second multi-medium data with described position The multi-medium data that the positional information that takes is corresponding, as destination multimedia data.
18. according to the electronic equipment described in claim 10,11,13,14,15 or 17, it is characterised in that described first multimedia Data or described second multi-medium data include view data or video data.
CN201610465724.2A 2016-06-21 2016-06-21 A kind of method that multi-medium data shows and electronic equipment Pending CN106131397A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610465724.2A CN106131397A (en) 2016-06-21 2016-06-21 A kind of method that multi-medium data shows and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610465724.2A CN106131397A (en) 2016-06-21 2016-06-21 A kind of method that multi-medium data shows and electronic equipment

Publications (1)

Publication Number Publication Date
CN106131397A true CN106131397A (en) 2016-11-16

Family

ID=57269575

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610465724.2A Pending CN106131397A (en) 2016-06-21 2016-06-21 A kind of method that multi-medium data shows and electronic equipment

Country Status (1)

Country Link
CN (1) CN106131397A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106713772A (en) * 2017-03-31 2017-05-24 维沃移动通信有限公司 Photographing method and mobile terminal
CN106888349A (en) * 2017-03-30 2017-06-23 努比亚技术有限公司 A kind of image pickup method and device
CN107277371A (en) * 2017-07-27 2017-10-20 青岛海信移动通信技术股份有限公司 A kind of method and device in mobile terminal amplification picture region
CN107800961A (en) * 2017-10-17 2018-03-13 珠海市魅族科技有限公司 A kind of lossless amplification picture method and device, terminal and readable storage medium storing program for executing
WO2018099037A1 (en) * 2016-11-29 2018-06-07 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Control method, control device and electronic device
CN108933881A (en) * 2017-05-22 2018-12-04 中兴通讯股份有限公司 A kind of method for processing video frequency and device
CN108965686A (en) * 2017-05-17 2018-12-07 中兴通讯股份有限公司 The method and device taken pictures
CN109327657A (en) * 2018-07-16 2019-02-12 广东小天才科技有限公司 Camera-based shooting question searching method and family education equipment
CN110602392A (en) * 2019-09-03 2019-12-20 Oppo广东移动通信有限公司 Control method, imaging module, electronic device and computer-readable storage medium
CN110944113A (en) * 2019-11-25 2020-03-31 维沃移动通信有限公司 Object display method and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101527828A (en) * 2009-04-14 2009-09-09 深圳华为通信技术有限公司 Image acquisition equipment
CN103986867A (en) * 2014-04-24 2014-08-13 宇龙计算机通信科技(深圳)有限公司 Image shooting terminal and image shooting method
CN104052931A (en) * 2014-06-27 2014-09-17 宇龙计算机通信科技(深圳)有限公司 Image shooting device, method and terminal
CN104601892A (en) * 2015-01-30 2015-05-06 深圳酷派技术有限公司 Terminal and image shooting method and device
CN105323552A (en) * 2015-10-26 2016-02-10 北京时代拓灵科技有限公司 Method and system for playing panoramic video

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101527828A (en) * 2009-04-14 2009-09-09 深圳华为通信技术有限公司 Image acquisition equipment
CN103986867A (en) * 2014-04-24 2014-08-13 宇龙计算机通信科技(深圳)有限公司 Image shooting terminal and image shooting method
CN104052931A (en) * 2014-06-27 2014-09-17 宇龙计算机通信科技(深圳)有限公司 Image shooting device, method and terminal
CN104601892A (en) * 2015-01-30 2015-05-06 深圳酷派技术有限公司 Terminal and image shooting method and device
CN105323552A (en) * 2015-10-26 2016-02-10 北京时代拓灵科技有限公司 Method and system for playing panoramic video

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10412298B2 (en) 2016-11-29 2019-09-10 Guangdong Oppo Mobile Telecommunications Corp, Ltd. Control method, control device and electronic device
WO2018099037A1 (en) * 2016-11-29 2018-06-07 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Control method, control device and electronic device
CN106888349A (en) * 2017-03-30 2017-06-23 努比亚技术有限公司 A kind of image pickup method and device
CN106713772B (en) * 2017-03-31 2018-08-17 维沃移动通信有限公司 A kind of photographic method and mobile terminal
CN106713772A (en) * 2017-03-31 2017-05-24 维沃移动通信有限公司 Photographing method and mobile terminal
CN108965686A (en) * 2017-05-17 2018-12-07 中兴通讯股份有限公司 The method and device taken pictures
CN108965686B (en) * 2017-05-17 2021-11-02 中兴通讯股份有限公司 Photographing method and device
CN108933881A (en) * 2017-05-22 2018-12-04 中兴通讯股份有限公司 A kind of method for processing video frequency and device
CN107277371A (en) * 2017-07-27 2017-10-20 青岛海信移动通信技术股份有限公司 A kind of method and device in mobile terminal amplification picture region
CN107800961A (en) * 2017-10-17 2018-03-13 珠海市魅族科技有限公司 A kind of lossless amplification picture method and device, terminal and readable storage medium storing program for executing
CN109327657A (en) * 2018-07-16 2019-02-12 广东小天才科技有限公司 Camera-based shooting question searching method and family education equipment
CN110602392A (en) * 2019-09-03 2019-12-20 Oppo广东移动通信有限公司 Control method, imaging module, electronic device and computer-readable storage medium
CN110602392B (en) * 2019-09-03 2021-10-01 Oppo广东移动通信有限公司 Control method, imaging module, electronic device and computer-readable storage medium
CN110944113A (en) * 2019-11-25 2020-03-31 维沃移动通信有限公司 Object display method and electronic equipment
CN110944113B (en) * 2019-11-25 2021-04-27 维沃移动通信有限公司 Object display method and electronic equipment

Similar Documents

Publication Publication Date Title
CN106131397A (en) A kind of method that multi-medium data shows and electronic equipment
US9667862B2 (en) Method, system, and computer program product for gamifying the process of obtaining panoramic images
US9723203B1 (en) Method, system, and computer program product for providing a target user interface for capturing panoramic images
US20170064174A1 (en) Image shooting terminal and image shooting method
US10915998B2 (en) Image processing method and device
CN104601892A (en) Terminal and image shooting method and device
US20200154053A1 (en) Camera area locking
CN109691080B (en) Image shooting method and device and terminal
CN105827970B (en) A kind of image processing method and mobile terminal
CN106454086B (en) Image processing method and mobile terminal
CN104427252A (en) Method for synthesizing images and electronic device thereof
CN101729788A (en) Image-taking apparatus, image-taking region displaying method, and image-taking region displaying program
CN104184928A (en) Information processing apparatus, information processing method, and program
CN106161932A (en) A kind of photographic method and mobile terminal
CN107517345A (en) Shooting preview method and capture apparatus
US20220245839A1 (en) Image registration, fusion and shielding detection methods and apparatuses, and electronic device
JP2012019292A (en) Imaging inspection device of 3d camera module and imaging inspection method thereof, imaging inspection control program of 3d camera module, imaging correction method of 3d camera module, imaging correction control program of 3d camera module, readable recording medium, 3d camera module and electronic information apparatus
KR20160111757A (en) Image photographing apparatus and method for photographing thereof
CN106162150A (en) A kind of photographic method and mobile terminal
CN103945116A (en) Apparatus and method for processing image in mobile terminal having camera
US11140327B2 (en) Image-capturing device and method for operating image-capturing system of two cameras
CN103856715A (en) Imaging device and method
CN106101552A (en) A kind of panorama photographic method and mobile terminal
CN104994288A (en) Shooting method and user terminal
CN102023763A (en) Positioning method of touch system camera

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20161116

RJ01 Rejection of invention patent application after publication