CN102638654B - Method, device and equipment for outputting multi-pictures - Google Patents
Method, device and equipment for outputting multi-pictures Download PDFInfo
- Publication number
- CN102638654B CN102638654B CN201210085807.0A CN201210085807A CN102638654B CN 102638654 B CN102638654 B CN 102638654B CN 201210085807 A CN201210085807 A CN 201210085807A CN 102638654 B CN102638654 B CN 102638654B
- Authority
- CN
- China
- Prior art keywords
- focus
- sprite
- sprites
- many pictures
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Circuits (AREA)
- Studio Devices (AREA)
Abstract
An embodiment of the invention discloses a method, a device and equipment for outputting multi-pictures. The method for outputting multi-pictures includes the steps of (1) extracting one or a plurality of focuses from an image taken by a camera and combining the focuses into a focus collection; (2) acquiring a picture window to be output and dividing the picture window into a plurality of sub-pictures; executing appointed times of filling operations which includes selecting an unselected focus from the focus collection, selecting an unfilled sub-picture from a plurality of sub-pictures, extracting the image to acquire a sub-image block which contains at least one unselected focus and is matched with displaying requirements of the selected sub-picture, and filling the sub-image block into the selected sub-picture; and (3) outputting the multi-pictures which consist of a plurality of sub-pictures. Focuses in the picture taken by the camera can be searched automatically, part of the image where the focuses locate is output and transferred to each sub-picture of the multi-pictures, so that each focus in the field can be highlighted and easily observed.
Description
Technical field
The present invention relates to image processing field, especially relate to a kind of method, device and the equipment that export many pictures.
Background technology
When using video camera to take, in scene being shot, comprise the point that multiple needs are paid close attention to sometimes.Such as, student (shown in Figure 1) on classroom, the participant in meeting, sportsman on sports ground etc. can be the points needing to pay close attention to.This point paid close attention to that needs is called focus herein.Problems of the prior art are, because each focus generally only accounts for the very fraction of whole scene, therefore when watching the picture of shooting, the problem that easy generation focus is outstanding, not easily observe, such as, there will be personage's details such as action of expressing one's feelings and be difficult to identification or can not find the situations such as spokesman.
A kind of scheme solved the problem in prior art is: controlled the orientation angles of taking by artificial or camera pan-tilt, make a focus be positioned at the center of shooting picture at every turn, thus this focus is given prominence to.When needs switch focus, then again by the rotation of video camera, another place's focus is made to be positioned at the center of shooting picture.
Inventor is realizing in process of the present invention, finds that the program can only give prominence to a focus at every turn, is difficult to process the scene needing simultaneously to give prominence to multiple focus.
Summary of the invention
The object of the embodiment of the present invention is: provide a kind of method, device and the equipment that export many pictures, can be highlighted to make multiple focus simultaneously.
The invention process provides a kind of method exporting many pictures, and described method comprises:
One or more focuses of shooting are extracted, to form focus set from the image that picture pick-up device obtains;
Obtain picture window to be output and described picture window is divided into some sprites;
Perform the padding of predetermined number of times, described padding comprises: in described focus set, choose a focus do not chosen, a unfilled sprite is chosen in described some sprites, extract in described image and at least comprise selected focus and show with selected sprite the subimage block requiring to match, and described subimage block is filled in selected sprite;
Export the many pictures be made up of described some sprites.
The embodiment of the present invention additionally provides a kind of device exporting many pictures, and described device comprises:
Focus acquiring unit, for extracting one or more focuses of shooting in the image that obtains from picture pick-up device, to form focus set;
Many pictures setting unit, for obtaining picture window to be output and described picture window being divided into some sprites;
Focus chooses unit, for choosing a focus do not chosen in described focus set;
Sprite chooses unit, for choosing a unfilled sprite in described some sprites;
Subimage block extraction unit, at least comprises selected focus for extracting in described image and shows with selected sprite the subimage block requiring to match;
Sprite filler cells, for being filled in selected sprite by described subimage block;
Filling control unit, for choosing unit to described focus, described sprite chooses unit, described subimage block extraction unit and described sprite filler cells carry out calling of predetermined number of times;
Many pictures output unit, for exporting the many pictures be made up of described some sprites.
The embodiment of the present invention additionally provides a kind of image processing equipment, for exporting many pictures, comprising:
Processor: for extracting one or more focuses of shooting in the image that obtains from picture pick-up device, to form focus set; Obtain picture window to be output and described picture window is divided into some sprites; Perform the padding of predetermined number of times, described padding comprises: in described focus set, choose a focus do not chosen, a unfilled sprite is chosen in described some sprites, extract in described image and at least comprise selected focus and show with selected sprite the subimage block requiring to match, and described subimage block is filled in selected sprite; Export the many pictures be made up of described some sprites;
Memory: for storing described focus set.
The method of the embodiment of the present invention, device and equipment, picture window to be output for video camera can be divided into the form of many pictures, and video camera obtain image in automatic search focus, then extract focus place parts of images and output to for viewing in each sprite of many pictures, thus each focus in scene is highlighted simultaneously, be easy to observe.In addition this many picture also can adjust according to the change of each focus automatically.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Schematic diagram when Fig. 1 is video camera shooting classroom scene;
Fig. 2 is the flow chart of one embodiment of the invention method;
Fig. 3 is a kind of layout pattern schematic diagram of many pictures in one embodiment of the invention;
Fig. 4 is the schematic diagram that the focus sprite obtained according to three kinds of algorithms in one embodiment of the invention carries out filling;
Fig. 5 is the flow chart of another embodiment of the present invention method;
Fig. 6 is the schematic diagram of further embodiment of this invention device;
Fig. 7 is the schematic diagram of yet another embodiment of the invention equipment.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Fig. 2 is the flow chart of one embodiment of the invention method.In embodiments of the present invention, described method is used for picture pick-up device, and picture pick-up device refers to video camera.Be understandable that, picture pick-up device can also be camera, mobile phone, the first-class all kinds of instrument and equipment with camera function of shooting in other embodiments of the present invention.In addition, in other embodiments of the present invention, described method can also be used for non-picture pick-up device, and as image processing equipment, described non-picture pick-up device is connected with picture pick-up device and receives the image that described picture pick-up device obtains.For the equipment used for described method, the embodiment of the present invention does not limit.Also need to do some basic preparations before this external use embodiment of the present invention method, such as pass through the button on click video camera or select in graphical user interfaces, to open many pictures output mode or to be switched to many pictures output mode from common output mode.
The method of the embodiment of the present invention comprises following step:
S201: the one or more focuses extracting shooting from the image that picture pick-up device obtains, to form focus set.One frame (or being called a width) image exports from absorption video camera to eventually to the external world, in video camera internal processes, links may exist with the form of (or claiming interim) processing result image in the middle of corresponding (certainly have may at last one group of signal and can not image be called).Can in these between select a width as the image obtaining focus in image and the last image exported.Specifically focus acquisition is carried out to the image of video camera inside AD/DA (analog-to-digital conversion/digital-to-analogue conversion) module output element in embodiments of the present invention.Below the image that described picture pick-up device obtains is called original image or described image.
After obtaining original image, focus can be identified according to any one prior art or algorithm from original image.Preferably can obtain one or more focus, to form focus set according to sound to the algorithm of locating, the algorithm of motion detection and/or the algorithm of recognition of face.Such as sound is the MIC (Microphone of multiple sensing shooting area that is built-in by video camera or that be connected with video camera to location algorithm, microphone) collect on-the-spot sound, the orientation angle according to the size of collected sound, frequency and each MIC can calculate the sound source number in raw frames and record the position coordinates (x of each sound source in raw frames
1, y
1), (x
2, y
2) ....Focus can be obtained according to the one in these three kinds of algorithms to form focus set, the multiple focus that obtains wherein also can be used simultaneously to form focus set.Multiple focus may be had in described focus set, also may only have a focus.Certainly, the focus of the repetition that various algorithm obtains preferably also should be rejected in focus set.
In addition, the embodiment of the present invention mainly describes the situation automatically identifying focus, be understandable that, in other embodiments of the present invention, focus can also mode manually obtain, such as, click certain point in original image on the touchscreen, then join in focus set using this o'clock as the focus that is manually specified, to this, the embodiment of the present invention does not limit.
S202: obtain picture window to be output and described picture window is divided into some sprites, becomes many pictures to make described picture window.In embodiments of the present invention, if the resolution of video camera original image is w × h, set the resolution of output signal as W × H simultaneously, for the ease of understanding and describing, be that the output signal of W × H is called picture window to be output herein by this resolution, therefore picture window resolution to be output and W × H, and the process of the data in this output signal being carried out resetting just is equivalent to carry out cutting to picture window to be output.
(or claim cutting) is divided to obtain multiple sprite thus the cutting method forming many pictures can comprise two kinds to picture window to be output: one is manual type, the layout of namely specifying according to user divides, another kind is automated manner, namely automatically divides according to the focus number obtained.In embodiments of the present invention, the layout of preferentially specifying by user divides, and when user does not specify, enables automated manner to divide.
When being divided by manual type, the concrete steps of S202 can be: obtain the layout pattern of specifying, according to described layout pattern, described picture window is divided into some sprites.Such as can user be allowed to input sprite number in video camera UI interface, picture window to be output be divided equally by the number according to sprite; Also user can be allowed from pre-configured many picture layout pattern to select one, then picture window to be output is divided into the layout pattern that user selects; User even can also be allowed in the picture window to be output of one piece of simulation to carry out any specified layout pattern by adding the form splitting line, and to this, the embodiment of the present invention does not limit.Wherein a kind of layout pattern can be shown in Figure 3, and in Fig. 3, CP1, CP2... etc. number each sprite represented in a picture window to be output, and its size (in units of pixel) is respectively W
cp1× H
cp1, W
cp2× H
cp2..., and W
cp1× H
cp1+ W
cp2× H
cp2+ ...=W × H.Certainly, in other embodiments of the present invention, CP1, CP2 etc. may not be the situation of just filling up picture window, i.e. W
cp1× H
cp1+ W
cp2× H
cp2+ ... can W × H be less than, now the vacant position in picture window be filled out black.The numbering principle of sprite can be: the numbering taking breadth larger in (1) picture is less; (2) numbering more close to center in picture is less.
When being divided by automated manner, the concrete steps of S202 can be: obtain one according to the focus number in described focus set and specify integer; According to described appointment integer, equal divisional processing is carried out to described picture window, to obtain some sprites.Preferably, described appointment integer is specially the number being more than or equal to focus in described focus set and the smallest positive integral that can extract square root: can circulate from 1, step-length is+1, each power once, the integer c obtained and focus number n is compared, if this integer c is less than focus number n, continues circulation, if this integer c is more than or equal to focus number n, exit circulation, and c is described appointment integer, now each sprite will be all same size W
cp× H
cp, namely
suppose that focus is 7, so can be regarded as c is 9, be divided into 3 × 3 pieces, then 7 focuses inserted 7 sprites respectively by picture window to be output, 2 vacant sprites are filled out black.In addition, described appointment integer can also be a minimum non-prime integer being more than or equal to focus number, is now the product of two immediate integers by this Integer Decomposition, then divides equally described picture window by these two immediate integers.Such as focus number is 11, then find an integer 12,12 to can be analyzed to 3 × 4, so described picture window can be divided into 3 × 4 sprites.
Select the implementation automatically divided if it should be noted that, then S202 needs after S201, if if but the implementation of selection artificial division, then S202 can before or after S201.
S203: the padding performing predetermined number of times, described padding comprises: in described focus set, choose a focus do not chosen, a unfilled sprite is chosen in described some sprites, extract in described image and at least comprise selected focus and show with selected sprite the subimage block requiring to match, and described subimage block is filled in selected sprite.Preferably, described predetermined number of times specifically can be determined according to the one in following several numerical value: the focus number in the sprite quantity in described some sprites, described focus set, the numerical value of specifying.In other words, because sprite or focus generally have multiple, all above padding can be carried out repeatedly, until all sprites all complete, or the focus in focus set has all been selected, or reach the number of times of miscellaneous stipulations, or reach number of times that user specifies and stop.
Preferably, when choosing a unfilled sprite in S203 in described some sprites, can choose in the following order: according to taking the higher rule of the larger sprite priority of breadth, or according to more close to the rule that the priority of the sprite of center is higher, for each sprite arranges priority; Then in described some sprites, a unfilled sprite is chosen according to sprite priority order from high to low.
Preferably, choose in described focus set in S203 one do not choose focus time, can choose in the following order: first the focus obtained by algorithms of different in focus set is returned in different queues, as being placed on sound in positioning of focal queue by by sound to the focus that location algorithm obtains, then focus sequence is chosen according to sound to the large order of location > motion detection > recognition of face, again by the time order and function obtained or this focus queue of little order traversal such as focus and original image centre distance size in each focus queue, selected focus is judged whether in many pictures when traveling through, if do not existed, focus is inserted selected sprite, if, get next focus, if queue arrives tail of the queue, next queue is then selected to proceed traversal, until get a focus not in many pictures.In addition, that also can determine focus as follows chooses order: repeatedly obtain focus set at multiple time point, then add up, obtain the active degree of focus, the priority of focus large for active degree is decided to be height, then according to priority chooses focus from high to low.
More than select the relevant configuration information of the order of the order of focus and/or chooser picture can be stored in advance in the internal memory of video camera, for user.Can certainly be defined by user oneself and select the order of focus and/or the order of chooser picture.In addition, in other embodiments of the present invention, focus choose and/or sprite choose also can be do not have sequential, such as can the focus do not chosen of random selecting one and a unfilled sprite, then the subimage block at selected focus place is inserted in selected sprite.
If after all focuses are filled into many pictures all successively, remain unfilled sprite in addition, then residue sprite can be carried out filling out black process.If after all sprites are all filled, in focus set, also have residue focus not insert, then residue focus can be ignored.
In addition, in embodiments of the present invention, be the empty sprite of first according to priority selective sequential one and then go to fill by way selection focus be not included in many pictures of traversal, namely first select sprite to select focus more in brief.In other embodiments of the present invention, can also be first select focus to select sprite again, the sequencing of the two be not unique, and to this, the embodiment of the present invention does not limit.
Preferably, extract in S203 at least to comprise selected focus and show with selected sprite in described image and require that the step of the subimage block matched specifically can comprise:
S2031: the size of scaling coefficient to selected sprite according to specifying reduces process, to obtain size to be intercepted.
S2032: intercept parts of images around selected focus according to described size to be intercepted in described image.
S2033: amplification process is carried out, to obtain subimage block to described parts of images according to described scaling coefficient of specifying.
If the size of sprite to be filled is W
cp× H
cp, the method that the focus just obtained according to three kinds of focus acquisition algorithms respectively below carries out filling carries out specifically describing:
If by the focus selected be the focus found by motion detection algorithm, then can: first determine a scaling coefficient L, L can be empirical value, also can be specified by user, can obtain reasonable observing effect after amplifying L times respectively to make the wide height of the following parts of images intercepted.Exactly because also need the wide height of the parts of images of intercepting to amplify respectively L doubly after fill, therefore calculate the wide height of parts of images that intercepts should be respectively accordingly
with
with the coordinate (x having the position at moving displacement place that namely focus detects
b, y
b) centered by, with
as top left co-ordinate, with
as lower right corner coordinate, in original image, intercept a wide height be respectively
with
parts of images (for rectangle).And then by interpolation amplification algorithm, the wide high ratio of the parts of images of described intercepting is amplified L doubly, obtains a subimage block, just in time can insert W
cp× H
cpsprite in.
If be the focus found to location algorithm by sound by the focus selected, then the step and the motion detection that intercept subimage block are similar, that is: first determine a scaling coefficient M, the coordinate (x of the position of the determination sound source then namely detected with focus
c, y
c) centered by, with
as top left co-ordinate, with
as lower right corner coordinate, in original image, intercept a wide height be respectively
with
parts of images, and then by interpolation amplification algorithm, wide high than amplifying M doubly by the parts of images of described intercepting, just in time can insert W
cp× H
cpsprite in.
If by the focus selected be the focus found by face recognition algorithms, the step then intercepting subimage block can locate with the sound and motion detection algorithm similar, namely wide high than intercepting one subimage block centered by focal coordinates, by selected sprite, and then amplify and fill.But also can do some optimization processes according to the characteristic of face: because the face focus detected is often a face rectangular block, so preferentially subimage block can be intercepted in the ratio of face rectangular block, and then by the mode of transverse direction or longitudinal compensation, the wide height of subimage block is become the wide high ratio with selected sprite, insert in selected sprite after finally subimage block geometric ratio being amplified.If selected scaling coefficient is K, then the wide height of parts of images to be intercepted should be distinguished
with
set again the ratio of width to height of face rectangular block as
and the center point coordinate of face rectangular block is (xa, ya).Will
with
compare: if
explanation enlargement ratio is
and high direction need compensate, then with
As top left co-ordinate, with
As lower right corner coordinate, in original image intercept a wide height be respectively Km and
parts of images, then by interpolation amplification algorithm, wide high than amplifying by the parts of images of described intercepting
doubly, then just in time W can be inserted
cp× H
cpsprite in.If
explanation enlargement ratio is
and cross direction need compensate, then with
as top left co-ordinate, with
as lower right corner coordinate, in original image, intercept a wide height be respectively
with the parts of images of Kn, and then by interpolation amplification algorithm, the wide high ratio of the parts of images of described intercepting is amplified
doubly, then just in time W can be inserted
cp× H
cpsprite in.Fig. 4 is the schematic diagram being carried out filling by the focus sprite obtained according to above three kinds of algorithms.
It should be noted that, in embodiments of the present invention, be all go out a less size by the Size calculation of selected sprite in original image, then according to this less size cut parts of images, geometric ratio is filled in selected sprite after amplifying.Such as, and in other embodiments of the present invention, the extracting at least to comprise selected focus and show with selected sprite in described image of S203 requires that the step of the subimage block matched can also be specifically other situations, comprises the following steps:
S2031 ': read size to be intercepted that is preset or input.Namely need not calculate size to be intercepted, but direct reading system is preset or a value of user's input.
S2032 ': intercept parts of images around selected focus according to described size to be intercepted in described image.
S2033 ': amplification process is carried out, to obtain subimage block to described parts of images according to described scaling coefficient of specifying.If such as selected sprite is larger, when then being amplified by the parts of images of intercepted fixed dimension, its amplification coefficient is just corresponding larger, otherwise, if selected sprite is comparatively large, if its amplification coefficient is just corresponding comparatively large when then being amplified by the parts of images of intercepted fixed dimension.Certainly, if this sprite is not filled complete after filling, then vacant position is filled out black.
Again such as, the parts of images of intercepting can not carry out amplifying and directly inserting in sprite, is also to play the object that focus become be easy to observe, reach outstanding focus.
Also such as, the partial original image at whole original image or multiple focus place can be chosen, be filled in a sprite after then being reduced, can panorama be taken into account to make user while each focus of observation.
S204: export the many pictures be made up of described some sprites.Described output may be export directly to the external world, and such as outputting to monitor or memory device etc., also may be next processing links outputting to video camera inside, concrete relevant to selected original image.
It should be noted that in addition, above step is all the process carried out a frame or title piece image, be understandable that, when after the information such as the position size getting subimage block, later each two field picture no longer can carry out the steps such as focus acquisition but the information extraction subimage blocks such as the position size of the direct subimage block according to obtaining in the past continue to fill many pictures, thus forms video flowing.
In addition, preferably, following step of updating can also be comprised after step S204:
According to the new image that described picture pick-up device obtains, upgrade described focus set, and according to the focus set after renewal, the subimage block that each sprite in described many pictures is filled is upgraded.In the scene being shot had, focus may can not change, and now only need obtain a secondary focal point set when initial; And focus may change to some extent in the scene had, the position of the focus of walking about or disappearing and causing of such as spokesman changes or disappears, and now can also re-start to fill to many pictures to upgrade in other words conj.or perhaps.Described renewal can be real-time, such as all carry out focus to every two field picture to obtain to obtain up-to-date focus set, and the subimage block new according to new focus set extract real-time carries out filling (or perhaps upgrading the subimage block that each sprite fills); Described renewal also can be regular, such as, carry out a secondary focal point acquisition to the image of present frame at set intervals, to upgrade focus set, and extracts new subimage block according to new focus set and fills.
Upgrade the step of described focus set with S201 step is similar above, such as: first use face recognition algorithms to regain some face focuses, then travel through the face focus queue in focus set and compare with the some face focuses regained, if there is newly-increased face focus, then add in the queue of face focus, if some focuses disappear, it is deleted from face queue.Use motion detection and sound to location algorithm upgrade the method for corresponding focus queue and above recognition of face similar, repeat no more herein.
The step upgraded the subimage block that each sprite in described many pictures is filled according to the focus set after upgrading is with S203 step is similar above, such as: from many pictures, choose a sprite according to the first order and from focus set, choose a focus according to the second order, then judge whether the coordinate of selected focus is included in the scope of the subimage block in selected sprite, if then continue to choose next focus, then subimage block corresponding for this focus is filled in selected sprite if not.
In addition, preferably, if the number of focus changes in the focus set after upgrading, then can also comprise in above-mentioned step of updating: the change according to focus number in the focus set after described renewal adjusts the layout pattern of sprite in described many pictures.In other words, if find after upgrading, the number of focus has become, then can adjust many pictures neutron picture layout pattern, and opportunity of described adjustment can be real-time also can be regular, and adjusting method used can be similar with step S202.Such as, many pictures of 16 sprite compositions if current, and after upgrading focus set, find that unduplicated focus number becomes 12, then adjustment exports automatically is many pictures that 12 sprites form, the size of sprite also adjusts accordingly simultaneously, can be fully exploited to make whole picture window to be output; In like manner, be many pictures of 12 sprite compositions if current, and find after upgrading focus set that unduplicated focus number becomes 16, then adjustment exports automatically is many pictures that 16 sprites form, and the size of sprite also adjusts accordingly.
By the method in the embodiment of the present invention, picture window to be output for video camera can be divided into the form of many pictures, and video camera obtain image in automatic search focus, then extract focus place parts of images and output to for viewing in each sprite of many pictures, thus each focus in scene is highlighted simultaneously, be easy to observe.In addition this many picture also can adjust according to the change of each focus automatically.
Fig. 5 is the flow chart of another embodiment of the present invention method, in video camera, comprises the following steps:
S501: the Sensor movement sampling in video camera;
S502:AD conversion, quantification, coding composition one frame original image;
S503: judge whether to open many image modes, if open, enter S504, if do not open, jumps directly to S519 and exports;
S504: obtain focus set in raw frames.Namely in raw frames, one or more focuses of shooting are extracted, to form focus set;
S505: judge the configuration information that whether there is many picture layout pattern in internal memory, if exist, enters S506, if do not exist, enters S507;
S506: read configuration information, and enter S508;
S507: according to the automatic segmentation of focus number, and enter S508;
S508: according to configuration information or automatic segmentation, determines many picture layout pattern;
S509: judge whether many pictures fill up, if then enter S517, then enter S510 if not;
S510: obtain the n-th sprite according to the first appointment order from many pictures;
S511: travel through according to the focus in the second appointment order focusing set;
S512: judge current selected focus whether in many pictures, if then carry out operation S511, then enter S513 if not;
S513: the parts of images intercepting this focal position from original image;
S514: carry out uniform zoom;
S515: insert in the n-th sprite;
S516: make n increase progressively 1, and continue to perform S509;
S517: export.
By the method in the embodiment of the present invention, picture window to be output for video camera can be divided into the form of many pictures, and video camera obtain image in automatic search focus, then extract focus place parts of images and output to for viewing in each sprite of many pictures, thus each focus in scene is highlighted simultaneously, be easy to observe.
Fig. 6 is the schematic diagram of further embodiment of this invention device, and described device comprises:
Focus acquiring unit 601, for extracting one or more focuses of shooting in the image that obtains from picture pick-up device, to form focus set;
Many pictures setting unit 602, for obtaining picture window to be output and described picture window being divided into some sprites;
Focus chooses unit 603, for choosing a focus do not chosen in described focus set;
Sprite chooses unit 604, for choosing a unfilled sprite in described some sprites;
Subimage block extraction unit 605, at least comprises selected focus for extracting in described image and shows with selected sprite the subimage block requiring to match;
Sprite filler cells 606, for being filled in selected sprite by described subimage block;
Filling control unit 607, for choosing unit to described focus, described sprite chooses unit, described subimage block extraction unit and described sprite filler cells carry out calling of predetermined number of times;
Many pictures output unit 608, for exporting the many pictures be made up of described some sprites.
Preferably, described subimage block extraction unit 605 specifically comprises:
Size reduces subelement, for reducing process according to the size of scaling coefficient to selected sprite of specifying, to obtain size to be intercepted;
Image interception subelement, for intercepting parts of images around selected focus according to described size to be intercepted in described image;
Nonlinear magnify subelement, for carrying out amplification process, to obtain subimage block according to described scaling coefficient of specifying to described parts of images.
Preferably, described subimage block extraction unit 605 specifically comprises:
Size obtains subelement, for reading size to be intercepted that is preset or input;
Image interception subelement, for intercepting parts of images around selected focus according to described size to be intercepted in described image;
Nonlinear magnify subelement, carries out amplification process, to obtain subimage block for the size according to selected sprite to described parts of images.
Preferably, described many pictures setting unit 602 specifically comprises:
Sprite number obtains subelement, for determining an appointment integer according to the focus number in described focus set;
Picture window cutting subelement, for obtaining picture window to be output and carrying out equal divisional processing according to described appointment integer to described picture window, becomes many pictures to make described picture window.
Preferably, described many pictures setting unit 602 specifically comprises:
Layout pattern obtains subelement, for obtaining the layout pattern of specifying;
Picture window cutting subelement, for obtaining picture window to be output and according to described layout pattern, described picture window being divided into some sprites, becomes many pictures to make described picture window.
Preferably, described device also comprises:
Updating block, for focus set acquiring unit described in the new image notification that obtains according to described picture pick-up device, described focus set is upgraded, and notify that described filling control unit upgrades the subimage block that each sprite in described many pictures is filled according to the focus set after upgrading.
Preferably, described updating block also adjusts for the division of many pictures setting unit to described picture window according to the change notification of focus number in the focus set after described renewal.
By the device in the embodiment of the present invention, picture window to be output for video camera can be divided into the form of many pictures, and video camera obtain image in automatic search focus, then extract focus place parts of images and output to for viewing in each sprite of many pictures, thus each focus in scene is highlighted simultaneously, be easy to observe.In addition this many picture also can adjust according to the change of each focus automatically.
Fig. 7 is the schematic diagram of yet another embodiment of the invention image processing equipment, for exporting many pictures, comprising:
Processor 701: for extracting one or more focuses of shooting in the image that obtains from picture pick-up device, to form focus set; Obtain picture window to be output and described picture window is divided into some sprites; Perform the padding of predetermined number of times, described padding comprises: in described focus set, choose a focus do not chosen, a unfilled sprite is chosen in described some sprites, extract in described image and at least comprise selected focus and show with selected sprite the subimage block requiring to match, and described subimage block is filled in selected sprite; Export the many pictures be made up of described some sprites;
Memory 702: for storing described focus set.
For apparatus embodiments, because it is substantially similar to embodiment of the method, so description is fairly simple, relevant part illustrates see the part of embodiment of the method.
By the image processing equipment in the embodiment of the present invention, picture window to be output can be divided into the form of many pictures, and video camera obtain image in automatic search focus, then extract focus place parts of images and output to for viewing in each sprite of many pictures, thus each focus in scene is highlighted simultaneously, be easy to observe.
It should be noted that, in this article, the such as relational terms of first and second grades and so on is only used for an entity or operation to separate with another entity or operating space, and not necessarily requires or imply the relation that there is any this reality between these entities or operation or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment comprising described key element and also there is other identical element.
One of ordinary skill in the art will appreciate that all or part of step realized in said method execution mode is that the hardware that can carry out instruction relevant by program has come, described program can be stored in computer read/write memory medium, here the alleged storage medium obtained, as: ROM/RAM, magnetic disc, CD etc.
The foregoing is only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.All any amendments done within the spirit and principles in the present invention, equivalent replacement, improvement etc., be all included in protection scope of the present invention.
Claims (16)
1. export a method for many pictures, it is characterized in that, described method comprises:
One or more focuses of shooting are extracted, to form focus set from the two field picture that picture pick-up device obtains;
Obtain picture window to be output and described picture window is divided into some sprites;
Perform the padding of predetermined number of times, described padding comprises: automatically in described focus set, choose a focus do not chosen, a unfilled sprite is chosen in described some sprites, extract in described image and at least comprise selected focus and show with selected sprite the subimage block requiring to match, and described subimage block is filled in selected sprite;
Export the many pictures be made up of described some sprites;
Wherein, in described some sprite, choose the step of a unfilled sprite, specifically comprise:
According to taking the higher rule of the larger sprite priority of breadth, or according to more close to the rule that the priority of the sprite of center is higher, for each sprite arranges priority;
In described some sprites, a unfilled sprite is chosen according to sprite priority order from high to low.
2. method according to claim 1, is characterized in that, extracts at least to comprise selected focus and show with selected sprite to require that the step of the subimage block matched specifically comprises in described image:
The size of scaling coefficient to selected sprite according to specifying reduces process, to obtain size to be intercepted;
In described image, parts of images is intercepted around selected focus according to described size to be intercepted;
According to described scaling coefficient of specifying, amplification process is carried out, to obtain subimage block to described parts of images.
3. method according to claim 1, is characterized in that, extracts at least to comprise selected focus and show with selected sprite to require that the step of the subimage block matched specifically comprises in described image:
Read size to be intercepted that is preset or input;
In described image, parts of images is intercepted around selected focus according to described size to be intercepted;
Size according to selected sprite carries out amplification process, to obtain subimage block to described parts of images.
4. method according to claim 1, is characterized in that, described predetermined number of times specifically can be determined according to the one in following several numerical value: the focus number in the sprite quantity in described some sprites, described focus set, the numerical value of specifying.
5. method according to claim 1, is characterized in that, described picture window is divided into the step of some sprites, specifically comprises:
An appointment integer is determined according to the focus number in described focus set;
According to described appointment integer, equal divisional processing is carried out to described picture window, to obtain some sprites.
6. method according to claim 1, is characterized in that, described picture window is divided into the step of some sprites, specifically comprises:
Obtain the layout pattern of specifying, according to described layout pattern, described picture window is divided into some sprites.
7. the method according to any one of claim 1 to 6, is characterized in that, also comprises after exporting the step of the many pictures be made up of described some sprites:
According to the new image that described picture pick-up device obtains, upgrade described focus set, and according to the focus set after renewal, the subimage block that each sprite in described many pictures is filled is upgraded.
8. method according to claim 7, is characterized in that, if the number of focus changes in the focus set after described renewal, then also comprises:
Change according to focus number in the focus set after described renewal adjusts the layout pattern of sprite in described many pictures.
9. export a device for many pictures, it is characterized in that, described device comprises:
Focus acquiring unit, for extracting one or more focuses of shooting in the two field picture that obtains from picture pick-up device, to form focus set;
Many pictures setting unit, for obtaining picture window to be output and described picture window being divided into some sprites;
Focus chooses unit, chooses a focus do not chosen for automatic in described focus set;
Sprite chooses unit, for choosing a unfilled sprite in described some sprites;
Subimage block extraction unit, at least comprises selected focus for extracting in described image and shows with selected sprite the subimage block requiring to match;
Sprite filler cells, for being filled in selected sprite by described subimage block;
Filling control unit, for choosing unit to described focus, described sprite chooses unit, described subimage block extraction unit and described sprite filler cells carry out calling of predetermined number of times;
Many pictures output unit, for exporting the many pictures be made up of described some sprites;
Wherein, described sprite is chosen in unit, chooses a unfilled sprite, specifically comprise in described some sprites:
According to taking the higher rule of the larger sprite priority of breadth, or according to more close to the rule that the priority of the sprite of center is higher, for each sprite arranges priority.
10. device according to claim 9, is characterized in that, described subimage block extraction unit specifically comprises:
Size reduces subelement, for reducing process according to the size of scaling coefficient to selected sprite of specifying, to obtain size to be intercepted;
Image interception subelement, for intercepting parts of images around selected focus according to described size to be intercepted in described image;
Nonlinear magnify subelement, for carrying out amplification process, to obtain subimage block according to described scaling coefficient of specifying to described parts of images.
11. devices according to claim 9, is characterized in that, described subimage block extraction unit specifically comprises:
Size obtains subelement, for reading size to be intercepted that is preset or input;
Image interception subelement, for intercepting parts of images around selected focus according to described size to be intercepted in described image;
Nonlinear magnify subelement, carries out amplification process, to obtain subimage block for the size according to selected sprite to described parts of images.
12. devices according to claim 9, is characterized in that, described many pictures setting unit specifically comprises:
Sprite number obtains subelement, for determining an appointment integer according to the focus number in described focus set;
Picture window cutting subelement, for obtaining picture window to be output and carrying out equal divisional processing according to described appointment integer to described picture window, becomes many pictures to make described picture window.
13. devices according to claim 9, is characterized in that, described many pictures setting unit specifically comprises:
Layout pattern obtains subelement, for obtaining the layout pattern of specifying;
Picture window cutting subelement, for obtaining picture window to be output and according to described layout pattern, described picture window being divided into some sprites, becomes many pictures to make described picture window.
14. devices according to any one of claim 9 to 13, it is characterized in that, described device also comprises:
Updating block, for focus acquiring unit described in the new image notification that obtains according to described picture pick-up device, described focus set is upgraded, and notify that described filling control unit upgrades the subimage block that each sprite in described many pictures is filled according to the focus set after upgrading.
15. devices according to claim 14, is characterized in that, described updating block also adjusts for the division of many pictures setting unit to described picture window according to the change notification of focus number in the focus set after described renewal.
16. 1 kinds of image processing equipments, is characterized in that, for exporting many pictures, comprising:
Processor: for extracting one or more focuses of shooting in the image that obtains from picture pick-up device, to form focus set; Obtain picture window to be output and described picture window is divided into some sprites; Perform the padding of predetermined number of times, described padding comprises: automatically in described focus set, choose a focus do not chosen, a unfilled sprite is chosen in described some sprites, extract in described image and at least comprise selected focus and show with selected sprite the subimage block requiring to match, and described subimage block is filled in selected sprite; Export the many pictures be made up of described some sprites;
Memory: for storing described focus set;
Wherein, in described some sprite, choose the step of a unfilled sprite, specifically comprise:
According to taking the higher rule of the larger sprite priority of breadth, or according to more close to the rule that the priority of the sprite of center is higher, for each sprite arranges priority;
In described some sprites, a unfilled sprite is chosen according to sprite priority order from high to low.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210085807.0A CN102638654B (en) | 2012-03-28 | 2012-03-28 | Method, device and equipment for outputting multi-pictures |
| PCT/CN2013/073315 WO2013143468A1 (en) | 2012-03-28 | 2013-03-28 | Multi-picture output method, apparatus and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210085807.0A CN102638654B (en) | 2012-03-28 | 2012-03-28 | Method, device and equipment for outputting multi-pictures |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102638654A CN102638654A (en) | 2012-08-15 |
| CN102638654B true CN102638654B (en) | 2015-03-25 |
Family
ID=46622880
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210085807.0A Active CN102638654B (en) | 2012-03-28 | 2012-03-28 | Method, device and equipment for outputting multi-pictures |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102638654B (en) |
| WO (1) | WO2013143468A1 (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102638654B (en) * | 2012-03-28 | 2015-03-25 | 华为技术有限公司 | Method, device and equipment for outputting multi-pictures |
| CN103685907B (en) * | 2012-09-26 | 2019-04-05 | 联想(北京)有限公司 | A kind of method and electronic equipment of Image Acquisition |
| CN105323477A (en) * | 2013-08-01 | 2016-02-10 | 华为终端有限公司 | Photographing method and device |
| JP6362433B2 (en) * | 2014-06-04 | 2018-07-25 | キヤノン株式会社 | Image processing apparatus, control method therefor, and program |
| CN105827928A (en) * | 2015-01-05 | 2016-08-03 | 中兴通讯股份有限公司 | Focusing area selection method and focusing area selection device |
| CN107333144A (en) * | 2016-04-28 | 2017-11-07 | 深圳锐取信息技术股份有限公司 | Multichannel picture display process and device based on football race broadcast relay system |
| CN106022307B (en) * | 2016-06-08 | 2019-09-27 | 中国科学院自动化研究所 | Remote sensing images ship detection method based on ship rotation rectangular space |
| CN106101857B (en) * | 2016-06-16 | 2019-07-19 | 华为技术有限公司 | A kind of display methods and device of video pictures |
| CN106331653B (en) * | 2016-09-29 | 2020-01-14 | 浙江宇视科技有限公司 | Method and device for positioning sub-picture display area of panoramic camera |
| CN106454089A (en) * | 2016-10-08 | 2017-02-22 | 广东小天才科技有限公司 | Photographing reminding method and device for camera |
| CN108270989A (en) * | 2016-12-30 | 2018-07-10 | 中移（杭州）信息技术有限公司 | A kind of method of video image processing and device |
| CN110611732B (en) * | 2018-06-15 | 2021-09-03 | Oppo广东移动通信有限公司 | Window control method and related product |
| CN110032701B (en) * | 2019-04-04 | 2021-07-09 | 网易（杭州）网络有限公司 | Image display control method and device, storage medium and electronic equipment |
| CN110996138B (en) * | 2019-12-17 | 2021-02-05 | 腾讯科技（深圳）有限公司 | Video annotation method, device and storage medium |
| US11678029B2 (en) | 2019-12-17 | 2023-06-13 | Tencent Technology (Shenzhen) Company Limited | Video labeling method and apparatus, device, and computer-readable storage medium |
| CN112040249A (en) * | 2020-08-11 | 2020-12-04 | 浙江大华技术股份有限公司 | Recording and broadcasting method and device and single camera |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001333422A (en) * | 2000-05-19 | 2001-11-30 | Matsushita Electric Ind Co Ltd | Monitoring device |
| CN1476242A (en) * | 2002-07-23 | 2004-02-18 | ������������ʽ���� | Display system, network answering display device, terminal apparatus and controlling program |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1073270A1 (en) * | 1999-07-30 | 2001-01-31 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for navigation through multimedia presentations |
| TWI276357B (en) * | 2002-09-17 | 2007-03-11 | Ginganet Corp | Image input apparatus for sign language talk, image input/output apparatus for sign language talk, and system for sign language translation |
| JP4431547B2 (en) * | 2006-04-14 | 2010-03-17 | 富士フイルム株式会社 | Image display control device, control method therefor, and control program therefor |
| CN101072332A (en) * | 2007-06-04 | 2007-11-14 | 深圳市融合视讯科技有限公司 | Automatic mobile target tracking and shooting method |
| CN101420534B (en) * | 2008-11-07 | 2011-02-02 | 华为终端有限公司 | Multiple image display method and apparatus |
| CN101605236B (en) * | 2009-07-10 | 2011-07-20 | 杭州华三通信技术有限公司 | Method for controlling remote camera in multi-frame session and multipoint control unit |
| CN102638654B (en) * | 2012-03-28 | 2015-03-25 | 华为技术有限公司 | Method, device and equipment for outputting multi-pictures |
-
2012
- 2012-03-28 CN CN201210085807.0A patent/CN102638654B/en active Active
-
2013
- 2013-03-28 WO PCT/CN2013/073315 patent/WO2013143468A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001333422A (en) * | 2000-05-19 | 2001-11-30 | Matsushita Electric Ind Co Ltd | Monitoring device |
| CN1476242A (en) * | 2002-07-23 | 2004-02-18 | ������������ʽ���� | Display system, network answering display device, terminal apparatus and controlling program |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2013143468A1 (en) | 2013-10-03 |
| CN102638654A (en) | 2012-08-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102638654B (en) | Method, device and equipment for outputting multi-pictures | |
| CN106170101B (en) | Contents providing system, information processing equipment and content reproducing method | |
| CN107481190B (en) | A kind of image processing method and device | |
| CN105320695B (en) | Picture processing method and device | |
| CN109690620A (en) | Threedimensional model generating means and threedimensional model generation method | |
| US8994785B2 (en) | Method for generating video data and image photographing device thereof | |
| CN105828090A (en) | Panorama live broadcasting method and device | |
| CN101872243B (en) | System and method for realizing 360-degree panoramic play following real space direction | |
| CN104038690A (en) | IMAGE PROCESSING APPARATUS, IMAGE CAPTURING APPARATUS, and IMAGE PROCESSING METHOD | |
| JP5615023B2 (en) | Display control apparatus and display control method | |
| US20210044793A1 (en) | Generation method for generating free viewpoint image, display method for displaying free viewpoint image, free viewpoint image generation device, and display device | |
| EP3306565A1 (en) | Entity visualization method | |
| JP2013009274A (en) | Image processing device, image processing method, and program | |
| CN105005960A (en) | Method, apparatus and system for obtaining watermarking picture | |
| KR20150106879A (en) | Method and apparatus for adding annotations to a plenoptic light field | |
| CN113242392A (en) | Short video production method | |
| EP3496042A1 (en) | System and method for generating training images | |
| Parker et al. | Data visualisation trends in mobile augmented reality applications | |
| CN115953504A (en) | Special effect processing method and device, electronic equipment and storage medium | |
| CN105867615A (en) | Information processing method and electronic device | |
| CN114390205B (en) | Shooting method and device and electronic equipment | |
| CN110148086A (en) | The depth polishing method, apparatus and three-dimensional rebuilding method of sparse depth figure, device | |
| KR100948101B1 (en) | System for extracting space information of change region using multi linkage of stereo viewer about time series images | |
| KR100897757B1 (en) | Developing analysis system of river plane change using air-photos and a GIS and method of the same | |
| CN111953907A (en) | Composition method, composition device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20170607 Address after: 510640 Guangdong City, Tianhe District Province, No. five, road, public education building, unit 371-1, unit 2401 Patentee after: Guangdong Gaohang Intellectual Property Operation Co., Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: Huawei Technologies Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20170829 Address after: 224000, Jiangsu Province, Yancheng City salt street, salt Dragon Street intelligent terminal Pioneer Park two 1 (D) Patentee after: Jiangsu Tianlong rich information technology Co. Ltd. Address before: 510640 Guangdong City, Tianhe District Province, No. five, road, public education building, unit 371-1, unit 2401 Patentee before: Guangdong Gaohang Intellectual Property Operation Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| CP03 | Change of name, title or address |
Address after: 224000 Yandu District Yanlong Street Intelligent Terminal Pioneer Park, Yancheng City, Jiangsu Province, Phase II, 3 (D) Patentee after: Jiangsu Shangxin Electronic Technology Co.,Ltd. Address before: 224000 1 buildings of intelligent terminal Pioneer Park, Yan Long Street, Yancheng City, Jiangsu Province, D (1) Patentee before: JIANGSU TIANLONGFU INFORMATION TECHNOLOGY Co.,Ltd. |
|
| CP03 | Change of name, title or address |