CN109729273A - Image-pickup method, system, device, computer equipment and storage medium - Google Patents

Image-pickup method, system, device, computer equipment and storage medium Download PDF

Info

Publication number
CN109729273A
CN109729273A CN201910052151.4A CN201910052151A CN109729273A CN 109729273 A CN109729273 A CN 109729273A CN 201910052151 A CN201910052151 A CN 201910052151A CN 109729273 A CN109729273 A CN 109729273A
Authority
CN
China
Prior art keywords
image
target object
video camera
frame image
sequential frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910052151.4A
Other languages
Chinese (zh)
Inventor
任杰
苗鹏
施之皓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai University of Sport
Original Assignee
Shanghai University of Sport
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai University of Sport filed Critical Shanghai University of Sport
Priority to CN201910052151.4A priority Critical patent/CN109729273A/en
Publication of CN109729273A publication Critical patent/CN109729273A/en
Pending legal-status Critical Current

Links

Landscapes

  • Image Analysis (AREA)

Abstract

This application involves a kind of image-pickup method, system, device, computer equipment and storage mediums.The described method includes: obtaining the sequential frame image of the first video camera acquisition, control signal is generated according to the position of target object in sequential frame image, according to the reflecting mirror rotation in control signal control reflection mirror array, so that target object is present in the acquisition visual field of the second video camera by the mirror-reflection of reflection mirror array, and by the image of the second video camera acquisition target object, wherein, the clarity of the second video camera acquisition image is higher than the clarity of the first video camera acquisition image.Since control signal is generated according to the position of target object, the rotation angle of reflecting mirror can be determined by the position of target object, so that target object is present in the acquisition visual field of the second video camera, the quality of the image of video camera acquisition can be improved.

Description

Image-pickup method, system, device, computer equipment and storage medium
Technical field
This application involves field of computer technology, more particularly to a kind of image-pickup method, system, device, computer Equipment and storage medium.
Background technique
With the development of computer technology, image acquisition technology is also evolving.Robot navigation, video monitoring, In the fields such as sports event live broadcast, need to track moving object and acquire include moving object image.To high speed Moving object carries out Image Acquisition and often requires to use high-speed camera, in order to analyze motion profile, the posture of moving object Shape or the rotation of itself, generally require to collect that image quality is more preferable, can differentiate the image of moving object local detail.Due to exploitation The video camera for being provided simultaneously with high frame per second and high pixel performance is relatively difficult, fuzzy in order to reduce image motion, can be by appropriate Frame per second is reduced, while shortening time for exposure progress Image Acquisition, but after frame per second reduction, the interval time for obtaining image is elongated, damage The sampling to the motion feature of moving object has been lost, the image analysis in later period is unfavorable for.
In traditional image acquisition technology, when the object of Image Acquisition quickly moves, acquired image is past It is bad toward quality.
Summary of the invention
Based on this, it is necessary in view of the above technical problems, provide a kind of image-pickup method, system, device, computer and set The quality of the image of acquisition can be improved in standby and storage medium.
A kind of image-pickup method, which comprises
Obtain the sequential frame image of the first video camera acquisition;
Control signal is generated according to the position of target object in the sequential frame image;
According to the reflecting mirror rotation in the control signal control reflection mirror array, so that the target object passes through reflection The mirror-reflection of lens array is present in the acquisition visual field of the second video camera, and acquires the object by second video camera The image of body;
Wherein, the clarity of the second video camera acquisition image is higher than the clear of first video camera acquisition image Degree.
The position according to target object in the sequential frame image generates control letter in one of the embodiments, Number, comprising:
Two-dimensional coordinate of the target object in the sequential frame image is obtained respectively;
The three-dimensional coordinate of the target object is calculated according to the two-dimensional coordinate;
Voltage value is calculated according to the three-dimensional coordinate;
Generate control signal corresponding with the voltage value.
In one of the embodiments, the method also includes:
Image procossing is carried out to the sequential frame image respectively, obtains target sequential frame image;
The image coordinate system pre-established is obtained, described image coordinate system is the seat of the not image comprising the target object Mark system;
According to described image coordinate system and the target sequential frame image, obtains the target object and connect in the target Coordinate in continuous frame image.
The reflecting mirror according in the control signal control reflection mirror array rotates in one of the embodiments, Include:
Obtain voltage value corresponding with the control signal;
According to the corresponding relationship of pre-set voltage value and rotation angle, the corresponding rotation angle of the voltage value is searched Degree;
According to the reflecting mirror rotation in the rotation angle control reflection mirror array.
In one of the embodiments, the described method includes:
Obtain the number of image frames of the sequential frame image;
When described image frame number is greater than frame number threshold value, the fortune of target object described in the sequential frame image is obtained respectively Dynamic path;
The track of the target object is analyzed according to the motion path, and obtains analysis result;
The control signal is adjusted according to the analysis result.
The movement road for obtaining target object described in the sequential frame image respectively in one of the embodiments, Diameter, comprising:
Obtain pre-set target area and candidate region;
The first probability that target object described in the sequential frame image falls into the target area is obtained respectively, is obtained respectively Target object described in the consecutive image is taken to fall into the second probability of the candidate region;
According to first probability and second probability, mean-shift vector is obtained;
The motion path of the target object is obtained according to the mean-shift vector.
A kind of image capturing system, the system comprises the first video camera, electronic equipment, reflection mirror array and second to take the photograph Camera, first video camera are connect with the electronic equipment, and the electronic equipment is connect with the reflection mirror array, in which:
The sequential frame image for acquiring sequential frame image, and is sent to the electronics and set by first video camera It is standby;
The electronic equipment, for obtaining the sequential frame image of the first video camera acquisition, according to the successive frame figure The position of target object generates control signal as in, and is revolved according to the reflecting mirror in the control signal control reflection mirror array Turn;
The reflection mirror array, for being reflected according to the control signal rotation, so that the target object passes through reflection The mirror-reflection of lens array is present in the acquisition visual field of the second video camera;
Second video camera, for acquiring the image of the target object.
A kind of image collecting device, described device include:
Image collection module, for obtaining the sequential frame image of the first video camera acquisition;
Signal generation module generates control signal for the position according to target object in the sequential frame image;
Control module is rotated, for rotating according to the reflecting mirror in the control signal control reflection mirror array, so that institute It states target object to be present in the acquisition visual field of the second video camera by the mirror-reflection of reflection mirror array, and is taken the photograph by described second Camera acquires the image of the target object;
Wherein, the clarity of the second video camera acquisition image is higher than the clear of first video camera acquisition image Degree.
A kind of computer equipment, including memory and processor, the memory are stored with computer program, the processing Device performs the steps of when executing the computer program
Obtain the sequential frame image of the first video camera acquisition;
Control signal is generated according to the position of target object in the sequential frame image;
According to the reflecting mirror rotation in the control signal control reflection mirror array, so that the target object passes through reflection The mirror-reflection of lens array is present in the acquisition visual field of the second video camera, and acquires the object by second video camera The image of body;
Wherein, the clarity of the second video camera acquisition image is higher than the clear of first video camera acquisition image Degree.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor It is performed the steps of when row
Obtain the sequential frame image of the first video camera acquisition;
Control signal is generated according to the position of target object in the sequential frame image;
According to the reflecting mirror rotation in the control signal control reflection mirror array, so that the target object passes through reflection The mirror-reflection of lens array is present in the acquisition visual field of the second video camera, and acquires the object by second video camera The image of body;
Wherein, the clarity of the second video camera acquisition image is higher than the clear of first video camera acquisition image Degree.
Above-mentioned image-pickup method, system, device, computer equipment and storage medium are adopted by obtaining the first video camera The sequential frame image of collection generates control signal according to the position of target object in sequential frame image, anti-according to control signal control The reflecting mirror rotation in lens array is penetrated, so that target object is present in the second video camera by the mirror-reflection of reflection mirror array It acquires in the visual field, and by the image of the second video camera acquisition target object, wherein the clarity that the second video camera acquires image is high In the clarity of the first video camera acquisition image.Since control signal is generated according to the position of target object, reflecting mirror Rotation angle can be determined by the position of target object, so that target object is present in the acquisition visual field of the second video camera In, the quality of the image of video camera acquisition can be improved.
Detailed description of the invention
Fig. 1 is the applied environment figure of image-pickup method in one embodiment;
Fig. 2 is the flow diagram of image-pickup method in one embodiment;
Fig. 3 is the flow diagram that the reflecting mirror rotation in reflection mirror array is controlled in one embodiment;
Fig. 4 is the structural block diagram of image collecting device in one embodiment;
Fig. 5 is the internal structure chart of computer equipment in one embodiment.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not For limiting the application.
It is appreciated that term " first " used in this application, " second " etc. can be used to describe various elements herein, But these elements should not be limited by these terms.These terms are only used to distinguish an element and another element.For example, In the case where not departing from scope of the present application, the first video camera can be known as the second video camera, and similarly, it can be by second Video camera is known as the first video camera.First video camera and the second video camera both video camera, but it is not same video camera.
Image-pickup method provided by the embodiments of the present application can be applied in application environment as shown in Figure 1.Such as Fig. 1 Shown, which includes computer equipment 110, the first video camera 120, reflection mirror array 130 and the second video camera 140.Wherein, computer equipment 110 is connect with the first video camera 120, and computer equipment 110 is also connect with reflection mirror array 130, Reflection mirror array 130 is connect with the second video camera 140.First video camera 120 can acquire sequential frame image, the first video camera The sequential frame image of acquisition can be transferred to computer equipment 110 by 120.Computer equipment 110 can be according to sequential frame image The position of middle target object 150 generates control signal, and computer equipment 110 can control reflection mirror array according to control signal Reflecting mirror rotation in 130, so that target object 150 is present in the second video camera by the mirror-reflection of reflection mirror array 130 In the 140 acquisition visual field.Second video camera 140 can acquire the image of target object 150.Wherein, the second video camera 140 acquires The clarity of image is higher than the clarity of the first video camera 120 acquisition image.It should be understood that computer equipment 110 can with but It is not limited to various personal computers, laptop, smart phone, tablet computer and portable wearable device, first takes the photograph Camera 120 can be high-speed camera, and the second video camera 140 can be high-definition camera.
In one embodiment, as shown in Fig. 2, providing a kind of image-pickup method, it is applied in Fig. 1 in this way Application environment is illustrated, comprising the following steps:
Step 202, the sequential frame image of the first video camera acquisition is obtained.
Sequential frame image can be the continuous multiple image of the first video camera acquisition, the successive frame of the first video camera acquisition Image can form video.Wherein, the first video camera can be used for the frame image that acquisition includes high-speed moving object, and first takes the photograph Camera can be high-speed camera.The quantity of first video camera can be one, two, can also be other quantity, herein not It limits.When the quantity of the first video camera is two, two the first video cameras may be constructed binocular vision.Wherein, it first takes the photograph Camera can be industrial high-speed camera.The frame per second of first video camera acquisition image can be 500fps, 600fps, 750fps Deng it is not limited here.The visual angle of first video camera can be fixed, and the camera lens of the first video camera can be the mirror of adjustable focus Head.User can placement location to the first video camera and the acquisition visual field be adjusted.First video camera collects successive frame After image, computer equipment is available to arrive sequential frame image.
Step 204, control signal is generated according to the position of target object in sequential frame image.
Target object can be what user was selected by the first video camera, and target object can be adopting in the first video camera Collect the object of visual field medium-high speed sports.For example, target object can be the ball of high-speed motion, the people of high-speed motion, high-speed motion The objects such as vehicle.The position of target object can be specific location of the target object in each sequential frame image, target object Position can use coordinate representation, can also indicate in other ways, it is not limited here.With with coordinate representation target object For position, computer equipment can establish coordinate system according to the acquisition visual field of the first video camera, and the position of target object can be with It is the coordinate points in the acquisition visual field of the first video camera.
Control signal can be used for controlling the rotation of the reflecting mirror in reflection mirror array.The successive frame that computer equipment is got It include the target object of high-speed motion in image, since target object is in high-speed motion, computer equipment is got each The position of target object can be different in frame image.Computer equipment can be according to the position of target image in sequential frame image Set generation control signal.
Step 206, it is rotated according to the reflecting mirror in control signal control reflection mirror array, so that target object passes through reflection The mirror-reflection of lens array is present in the acquisition visual field of the second video camera, and by the figure of the second video camera acquisition target object Picture.
It is can wrap in reflection mirror array containing at least one reflecting mirror, motor and transmission device, in reflection mirror array Motor can control reflecting mirror rotation.Reflection mirror array can be connected by USB interface, Ethernet interface etc. and computer equipment It connects.Reflecting mirror in reflection mirror array can be adjusted the acquisition visual field of the second video camera by rotation.Second video camera It can be used for the sequential frame image that acquisition includes target object, the second video camera can be high-definition camera, and the second camera shooting The clarity that machine acquires image is higher than the clarity of the first video camera acquisition image.The acquisition visual field of second video camera, which can be, to be fallen Enter the range of the picture of the image of the second video camera acquisition.Wherein, the quantity of the second video camera can be one, two, may be used also To be other quantity, it is not limited here.Second video camera can carry out Image Acquisition using long focal length lens.Second video camera It can be work high-definition camera.
Computer equipment can revolve after generating control signal according to the reflecting mirror in control signal control reflection mirror array Turn.It is generated since control signal is computer equipment according to the position of target object, computer equipment passes through control letter Number come control the reflecting mirror in reflection mirror array rotation when, can be corresponding with the position of target object.In reflection mirror array After reflecting mirror rotation, target object can be present in the acquisition visual field of the second video camera by the mirror-reflection of reflection mirror array In, that is, pass through the acquisition visual field of adjustable second video camera of reflecting mirror in rotating mirror array.Second video camera can be with Acquisition includes the image of target object.
In the present embodiment, the sequential frame image that computer equipment is acquired by obtaining the first video camera, according to successive frame The position of target object generates control signal in image, is rotated, is made according to the reflecting mirror in control signal control reflection mirror array It obtains target object to be present in the acquisition visual field of the second video camera by the mirror-reflection of reflection mirror array, and by the second video camera Acquire the image of target object, wherein the clarity that the second video camera acquires image is higher than the clear of the first video camera acquisition image Clear degree.Since control signal is generated according to the position of target object, the rotation angle of reflecting mirror can be by target object Position determines, so that target object is present in the acquisition visual field of the second video camera, video camera acquisition can be improved The quality of image.
In one embodiment, a kind of image-pickup method provided can also include the process for generating control signal, tool Body includes: to obtain two-dimensional coordinate of the target object in sequential frame image respectively;Target object is calculated according to two-dimensional coordinate Three-dimensional coordinate;Voltage value is calculated according to three-dimensional coordinate;Generate control signal corresponding with voltage value.
The image for the first video camera acquisition that computer equipment is got is sequential frame image, company of the target object in acquisition Position in continuous frame image is different.Computer equipment can obtain two of target object in sequential frame image respectively Tie up coordinate, that is, the first video camera can acquire in real time include high-speed motion target object, computer equipment can be according to the The sequential frame image of one video camera acquisition obtains the two-dimensional coordinate of target object in every frame image.Specifically, computer equipment can Two-dimensional coordinate of the target object in every frame image is calculated by track algorithm and motion prediction algorithm.
Two-dimensional coordinate of the target object that computer equipment can will acquire in sequential frame image substitutes into affine transformation In formula, and target object is calculated by affine transformation formula and acquires the three-dimensional coordinate in the visual field in the second video camera.Its In, affine transformation refers to that a vector space carries out once linear transformation and connects a translation, is transformed to another vector sky Between.That is, computer equipment can be by affine transformation formula, according to the target object in the frame image of the first video camera acquisition Three-dimensional coordinate of the target object in the second camera shooting acquisition visual field is calculated in two-dimensional coordinate.
Computer equipment can be according to two-dimensional coordinate and object of the target object in the first video camera acquisition visual field Three-dimensional coordinate of the body in the second video camera acquisition visual field, calculates corresponding voltage value.Computer equipment can be according to voltage Value generates corresponding control signal, wherein the control signal that computer equipment generates is digital signal, and computer equipment can will The control signal of digital signal type is converted into the control signal of analog signal types.
In the present embodiment, computer equipment passes through obtains two-dimensional coordinate of the target object in sequential frame image respectively, The three-dimensional coordinate that target object is calculated according to two-dimensional coordinate calculates voltage value according to three-dimensional coordinate, generates and voltage value pair The control signal answered.Computer equipment calculates voltage value according to the coordinate of target object, so that the voltage value and mesh that calculate The position for marking object is corresponding, and computer equipment generates control signal corresponding with voltage value, and computer equipment control can be improved The angle and direction of reflecting mirror rotation in reflection mirror array processed.
In one embodiment, a kind of image-pickup method provided can also include the mistake for obtaining the coordinate of target object Journey, detailed process include: to carry out image procossing to sequential frame image respectively, obtain target sequential frame image;Acquisition pre-establishes Image coordinate system, image coordinate system be not comprising target object image coordinate system;According to image coordinate system and target Sequential frame image obtains coordinate of the target object in target sequential frame image.
The sequential frame image that image procossing is used to acquire the first video camera carries out image preprocessing, specifically, computer Equipment can respectively pre-process sequential frame image.For example, computer equipment frame image can be converted to HSV (Hue, Saturation, Value, tone, saturation degree, lightness) color space image, computer equipment can remove frame image It the processing such as makes an uproar, enhance.After computer equipment carries out image procossing to frame image, target object in frame image can be protruded.It calculates After machine equipment carries out image procossing to sequential frame image respectively, available target sequential frame image.
Image coordinate system can be the coordinate system of the not image comprising target object.Computer equipment can be built by background Modulo n arithmetic calculate and update do not include target object image, computer equipment can be according to the figure for not including target object As establishing coordinate system.Computer equipment can store established coordinate system.When computer equipment carries out figure to sequential frame image As processing, after obtaining target sequential frame image, computer equipment is available pre-establish do not include target object figure As coordinate system.
Computer equipment it is continuous in target can to obtain target image according to image coordinate system and target sequential frame image Coordinate in frame image.Specifically, computer equipment can by obtained target sequential frame image and not include respectively target The image subtraction modulus of object obtains the movement difference of target object, to obtain target object in target sequential frame image Coordinate.Computer equipment can obtain the coordinate range of target object according to the differences in motion value of target object respectively.
In the present embodiment, it is continuous to obtain target by carrying out image procossing to sequential frame image respectively for computer equipment Frame image obtains the image coordinate system pre-established, and image coordinate system is the coordinate system of the not image comprising target object, according to Image coordinate system and target sequential frame image obtain coordinate of the target object in target sequential frame image.Computer equipment By carrying out image procossing to the sequential frame image of acquisition, and target is obtained according to image coordinate system and target sequential frame image The coordinate of object can more accurately obtain coordinate of the target object in sequential frame image.
In one embodiment, as shown in figure 3, a kind of image-pickup method provided can also include control reflecting mirror battle array The process of reflecting mirror rotation in column, specific steps include:
Step 302, voltage value corresponding with control signal is obtained.
Step 304, according to the corresponding relationship of pre-set voltage value and rotation angle, the corresponding rotation of voltage value is searched Angle.
Step 306, it is rotated according to the reflecting mirror in rotation angle control reflection mirror array.
It can store the corresponding relationship of control signal and voltage value in computer equipment, for example, when control signal is A control When signal processed, corresponding voltage value can be 3V;When controlling signal is that B controls signal, corresponding voltage value can be 4V.Meter After calculating machine equipment generation control signal, available voltage value corresponding with control signal.It can store in computer equipment The corresponding relationship of voltage value and rotation angle, can also be stored with the corresponding relationship of voltage value and direction of rotation.For example, working as voltage When value is 3V, corresponding rotation angle can be 30 °, and corresponding direction of rotation, which can be, to be rotated to the right.Wherein, computer equipment The voltage value of middle storage and the corresponding relationship of rotation angle can be what user was arranged by computer equipment.
The voltage value of the available storage of computer equipment and the corresponding relationship of rotation angle, computer equipment can basis Corresponding relationship searches rotation angle corresponding with voltage value.Computer equipment can be according in rotation angle control reflection mirror array Reflecting mirror rotation.For example, the voltage value that computer equipment is got is 3V, the voltage value that computer equipment is found is 3V pairs The rotation angle answered is 30 °, and the voltage value that computer equipment is found is that the corresponding direction of rotation 3V is to rotate to the right, computer Equipment can control the reflecting mirror in reflection mirror array and rotate to the right 30 °.
In the present embodiment, computer equipment is by obtaining voltage value corresponding with control signal, according to pre-set The corresponding relationship of voltage value and rotation angle searches the corresponding rotation angle of voltage value, controls reflecting mirror battle array according to rotation angle Reflecting mirror rotation in column.Since control signal is the Coordinate generation according to target object in sequential frame image, according to control The corresponding voltage value of signal processed searches rotation angle, and rotates according to the reflecting mirror in rotation angle control reflection mirror array, makes The angle for obtaining the reflecting mirror rotation in reflection mirror array is more accurate, the mirror-reflection for passing through reflection mirror array convenient for target object It is present in the acquisition visual field of the second video camera, target object can be made in the center in the second video camera acquisition visual field, improved The quality of the image of acquisition.
In one embodiment, a kind of image-pickup method provided can also include the process of adjustment control signal, tool Body process includes: to obtain the number of image frames of sequential frame image;When number of image frames is greater than frame number threshold value, successive frame figure is obtained respectively The motion path of target object as in;The track of target object is analyzed according to motion path, and obtains analysis result;According to analysis As a result adjustment control signal.
Number of image frames can be used to indicate that the quantity of the frame image of the first video camera acquisition, computer equipment can be according to adopting The sequential frame image got is numbered in the collection time.For example, computer equipment can be by first picture number of acquisition It is the second frame by second picture number of acquisition for first frame.Frame number threshold value can be user and is arranged by computer equipment , it can also be the specific value that computer equipment generates at random.For example, frame number threshold value can be 5 frames, 7 frames, 10 frames etc. Specific frame number.
Computer equipment is after getting sequential frame image, the number of image frames of available sequential frame image.Computer is set The standby number of image frames that can be will acquire is compared with frame number threshold value, and obtains comparison result.When the ratio that computer equipment obtains When relatively result is that number of image frames is greater than frame number threshold value, computer equipment can obtain the fortune of target object in sequential frame image respectively Dynamic path.For example, the frame number threshold value stored in computer equipment is 5 frames, the figure for the sequential frame image that computer equipment is got Picture frame number is 6 frames, and computer equipment can obtain the motion path of target object from this continuous 6 frame image.Specifically, meter The motion path of target object in sequential frame image can be obtained according to track algorithm and motion prediction algorithm by calculating machine equipment.
Computer equipment can analyze the track of target object according to the motion path of the target object of acquisition, and computer is set It is standby the stress condition of target object to be analyzed according to the motion path of acquisition, to obtain analysis result.Wherein, analysis knot It may include the prediction to target object movement in fruit, for example, computer equipment is analyzed by the motion path of target object It is parabolic path to the track of target object, computer equipment can be according to the parabolic path of target object to target object Motion path predicted.
Computer equipment can based on the analysis results be adjusted control signal.Since different control signals can be right Answer different voltage values, different voltage values can correspond to different rotation angle or direction of rotation, and computer equipment can be with By adjusting control signal, rotation angle or the direction of rotation of the reflecting mirror in reflection mirror array are further adjusted, so that mesh Mark object is present in the acquisition visual field of the second video camera by the mirror-reflection of the reflection mirror array obtained after rotation.
In the present embodiment, computer equipment passes through the number of image frames for obtaining sequential frame image, when number of image frames is greater than frame When number threshold value, the motion path of target object in sequential frame image is obtained respectively, and the rail of target object is analyzed according to motion path Mark, and analyzed as a result, adjustment controls signal based on the analysis results.Computer equipment passes through the motion path to target object The track for analyzing target object, can adjust control signal based on the analysis results, so that target object after rotation by obtaining The mirror-reflection of reflection mirror array is present in the acquisition visual field of the second video camera, further increases the figure of the second video camera acquisition The quality of picture.
In one embodiment, a kind of image-pickup method provided can also include the motion path for obtaining target object Process, detailed process includes: to obtain pre-set target area and candidate region;Mesh in sequential frame image is obtained respectively Mark object falls into the first probability of target area, obtains target object in consecutive image respectively and falls into the second general of candidate region Rate;According to the first probability and the second probability, mean-shift vector is obtained;The fortune of target object is obtained according to mean-shift vector Dynamic path.
It is pre-set by computer equipment that target area and candidate region can be user, wherein target object goes out The probability of present target area is greater than the probability that target object appears in candidate region.Mean shift is a nonparametric feature sky Between analytical technology, be the method for seeking density function extreme point an of iteration, can be used to find the maximum of points of density function. Mean-shift vector can be used to indicate that the mean vector of offset.First probability can be used to indicate that object in current frame image Body appears in the probability of target area, and the second probability can be used to indicate that target object appears in candidate region in current frame image Interior probability.
Computer equipment can calculate in sequential frame image that target object falls into the first of target area in first frame image Probability, and object module is obtained according to the first probability that target object falls into target area.It should be understood that computer equipment can To calculate, target object falls into the second probability of candidate region in first frame image in sequential frame image, and is fallen according to target object The second probability for entering target area obtains candidate family.
Similarity between the available object module of computer equipment and candidate family, and according to the maximum time of similarity Modeling type obtains current mean-shift vector.Computer equipment can calculate in sequential frame image target object in the second frame image It falls into the first probability of target area, and calculates in sequential frame image that target object falls into candidate region in the second frame image Second probability, and the second mean-shift vector is obtained, computer equipment can obtain multiple according to the sequential frame image got Mean-shift vector.Computer equipment can obtain the motion path of target object according to obtained multiple mean-shift vectors.
Computer equipment can predict the position of target object according to the motion path of obtained target object. Computer equipment can generate control signal according to the position for the target object that prediction obtains, and then anti-by control signal control Penetrate the reflecting mirror rotation in lens array.Computer equipment is predicted by the position to target object, so that reflection mirror array In reflecting mirror rotate in advance, the accuracy rate to the Image Acquisition of target object can be improved.
In the present embodiment, computer equipment is obtained respectively by obtaining pre-set target area and candidate region It takes target object in sequential frame image to fall into the first probability of target area, obtains target object in consecutive image respectively and fall into time Second probability of favored area obtains mean-shift vector, is obtained according to mean-shift vector according to the first probability and the second probability Take the motion path of target object.Mean-shift vector is obtained by calculation in computer equipment, and is obtained according to mean-shift vector The motion path of target object is taken, the motion path of the target object obtained can be made more accurate.
In one embodiment, a kind of image-pickup method provided can also include the figure of the target object of storage acquisition The process of picture.The image of target object can be sent to computer after collecting the image of target object by the second video camera Equipment is stored by computer equipment.
Second video camera can acquire the sequential frame image of target object, and the second video camera can connect with computer equipment It connects.The image of collected target object can be sent to computer equipment by the second video camera, and computer equipment can store The image of target object.
In the present embodiment, the second video camera, can be by the image of target object after collecting the image of target object It is sent to computer equipment, is stored by computer equipment.When needing the image to target object to analyze, computer Equipment can show the image of target object, analyze convenient for the image to target object.
It should be understood that although each step in above-mentioned each flow chart is successively shown according to the instruction of arrow, It is these steps is not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps There is no stringent sequences to limit for rapid execution, these steps can execute in other order.Moreover, above-mentioned each flow chart In at least part step may include that perhaps these sub-steps of multiple stages or stage are not necessarily multiple sub-steps Completion is executed in synchronization, but can be executed at different times, the execution in these sub-steps or stage sequence is not yet Necessarily successively carry out, but can be at least part of the sub-step or stage of other steps or other steps in turn Or it alternately executes.
In one embodiment, a kind of image capturing system is provided.System includes the first video camera, electronic equipment, anti- Lens array and the second video camera are penetrated, the first video camera is connect with electronic equipment, and electronic equipment is connect with reflection mirror array, In:
First video camera is sent to electronic equipment for acquiring sequential frame image, and by sequential frame image;
Electronic equipment, for obtaining the sequential frame image of the first video camera acquisition, according to target object in sequential frame image Position generate control signal, and according to control signal control reflection mirror array in reflecting mirror rotate;
Reflection mirror array, for being reflected according to control signal rotation, so that the mirror surface that target object passes through reflection mirror array Reflection is present in the acquisition visual field of the second video camera;
Second video camera, for acquiring the image of target object.
In one embodiment, as shown in figure 4, providing a kind of image collecting device, comprising: image collection module 410, Signal generation module 420 and rotation control module 430, in which:
Image collection module 410, for obtaining the sequential frame image of the first video camera acquisition;
Signal generation module 420 generates control signal for the position according to target object in sequential frame image;
Control module 430 is rotated, for rotating according to the reflecting mirror in control signal control reflection mirror array, so that target Object is present in the acquisition visual field of the second video camera by the mirror-reflection of reflection mirror array, and acquires mesh by the second video camera Mark the image of object;Wherein, the clarity of the second video camera acquisition image is higher than the clarity of the first video camera acquisition image.
In one embodiment, signal generation module 420 can be also used for obtaining target object respectively in sequential frame image In two-dimensional coordinate;The three-dimensional coordinate of target object is calculated according to two-dimensional coordinate;Voltage value is calculated according to three-dimensional coordinate;It is raw At control signal corresponding with voltage value.
In one embodiment, signal generation module 420 can be also used for carrying out image procossing to sequential frame image respectively, Obtain target sequential frame image;The image coordinate system pre-established is obtained, image coordinate system is the image for not including target object Coordinate system;According to image coordinate system and target sequential frame image, seat of the target object in target sequential frame image is obtained Mark.
In one embodiment, rotation control module 430 can be also used for obtaining voltage value corresponding with control signal;Root According to the corresponding relationship of pre-set voltage value and rotation angle, the corresponding rotation angle of voltage value is searched;According to rotation angle Control the reflecting mirror rotation in reflection mirror array.
In one embodiment, signal generation module 420 can be also used for obtaining the number of image frames of sequential frame image;Work as figure When being greater than frame number threshold value as frame number, the motion path of target object in sequential frame image is obtained respectively;It is analyzed according to motion path The track of target object, and obtain analysis result;Adjustment control signal based on the analysis results.
In one embodiment, signal generation module 420 can be also used for obtaining pre-set target area and time Favored area;The first probability that target object in sequential frame image falls into target area is obtained respectively, is obtained in consecutive image respectively Target object falls into the second probability of candidate region;According to the first probability and the second probability, mean-shift vector is obtained;According to The motion path of mean-shift vector acquisition target object.
Specific about image collecting device limits the restriction that may refer to above for image-pickup method, herein not It repeats again.Modules in above-mentioned image collecting device can be realized fully or partially through software, hardware and combinations thereof.On Stating each module can be embedded in the form of hardware or independently of in the processor in computer equipment, can also store in a software form In memory in computer equipment, the corresponding operation of the above modules is executed in order to which processor calls.
In one embodiment, a kind of computer equipment is provided, which can be terminal, internal structure Figure can be as shown in Figure 5.The computer equipment includes processor, the memory, network interface, display connected by system bus Screen and input unit.Wherein, the processor of the computer equipment is for providing calculating and control ability.The computer equipment is deposited Reservoir includes non-volatile memory medium, built-in storage.The non-volatile memory medium is stored with operating system and computer journey Sequence.The built-in storage provides environment for the operation of operating system and computer program in non-volatile memory medium.The calculating The network interface of machine equipment is used to communicate with external terminal by network connection.When the computer program is executed by processor with Realize a kind of image-pickup method.The display screen of the computer equipment can be liquid crystal display or electric ink display screen, The input unit of the computer equipment can be the touch layer covered on display screen, be also possible to be arranged on computer equipment shell Key, trace ball or Trackpad, can also be external keyboard, Trackpad or mouse etc..
It will be understood by those skilled in the art that structure shown in Fig. 5, only part relevant to application scheme is tied The block diagram of structure does not constitute the restriction for the computer equipment being applied thereon to application scheme, specific computer equipment It may include perhaps combining certain components or with different component layouts than more or fewer components as shown in the figure.
In one embodiment, a kind of computer equipment, including memory and processor are provided, is stored in memory Computer program, the processor perform the steps of when executing computer program
Obtain the sequential frame image of the first video camera acquisition;
Control signal is generated according to the position of target object in sequential frame image;
According to the reflecting mirror rotation in control signal control reflection mirror array, so that target object passes through reflection mirror array Mirror-reflection is present in the acquisition visual field of the second video camera, and by the image of the second video camera acquisition target object;Wherein, The clarity that two video cameras acquire image is higher than the clarity of the first video camera acquisition image.
In one embodiment, it is also performed the steps of when processor executes computer program and obtains target object respectively Two-dimensional coordinate in sequential frame image;The three-dimensional coordinate of target object is calculated according to two-dimensional coordinate;According to three-dimensional coordinate meter Calculate voltage value;Generate control signal corresponding with voltage value.
In one embodiment, it also performs the steps of respectively when processor executes computer program to sequential frame image Image procossing is carried out, target sequential frame image is obtained;The image coordinate system pre-established is obtained, image coordinate system is not comprising mesh Mark the coordinate system of the image of object;According to image coordinate system and target sequential frame image, it is continuous in target to obtain target object Coordinate in frame image.
In one embodiment, acquisition and control signal pair are also performed the steps of when processor executes computer program The voltage value answered;According to the corresponding relationship of pre-set voltage value and rotation angle, the corresponding rotation angle of voltage value is searched; According to the reflecting mirror rotation in rotation angle control reflection mirror array.
In one embodiment, it is also performed the steps of when processor executes computer program and obtains sequential frame image Number of image frames;When number of image frames is greater than frame number threshold value, the motion path of target object in sequential frame image is obtained respectively;According to Motion path analyzes the track of target object, and obtains analysis result;Adjustment control signal based on the analysis results.
In one embodiment, it is also performed the steps of when processor executes computer program and obtains pre-set mesh Mark region and candidate region;The first probability that target object in sequential frame image falls into target area is obtained respectively, is obtained respectively Target object in consecutive image is taken to fall into the second probability of candidate region;According to the first probability and the second probability, mean value is obtained Offset vector;The motion path of target object is obtained according to mean-shift vector.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated Machine program performs the steps of when being executed by processor
Obtain the sequential frame image of the first video camera acquisition;
Control signal is generated according to the position of target object in sequential frame image;
According to the reflecting mirror rotation in control signal control reflection mirror array, so that target object passes through reflection mirror array Mirror-reflection is present in the acquisition visual field of the second video camera, and by the image of the second video camera acquisition target object;Wherein, The clarity that two video cameras acquire image is higher than the clarity of the first video camera acquisition image.
In one embodiment, it is also performed the steps of when computer program is executed by processor and obtains object respectively Two-dimensional coordinate of the body in sequential frame image;The three-dimensional coordinate of target object is calculated according to two-dimensional coordinate;According to three-dimensional coordinate Calculate voltage value;Generate control signal corresponding with voltage value.
In one embodiment, it is also performed the steps of when computer program is executed by processor respectively to successive frame figure As carrying out image procossing, target sequential frame image is obtained;The image coordinate system pre-established is obtained, image coordinate system is not include The coordinate system of the image of target object;According to image coordinate system and target sequential frame image, obtains target object and connect in target Coordinate in continuous frame image.
In one embodiment, acquisition and control signal are also performed the steps of when computer program is executed by processor Corresponding voltage value;According to the corresponding relationship of pre-set voltage value and rotation angle, the corresponding rotation angle of voltage value is searched Degree;According to the reflecting mirror rotation in rotation angle control reflection mirror array.
In one embodiment, acquisition sequential frame image is also performed the steps of when computer program is executed by processor Number of image frames;When number of image frames is greater than frame number threshold value, the motion path of target object in sequential frame image is obtained respectively;Root According to the track of motion path analysis target object, and obtain analysis result;Adjustment control signal based on the analysis results.
In one embodiment, it is pre-set that acquisition is also performed the steps of when computer program is executed by processor Target area and candidate region;The first probability that target object in sequential frame image falls into target area is obtained respectively, respectively Obtain the second probability that target object in consecutive image falls into candidate region;According to the first probability and the second probability, obtain It is worth offset vector;The motion path of target object is obtained according to mean-shift vector.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, To any reference of memory, storage, database or other media used in each embodiment provided herein, Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms, Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance Shield all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art It says, without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection of the application Range.Therefore, the scope of protection shall be subject to the appended claims for the application patent.

Claims (10)

1. a kind of image-pickup method, which comprises
Obtain the sequential frame image of the first video camera acquisition;
Control signal is generated according to the position of target object in the sequential frame image;
According to the reflecting mirror rotation in the control signal control reflection mirror array, so that the target object passes through reflecting mirror battle array The mirror-reflection of column is present in the acquisition visual field of the second video camera, and acquires the target object by second video camera Image;
Wherein, the clarity of the second video camera acquisition image is higher than the clarity of first video camera acquisition image.
2. the method according to claim 1, wherein the position according to target object in the sequential frame image Set generation control signal, comprising:
Two-dimensional coordinate of the target object in the sequential frame image is obtained respectively;
The three-dimensional coordinate of the target object is calculated according to the two-dimensional coordinate;
Voltage value is calculated according to the three-dimensional coordinate;
Generate control signal corresponding with the voltage value.
3. according to the method described in claim 2, it is characterized in that, the method also includes:
Image procossing is carried out to the sequential frame image respectively, obtains target sequential frame image;
The image coordinate system pre-established is obtained, described image coordinate system is the coordinate of the not image comprising the target object System;
According to described image coordinate system and the target sequential frame image, the target object is obtained in the target successive frame Coordinate in image.
4. according to the method described in claim 2, it is characterized in that, described control in reflection mirror array according to the control signal Reflecting mirror rotation, comprising:
Obtain voltage value corresponding with the control signal;
According to the corresponding relationship of pre-set voltage value and rotation angle, the corresponding rotation angle of the voltage value is searched;
According to the reflecting mirror rotation in the rotation angle control reflection mirror array.
5. the method according to claim 1, wherein the described method includes:
Obtain the number of image frames of the sequential frame image;
When described image frame number is greater than frame number threshold value, the movement road of target object described in the sequential frame image is obtained respectively Diameter;
The track of the target object is analyzed according to the motion path, and obtains analysis result;
The control signal is adjusted according to the analysis result.
6. according to the method described in claim 5, it is characterized in that, described obtain target described in the sequential frame image respectively The motion path of object, comprising:
Obtain pre-set target area and candidate region;
The first probability that target object described in the sequential frame image falls into the target area is obtained respectively, obtains institute respectively State the second probability that target object described in consecutive image falls into the candidate region;
According to first probability and second probability, mean-shift vector is obtained;
The motion path of the target object is obtained according to the mean-shift vector.
7. a kind of image capturing system, which is characterized in that the system comprises the first video camera, electronic equipment, reflection mirror arrays And second video camera, first video camera are connect with the electronic equipment, the electronic equipment and the reflection mirror array Connection, in which:
First video camera is sent to the electronic equipment for acquiring sequential frame image, and by the sequential frame image;
The electronic equipment, for obtaining the sequential frame image of the first video camera acquisition, according in the sequential frame image The position of target object generates control signal, and is rotated according to the reflecting mirror in the control signal control reflection mirror array;
The reflection mirror array, for being reflected according to the control signal rotation, so that the target object passes through reflecting mirror battle array The mirror-reflection of column is present in the acquisition visual field of the second video camera;
Second video camera, for acquiring the image of the target object.
8. a kind of image collecting device, which is characterized in that described device includes:
Image collection module, for obtaining the sequential frame image of the first video camera acquisition;
Signal generation module generates control signal for the position according to target object in the sequential frame image;
Control module is rotated, for rotating according to the reflecting mirror in the control signal control reflection mirror array, so that the mesh Mark object is present in the acquisition visual field of the second video camera by the mirror-reflection of reflection mirror array, and by second video camera Acquire the image of the target object;
Wherein, the clarity of the second video camera acquisition image is higher than the clarity of first video camera acquisition image.
9. a kind of computer equipment, including memory and processor, the memory are stored with computer program, feature exists In the step of processor realizes any one of claims 1 to 6 the method when executing the computer program.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program The step of method described in any one of claims 1 to 6 is realized when being executed by processor.
CN201910052151.4A 2019-01-21 2019-01-21 Image-pickup method, system, device, computer equipment and storage medium Pending CN109729273A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910052151.4A CN109729273A (en) 2019-01-21 2019-01-21 Image-pickup method, system, device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910052151.4A CN109729273A (en) 2019-01-21 2019-01-21 Image-pickup method, system, device, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
CN109729273A true CN109729273A (en) 2019-05-07

Family

ID=66298475

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910052151.4A Pending CN109729273A (en) 2019-01-21 2019-01-21 Image-pickup method, system, device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109729273A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110853416A (en) * 2019-11-27 2020-02-28 上海体育学院 Video feedback training system for motor skill learning
CN111369631A (en) * 2020-03-06 2020-07-03 厦门华联电子股份有限公司 Sample image automatic acquisition method and device based on XYZ axis platform
CN113179371A (en) * 2021-04-21 2021-07-27 新疆爱华盈通信息技术有限公司 Shooting method, device and snapshot system
CN113630543A (en) * 2020-05-06 2021-11-09 杭州海康威视数字技术股份有限公司 Falling object and person smashing event monitoring method and device, electronic equipment and monitoring system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1404682A (en) * 2000-08-25 2003-03-19 皇家菲利浦电子有限公司 Method and apparatus for tracking an object of interest in a digital image
JP2014103597A (en) * 2012-11-21 2014-06-05 Olympus Corp Imaging apparatus
CN105592269A (en) * 2016-03-03 2016-05-18 北京志光伯元科技有限公司 Motion target capturing and tracking device and motion target capturing and tracking method
CN107409204A (en) * 2015-04-01 2017-11-28 索尼公司 Power-efficient multicamera system
CN108986161A (en) * 2018-06-19 2018-12-11 亮风台(上海)信息科技有限公司 A kind of three dimensional space coordinate estimation method, device, terminal and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1404682A (en) * 2000-08-25 2003-03-19 皇家菲利浦电子有限公司 Method and apparatus for tracking an object of interest in a digital image
JP2014103597A (en) * 2012-11-21 2014-06-05 Olympus Corp Imaging apparatus
CN107409204A (en) * 2015-04-01 2017-11-28 索尼公司 Power-efficient multicamera system
CN105592269A (en) * 2016-03-03 2016-05-18 北京志光伯元科技有限公司 Motion target capturing and tracking device and motion target capturing and tracking method
CN108986161A (en) * 2018-06-19 2018-12-11 亮风台(上海)信息科技有限公司 A kind of three dimensional space coordinate estimation method, device, terminal and storage medium

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110853416A (en) * 2019-11-27 2020-02-28 上海体育学院 Video feedback training system for motor skill learning
CN111369631A (en) * 2020-03-06 2020-07-03 厦门华联电子股份有限公司 Sample image automatic acquisition method and device based on XYZ axis platform
CN111369631B (en) * 2020-03-06 2023-04-07 厦门华联电子股份有限公司 Sample image automatic acquisition method and device based on XYZ axis platform
CN113630543A (en) * 2020-05-06 2021-11-09 杭州海康威视数字技术股份有限公司 Falling object and person smashing event monitoring method and device, electronic equipment and monitoring system
CN113630543B (en) * 2020-05-06 2022-12-06 杭州海康威视数字技术股份有限公司 Falling object and person smashing event monitoring method and device, electronic equipment and monitoring system
CN113179371A (en) * 2021-04-21 2021-07-27 新疆爱华盈通信息技术有限公司 Shooting method, device and snapshot system

Similar Documents

Publication Publication Date Title
CN109729273A (en) Image-pickup method, system, device, computer equipment and storage medium
Bhat et al. Deep burst super-resolution
Zhang et al. Exploiting temporal consistency for real-time video depth estimation
CN107481270B (en) Table tennis target tracking and trajectory prediction method, device, storage medium and computer equipment
Chin et al. Star tracking using an event camera
JP7274048B2 (en) Motion recognition method, apparatus, computer program and computer device
JP2020042476A5 (en)
JP4970557B2 (en) Face search and detection in digital image capture device
Sauer et al. Tracking holistic object representations
JP2021506017A (en) Object detector and object detection method
Mustaniemi et al. Gyroscope-aided motion deblurring with deep networks
CN111160375A (en) Three-dimensional key point prediction and deep learning model training method, device and equipment
CN111179419A (en) Three-dimensional key point prediction and deep learning model training method, device and equipment
CN111080776B (en) Human body action three-dimensional data acquisition and reproduction processing method and system
Kim et al. Simvodis: Simultaneous visual odometry, object detection, and instance segmentation
WO2021093637A1 (en) Focusing method and apparatus, electronic device, and computer readable storage medium
CN110992401A (en) Target tracking method and device, computer equipment and storage medium
CN108876806A (en) Method for tracking target and system, storage medium and equipment based on big data analysis
CN114937125B (en) Reconstructable metric information prediction method, reconstructable metric information prediction device, computer equipment and storage medium
US20060215036A1 (en) Method and apparatus for video stabilization
CN110992393B (en) Target motion tracking method based on vision
JP7032913B2 (en) Image processing device, image processing method, computer program
CN113438409B (en) Delay calibration method, delay calibration device, computer equipment and storage medium
JP2007304721A (en) Image processing device and image processing method
JP2022101519A (en) Method of creating hyperspectral high speed camera image using generative adversarial network algorithm

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190507

RJ01 Rejection of invention patent application after publication