WO2018103371A1

WO2018103371A1 - Processing method in video recording and apparatus

Info

Publication number: WO2018103371A1
Application number: PCT/CN2017/098515
Authority: WO
Inventors: 高鹏
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-12-07
Filing date: 2017-08-22
Publication date: 2018-06-14
Also published as: CN108174112B; CN108174112A

Abstract

A processing method in video recording, comprising: determining frame rate; determining a first exposure time and a second exposure time according to the frame rate, the first exposure time being the exposure time of a main camera and an auxiliary camera; determining an interval during which the auxiliary camera delays start of the main camera according to the second exposure time; and starting video recording of the main camera, delaying the interval, starting video recording of the auxiliary camera, and storing video recording data obtained for the main camera and the auxiliary camera respectively according to a recording sequence.

Description

Processing method and device in imaging

Technical field

The present disclosure relates to, but is not limited to, the field of imaging technology, and in particular, a processing method and apparatus in imaging.

Background technique

With the continuous advancement and rapid development of image technology in the field of mobile terminals, the imaging hardware and software functions of mobile terminals are becoming more and more perfect and powerful, correspondingly generating a variety of interesting imaging applications. High-speed camera is one of them. In the scene we also call it "bullet time." High-speed camera is to shoot high-speed moving objects with high frame rate camera. Due to the high frame rate, a large amount of motion details can be captured. In the later playback, due to the usual 24FPS (frames/second), it is visually created. Slow motion effect.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The mobile terminal can already reach 240 frames per second, and it is enough to shoot daily motion scenes at this frame rate, which can achieve better slow motion effects during playback. Moreover, the mobile terminal can ensure a high frame rate in different environments by using a fixed imaging sensor and a fixed exposure time parameter at the time of high speed imaging.

However, it is difficult to achieve real bullet-level high-speed imaging on a mobile terminal, since the actual frame rate = 1 / (exposure time + data read time), therefore, to achieve a frame rate such as 240 FPS, exposure time and data reading The sum time of the time is about 4.2 milliseconds, since the data reading time is also included in the total time, and the data reading time needs to be maintained at a stable value, and therefore, when each frame of data is generated, it is left to the imaging sensor in the mobile terminal. The exposure time will be lower than the sum time, so lower exposure times are required to achieve a higher frame rate.

In addition, in a scene where the brightness of the light is dark, since the exposure time cannot be adjusted, the mobile terminal The brightness of the image data acquired by the imaging sensor is low, which directly leads to insufficient brightness of the generated image data, which affects the image quality and seriously affects the user experience.

This paper provides a processing method and device for capturing images, which can improve the image quality of high-speed imaging.

An embodiment of the present disclosure provides a processing method in imaging, where the method includes:

Determine the frame rate;

Determining, according to the frame rate, a first exposure time and a second exposure time, the first exposure time being an exposure time of the main camera and the auxiliary camera;

Determining, according to the second exposure time, an interval time during which the auxiliary camera delays starting the main camera;

The main camera is started to be photographed, the interval time is delayed, the auxiliary camera is started, and the image data obtained by the main camera and the auxiliary camera are respectively stored in the order of imaging.

In an exemplary embodiment, the determining a frame rate includes:

A reception frame rate selection operation is performed to determine a frame rate used for the current imaging based on the frame rate selection operation.

In an exemplary embodiment, the determining the first exposure time and the second exposure time according to the frame rate includes:

Determining twice the reciprocal of the frame rate as the first exposure time;

The reciprocal of the frame rate is determined as the second exposure time.

In an exemplary embodiment, the determining, according to the second exposure time, an interval at which the secondary camera delays the activation of the main camera includes:

A delay time of the main camera is determined, and a difference between the second exposure time and the delay time is determined as an interval time.

In an exemplary embodiment, the storing the image data obtained by the main camera and the auxiliary camera in the imaging sequence respectively includes:

The ith frame image data obtained by the main camera is stored, and is marked with the first mark, and the ith frame image data obtained by the auxiliary camera is stored and marked with the second mark; then, the i+ obtained by the main camera is continuously stored. 1 frame of image data, and marked with the first mark, and then store the i+1th frame of image data obtained by the auxiliary camera, and mark with the second mark, and so on;

Wherein, i=1, 2, . . . N, N is a positive integer.

In an exemplary embodiment, after storing the image data obtained by the main camera and the auxiliary camera in the imaging sequence, the method further includes:

The stored image data is cropped to obtain coincidence image data of the main camera and the secondary camera.

In an exemplary embodiment, the cropping the stored image data to obtain the coincidence image data of the main camera and the auxiliary camera includes:

The ith frame image data obtained by the stored main camera is cropped according to the first crop frame, and the image data that is not coincident with the ith frame image data of the auxiliary camera is cropped;

And cutting, according to the second cropping frame, the ith frame image data obtained by the stored auxiliary camera, and cutting out the image data that is not coincident with the ith frame image data of the main camera;

The camera data obtained by the uncut main camera and the camera data obtained by the auxiliary camera constitute a coincidence camera data;

Wherein, i=1, 2, . . . N, N is a positive integer.

In an exemplary embodiment, the determining of the first crop box and the second crop box includes:

Determining the first cropping frame according to the screen size and the coincidence data width of the camera captured by the main camera;

The second cropping frame is determined according to the screen size and the coincidence data width of the sub camera.

In an exemplary embodiment, the determination of the coincidence data width of the main camera includes:

The sum of the distance from the imaging position of the subject on the main camera to the right edge of the camera screen of the main camera, and the distance from the imaging position of the subject on the sub camera to the left edge of the camera screen of the sub camera is determined as the main camera. The coincidence data width of the camera;

or,

The determination of the coincidence data width of the auxiliary camera includes:

The sum of the distance from the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the distance from the imaging position of the subject on the main camera to the right edge of the imaging screen of the main camera is determined as the secondary camera. The coincidence data width of the camera;

or,

The determination of the coincidence data width of the main camera includes: placing the subject on the main camera The sum of the imaging position to the right edge of the imaging screen of the main camera, the distance from the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the coincidence data width of the imaging of the main camera; The determination of the coincidence data width of the auxiliary camera includes: the distance from the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the imaging position of the subject on the main camera to the imaging screen of the main camera The sum of the distances of the right edges is determined as the coincidence data width of the auxiliary camera image.

In an exemplary embodiment, after the obtaining the coincidence imaging data of the main camera and the auxiliary camera, the method further includes:

The coincidence imaging data is encoded and displayed.

The embodiment of the present disclosure further provides a processing device in imaging, the device comprising:

a first determining module, configured to: determine a frame rate;

The second determining module is configured to: determine, according to the frame rate, a first exposure time and a second exposure time, where the first exposure time is an exposure time of the main camera and the auxiliary camera;

a third determining module, configured to: determine, according to the second exposure time, an interval time during which the auxiliary camera delays starting the main camera;

The startup module is set to: start the main camera to capture, delay the interval time, start the auxiliary camera to capture, and store the camera data obtained by the main camera and the auxiliary camera respectively according to the imaging sequence.

In an exemplary embodiment, the apparatus further includes: a cropping module;

The cropping module is configured to: crop the stored image data to obtain coincidence image data of the main camera and the auxiliary camera.

In an exemplary embodiment, the device further includes: a display module;

The display module is configured to: encode and display the coincidence imaging data.

In an exemplary embodiment, the cropping module is further configured to: determine a first cropping frame according to a screen size and a coincidence data width of the image captured by the main camera; determine a first image according to a screen size and a coincidence data width of the auxiliary camera image capturing Two cropping frames.

In an exemplary embodiment, the cropping module is further configured to:

The distance from the imaging position of the subject on the main camera to the right edge of the main camera's camera screen Determining the sum of the distance from the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and determining the coincidence data width of the imaging of the primary camera; or

The sum of the distance from the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the distance from the imaging position of the subject on the main camera to the right edge of the imaging screen of the main camera is determined as the secondary camera. The coincidence data width of the camera; or,

The sum of the distance from the imaging position of the subject on the main camera to the right edge of the camera screen of the main camera, and the distance from the imaging position of the subject on the sub camera to the left edge of the camera screen of the sub camera is determined as the main camera. The coincidence data width of the imaging; the distance from the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the distance from the imaging position of the subject on the main camera to the right edge of the imaging screen of the main camera And, determine the coincidence data width for the auxiliary camera.

Embodiments of the present disclosure also provide a computer readable storage medium storing computer executable instructions that, when executed, implement a processing method in the above imaging.

The processing method and apparatus in the imaging provided by the embodiment of the present disclosure determines a frame rate; determines a first exposure time and a second exposure time according to the frame rate, wherein the first exposure time is an exposure time of the main camera and the auxiliary camera; Determining, according to the second exposure time, an interval interval between the auxiliary camera and the start of the main camera; starting the main camera, delaying the interval, starting the auxiliary camera, and storing the image data obtained by the main camera and the auxiliary camera in the imaging sequence. In this way, the main camera and the auxiliary camera increase the imaging brightness by the first exposure time, and the second exposure time is used as the interval between the activation of the main camera and the auxiliary camera, so that high-speed imaging can be realized, which can improve the imaging quality of the high-speed imaging.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a schematic flowchart showing an implementation process of a processing method in imaging according to an embodiment of the present disclosure;

2 is a schematic diagram of a processing device in imaging according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of an implementation process for improving image quality of high speed imaging according to an embodiment of the present disclosure; FIG.

4 is a timing diagram of starting shooting of a main camera and a secondary camera according to an embodiment of the present disclosure;

5 is a schematic diagram of the use of a buffer according to an embodiment of the present disclosure;

6 is a schematic diagram of determining a coincidence data width of a main camera and a coincidence data width of a secondary camera according to an embodiment of the present disclosure;

FIG. 7 is another schematic diagram of determining a coincidence data width of a main camera and a coincidence data width of a secondary camera according to an embodiment of the present disclosure.

Preferred embodiment of the present disclosure

Embodiments of the present disclosure will be described below with reference to the accompanying drawings.

In order to more fully understand the features and technical contents of the embodiments of the present disclosure, the implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

As shown in FIG. 1 , an embodiment of the present disclosure provides an implementation process of a processing method in imaging, which may include the following steps:

Step 101: Determine a frame rate.

Optionally, the mobile terminal receives a frame rate selection operation of the user, and determines a frame rate used by the current camera according to a frame rate selection operation input by the user. The user can select the frame rate according to the brightness of the current camera environment. The frame rate that can be selected by the user may be multiple, for example, 240FPS, 120FPS, and 60FPS. The mobile terminal may be a mobile phone, a PDA (Personal Digital Assistant), a PAD (Portable Android Device), or the like having a camera function.

Step 102: Determine a first exposure time and a second exposure time according to the frame rate, where the first exposure time is an exposure time of a primary camera and a secondary camera.

Here, the determining the first exposure time according to the frame rate may include:

The mobile terminal determines twice the reciprocal of the frame rate as the first exposure time.

Wherein, the first exposure time, as the exposure time of the main camera and the auxiliary camera, the greater the exposure time, the higher the brightness of the image obtained by the main camera or the auxiliary camera.

Here, the determining the second exposure time according to the frame rate comprises:

The mobile terminal determines the reciprocal of the frame rate as the second exposure time.

Wherein, the second exposure time can be used to ensure a high frame rate of the main camera and the auxiliary camera image.

Step 103: Determine, according to the second exposure time, an interval time during which the secondary camera delays the startup of the main camera.

Here, the determining, according to the second exposure time, that the auxiliary camera delays the start of the main camera, may include:

The mobile terminal determines a delay time of the main camera, and determines a difference between the second exposure time and the delay time as an interval time.

The delay time may be initiated by the main camera to a time interval when the main camera starts to capture.

Step 104: Start the main camera imaging, delay the interval time, start the auxiliary camera imaging, and store the imaging data obtained by the main camera and the auxiliary camera respectively according to the imaging sequence.

Here, the storing the image data obtained by the main camera and the auxiliary camera in the imaging sequence may include:

The mobile terminal stores the ith frame image data obtained by the main camera, and marks the first frame, stores the ith frame image data obtained by the secondary camera, and marks the image with the second mark; and then continues to store the first camera. i+1 frame camera data, and marking with the first mark, storing the i+1th frame image data obtained by the auxiliary camera, and marking with the second mark, and so on, wherein the i=1, 2 ,...N,N is a positive integer.

Here, after storing the imaging data obtained by the main camera and the secondary camera in the imaging sequence, the method may further include: cutting the stored imaging data to obtain overlapping imaging data of the primary camera and the secondary camera.

Here, the cropping the stored image data to obtain the coincidence image data of the main camera and the auxiliary camera may include:

The mobile terminal performs cropping on the ith frame image data obtained by the stored main camera according to the first cropping frame, and crops the image data that is not coincident with the ith frame image data of the auxiliary camera;

The camera data obtained by the uncut main camera and the camera data obtained by the auxiliary camera are heavy. Camera data

Wherein, i=1, 2, . . . N, N is a positive integer.

The determining process of the first cropping frame and the second cropping frame may include:

The mobile terminal determines the first cropping frame according to the screen size and the coincidence data width of the camera captured by the main camera;

Here, the determining process of the coincidence data width of the main camera may include:

The mobile terminal determines the distance between the imaging position of the subject on the main camera to the right edge of the imaging screen of the main camera, and the distance from the imaging position of the subject on the sub camera to the left edge of the imaging screen of the sub camera, and determines The coincidence data width of the main camera image;

or,

The determining process of the coincidence data width of the auxiliary camera may include:

The mobile terminal determines the distance between the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the distance from the imaging position of the subject on the main camera to the right edge of the imaging screen of the main camera, and determines Coincident data width of the auxiliary camera;

or,

The determining process of the coincidence data width of the main camera may include: the distance that the mobile terminal sets the imaging position of the subject on the main camera to the right edge of the imaging screen of the main camera, and the imaging position of the subject on the auxiliary camera The sum of the distances to the left edge of the camera screen of the secondary camera determines the coincidence data width of the camera capture; the process of determining the coincidence data width of the secondary camera may include: the image of the subject being on the secondary camera by the mobile terminal The sum of the distance from the position to the left edge of the imaging screen of the sub camera, and the distance from the imaging position of the subject on the main camera to the right edge of the imaging screen of the main camera is determined as the coincidence data width of the sub camera imaging.

After obtaining the coincidence imaging data of the main camera and the auxiliary camera, the method further includes: encoding the coincidence imaging data; and displaying the encoded coincidence imaging data.

Here, the encoding the coincidence imaging data may include:

The coincidence of the main camera and the auxiliary camera respectively based on the high compression ratio parameter of the video coding The camera data is compressed; wherein the techniques used for the video encoding may include, but are not limited to, H264.

In order to achieve the processing method in the above imaging, the embodiment of the present disclosure further provides a processing device in the imaging. As shown in FIG. 2, the device may include: a first determining module 21, a second determining module 22, and a third Determining module 23 and starting module 24; wherein

The first determining module 21 is configured to: determine a frame rate;

The second determining module 22 is configured to: determine, according to the frame rate, a first exposure time and a second exposure time, where the first exposure time is an exposure time of the main camera and the auxiliary camera;

The third determining module 23 is configured to: determine, according to the second exposure time, an interval time during which the secondary camera delays the startup of the main camera;

The startup module 24 is configured to: start the main camera imaging, delay the interval time, start the auxiliary camera imaging, and store the imaging data obtained by the main camera and the secondary camera respectively according to the imaging sequence.

Optionally, the first determining module 21 is configured to: receive a frame rate selection operation of the user, and determine a frame rate used by the current camera according to a frame rate selection operation input by the user. The user can select the frame rate according to the brightness of the current camera environment. The frame rate that can be selected by the user may be multiple, for example, 240FPS, 120FPS, and 60FPS.

Optionally, the second determining module 22 is configured to determine twice the reciprocal of the frame rate as the first exposure time.

Optionally, the second determining module 22 is configured to determine the reciprocal of the frame rate as the second exposure time.

Optionally, the third determining module 23 is further configured to: determine a delay time of the main camera; optionally, the third determining module 23 is configured to: set the second exposure time and the delay time The difference is determined as the interval time.

The startup module 24 may be configured to: store the ith frame image data obtained by the main camera, mark the first frame, store the ith frame image data obtained by the secondary camera, and mark the mark with the second mark; And continuing to store the i+1th frame image data obtained by the main camera, and marking with the first mark, storing the i+1th frame image data obtained by the auxiliary camera, and marking with the second mark, and so on, wherein , i = 1, 2, ... N, N is a positive integer.

The device may further include a cropping module configured to: trim the stored image data to obtain coincidence image data of the main camera and the auxiliary camera.

The cropping module may be configured to: crop the ith frame image data obtained by the stored main camera according to the first crop frame, and crop the image data that is not coincident with the ith frame image data of the auxiliary camera;

Wherein, i=1, 2, . . . N, N is a positive integer.

The cutting module may be further configured to: determine a first cropping frame according to a screen size and a coincidence data width of the camera captured by the main camera;

The cropping module may be further configured to: set a distance of an imaging position of the subject on the main camera to a right edge of the imaging screen of the main camera, and an imaging position of the subject on the auxiliary camera to an imaging screen of the auxiliary camera. The sum of the distances of the edges, determining the coincidence data width of the main camera image; or,

The device may further include a display module configured to: encode the coincidence imaging data; and display the encoded coincidence imaging data.

The display module may be configured to: compress the coincidence imaging data of the main camera and the secondary camera respectively according to a high compression ratio parameter of the video coding technology; wherein the video coding technology may include, but is not limited to, H264.

In a practical application, the first determining module 21, the second determining module 22, the third determining module 23, the starting module 24, the cropping module, and the display module may all be configured by a central processing unit (CPU, Central Processing Unit) located in the mobile terminal. ), a microprocessor (MPU, Micro Processor Unit), a digital signal processor (DSP, Digital Signal Processor), or a Field Programmable Gate Array (FPGA).

The implementation process and principle of the method of the embodiment of the present disclosure are described in detail below with an optional embodiment.

FIG. 3 is a schematic diagram of an implementation process for improving the image quality of a high-speed camera according to an embodiment of the present disclosure. As shown in FIG. 3, the following steps may be included:

Step 301: The mobile terminal enters high-speed imaging, and determines whether the frame rate selection operation of the user is received. If the frame rate selection operation of the user is received, step 302 is performed; otherwise, the shooting is directly performed.

The user can select the frame rate according to the brightness of the current camera environment. The frame rate that can be selected by the user may be multiple, for example, 240FPS, 120FPS, and 60FPS.

If the brightness of the shooting environment is insufficient, the user can select a frame rate of 240 FPS for shooting; if the brightness of the shooting picture displayed according to step 307 is still insufficient, the user can reselect the frame rate of 120 FPS for shooting; The brightness of the shooting screen displayed in step 307, which is obtained by taking the value of 120 FPS, is still insufficient, and the user can again select the frame rate of 60 FPS to perform shooting.

Steps 302-303: The mobile terminal determines an frame rate used by the current camera according to the received frame rate selection operation of the user input.

The mobile terminal may determine twice the reciprocal of the frame rate as the first exposure time, and may determine the reciprocal of the frame rate as the second exposure time, where the first exposure time may be an exposure of the primary camera and the secondary camera. After the time, step 304 is performed.

Step 304: The mobile terminal determines a delay time of the main camera, and determines a difference between the second exposure time and the delay time as an interval time. Thereafter, step 305 is performed.

Step 305: The mobile terminal, the controller that can be the mobile terminal, starts the main camera, delays the interval time, starts the auxiliary camera, and stores the camera data obtained by the main camera and the auxiliary camera respectively according to the imaging sequence. Optionally, The mobile terminal can store one frame of image data obtained by the main camera, mark it with the first mark, store one frame of image data obtained by the auxiliary camera, and mark it with the second mark; then, continue to store the next obtained by the main camera. Frame camera data, and mark with the first mark, store the next frame of image data obtained by the secondary camera, mark with the second mark, and so on, and store one frame of the camera obtained by the main camera and the secondary camera respectively. After the data, step 306 is performed.

Step 306: The mobile terminal performs cropping on the ith frame image data obtained by the stored main camera according to the first cropping frame, and cuts out the camera data that is not coincident with the ith frame camera data of the secondary camera; and stores the image according to the second cropping frame. The ith frame image data obtained by the auxiliary camera is cropped, and the image data that is not coincident with the ith frame image data of the main camera is cropped; the image data obtained by the uncut main camera and the camera data obtained by the auxiliary camera are combined to form a camera image. Data; wherein, i = 1, 2, ... N, N is a positive integer.

The determining process of the first cropping frame and the second cropping frame may include: determining, by the mobile terminal, the first cropping frame according to the screen size and the coincident data width captured by the main camera; and the screen size and the coincidence data according to the auxiliary camera Width, determine the second crop box.

The determining process of the coincidence data width of the main camera may include: the distance that the mobile terminal sets the imaging position of the subject on the main camera to the right edge of the imaging screen of the main camera, and the imaging position of the subject on the auxiliary camera The sum of the distances to the left edge of the camera screen of the secondary camera determines the coincidence data width of the camera image captured by the main camera;

The determining process of the coincidence data width of the auxiliary camera may include: the distance that the mobile terminal sets the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the imaging position of the subject on the main camera The sum of the distances to the right edge of the camera screen of the main camera is determined as the coincidence data width of the auxiliary camera image.

Step 307: The mobile terminal compresses the coincidence imaging data of the main camera and the secondary camera respectively according to the high compression ratio parameter of the video encoding, and displays the compressed coincidence imaging data.

FIG. 4 is a timing diagram of the main camera and the auxiliary camera starting the imaging according to the embodiment of the present disclosure. As shown in FIG. 4, the following steps may be included:

Step 1: The controller of the mobile terminal starts the main camera.

Step 2: The controller of the mobile terminal receives the first frame of image data obtained by the main camera, and previews the image formed by the camera data, and there is a certain delay time from the start of the main camera to the main camera to obtain the preview of the image data.

Step 3: The controller delays the interval of the mobile terminal to start the secondary camera, the interval time is the difference between the second exposure time and the delay time, and the second exposure time is the reciprocal of the frame rate.

Step 4: The controller of the mobile terminal receives the first frame of image data obtained by the secondary camera, and previews the image formed by the camera data, and has a certain delay time from the start of the secondary camera to the secondary camera to obtain the preview of the captured data.

Step 5: The controller of the mobile terminal receives the second frame of image data obtained by the main camera.

Step 6: The controller of the mobile terminal stores the first frame of image data obtained by the main camera to a buffer, and marks it with a first mark, such as 0; the controller of the mobile terminal obtains the first frame obtained by the auxiliary camera. The image data is stored to the buffer and marked with a second mark, such as 1.

Step 7: The controller of the mobile terminal receives the second frame of image data obtained by the secondary camera.

Step 8: The controller of the mobile terminal stores the second frame image data obtained by the main camera to the buffer, and marks it with a first mark, such as 0; the controller of the mobile terminal stores the second frame image data obtained by the auxiliary camera. To the buffer, and use the second flag, such as 1 for marking, the subsequent acquisition of the image data of each frame obtained by the main camera and the secondary camera in the buffer, and so on.

It can be noted that step 6 and step 5 or step 7 may have no obvious chronological order, as long as they are performed after step 3 and step 4.

FIG. 5 is a schematic diagram of the use of the buffer according to the embodiment of the present disclosure. As shown in FIG. 5, the buffer is configured to implement the writing and reading of the image data by the main camera and the auxiliary camera, and the implementation manner may include:

When the camera data of the main camera and the auxiliary camera are stored in the buffer, the method may include:

The pointer Pin starts to point to the head of the buffer. Whenever one frame of camera data is stored in the buffer, the pointer Pin is incremented by one. The index of the buffer is an even number such as 0 and 2, and the image data obtained by the main camera is stored, and A mark, such as the number 0 mark. The index of the buffer is an odd number such as 1, 3, and the image data obtained by the auxiliary camera is stored, and is marked with a second mark, such as the number 1.

When the image data obtained by the main camera and the auxiliary camera are read out from the buffer, the method may include:

The pointer Pout initially points to the head of the buffer, and the pointer Pout is incremented by one for each frame of image data taken in the buffer.

Here, Pin may be set to: identify the location where the image data is written, and Pout may be set to: identify the location at which the camera data is read out, and synchronization technology must be used.

FIG. 6 is a schematic diagram of determining a coincidence data width of a main camera and a coincidence data width of a secondary camera according to an embodiment of the present disclosure. As shown in FIG. 6, the determining manner may include:

Establish a coordinate system to determine that the coordinate origin of the main camera is O _left , and the coordinate origin of the secondary camera is O _right , where left is called left and right is called right; normal direction is Y axis, upward is positive, and horizontal is X The axis is positive to the right; the imaging position of the subject on the left main camera is X _left , and the imaging position of the subject on the right auxiliary camera is X _right ; the main lens of the main camera and the auxiliary camera The distance between the axes is T, the focal lengths of the main camera and the secondary camera are both f, and the vertical distance from the subject to the origin of the main camera coordinate origin and the auxiliary camera coordinate origin is Z.

FIG. 7 is another schematic diagram of determining a coincidence data width of a main camera and a coincidence data width of a secondary camera according to an embodiment of the present disclosure. As shown in FIG. 7, the determining manner may include:

The sum of the distance from the imaging position X _{left of the} subject on the main camera to the right edge of the imaging screen of the main camera, and the distance from the imaging position X _{right of the} subject on the secondary camera to the left edge of the imaging screen of the secondary camera, Determine the width of the coincidence data of the main camera, which is expressed as: w/2-X _left +(X _right -w/2)=w-(X _left -X _right )=wd, where w is the width of the image , d the horizontal displacement of the subject imaged by the main camera and the sub camera, where the main camera and the sub camera are placed horizontally.

a sum of a distance from the imaging position X _{right of the} subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the distance from the imaging position X _{left of the} subject on the main camera to the right edge of the imaging screen of the main camera, The width of the coincidence data determined as the secondary camera is expressed as: X _right -(-w/2)+w/2-X _left =w-(X _left -X _right )=wd, where w is the image of the camera Width, d The horizontal displacement of the subject imaged by the primary camera and the secondary camera, where the primary camera and the secondary camera are placed horizontally.

When the data is cropped, the processing may be performed according to the first cropping frame and the second cropping frame. Here, the determining process of the first cropping frame may include:

Optionally, a coordinate system is established on the screen captured by the main camera, where the coordinate origin is the lower left corner of the screen, the width of the first crop frame is wd, and the height of the first crop frame is h, and the first crop frame is represented by coordinates. Is: (d, 0) (w, 0) (d, h) (w, h).

The determining process of the second cropping frame may include:

Determining a second cropping frame according to a screen size and a coincidence data width of the auxiliary camera imaging;

Optionally, a coordinate system is established on the screen captured by the auxiliary camera, the coordinate origin is the lower left corner of the screen, the width of the second crop frame is wd, and the height of the second crop frame is h, and the second crop frame is represented by coordinates. It is: (0,0)(wd,0)(0,h)(wd,h).

If the main camera and the secondary camera have size scaling for the camera and the zoom factor is ratio, the first crop frame and the second crop frame may be adjusted accordingly:

The coordinates of the first cropping frame are expressed as: (d×ratio, 0) (w×ratio, 0) (d×ratio, h×ratio) (w×ratio, h×ratio); the coordinates of the second cropping frame are expressed as : (0, 0) (w × ratio - d × ratio, 0) (0, h × ratio) (w × ratio - d × ratio, h × ratio).

Those of ordinary skill in the art will appreciate that all or some of the steps, systems, and functional blocks/units of the methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical The components work together. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on a computer readable medium, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media. Computer storage media includes, but is not limited to, random access memory (RAM, Random Access Memory), Read-Only Memory (ROM), Electrically Erasable Programmable Read-only Memory (EEPROM), Flash or other memory technology, CD-ROM (CD-ROM) , Compact Disc Read-Only Memory), digital versatile disc (DVD) or other optical disc storage, magnetic box, magnetic tape, disk storage or other magnetic storage device, or any other device that can be used to store desired information and be accessible by a computer Medium. Moreover, it is well known to those skilled in the art that communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media. .

A person skilled in the art can understand that the technical solutions of the present disclosure may be modified or equivalent, without departing from the spirit and scope of the present disclosure, and should be included in the scope of the claims of the present disclosure.

Industrial applicability

Claims

A processing method in imaging, the method comprising:

Determine the frame rate;

Determining, according to the frame rate, a first exposure time and a second exposure time, the first exposure time being an exposure time of the main camera and the auxiliary camera;

Determining, according to the second exposure time, an interval time during which the auxiliary camera delays starting the main camera;

The main camera is started to be photographed, the interval time is delayed, the auxiliary camera is started, and the image data obtained by the main camera and the auxiliary camera are respectively stored in the order of imaging.
The method of claim 1 wherein said determining a frame rate comprises:

A reception frame rate selection operation is performed to determine a frame rate used for the current imaging based on the frame rate selection operation.
The method of claim 1, wherein the determining the first exposure time and the second exposure time based on the frame rate comprises:

Determining twice the reciprocal of the frame rate as the first exposure time;

The reciprocal of the frame rate is determined as the second exposure time.
The method according to claim 1, wherein the determining, according to the second exposure time, an interval at which the secondary camera delays the activation of the main camera comprises:

A delay time of the main camera is determined, and a difference between the second exposure time and the delay time is determined as an interval time.
The method according to claim 1, wherein the storing the image data obtained by the main camera and the auxiliary camera in the imaging sequence respectively comprises:

The ith frame image data obtained by the main camera is stored, and is marked with the first mark, and the ith frame image data obtained by the auxiliary camera is stored and marked with the second mark; then, the i+ obtained by the main camera is continuously stored. 1 frame of image data, and marked with the first mark, and then store the i+1th frame of image data obtained by the auxiliary camera, and mark with the second mark, and so on;

Wherein, i=1, 2, . . . N, N is a positive integer.
The method of claim 1, after storing the image data obtained by the main camera and the auxiliary camera in the order of imaging, respectively, further comprising:

The stored image data is cropped to obtain coincidence image data of the main camera and the secondary camera.
The method according to claim 6, wherein the cropping the stored image data to obtain coincidence image data of the main camera and the auxiliary camera comprises:

The ith frame image data obtained by the stored main camera is cropped according to the first crop frame, and the image data that is not coincident with the ith frame image data of the auxiliary camera is cropped;

And cutting, according to the second cropping frame, the ith frame image data obtained by the stored auxiliary camera, and cutting out the image data that is not coincident with the ith frame image data of the main camera;

The camera data obtained by the uncut main camera and the camera data obtained by the auxiliary camera constitute a coincidence camera data;

Wherein, i=1, 2, . . . N, N is a positive integer.
The method of claim 7 wherein

The determining of the first cropping frame and the second cropping frame includes:

Determining the first cropping frame according to the screen size and the coincidence data width of the camera captured by the main camera;

The second cropping frame is determined according to the screen size and the coincidence data width of the sub camera.
The method of claim 8 wherein

The determination of the coincidence data width of the main camera includes:

The sum of the distance from the imaging position of the subject on the main camera to the right edge of the camera screen of the main camera, and the distance from the imaging position of the subject on the sub camera to the left edge of the camera screen of the sub camera is determined as the main camera. The coincidence data width of the camera;

or,

The determination of the coincidence data width of the auxiliary camera includes:

The sum of the distance from the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the distance from the imaging position of the subject on the main camera to the right edge of the imaging screen of the main camera is determined as the secondary camera. The coincidence data width of the camera;

or,

The determination of the coincidence data width of the main camera includes: placing the subject on the main camera The sum of the imaging position to the right edge of the imaging screen of the main camera, the distance from the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the coincidence data width of the imaging of the main camera; The determination of the coincidence data width of the auxiliary camera includes: the distance from the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the imaging position of the subject on the main camera to the imaging screen of the main camera The sum of the distances of the right edges is determined as the coincidence data width of the auxiliary camera image.
The method of claim 7, after the obtaining the coincidence imaging data of the main camera and the auxiliary camera, further comprising:

Encoding the coincident camera data;

The encoded coincidence imaging data is displayed.
A processing device in imaging, the device comprising:

a first determining module, configured to: determine a frame rate;

The second determining module is configured to: determine, according to the frame rate, a first exposure time and a second exposure time, where the first exposure time is an exposure time of the main camera and the auxiliary camera;

a third determining module, configured to: determine, according to the second exposure time, an interval time during which the auxiliary camera delays starting the main camera;

The startup module is set to: start the main camera to capture, delay the interval time, start the auxiliary camera to capture, and store the camera data obtained by the main camera and the auxiliary camera respectively according to the imaging sequence.
The apparatus of claim 11, the apparatus further comprising: a cropping module;

The cropping module is configured to: crop the stored image data to obtain coincidence image data of the main camera and the auxiliary camera.
The device of claim 12, the device further comprising: a display module;

The display module is configured to: encode the coincidence imaging data; and display the encoded coincidence imaging data.
The apparatus according to claim 12, wherein the cropping module is configured to: crop the ith frame image data obtained by the stored main camera according to the first crop frame, and crop the ith frame image that is not associated with the auxiliary camera Data coincides with the camera data; and according to the second crop box The ith frame image data obtained by the camera is cropped, and the image data that is not coincident with the ith frame image data of the main camera is cropped; the image data obtained by the uncut main camera and the image data obtained by the auxiliary camera are combined to form the image data; Wherein, i=1, 2, . . . N, N is a positive integer.
The apparatus according to claim 14, wherein the cropping module is further configured to: determine a first cropping frame according to a screen size and a coincidence data width of the image captured by the main camera; and determine a first image according to a screen size and a coincidence data width of the auxiliary camera image Two cropping frames.
The device of claim 15

The cutting module is further configured to:

The sum of the distance from the imaging position of the subject on the main camera to the right edge of the camera screen of the main camera, and the distance from the imaging position of the subject on the sub camera to the left edge of the camera screen of the sub camera is determined as the main camera. The coincidence data width of the camera; or,

The sum of the distance from the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the distance from the imaging position of the subject on the main camera to the right edge of the imaging screen of the main camera is determined as the secondary camera. The coincidence data width of the camera; or,

The sum of the distance from the imaging position of the subject on the main camera to the right edge of the camera screen of the main camera, and the distance from the imaging position of the subject on the sub camera to the left edge of the camera screen of the sub camera is determined as the main camera. The coincidence data width of the imaging; the distance from the imaging position of the subject on the secondary camera to the left edge of the imaging screen of the secondary camera, and the distance from the imaging position of the subject on the main camera to the right edge of the imaging screen of the main camera And, determine the coincidence data width for the auxiliary camera.