CN112954216A - Image processing method based on high-speed shooting instrument and related equipment - Google Patents

Image processing method based on high-speed shooting instrument and related equipment Download PDF

Info

Publication number
CN112954216A
CN112954216A CN202110191850.4A CN202110191850A CN112954216A CN 112954216 A CN112954216 A CN 112954216A CN 202110191850 A CN202110191850 A CN 202110191850A CN 112954216 A CN112954216 A CN 112954216A
Authority
CN
China
Prior art keywords
speed
video
preview
data
shooting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110191850.4A
Other languages
Chinese (zh)
Inventor
武绍星
朱玉
曾礼伟
梁辉
廖秋华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netum Intelligent Guangzhou Technology Co ltd
Original Assignee
Netum Intelligent Guangzhou Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netum Intelligent Guangzhou Technology Co ltd filed Critical Netum Intelligent Guangzhou Technology Co ltd
Priority to CN202110191850.4A priority Critical patent/CN112954216A/en
Publication of CN112954216A publication Critical patent/CN112954216A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The embodiment of the invention discloses an image processing method based on a high-speed shooting instrument and related equipment, and relates to the technical field of high-speed shooting instruments, wherein the image processing method based on the high-speed shooting instrument comprises the following steps: transmitting a first shooting instruction to a high-speed shooting instrument according to user operation, wherein the first shooting instruction is used for triggering the high-speed shooting instrument to start a camera to acquire image data; acquiring preview video data transmitted by the high-speed shooting instrument through a first video streaming interface, and acquiring still picture data transmitted by the high-speed shooting instrument through a second video streaming interface; if a second shooting instruction is received, generating a snapshot picture according to the static picture data; and otherwise, outputting the real-time preview video corresponding to the high-speed shooting instrument according to the preview video data. The embodiment of the invention solves the problem of low shooting efficiency of the high-speed shooting instrument in the prior art, and improves the use efficiency of the high-speed shooting instrument.

Description

Image processing method based on high-speed shooting instrument and related equipment
Technical Field
The embodiment of the invention relates to the technical field of high-speed cameras, in particular to an image processing method based on a high-speed camera and related equipment.
Background
With the rapid development of science and technology, the portable high-speed photographing instrument is more and more popular, and brings great convenience to life, work and study of people.
In actual processing, the high-speed scanner software uses auxiliary software as an auxiliary high-speed scanner device, and when displaying in real time, the display is usually performed at the resolution of the shot picture. Specifically, at present, high-speed shooting instrument software and high-speed shooting instrument equipment are connected through a common Universal Serial Bus (USB) interface, for example, through a USB2.0 interface, when a picture with a large resolution needs to be shot, an image displayed in real time is displayed according to the resolution of the shot picture, so that the effect of real-time display of the high-speed shooting instrument software is delayed, the real-time change of the image below a camera of the high-speed shooting instrument cannot be displayed in time, and the display frame rate of the equipment is low.
Specifically, when the high-speed image capturing device is connected to software through a common USB2.0 interface, because the high-speed image capturing device camera pixels are generally large pixels, for example, when the high-speed image capturing device camera pixels are 800 ten thousand pixels, 1200 ten thousand pixels, or 1600 ten thousand pixels, the image data volume of each frame is large, the number of image frames transmitted in one second is low, and under the condition that the number of image frames displayed is low, an obvious pause phenomenon can be seen by naked eyes.
Disclosure of Invention
In view of this, the present invention provides an image processing method based on a high-speed camera and a related device, so as to solve the problem of stutter of the high-speed camera software in real-time display in the prior art, so that an image displayed by the high-speed camera software can be displayed quickly, clearly and timely.
In a first aspect, an embodiment of the present invention provides an image processing method based on a high-speed shooting instrument, including:
transmitting a first shooting instruction to a high-speed shooting instrument according to user operation, wherein the first shooting instruction is used for triggering the high-speed shooting instrument to start a camera to acquire image data;
acquiring preview video data transmitted by the high-speed shooting instrument through a first video streaming interface, and acquiring still picture data transmitted by the high-speed shooting instrument through a second video streaming interface;
if a second shooting instruction is received, generating a snapshot picture according to the static picture data; and otherwise, outputting the real-time preview video corresponding to the high-speed shooting instrument according to the preview video data.
Optionally, the transmitting the first shooting instruction to the high-speed shooting instrument according to the user operation includes:
receiving the operation of a user, and sending the operation,
generating a first shooting instruction according to user operation;
and sending the first shooting instruction to a high-speed shooting instrument through a video control interface.
Optionally, the image processing method is applied to an image processing apparatus connected to a high-speed camera, and the image processing method further includes:
and detecting whether a second shooting instruction is received, wherein the second shooting instruction is used for triggering the image processing equipment to generate a snapshot picture according to the static picture data, and the pixel of the static picture data is higher than the pixel of the preview video data.
Optionally, the obtaining, through a first video stream interface, the preview video data transmitted by the high-speed shooting apparatus, and obtaining, through a second video stream interface, the still picture data transmitted by the high-speed shooting apparatus includes:
calling a video preview grabber through a first video stream interface, wherein the video preview grabber is used for acquiring preview video data transmitted by the high-speed shooting instrument according to a preset preview pixel threshold value;
and calling a static picture grabber through a second video interface, wherein the static picture grabber is used for acquiring the static picture data transmitted by the high-speed shooting instrument according to the pixel threshold value of the camera.
Optionally, the image processing method based on the high-speed shooting instrument further includes:
after a video control interface is obtained, a video preview grabber and a static picture grabber are created;
adding the video preview grabber and the static picture grabber into a preset graphic filter;
and configuring the video preview grabber according to a preset preview pixel value, and configuring the static picture grabber according to a camera pixel threshold value of the high-speed shooting instrument, wherein the preset preview pixel value is lower than the camera pixel threshold value.
In a second aspect, an embodiment of the present invention further provides an image processing method based on a high-speed shooting instrument, including:
receiving a first shooting instruction;
starting a camera according to the first shooting instruction to acquire an image, and acquiring image acquisition data;
generating static picture data and preview video data according to the image acquisition data;
and transmitting preview video data through a first video stream interface, and transmitting the static picture data through a second video stream interface.
In a third aspect, an embodiment of the present invention further provides an image processing apparatus based on a high-speed shooting device, including:
the shooting instruction transmission module is used for transmitting a first shooting instruction to the high-speed shooting instrument according to user operation, and the first shooting instruction is used for triggering the high-speed shooting instrument to start a camera to acquire image data;
the data acquisition module is used for acquiring preview video data transmitted by the high-speed shooting instrument through a first video stream interface and acquiring still picture data transmitted by the high-speed shooting instrument through a second video stream interface;
the snapshot picture generation module is used for generating a snapshot picture according to the static picture data when receiving a second shooting instruction;
and the preview video output module is used for outputting the real-time preview video corresponding to the high shooting instrument according to the preview video data when a second shooting instruction is not received.
In a fourth aspect, an embodiment of the present invention further provides a high-speed shooting apparatus, including:
the shooting instruction receiving module is used for receiving a first shooting instruction;
the image acquisition module is used for starting a camera for image acquisition according to the first shooting instruction to obtain image acquisition data;
the collected data processing module is used for generating static picture data and preview video data according to the image collected data;
and the data transmission module is used for transmitting the preview video data through the first video stream interface and transmitting the static picture data through the second video stream interface.
In a fifth aspect, an embodiment of the present invention further provides an image processing apparatus based on a high-speed shooting instrument, including: a processor and a memory; the memory has stored therein at least one instruction that, when executed by the processor, causes the image processing apparatus to perform the high-imager based image processing method of the first aspect.
In a sixth aspect, the present invention further provides a computer-readable storage medium, where instructions of the computer-readable storage medium, when executed by a processor of a computer device, enable the computer device to perform the high-speed camera-based image processing method according to the first aspect or the second aspect.
The embodiment of the invention transmits a first shooting instruction to the high shooting instrument according to the operation of a user to trigger the high shooting instrument to start a camera to collect image data to generate preview video data and static picture data, then can acquire the preview video data transmitted by the high shooting instrument through a first video stream interface, and acquire the static picture data transmitted by the high shooting instrument through a second video stream interface, namely, different video stream interfaces are adopted to transmit the preview video data and the static picture data, so as to achieve the purpose of transmitting trial preview video and the snapshot picture through different video stream interfaces, a snapshot picture is generated according to the acquired static picture data when the second shooting instruction is received, and real-time preview video is generated and output according to the acquired preview video data when the second shooting instruction is not received, so that the user can watch the real-time preview video corresponding to the high shooting instrument, the purpose of timely displaying the real-time change of the image below the camera of the high-speed shooting instrument is achieved, the problem that the display blockage easily occurs to the existing high-speed shooting instrument software according to the shooting resolution ratio of the camera to display the image in real time can be avoided, the problem that the high-speed shooting instrument software displays the blockage in real time due to the fact that preview images are displayed according to the pixels of the camera of the high-speed shooting instrument in the prior art is solved, and the display frame rate of equipment is improved.
Drawings
FIG. 1 is a flowchart illustrating steps of a method for processing an image based on a high-speed scanner according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating steps of a method for processing an image based on a high-speed scanner according to an alternative embodiment of the present invention;
FIG. 3 is a flowchart illustrating steps of another method for processing an application installation package according to an embodiment of the present invention;
FIG. 4 is a block diagram of an image processing apparatus based on a high-speed scanner according to an embodiment of the present invention;
fig. 5 is a block diagram of a high-speed scanner according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Referring to fig. 1, a flowchart illustrating steps of an image processing method based on a high-speed scanner according to an embodiment of the present invention is shown. The image processing method based on the high-speed scanner provided by the embodiment can be applied to the image processing situation based on the high-speed scanner, and specifically comprises the following steps:
and 110, transmitting a first shooting instruction to the high-speed shooting instrument according to user operation, wherein the first shooting instruction is used for triggering the high-speed shooting instrument to start a camera for image data acquisition.
Specifically, when receiving a user operation, the embodiment of the present invention may send an instruction to the high-speed shooting apparatus according to the user operation, so as to trigger the high-speed shooting apparatus to start the camera for image data acquisition as a first shooting instruction, so that the high-speed shooting apparatus may generate still image data and preview video data according to the acquired image acquisition data. For example, when a user needs to use a high-speed shooting instrument to shoot, the user operation may be submitted on high-speed shooting instrument software to trigger the high-speed shooting instrument software to generate a first shooting instruction, and the first shooting instruction may be transmitted to the high-speed shooting instrument connected to the high-speed shooting instrument software through a video control Interface (VideoControl Interface), so that the high-speed shooting instrument starts a camera to perform image data acquisition after receiving the first shooting instruction.
Further, the transmitting the first shooting instruction to the high-speed shooting instrument according to the user operation in the embodiment of the present invention may specifically include: receiving user operation, and generating a first shooting instruction according to the user operation; through the video control interface, will first shooting instruction sends for high appearance of shooing to make high appearance of shooing can open the camera according to this first shooting instruction and carry out image acquisition. Specifically, after receiving a first shooting instruction, the high-speed shooting instrument can start the camera according to the first shooting instruction to acquire images, and then can generate static image data and preview video data according to acquired image acquisition data. The static picture data can be used for generating a snapshot picture, for example, the static picture data can be snapshot picture data generated by a high-speed shooting instrument according to camera pixels; the preview video data may be used to generate a preview video, for example, the preview video data may be generated by a high-speed shooting device according to preset preview image pixels, and specifically, the preview video data may be used to generate a real-time preview video of the high-speed shooting device. It should be noted that the camera pixel and the preview image pixel in the embodiment of the present invention may be two unequal pixels, for example, the camera pixel may be larger than a preset preview image pixel.
And step 120, acquiring preview video data transmitted by the high-speed shooting instrument through a first video streaming interface, and acquiring still picture data transmitted by the high-speed shooting instrument through a second video streaming interface.
In this embodiment of the present invention, the first video stream Interface may be a video stream Interface (video streaming Interface) for transmitting a live preview video, and specifically may be configured to transmit preview video data, where the preview video data may include image frame data for generating the live preview video; the second video stream interface may be a video stream interface for transmitting a snapshot picture, and specifically may be used for transmitting still picture data generated by the high-speed shooting device according to the high-speed shooting device camera pixels.
Specifically, after the high-speed shooting instrument generates preview video data and still picture data according to the acquired image acquisition data, the embodiment of the invention can acquire the preview video data transmitted by the high-speed shooting instrument through the first video streaming interface, so that a preview video can be generated and output in real time according to the acquired preview video data, and simultaneously can acquire the still picture data transmitted by the high-speed shooting instrument through the second video streaming interface, so that a snapshot picture can be generated according to the still picture data when a second shooting instruction is received. The second shooting instruction may be used to trigger generation of a snapshot picture, and specifically may include various instructions for triggering generation of a snapshot picture, for example, a shooting instruction that may be sent by high-speed shooting instrument software based on a shooting operation submitted by a user, which is not specifically limited in this embodiment.
For example, in a case that the high-speed camera software is based on a uvc (usb Video class) protocol for camera module communication of the high-speed camera, two Video Stream (VS) interfaces may be created, where one VS interface is used as a first Video stream interface for transmitting a real-time preview Video, and the other VS interface is used as a second Video stream interface for transmitting a snapshot picture. Specifically, after the high-speed shooting instrument generates preview video data and still picture data, the preview video data can be transmitted to the high-speed shooting instrument software through a VS (namely, a first video stream interface) for transmitting a real-time preview video, so that the high-speed shooting instrument software can acquire the preview video data transmitted by the high-speed shooting instrument through the first video stream interface to achieve the purpose of transmitting the real-time preview video data, and can transmit the still picture data to the high-speed shooting instrument software through the VS (namely, a second video stream interface) for transmitting a snapshot picture, so that the high-speed shooting instrument software can acquire the still picture data transmitted by the high-speed shooting instrument through the first video stream interface to achieve the purpose of transmitting the snapshot picture data.
Step 130, if a second shooting instruction is received, generating a snapshot picture according to the static picture data; and otherwise, outputting the real-time preview video corresponding to the high-speed shooting instrument according to the preview video data.
Specifically, after the first shooting instruction is sent, whether a snapshot picture needs to be generated according to the acquired still picture data can be determined by judging whether a second shooting instruction is received or not, so that when the second shooting instruction is received, the snapshot picture needs to be generated according to the acquired still picture data at present, and a corresponding snapshot picture can be generated according to the acquired still picture data, so that a response to the second shooting instruction is completed, and the purpose of generating the snapshot picture is achieved; when a second shooting instruction is not received, the fact that a snapshot picture does not need to be generated according to the obtained static picture data at present can be determined, a real-time preview video can be generated according to the obtained preview video data and output, the user can view the real-time preview video corresponding to the high-speed shooting instrument, and the purpose of displaying real-time changes of the image below the camera of the high-speed shooting instrument in time is achieved.
To sum up, the embodiment of the present invention transmits a first shooting instruction to the high-speed shooting instrument according to a user operation to trigger the high-speed shooting instrument to start the camera for image data acquisition to generate preview video data and still picture data, and then can acquire the preview video data transmitted by the high-speed shooting instrument through the first video streaming interface and can acquire the still picture data transmitted by the high-speed shooting instrument through the second video streaming interface, that is, different video streaming interfaces are adopted to transmit the preview video data and the still picture data, so as to achieve the purpose of adopting different video streaming interfaces to transmit a trial preview video and a snapshot picture, thereby solving the problem in the prior art that the high-speed shooting instrument software displays a jam in real time due to implementation of a preview image displayed by the high-speed shooting instrument camera.
Further, in the embodiment of the present invention, when a second shooting instruction is received, a snapshot picture is generated according to the obtained static picture data, so as to achieve the purpose of generating the snapshot picture; and when a second shooting instruction is not received, a real-time preview video can be generated according to the acquired preview video data and output, so that a user can watch the real-time preview video corresponding to the high-speed shooting instrument, the purpose of timely displaying the real-time change of the image below the camera of the high-speed shooting instrument is achieved, and the display frame rate of the equipment is improved.
In the actual process, the image processing method based on the high shooting instrument provided by the embodiment of the invention can be applied to image processing equipment connected with the high shooting instrument, so that the image processing equipment can transmit a first shooting instruction to the high shooting instrument according to the user operation after receiving the user operation to trigger the high shooting instrument to start a camera for image data acquisition, thereby acquiring preview video data transmitted by the high shooting instrument through a first video stream interface, acquiring still picture data transmitted by the high shooting instrument through a second video stream interface, further generating a snapshot picture according to the still picture data when receiving a second shooting instruction, and outputting a real-time preview video corresponding to the high shooting instrument according to the preview video data when not receiving the second shooting instruction, thereby solving the problem that the real-time display effect caused by the real-time change of an image below the camera of the high shooting instrument cannot be displayed in time in the prior art generates hysteresis, and improving the display frame rate of the equipment.
Optionally, on the basis of the foregoing embodiment, the image processing method based on a high-speed scanner according to an embodiment of the present invention may further include: whether a second shooting instruction is received is detected. The second shooting instruction is used for triggering the image processing equipment to generate a snapshot picture according to the static picture data, and the pixels of the static picture data are higher than the pixels of the preview video data.
Referring to fig. 2, a flowchart illustrating steps of a method for processing an image based on a high-speed scanner according to an alternative embodiment of the present invention is shown. The image processing method based on the high-speed camera can be applied to image processing equipment connected with the high-speed camera, and specifically comprises the following steps:
step 210, receiving a user operation.
Step 220, generating a first shooting instruction according to the user operation.
And step 230, sending the first shooting instruction to a high-speed shooting instrument through a video control interface.
Specifically, an image processing apparatus such as a computer can establish a connection with a high-speed scanner through high-speed scanner software in accordance with a communication protocol. After receiving the user operation for opening the high-speed shooting instrument camera, a first shooting instruction can be generated according to the user operation for opening the high-speed shooting instrument camera through high-speed shooting instrument software, and then the first shooting instruction is transmitted to the high-speed shooting instrument through a Video Control (VC) interface according to a communication protocol, so that the high-speed shooting instrument acquires image data after receiving the first shooting instruction and generates preview video data and static picture data transmission.
And step 240, acquiring preview video data transmitted by the high-speed shooting instrument through a first video streaming interface, and acquiring still picture data transmitted by the high-speed shooting instrument through a second video streaming interface.
Specifically, after sending a first shooting instruction, the image processing device in the embodiment of the present invention may call a preset video preview grabber through a first video stream interface, so as to obtain preview video data for generating a real-time preview video through the video preview grabber; and a preset still picture grabber can be called through the second video stream interface, so that still picture data used for generating the snapshot picture can be acquired through the still picture grabber. Optionally, in the embodiment of the present invention, obtaining preview video data transmitted by the high-speed shooting instrument through a first video stream interface, and obtaining still picture data transmitted by the high-speed shooting instrument through a second video stream interface specifically includes: calling a video preview grabber through a first video stream interface, wherein the video preview grabber is used for acquiring preview video data transmitted by the high-speed shooting instrument according to a preset preview pixel threshold value; and calling a static picture grabber through a second video interface, wherein the static picture grabber is used for acquiring the static picture data transmitted by the high-speed shooting instrument according to the pixel threshold value of the camera.
In the actual processing, after the image processing device connected to the high-speed shooting instrument acquires the video control interface of the high-speed shooting instrument, for example, after the video control interface IAMVideoControl of the high-speed shooting instrument is acquired, a video preview grabber and a still picture grabber can be created, and the created video preview grabber and the created still picture grabber can be added to the image filter for transmitting pictures by the high-speed shooting instrument, so that preview video data transmitted by the high-speed shooting instrument according to a preset preview pixel threshold can be acquired by calling the video preview grabber through the first video control interface, and still picture data transmitted by the high-speed shooting instrument according to a camera pixel threshold can be acquired by calling the still picture grabber through the second video control interface, and the purpose of transmitting the preview video data and the still picture data by adopting different video control interfaces is achieved.
Further, the image processing method based on the high-speed camera provided by the implementation of the present invention may further include: after a video control interface is obtained, a video preview grabber and a static picture grabber are created; adding the video preview grabber and the static picture grabber into a preset graphic filter; the method comprises the steps of configuring the video preview grabber according to a preset preview pixel value, and configuring the static picture grabber according to a camera pixel threshold value of the high-speed shooting instrument, wherein the preset preview pixel value is lower than the camera pixel threshold value, so that preview video data can be rapidly transmitted, and the real-time property of the transmission of the preview video data is ensured. It should be noted that the camera pixel threshold of the high-speed camera may be the maximum pixel value of the high-speed camera.
As an optional example of the present invention, after creating a graphic Filter based on Directshow of the development kit, a source Filter of the device may be created, then a video control interface IAMVideoControl of the high-speed camera device may be obtained, and a video sample collector Grabber1 of the device for video preview may be created to serve as a video preview Grabber in the embodiment of the present invention, and meanwhile, a Grabber2 may be adopted to obtain a snapshot of a still picture to serve as a still picture Grabber in the embodiment of the present invention. Subsequently, a source Filter 1 and a video sample collector tab 2 of the device may be added to the image screener, and the video sample collector tab 1 may be configured according to the preset preview pixel value, so that the subsequent video sample collector tab 1 may capture the preview video data according to the configured preview pixel value, for example, the video sample collector tab 1 may be configured according to the preset preview pixel value 200, so that the video sample collector tab 1 captures the preview video data according to the preset preview pixel value 200, to ensure real-time performance of transmission of the preview video data, and at the same time, the snapshot sample collector tab 2 may be configured according to the camera pixel threshold value, so that the snapshot sample tab 2 may capture the still picture data for generating the snapshot picture according to the camera threshold value, to ensure the clarity of the snapshot picture. After configuring the video sample collector marker 1 and the snapshot sample Grabber marker 2, a video preview pin and a render video preview pin can be configured, and then media control is acquired and a running state is entered to try a device image of the high shooting instrument, that is, preview video data generated by the high shooting instrument is acquired through the video sample collector marker 1, and still picture data generated by the high shooting instrument can be acquired through the snapshot sample Grabber marker 2.
Step 250, detecting whether a second shooting instruction is received.
The second shooting instruction is used for triggering the image processing equipment to generate a snapshot picture according to the static picture data, and the pixels of the static picture data are higher than the pixels of the preview video data. It should be noted that the second shooting instruction may be automatically generated by the image processing apparatus, for example, the second shooting instruction may be automatically generated by the image processing apparatus according to a certain waiting time after the first shooting instruction is sent, or the second shooting instruction may be generated by the image processing apparatus based on a shooting operation submitted by a user, which is not limited in this embodiment of the present invention.
Specifically, after sending the first shooting instruction, the image processing apparatus in the embodiment of the present invention may detect whether a second shooting instruction is received, and if the second shooting instruction is received, may execute step 260 to generate a snapshot picture according to the obtained still picture data; if the second shooting instruction is not received, the process may jump to execute step 270, so as to output the real-time preview video corresponding to the high-speed shooting instrument according to the obtained preview video data.
Step 260, generating a snapshot picture according to the static picture data.
And 270, outputting a real-time preview video corresponding to the high-speed shooting instrument according to the preview video data.
Therefore, after sending a first shooting instruction to a high-speed shooting instrument, the embodiment of the invention obtains preview video data transmitted by the high-speed shooting instrument through a first video stream interface, and obtains still picture data transmitted by the high-speed shooting instrument through a second video stream interface, namely, different video stream interfaces are adopted to transmit the preview video data and the still picture data, so that a snapshot picture can be generated according to the obtained still picture data when the second shooting instruction is received, and a real-time preview video is generated and output according to the obtained preview video data when the second shooting instruction is not received, so that a user can watch the real-time preview video corresponding to the high-speed shooting instrument, the purpose of transmitting a trial preview video and the snapshot picture through different video stream interfaces is achieved, the real-time change of an image below the high-speed shooting instrument camera can be displayed in time, and the problem that the high-speed shooting instrument software displays a jam in real time due to implementation of the preview image according to the high-speed shooting instrument camera pixel display in the prior art is, and improving the display frame rate of the equipment.
Example two
On the basis of the above embodiment, another image processing method based on a high-speed shooting instrument is provided in an embodiment of the present invention, and is applied to the high-speed shooting instrument, so that the high-speed shooting instrument can transmit preview video data and still picture data through different video stream interfaces after receiving a first shooting instruction, thereby solving the problem in the prior art that the high-speed shooting instrument software displays a preview image in real time according to the display of a camera pixel of the high-speed shooting instrument, and ensuring the timeliness of the real-time display effect of the high-speed shooting instrument software.
Referring to fig. 3, a schematic step flow diagram of another processing method for an application installation package according to an embodiment of the present invention is shown. The embodiment is applicable to the image processing situation based on the high-speed shooting instrument, for example, the embodiment can be applied to the situation that the high-speed shooting instrument shoots and transmits preview video data and still picture data, and specifically includes the following steps:
step 310, receiving a first shooting instruction;
step 320, starting a camera according to the first shooting instruction to acquire an image, so as to obtain image acquisition data;
specifically, after receiving the first shooting instruction, the high-speed shooting instrument in the embodiment of the present invention may start one or more cameras to perform image acquisition based on the first shooting instruction, so as to obtain image acquisition data.
Step 330, generating still picture data and preview video data according to the image acquisition data.
Specifically, after image acquisition data is obtained, the embodiment of the present invention may generate still image data according to a camera pixel threshold, so that the still image data may be transmitted by using a second video interface correspondingly set to the camera pixel threshold subsequently; and preview video data can be generated according to a preset preview pixel threshold value, so that the preview video data can be transmitted by adopting a first video stream interface correspondingly set to the preview pixel threshold value in the following pleasure.
Step 340, transmitting the preview video data through the first video streaming interface, and transmitting the still picture data through the second video streaming interface.
Specifically, after the high-speed shooting instrument generates preview video data and still picture data, the preview video data can be transmitted through the first video stream interface, so that the image processing device with the high-speed shooting instrument software can acquire the preview video data transmitted by the high-speed shooting instrument through the first video stream interface, and simultaneously can transmit the still picture data through the second video stream interface, so that the image processing device with the high-speed shooting instrument software can acquire the still picture data transmitted by the high-speed shooting instrument through the second video stream interface, so that the image processing device can generate a snapshot picture according to the still picture data when receiving a second shooting instruction, and can output a real-time preview video corresponding to the high-speed shooting instrument according to the preview video data when not receiving the second shooting instruction, thereby ensuring that the pixels of the shot picture are not changed, the image change in the camera field of view can be clearly checked in real time, and the display frame rate of the equipment is improved.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention.
EXAMPLE III
Referring to fig. 4, a block diagram of a high-speed scanner-based image processing apparatus according to an embodiment of the present invention is shown, where the high-speed scanner-based image processing apparatus may specifically include the following modules:
a shooting instruction transmission module 410, configured to transmit a first shooting instruction to a high-speed shooting instrument according to a user operation, where the first shooting instruction is used to trigger the high-speed shooting instrument to start a camera for image data acquisition;
a data obtaining module 420, configured to obtain preview video data transmitted by the high-speed shooting instrument through a first video streaming interface, and obtain still picture data transmitted by the high-speed shooting instrument through a second video streaming interface;
a snapshot image generating module 430, configured to generate a snapshot image according to the static image data when a second shooting instruction is received;
and a preview video output module 440, configured to output a real-time preview video corresponding to the high-speed shooting instrument according to the preview video data when a second shooting instruction is not received.
On the basis of the above embodiment, optionally, the captured instruction transmitting module 310 may include the following sub-modules:
a user operation receiving submodule for receiving a user operation,
the shooting instruction generating submodule is used for generating a first shooting instruction according to user operation;
and the shooting instruction sending submodule is used for sending the first shooting instruction to the high-speed shooting instrument through a video control interface.
In actual processing, alternatively, the image processing apparatus described above may be applied to an image processing device connected to a high-speed camera, and the image processing apparatus further includes a second shooting instruction detection module. The second shooting instruction detection module may be configured to detect whether a second shooting instruction is received. The second shooting instruction is used for triggering the image processing equipment to generate a snapshot picture according to the static picture data, and the pixels of the static picture data are higher than the pixels of the preview video data.
Further, the data obtaining module 420 in the embodiment of the present invention may include the following sub-modules:
the video preview grabber calling sub-module is used for calling a video preview grabber through a first video stream interface, and the video preview grabber is used for acquiring preview video data transmitted by the high-speed shooting instrument according to a preset preview pixel threshold value;
and the static picture grabber calling submodule is used for calling the static picture grabber through a second video interface, and the static picture grabber is used for acquiring the static picture data transmitted by the high-speed shooting instrument according to the pixel threshold value of the camera.
Optionally, the image processing apparatus based on a high-speed scanner further includes the following modules:
the creation module is used for creating a video preview grabber and a static picture grabber after the video control interface is obtained;
the adding module is used for adding the video preview grabber and the static picture grabber into a preset graphic filter;
and the configuration module is used for configuring the video preview grabber according to a preset preview pixel value and configuring the static picture grabber according to a camera pixel threshold value of the high-speed shooting instrument, wherein the preset preview pixel value is lower than the camera pixel threshold value.
The image processing apparatus based on a high-speed scanner can execute the image processing method based on a high-speed scanner according to any of the embodiments of the present invention, and has the corresponding functions and advantages of the execution method.
In a specific implementation, the image processing apparatus based on the high-speed scanner may be configured by two or more physical entities, or may be configured by one physical entity, which is not limited in this embodiment. Furthermore, the high-camera based image processing apparatus may be integrated in a high-camera based image processing device.
Example four
The embodiment of the invention also provides a high-speed scanner, which specifically comprises the following modules as shown in fig. 5:
a shooting instruction receiving module 510, configured to receive a first shooting instruction;
the image acquisition module 520 is configured to start a camera for image acquisition according to the first shooting instruction to obtain image acquisition data;
a collected data processing module 530, configured to generate still picture data and preview video data according to the image collected data;
and a data transmission module 540, configured to transmit the preview video data through the first video streaming interface, and transmit the still picture data through the second video streaming interface.
EXAMPLE five
The embodiment of the invention also provides image processing equipment based on the high-speed shooting instrument, which comprises: a processor and a memory; the memory has stored therein at least one instruction that, when executed by the processor, causes the high-imager based image processing apparatus to perform a high-imager based image processing method as described in any one of the above method embodiments.
In actual processing, the memory may be used as a computer-readable storage medium for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the image processing method based on the high-speed camera according to any embodiment of the present invention (for example, a shooting instruction transmission module, a data acquisition module, a snapshot image generation module, a preview video output module, and the like in the image processing apparatus based on the high-speed camera). The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating device, an application program required for at least one function; the storage data area may store data created from use of the high-speed scanner, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device.
The processor executes various functional applications and data processing of the high-speed camera by running software programs, instructions and modules stored in the memory, namely, the image processing method based on the high-speed camera is realized. For example, when the processor executes one or more programs stored in the memory, the following operations are implemented: transmitting a first shooting instruction to a high-speed shooting instrument according to user operation, wherein the first shooting instruction is used for triggering the high-speed shooting instrument to start a camera to acquire image data; acquiring preview video data transmitted by the high-speed shooting instrument through a first video streaming interface, and acquiring still picture data transmitted by the high-speed shooting instrument through a second video streaming interface; if a second shooting instruction is received, generating a snapshot picture according to the static picture data; and otherwise, outputting the real-time preview video corresponding to the high-speed shooting instrument according to the preview video data. For another example, when the processor executes one or more programs stored in the memory, the following operations are implemented: receiving a first shooting instruction; starting a camera according to the first shooting instruction to acquire an image, and acquiring image acquisition data; generating static picture data and preview video data according to the image acquisition data; and transmitting preview video data through a first video stream interface, and transmitting the static picture data through a second video stream interface.
EXAMPLE six
Embodiments of the present invention further provide a computer-readable storage medium, where instructions, when executed by a processor of a computer device, enable the computer device to perform the image processing method based on a high-speed scanner as described in the above method embodiments.
Illustratively, the high-speed camera-based image processing method includes: transmitting a first shooting instruction to a high-speed shooting instrument according to user operation, wherein the first shooting instruction is used for triggering the high-speed shooting instrument to start a camera to acquire image data; acquiring preview video data transmitted by the high-speed shooting instrument through a first video streaming interface, and acquiring still picture data transmitted by the high-speed shooting instrument through a second video streaming interface; if a second shooting instruction is received, generating a snapshot picture according to the static picture data; and otherwise, outputting the real-time preview video corresponding to the high-speed shooting instrument according to the preview video data.
As another example of the present invention, for example, the high-speed camera-based image processing method includes: receiving a first shooting instruction; starting a camera according to the first shooting instruction to acquire an image, and acquiring image acquisition data; generating static picture data and preview video data according to the image acquisition data; and transmitting preview video data through a first video stream interface, and transmitting the static picture data through a second video stream interface.
It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. For simplicity of explanation, the method embodiments are described as a series of acts or combinations, but those skilled in the art will appreciate that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently with other steps in accordance with the embodiments of the invention. For the system, apparatus, and media embodiments, because they are substantially similar to the method embodiments, the description is relatively simple, and for related parts, reference may be made to some descriptions of the method embodiments.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. It should be noted that, the units and modules included in the above embodiments are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (10)

1. An image processing method based on a high-speed shooting instrument is characterized by comprising the following steps:
transmitting a first shooting instruction to a high-speed shooting instrument according to user operation, wherein the first shooting instruction is used for triggering the high-speed shooting instrument to start a camera to acquire image data;
acquiring preview video data transmitted by the high-speed shooting instrument through a first video streaming interface, and acquiring still picture data transmitted by the high-speed shooting instrument through a second video streaming interface;
if a second shooting instruction is received, generating a snapshot picture according to the static picture data; and otherwise, outputting the real-time preview video corresponding to the high-speed shooting instrument according to the preview video data.
2. The image processing method based on the high-speed camera according to claim 1, wherein the transmitting the first shooting instruction to the high-speed camera according to the user operation comprises:
receiving the operation of a user, and sending the operation,
generating a first shooting instruction according to user operation;
and sending the first shooting instruction to a high-speed shooting instrument through a video control interface.
3. The high-speed camera-based image processing method according to claim 1 or 2, wherein the image processing method is applied to an image processing apparatus connected to a high-speed camera, and the image processing method further comprises:
and detecting whether a second shooting instruction is received or not, wherein the second shooting instruction is used for triggering the image processing equipment to generate a snapshot picture according to the static picture data, and the pixel of the static picture data is higher than the pixel of the preview video data.
4. The image processing method based on the high-speed camera according to claim 1 or 2, wherein the obtaining of the preview video data transmitted by the high-speed camera through a first video streaming interface and the obtaining of the still picture data transmitted by the high-speed camera through a second video streaming interface comprises:
calling a video preview grabber through a first video stream interface, wherein the video preview grabber is used for acquiring preview video data transmitted by the high-speed shooting instrument according to a preset preview pixel threshold value;
and calling a static picture grabber through a second video interface, wherein the static picture grabber is used for acquiring the static picture data transmitted by the high-speed shooting instrument according to the pixel threshold value of the camera.
5. The high-speed camera-based image processing method according to claim 4, further comprising:
after a video control interface is obtained, a video preview grabber and a static picture grabber are created;
adding the video preview grabber and the static picture grabber into a preset graphic filter;
and configuring the video preview grabber according to a preset preview pixel value, and configuring the static picture grabber according to a camera pixel threshold value of the high-speed shooting instrument, wherein the preset preview pixel value is lower than the camera pixel threshold value.
6. An image processing method based on a high-speed shooting instrument is characterized by comprising the following steps:
receiving a first shooting instruction;
starting a camera according to the first shooting instruction to acquire an image, and acquiring image acquisition data;
generating static picture data and preview video data according to the image acquisition data;
and transmitting preview video data through a first video stream interface, and transmitting the static picture data through a second video stream interface.
7. An image processing apparatus based on a high-speed scanner, comprising:
the shooting instruction transmission module is used for transmitting a first shooting instruction to the high-speed shooting instrument according to user operation, and the first shooting instruction is used for triggering the high-speed shooting instrument to start a camera to acquire image data;
the data acquisition module is used for acquiring preview video data transmitted by the high-speed shooting instrument through a first video stream interface and acquiring still picture data transmitted by the high-speed shooting instrument through a second video stream interface;
the snapshot picture generation module is used for generating a snapshot picture according to the static picture data when receiving a second shooting instruction;
and the preview video output module is used for outputting the real-time preview video corresponding to the high shooting instrument according to the preview video data when a second shooting instruction is not received.
8. A high speed scanner, comprising:
the shooting instruction receiving module is used for receiving a first shooting instruction;
the image acquisition module is used for starting a camera for image acquisition according to the first shooting instruction to obtain image acquisition data;
the collected data processing module is used for generating static picture data and preview video data according to the image collected data;
and the data transmission module is used for transmitting the preview video data through the first video stream interface and transmitting the static picture data through the second video stream interface.
9. An image processing apparatus based on a high-speed scanner, comprising: a processor and a memory;
the memory has stored therein at least one instruction that, when executed by the processor, causes the image processing apparatus to perform the high-camera based image processing method of any one of claims 1 to 5.
10. A computer-readable storage medium, wherein instructions in the readable storage medium, when executed by a processor of a computer device, enable the computer device to perform the high-camera based image processing method of any one of claims 1 to 6.
CN202110191850.4A 2021-02-19 2021-02-19 Image processing method based on high-speed shooting instrument and related equipment Pending CN112954216A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110191850.4A CN112954216A (en) 2021-02-19 2021-02-19 Image processing method based on high-speed shooting instrument and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110191850.4A CN112954216A (en) 2021-02-19 2021-02-19 Image processing method based on high-speed shooting instrument and related equipment

Publications (1)

Publication Number Publication Date
CN112954216A true CN112954216A (en) 2021-06-11

Family

ID=76244605

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110191850.4A Pending CN112954216A (en) 2021-02-19 2021-02-19 Image processing method based on high-speed shooting instrument and related equipment

Country Status (1)

Country Link
CN (1) CN112954216A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103402055A (en) * 2013-07-29 2013-11-20 广东欧珀移动通信有限公司 Camera chip for mobile terminal, mobile terminal with image pick-up function, shooting method for mobile terminal and shooting device for mobile terminal
US20140365892A1 (en) * 2013-06-08 2014-12-11 Tencent Technology (Shenzhen) Company Limited Method, apparatus and computer readable storage medium for displaying video preview picture
CN106797424A (en) * 2014-12-22 2017-05-31 谷歌公司 Imageing sensor with multiple output ports
CN107509038A (en) * 2017-10-16 2017-12-22 维沃移动通信有限公司 A kind of image pickup method and mobile terminal
CN110401798A (en) * 2019-07-30 2019-11-01 晶晨半导体(深圳)有限公司 A kind of adjusting method and device of MIPI camera output resolution ratio
CN110620872A (en) * 2018-06-20 2019-12-27 三星电子株式会社 Image sensor and electronic device including the same

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140365892A1 (en) * 2013-06-08 2014-12-11 Tencent Technology (Shenzhen) Company Limited Method, apparatus and computer readable storage medium for displaying video preview picture
CN103402055A (en) * 2013-07-29 2013-11-20 广东欧珀移动通信有限公司 Camera chip for mobile terminal, mobile terminal with image pick-up function, shooting method for mobile terminal and shooting device for mobile terminal
CN106797424A (en) * 2014-12-22 2017-05-31 谷歌公司 Imageing sensor with multiple output ports
CN107509038A (en) * 2017-10-16 2017-12-22 维沃移动通信有限公司 A kind of image pickup method and mobile terminal
CN110620872A (en) * 2018-06-20 2019-12-27 三星电子株式会社 Image sensor and electronic device including the same
CN110401798A (en) * 2019-07-30 2019-11-01 晶晨半导体(深圳)有限公司 A kind of adjusting method and device of MIPI camera output resolution ratio

Similar Documents

Publication Publication Date Title
US8098297B2 (en) Pre- and post-shutter signal image capture and sort for digital camera
CN107040794A (en) Video broadcasting method, server, virtual reality device and panoramic virtual reality play system
US8897602B2 (en) Imaging system with multiframe scaler
WO2014086223A1 (en) Video communication method and apparatus
JP2016197858A (en) Real time image stitch device and real time image stitch method
CN113067994B (en) Video recording method and electronic equipment
CN105262948B (en) A kind of panorama shooting method and mobile terminal
EP3528490B1 (en) Image data frame synchronization method and terminal
WO2018000619A1 (en) Data display method, device, electronic device and virtual reality device
CN109194866B (en) Image acquisition method, device, system, terminal equipment and storage medium
JP5317630B2 (en) Image distribution apparatus, method and program
CN113766217B (en) Video delay testing method and device, electronic equipment and storage medium
WO2015024367A1 (en) Shot image processing method and apparatus
US9007531B2 (en) Methods and apparatus for expanding a field of view in a video communication session
CN112954216A (en) Image processing method based on high-speed shooting instrument and related equipment
CN108882004B (en) Video recording method, device, equipment and storage medium
CN114501136B (en) Image acquisition method, device, mobile terminal and storage medium
US20210152782A1 (en) Data Transmission Method, Camera and Electronic Device
US11443403B2 (en) Image and video processing using multiple pipelines
CN103685943A (en) Display equipment, image capturing and controlling device and image capturing and controlling method
CN108683842B (en) Panoramic camera and method and device for outputting panoramic video
JP2012533922A (en) Video processing method and apparatus
US10440266B2 (en) Display apparatus and method for generating capture image
WO2022061723A1 (en) Image processing method, device, terminal, and storage medium
WO2022121504A1 (en) Image processing method, image processor, and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210611

RJ01 Rejection of invention patent application after publication