CN112995488A - High-resolution video image processing method and device and electronic equipment - Google Patents

High-resolution video image processing method and device and electronic equipment Download PDF

Info

Publication number
CN112995488A
CN112995488A CN201911273597.6A CN201911273597A CN112995488A CN 112995488 A CN112995488 A CN 112995488A CN 201911273597 A CN201911273597 A CN 201911273597A CN 112995488 A CN112995488 A CN 112995488A
Authority
CN
China
Prior art keywords
video image
roi
processing
image processing
key
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911273597.6A
Other languages
Chinese (zh)
Other versions
CN112995488B (en
Inventor
罗腓力
沈奕鹏
蔡一飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Futaihong Precision Industry Co Ltd
Chiun Mai Communication Systems Inc
Original Assignee
Shenzhen Futaihong Precision Industry Co Ltd
Chiun Mai Communication Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Futaihong Precision Industry Co Ltd, Chiun Mai Communication Systems Inc filed Critical Shenzhen Futaihong Precision Industry Co Ltd
Priority to CN201911273597.6A priority Critical patent/CN112995488B/en
Publication of CN112995488A publication Critical patent/CN112995488A/en
Application granted granted Critical
Publication of CN112995488B publication Critical patent/CN112995488B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/64Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Image Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The invention provides a video image processing method, which comprises the following steps: (a) collecting a video image with high resolution; (b) defining one or a plurality Of interesting picture areas needing further processing in the video image as ROI (region Of interest) and identifying a plurality Of ROI areas needing processing; (c) analyzing and processing the ROI areas to obtain key information of each ROI area, and obtaining further key ROI areas according to the key information; and (d) sending the obtained ROI area and the analysis result to a corresponding display terminal, and displaying on a screen of the display terminal. The invention also provides a video image processing device and electronic equipment.

Description

High-resolution video image processing method and device and electronic equipment
Technical Field
The present invention relates to the field of video image processing technologies, and in particular, to a method and an apparatus for processing a high-resolution video image, and an electronic device.
Background
With the progress of image sensing technology and encoding and decoding technology, the application of ultra-high-definition video images (4K/8K) is becoming popular. Ultra-high definition image detail will greatly enhance the effectiveness of a variety of applications such as industrial inspection, surveillance, and the like. Meanwhile, artificial intelligence AI techniques include advances in deep learning, making intelligent automatic analysis processing (e.g., classification, defect identification, etc.) of video images increasingly reliable. However, for ultra-high-definition video images such as 8K, the data size is 16 times that of 2K full-high-definition video, and a system with high computing power is required for real-time video processing.
In addition, although in large-screen systems such as 8K televisions, 8K ultra-high-definition decoding and display can be achieved. However, for many portable terminals, such as mobile phones, tablet computers, and the like, ultra-high definition decoding and display capabilities are still insufficient. Therefore, how to implement the ultra-high-definition detail presentation on the ultra-high-definition decoding and display-limited device, such as a mobile phone, on the result and the video image after the intelligent AI processing is an important issue to be faced at present.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a high-resolution video image processing method, apparatus and electronic device.
One aspect of the present invention provides a video image processing method, including:
(a) collecting a video image with high resolution;
(b) defining one or a plurality Of interesting picture areas needing further processing in the video image as ROI (region Of interest) and identifying a plurality Of ROI areas needing processing;
(c) analyzing and processing the ROI areas to obtain key information of each ROI area, and obtaining further key ROI areas according to the key information; and
(d) and sending the obtained ROI area and the analysis result to a corresponding display terminal, and displaying on a screen of the display terminal.
Preferably, the method further comprises the step of preprocessing the video image before performing step (b).
As a preferable scheme, the method further comprises the step of judging whether the computing resources are sufficient before the step (b) is executed, and when the computing resources are judged to be sufficient, the step (b) is executed; when the computing resources are judged to be insufficient, the high-resolution video image is processed to be converted into a low-resolution video image, and then the step (b) is executed.
As a preferable aspect, the method further includes:
and analyzing and processing the key ROI according to the acquired key ROI area to obtain associated information of the key ROI area, and acquiring a further associated ROI area according to the associated information.
Preferably, the ROI is a sub-picture of the panorama picture, the panorama picture itself, or a reduced resolution panorama picture.
Another aspect of the present invention provides a video image processing apparatus, comprising:
the acquisition module is used for acquiring a high-resolution video image;
the first processing module is used for defining one or a plurality Of interesting picture areas needing further processing in the video image as ROI (region Of interest) and identifying a plurality Of ROI areas needing processing;
the second processing module is used for analyzing and processing the ROI areas to obtain key information of each ROI area and obtaining further key ROI areas according to the key information; and
and the distribution module is used for sending the obtained ROI area and the analysis result to a corresponding display terminal and displaying the ROI area and the analysis result on a screen of the display terminal.
Preferably, the acquisition module is further configured to pre-process the video image.
As a preferred solution, the video image processing apparatus further includes a determining module and a resolution reducing module, wherein the determining module is configured to determine whether the computing resource is sufficient, and when the computing resource is determined to be insufficient, the resolution reducing module is configured to process the high-resolution video image to convert the high-resolution video image into the low-resolution video image.
As a preferred scheme, the video image processing apparatus further includes a third processing module, configured to analyze and process the obtained key ROI region according to the obtained key ROI region, so as to obtain associated information of the key ROI region, and obtain a further associated ROI region according to the associated information.
Preferably, the ROI is a sub-picture of the panorama picture, the panorama picture itself, or a reduced resolution panorama picture.
Another aspect of the present invention provides an electronic device, which executes the video image processing method according to any one of the above items.
The video image processing method and the video image processing device can directly and quickly identify the high-resolution video image or the low-resolution video image. In addition, the video image processing method can dynamically acquire the detailed ROI and analysis process based on the high-resolution image in each stage according to various configuration methods, and can also acquire the low-resolution panoramic preview. For example, the video image processing method can obtain and display the ROI of a smiling face with details of 8K degrees, the ROI of a crying face or the ROI with a bleeding part on a display terminal of a small screen, and can browse the distribution and analysis introduction of all human faces in a panoramic low-resolution picture and click into human face detail browsing. In this way, under the condition that an 8K large display screen is not needed, by using the video image processing method of the invention, the display terminal can also rapidly access the ROI picture needing attention in the 8K full-width image and rapidly follow up the processing.
Drawings
FIG. 1 is a flowchart illustrating a video image processing method according to a preferred embodiment of the invention.
Fig. 2 is a schematic view of an application scenario of the video image processing method shown in fig. 2.
FIG. 3 is a functional block diagram of a video image processing apparatus according to a preferred embodiment of the invention.
FIG. 4 is a functional block diagram of a video image processing system according to a preferred embodiment of the present invention.
Description of the main elements
Figure BDA0002314916440000031
Figure BDA0002314916440000041
The following detailed description will further illustrate the invention in conjunction with the above-described figures.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without inventive effort based on the embodiments of the present invention, are within the scope of the present invention.
Referring to fig. 1, fig. 1 is a flow chart of a video image processing method according to a preferred embodiment of the invention. The method is used for effectively processing the video image with high resolution. It will be understood that the order of the steps in the flow diagrams may be changed and certain steps may be omitted, depending on various requirements.
And step S01, acquiring a video image with high resolution in real time, and preprocessing the video image.
It can be understood that, in this embodiment, a photographing module can perform image sensing on a picture in a photographing field of view to obtain a picture composed of digitized original pixel data. It is understood that the picture is typically 4K/8K ultra high definition picture data of a large data volume. That is, in the present embodiment, the ultra-high definition, for example, 4K or 8K video images can be acquired in real time.
It can be understood that, in this embodiment, a frame of ultra high definition picture composed of original pixel data can be periodically obtained from the camera module, and the pixel data format of the picture is converted and preprocessed accordingly according to application requirements. For example, the number of frames collected per second may be 25, 30, 60, 120, etc., depending on the configuration. The format of the pixel may be YUV444, YUV422, YUV420, etc. In addition, if necessary, preprocessing operations such as noise reduction and edge sharpening can be performed on the picture according to needs.
In step S02, it is determined whether the computing resources are sufficient. If not, step S03 is executed. If yes, go to step S04.
In step S03, the high resolution video image is processed to be converted into a low resolution video image.
For example, the 8K image is reduced to a 2K image.
Step S04, defining one or several interesting picture areas in the video image that need further processing as ROI (region Of interest), and under the coarse mode picture, identifying several ROI areas that need processing.
It is understood that the ROI may be one sub-picture of the panorama picture. Furthermore, the panoramic picture itself or the reduced resolution panoramic picture may also be considered as a type of special ROI picture.
It is understood that in the present embodiment, a face region can be defined as an ROI region, and a plurality of face regions in the video image can be rapidly marked by using a fast face recognition algorithm.
Step S05, analyzing and processing the plurality of ROI areas in the rough mode screen to execute the fine mode, and further obtaining the key information of each ROI area, and obtaining further key ROI areas according to the key information.
For example, for each ROI region (e.g., each face region), further analysis processing is performed to obtain key information of each ROI region, such as emotion information of the face region. The emotional information may be joy, calm, cry, or otherwise. And obtaining corresponding key ROI areas according to the key information of each ROI area. For example, the corresponding key ROI area obtained according to the crying information in the emotion information is a face area with crying information.
Step S06, analyzing and processing the key ROI according to the acquired key ROI to execute a correlation mode, further obtaining correlation information of the key ROI, and obtaining a further correlation ROI according to the correlation information.
For example, in step S05, when a crying face region is found by analysis, a human body contour region relating to the face region is further calculated, and the human body contour region is analyzed and detected to determine whether there is information relating to bleeding, a fallen posture, a jersey number, and the like.
And step S07, sending the ROI image area and the analysis result obtained in the step S03, the step S04, the step S05 and/or the step S06 to a corresponding display terminal according to the system configuration or the dynamic requirement of the display terminal, and displaying the ROI image area and the analysis result on the screen of the display terminal.
It is understood that in other embodiments, when the association area analysis is not required, step S07 may be directly performed, and step S06 may be omitted.
It can be understood that, in this embodiment, the video image processing method can directly and rapidly identify a high-resolution video image or a low-resolution video image. In addition, the video image processing method can dynamically acquire the detailed ROI and analysis process based on the high-resolution image in each stage according to various configuration methods, and can also acquire the low-resolution panoramic preview. For example, the video image processing method may obtain and display an ROI of a smiling face with details of 8K degree, an ROI of a crying face, or an ROI with a bleeding part on a display terminal of a small screen, and may browse all face distributions and analysis introductions in a panoramic low-resolution picture, and click into face detail browsing (e.g., step S03). In this way, under the condition that an 8K large display screen is not needed, by using the video image processing method of the invention, the display terminal can also rapidly access the ROI picture needing attention in the 8K full-width image and rapidly follow up the processing.
Referring to fig. 2, the video image processing method will be further described by taking the identification and analysis of the face area as an example.
First, ultra-high definition (e.g., 8K) video image acquisition is performed. Then, the calculated amount is judged. When the calculation amount is low, the super high definition video image is subjected to resolution reduction operation, for example, an 8K image is reduced to a 2K image. The coarse mode is then performed to identify relevant ROI regions, for example to identify regions of a plurality of human faces, including smiling faces, crying faces, etc. And when the calculation amount is high, directly skipping the operation of reducing the resolution so as to identify a plurality of related ROI areas for the ultra-high definition video image in the rough mode picture.
Then, the plurality of face regions are further analyzed and processed, namely, a fine mode is executed, so that key information of each ROI region is obtained, and further key ROI regions are obtained according to the key information. For example, the plurality of face regions are analyzed and processed to obtain emotion information of each face region. The emotional information may be joy, calm, cry, or otherwise. And obtaining corresponding key ROI areas according to the key information of each ROI area. For example, expressions or emotions of a plurality of face regions are analyzed, and the crying face region is taken as a key ROI region.
And then, analyzing and processing the key ROI according to the acquired key ROI area to execute a correlation mode so as to obtain correlation information of the key ROI area, and obtaining a further correlation ROI area according to the correlation information. For example, when a crying face region is found by analysis, a related human body contour region related to the face region is further calculated, and analysis and detection are performed to determine whether there is related information such as bleeding, a fallen posture, and a jersey number.
And finally, according to the dynamic requirements of system configuration or a display terminal, transmitting the ROI images obtained at each stage, such as a plurality of ROI areas, key ROI areas and/or associated ROI areas and analysis results to the corresponding display terminal, and displaying the ROI images on a screen of the display terminal.
It is understood that referring to fig. 3, another embodiment of the invention further provides a video image processing apparatus 100. The video image processing device 100 includes an acquisition module 11, a determination module 13, a degradation analysis module 15, a first processing module 16, a second processing module 17, a third processing module 18, and a distribution module 19.
The acquisition module 11 is configured to acquire an ultra-high-definition, for example, 4K or 8K, video image in real time and pre-process the video image.
The determining module 13 is used for determining whether the computing resources are sufficient.
The resolution reduction module 15 is configured to process the high-resolution video image to convert the high-resolution video image into a low-resolution video image. For example, the 8K image is reduced to a 2K image.
The first processing module 16 is used to define one or several interesting picture areas in the video image that need further processing as ROI (region Of interest), and under the coarse mode picture, identify several ROI areas that need processing.
It is understood that the ROI may be one sub-picture of the panorama picture. Furthermore, the panoramic picture itself or the reduced resolution panoramic picture may also be considered as a type of special ROI picture.
It is understood that in the present embodiment, a face region can be defined as an ROI region, and a plurality of face regions in the video image can be rapidly marked by using a fast face recognition algorithm.
The second processing module 17 is configured to analyze and process a plurality of ROI areas in the rough mode screen to execute the fine mode, so as to obtain key information of each ROI area, and obtain a further key ROI area according to the key information. For example, for each ROI region (e.g., each face region), further analysis processing is performed to obtain key information of each ROI region, such as emotion information of the face region. The emotional information may be joy, calm, cry, or otherwise. And obtaining corresponding key ROI areas according to the key information of each ROI area. For example, the corresponding key ROI area obtained according to the crying information in the emotion information is a face area with crying information.
The third processing module 18 is configured to analyze and process the key ROI according to the obtained key ROI, so as to execute an association mode, further obtain association information of the key ROI, and obtain a further association ROI according to the association information.
For example, when a crying face region is found by analysis, a human body contour region related to the face region is further calculated, and the human body contour region is analyzed and detected to determine whether there is related information such as bleeding, a fallen posture, a jersey number, and the like.
The distribution module 19 is configured to send the ROI image region and the analysis result obtained by the first processing module 16, the second processing module 17, and/or the third processing module 18 to a corresponding display terminal according to system configuration or a dynamic requirement of the display terminal, and display the ROI image region and the analysis result on a screen of the display terminal.
It is understood that, referring to fig. 4, an electronic device 200 is further provided according to another embodiment of the present invention. The electronic device 200 comprises a memory 201, a processor 202 and a computer program 203 stored in the memory 201 and executable on the processor 202.
The electronic device 200 may also include a camera module 205. The photographing module 205 is used for image sensing of a picture in a photographing field of view to obtain a picture composed of digitized original pixel data.
The electronic device 200 may be a device with ultra-high-definition video image processing, real-time processor, image playing or displaying functions, such as an 8K camera, a high-speed server, an integrated system of 8K televisions, and the like. Those skilled in the art will appreciate that the schematic diagram is merely an example of the electronic device 200 and does not constitute a limitation of the electronic device 200, and may include more or less components than those shown, or some components in combination, or different components.
The processor 202 is configured to execute the computer program 203 to implement the steps of the video image processing method embodiments, such as the steps S01-S07 shown in fig. 1. Alternatively, the processor 202, when executing the computer program 203, implements the functions of the modules/units in the above-mentioned embodiment of the video image processing apparatus 100, such as the acquisition module 11, the judgment module 13, the degradation analysis module 15, the first processing module 16, the second processing module 17, the third processing module 18, and the distribution module 19 in fig. 3.
Illustratively, the computer program 203 may be partitioned into one or more modules/units that are stored in the memory 201 and executed by the processor 202 to implement the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, the instruction segments describing the execution process of the computer program 203 in the electronic device 200. For example, the computer program 203 may be divided into the acquisition module 11, the determination module 13, the degradation analysis module 15, the first processing module 16, the second processing module 17, the third processing module 18, and the distribution module 19 in fig. 3.
The Processor 202 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, or the like. A general purpose processor may be a microprocessor or the processor 202 may be any conventional processor or the like, the processor 202 being the control center of the electronic device 200 and connecting the various parts of the entire electronic device 200 using various interfaces and lines.
The memory 201 may be used to store the computer program 203 and/or the modules/units the processor 202 implements various functions of the electronic device 200 by running or executing the computer program and/or the modules/units stored in the memory 201 and invoking data stored in the memory 201. The memory 201 may mainly include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as video data, audio data, a phonebook, etc.) created according to the use of the electronic apparatus 200, and the like. In addition, the memory 201 may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
The integrated modules/units of the electronic device 200, if implemented in the form of software functional modules and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and which, when executed by a processor, may implement the steps of the above-described embodiments of the method. Wherein the computer program comprises computer program code, which may be in the form of source code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical signals, and software distribution medium. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
It is to be appreciated that referring again to fig. 4, another embodiment of the invention further provides a video image processing system 300. The video image processing system 300 includes the electronic device 200 and a display terminal 301. The display terminal 301 may be a terminal device with limited ultra-high-definition decoding and display capabilities, such as a mobile phone and a tablet computer.
In the embodiments provided in the present invention, it should be understood that the disclosed electronic device and method can be implemented in other ways. For example, the above-described embodiments of the electronic device are merely illustrative, and for example, the division of the modules is only one logical functional division, and there may be other divisions when the actual implementation is performed.
In addition, each functional module in each embodiment of the present invention may be integrated into the same processing module, or each module may exist alone physically, or two or more modules may be integrated into the same module. The integrated module can be realized in a hardware form, and can also be realized in a form of hardware and a software functional module.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is to be understood that the word "comprising" does not exclude other modules or steps, and the singular does not exclude the plural. Several modules or electronic devices recited in the electronic device claims may also be implemented by one and the same module or electronic device by means of software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.
Finally, it should be noted that the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.

Claims (11)

1. A method for video image processing, the method comprising:
(a) collecting a video image with high resolution;
(b) defining one or a plurality of interesting picture areas needing further processing in the video image as ROI (region of interest) and identifying a plurality of ROI areas needing processing;
(c) analyzing and processing the ROI areas to obtain key information of each ROI area, and obtaining further key ROI areas according to the key information; and
(d) and sending the obtained ROI area and the analysis result to a corresponding display terminal, and displaying on a screen of the display terminal.
2. The video image processing method according to claim 1, characterized in that: the method further comprises the step of pre-processing the video image before performing step (b).
3. The video image processing method according to claim 1, characterized in that: the method further comprises the step of judging whether the computing resources are sufficient before the step (b) is executed, and when the computing resources are judged to be sufficient, the step (b) is executed; when the computing resources are judged to be insufficient, the high-resolution video image is processed to be converted into a low-resolution video image, and then the step (b) is executed.
4. The video image processing method according to claim 1, characterized in that: the method further comprises the following steps:
and analyzing and processing the key ROI according to the acquired key ROI area to obtain associated information of the key ROI area, and acquiring a further associated ROI area according to the associated information.
5. The video image processing method according to claim 1, characterized in that: the ROI is a sub-picture of the panoramic picture, the panoramic picture or the panoramic picture with reduced resolution.
6. A video image processing apparatus, characterized in that the apparatus comprises:
the acquisition module is used for acquiring a high-resolution video image;
the first processing module is used for defining one or a plurality of interesting picture areas needing further processing in the video image as ROI (region of interest) and identifying a plurality of ROI areas needing processing;
the second processing module is used for analyzing and processing the ROI areas to obtain key information of each ROI area and obtaining further key ROI areas according to the key information; and
and the distribution module is used for sending the obtained ROI area and the analysis result to a corresponding display terminal and displaying the ROI area and the analysis result on a screen of the display terminal.
7. The video image processing apparatus according to claim 6, characterized in that: the acquisition module is further used for preprocessing the video image.
8. The video image processing apparatus according to claim 6, characterized in that: the video image processing device also comprises a judging module and a resolution reducing module, wherein the judging module is used for judging whether the computing resources are sufficient, and when the computing resources are judged to be insufficient, the resolution reducing module is used for processing the video image with high resolution so as to convert the video image into the video image with low resolution.
9. The video image processing apparatus according to claim 6, characterized in that: the video image processing device further comprises a third processing module, wherein the third processing module is used for analyzing and processing the key ROI according to the acquired key ROI area so as to obtain the associated information of the key ROI area, and further associated ROI areas are obtained according to the associated information.
10. The video image processing apparatus according to claim 6, characterized in that: the ROI is a sub-picture of the panoramic picture, the panoramic picture or the panoramic picture with reduced resolution.
11. An electronic device, characterized in that: the electronic device performs the video image processing method of any of claims 1-5.
CN201911273597.6A 2019-12-12 2019-12-12 High-resolution video image processing method and device and electronic equipment Active CN112995488B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911273597.6A CN112995488B (en) 2019-12-12 2019-12-12 High-resolution video image processing method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911273597.6A CN112995488B (en) 2019-12-12 2019-12-12 High-resolution video image processing method and device and electronic equipment

Publications (2)

Publication Number Publication Date
CN112995488A true CN112995488A (en) 2021-06-18
CN112995488B CN112995488B (en) 2023-04-18

Family

ID=76331564

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911273597.6A Active CN112995488B (en) 2019-12-12 2019-12-12 High-resolution video image processing method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN112995488B (en)

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101895741A (en) * 2009-05-22 2010-11-24 宏正自动科技股份有限公司 To the image processing of range of interest special processing and the method and system of transmission
CN102332090A (en) * 2010-06-21 2012-01-25 微软公司 Compartmentalizing focus area within field of view
EP2584451A2 (en) * 2011-10-18 2013-04-24 Acer Incorporated Method for adjusting video image compression using gesture
CN103297754A (en) * 2013-05-02 2013-09-11 上海交通大学 Monitoring video self-adaption interesting area coding system
CN104105006A (en) * 2014-07-23 2014-10-15 北京永新视博信息技术有限公司 Video image processing method and system
CN104185078A (en) * 2013-05-20 2014-12-03 华为技术有限公司 Video monitoring processing method, device and system thereof
CN107566834A (en) * 2017-10-10 2018-01-09 司马大大(北京)智能系统有限公司 Intraprediction unit division methods, device and electronic equipment
CN107682638A (en) * 2017-10-31 2018-02-09 北京疯景科技有限公司 Generation, the method and device of display panoramic picture
CN108241853A (en) * 2017-12-28 2018-07-03 深圳英飞拓科技股份有限公司 A kind of video frequency monitoring method, system and terminal device
CN108377407A (en) * 2016-11-04 2018-08-07 株式会社理光 Processing method, device and the electronic equipment of panoramic video
CN108683842A (en) * 2018-04-25 2018-10-19 深圳岚锋创视网络科技有限公司 A kind of panorama camera and the method and apparatus for exporting panoramic video
CN108848389A (en) * 2018-07-27 2018-11-20 恒信东方文化股份有限公司 A kind of panoramic video processing method, apparatus and system
CN110022463A (en) * 2019-04-11 2019-07-16 重庆紫光华山智安科技有限公司 Video interested region intelligent coding method and system are realized under dynamic scene
CN110378218A (en) * 2019-06-13 2019-10-25 大亚湾核电运营管理有限责任公司 A kind of image processing method, device and terminal device

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101895741A (en) * 2009-05-22 2010-11-24 宏正自动科技股份有限公司 To the image processing of range of interest special processing and the method and system of transmission
CN102332090A (en) * 2010-06-21 2012-01-25 微软公司 Compartmentalizing focus area within field of view
EP2584451A2 (en) * 2011-10-18 2013-04-24 Acer Incorporated Method for adjusting video image compression using gesture
CN103297754A (en) * 2013-05-02 2013-09-11 上海交通大学 Monitoring video self-adaption interesting area coding system
CN104185078A (en) * 2013-05-20 2014-12-03 华为技术有限公司 Video monitoring processing method, device and system thereof
CN104105006A (en) * 2014-07-23 2014-10-15 北京永新视博信息技术有限公司 Video image processing method and system
CN108377407A (en) * 2016-11-04 2018-08-07 株式会社理光 Processing method, device and the electronic equipment of panoramic video
CN107566834A (en) * 2017-10-10 2018-01-09 司马大大(北京)智能系统有限公司 Intraprediction unit division methods, device and electronic equipment
CN107682638A (en) * 2017-10-31 2018-02-09 北京疯景科技有限公司 Generation, the method and device of display panoramic picture
CN108241853A (en) * 2017-12-28 2018-07-03 深圳英飞拓科技股份有限公司 A kind of video frequency monitoring method, system and terminal device
CN108683842A (en) * 2018-04-25 2018-10-19 深圳岚锋创视网络科技有限公司 A kind of panorama camera and the method and apparatus for exporting panoramic video
CN108848389A (en) * 2018-07-27 2018-11-20 恒信东方文化股份有限公司 A kind of panoramic video processing method, apparatus and system
CN110022463A (en) * 2019-04-11 2019-07-16 重庆紫光华山智安科技有限公司 Video interested region intelligent coding method and system are realized under dynamic scene
CN110378218A (en) * 2019-06-13 2019-10-25 大亚湾核电运营管理有限责任公司 A kind of image processing method, device and terminal device

Also Published As

Publication number Publication date
CN112995488B (en) 2023-04-18

Similar Documents

Publication Publication Date Title
US7949157B2 (en) Interpreting sign language gestures
JP5318122B2 (en) Method and apparatus for reading information contained in bar code
KR102087882B1 (en) Device and method for media stream recognition based on visual image matching
CN112329702B (en) Method and device for rapid face density prediction and face detection, electronic equipment and storage medium
US20120057745A9 (en) Detection of objects using range information
KR20160130769A (en) Method and device for processing a picture
CN103198311A (en) Method and apparatus for recognizing a character based on a photographed image
CN113496208B (en) Video scene classification method and device, storage medium and terminal
CN113569840A (en) Form recognition method and device based on self-attention mechanism and storage medium
CN113255516A (en) Living body detection method and device and electronic equipment
CN113158773B (en) Training method and training device for living body detection model
Mehta et al. Near-duplicate detection for LCD screen acquired images using edge histogram descriptor
CN112287905A (en) Vehicle damage identification method, device, equipment and storage medium
CN110321858B (en) Video similarity determination method and device, electronic equipment and storage medium
CN113395583A (en) Watermark detection method, watermark detection device, computer equipment and storage medium
CN112995488B (en) High-resolution video image processing method and device and electronic equipment
CN110610178A (en) Image recognition method, device, terminal and computer readable storage medium
Mancas et al. Human attention modelization and data reduction
CN106303366B (en) Video coding method and device based on regional classification coding
CN115424293A (en) Living body detection method, and training method and device of living body detection model
TWI736060B (en) High-resolution video image processing method, device, and electronic device
CN115004245A (en) Target detection method, target detection device, electronic equipment and computer storage medium
CN112487943A (en) Method and device for removing duplicate of key frame and electronic equipment
CN111985423A (en) Living body detection method, living body detection device, living body detection equipment and readable storage medium
CN113542866B (en) Video processing method, device, equipment and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant