CN112911169A - Video image segmentation method and device and video image control method and device - Google Patents
Video image segmentation method and device and video image control method and device Download PDFInfo
- Publication number
- CN112911169A CN112911169A CN202110129219.1A CN202110129219A CN112911169A CN 112911169 A CN112911169 A CN 112911169A CN 202110129219 A CN202110129219 A CN 202110129219A CN 112911169 A CN112911169 A CN 112911169A
- Authority
- CN
- China
- Prior art keywords
- video image
- display area
- image
- sub
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 238000003709 image segmentation Methods 0.000 title claims abstract description 50
- 238000012545 processing Methods 0.000 claims abstract description 64
- 230000011218 segmentation Effects 0.000 claims abstract description 23
- 238000003860 storage Methods 0.000 claims abstract description 15
- 238000004590 computer program Methods 0.000 claims description 9
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 230000001131 transforming effect Effects 0.000 claims description 2
- 238000005520 cutting process Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 235000002864 food coloring agent Nutrition 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The embodiment of the application belongs to the technical field of video image processing, and relates to a video image segmentation method and device, a video image control method and device, computer equipment, a storage medium and a video image control system, wherein the video image segmentation method comprises the following steps: acquiring a frame of video image and performing first processing to obtain a first processed image; setting a display area based on the format information of the video image, and performing segmentation processing on the display area according to the first processing image; and carrying out second processing on the first processed image in the display area to obtain a segmented image. The method comprises the steps of performing first processing of cutting a video image, correspondingly dividing and marking a display area, and correspondingly binding a second processing of the cut video image to the marked display area, so that the division and marking of the image can be conveniently realized, and the image can be quickly controlled by controlling the marked display area.
Description
Technical Field
The present application relates to the field of video image processing technologies, and in particular, to a video image segmentation method and apparatus, a video image control method and apparatus, a computer device, a storage medium, and a video image control system.
Background
For many digital image processing techniques, segmentation of an image is an important process. For example, image segmentation may be used to generate depth maps for three-dimensional imaging, object recognition, artificial coloring, and so on. Efficient interactive image segmentation by an operator is important in, for example, digital photo and image processing, or in post-production work for video or digital images. For example, creating a depth map or a disparity map for a video with stereoscopic effect requires a detailed description of the object boundaries in order to accurately assign depth or disparity. One proposed approach to interactive segmentation is to let the user directly define the edges between different objects. For example, a user may track a particular contour of an image object, and segmentation may use this contour as a definition of a boundary between different segments by assigning pixels on one side of the contour to one segment and pixels on the other side of the contour to another segment. However, this approach tends to be laborious and time consuming for the user, as well as requiring the user to manually track many (or even all) contours in order to provide the segmentation. Therefore, the segmentation method is very laborious and cumbersome, and is not conducive to image control.
Disclosure of Invention
The embodiment of the application aims to provide a video image segmentation method so as to improve convenience of image segmentation and control.
In order to solve the above technical problem, an embodiment of the present application provides a video image segmentation method, including the following steps:
acquiring a frame of video image and performing first processing to obtain a first processed image;
setting a display area based on the format information of the video image, and performing segmentation processing on the display area according to the first processing image;
and carrying out second processing on the first processed image in the display area to obtain a segmented image.
Further, the first processing includes image decoding and cropping, and the first processed image includes a plurality of decoded and cropped sub-images.
Further, the step of setting a display area based on the format information of the video image and performing segmentation processing on the display area according to the first processing image includes:
acquiring the resolution of the video image;
setting a size of the display area based on the resolution;
and averagely dividing the display area into a plurality of corresponding sub-display areas according to a plurality of sub-images of the first processing image.
Further, the step of performing a second processing on the first processed image in the display area to obtain a segmented image includes:
sequentially marking the plurality of sub-display areas to obtain a plurality of corresponding marked sub-display areas;
and correspondingly binding a plurality of sub-images of the first processing image into the mark sub-display area to obtain the segmented image, wherein the segmented image comprises a plurality of corresponding display area sub-images with marks.
In order to solve the above technical problem, an embodiment of the present application provides a video image control method, including the following steps:
acquiring at least one frame of video image;
dividing each frame of video image of the at least one frame of video image based on the video image dividing method to obtain a plurality of corresponding sequenced display area sub-images with marks, and acquiring the sequence of the sub-images;
carrying out disorder processing on the plurality of display area sub-images with marks;
acquiring an operation instruction for a display area, transforming the display area sub-images with the marks according to the operation instruction until the sequence of the plurality of display area sub-images with the marks accords with the sequence of the sub-images, and stopping acquiring the operation instruction;
and repeating the steps and starting the control of the next video image.
In order to solve the above technical problem, an embodiment of the present application further provides a video image segmentation apparatus, which adopts the following technical solutions:
a video image segmentation apparatus comprising:
the first processing module is used for acquiring a frame of video image and performing first processing to obtain a first processed image;
the segmentation module is used for setting a display area based on the format information of the video image and segmenting the display area according to the first processing image;
and the second processing module is used for carrying out second processing on the first processed image in the display area to obtain a segmented image.
In order to solve the above technical problem, an embodiment of the present application further provides a video image control apparatus, which adopts the following technical solutions:
a video image control apparatus comprising:
the acquisition module is used for acquiring at least one frame of video image;
the segmentation module is used for segmenting each frame of video image of at least one frame of video image based on the video image segmentation method to obtain a plurality of corresponding sequenced display area sub-images with marks and acquiring the sequence of the sub-images;
the disorder module is used for carrying out disorder processing on the plurality of display area sub-images with marks;
the conversion module is used for acquiring an operation instruction for a display area, converting the display area sub-images with the marks according to the operation instruction until the sequence of the display area sub-images with the marks accords with the sequence of the sub-images, and stopping acquiring the operation instruction;
and the repeating module is used for repeating the steps and starting the control of the next video image.
In order to solve the above technical problem, an embodiment of the present application further provides a video image control system, including: the video image control device can execute the steps of the video image control method based on the image segmentation result obtained by the video image segmentation device, and realize the control of continuous multi-frame video images.
In order to solve the above technical problem, an embodiment of the present application further provides a computer device, which adopts the following technical solutions:
the computer device comprises a memory and a processor, wherein the memory stores a computer program, and the processor realizes the steps of the video image segmentation method or/and the steps of the video image control method when executing the computer program.
In order to solve the above technical problem, an embodiment of the present application further provides a computer-readable storage medium, which adopts the following technical solutions:
the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the video image segmentation method or/and the steps of the video image control method.
In the embodiment, a frame of video image is acquired and subjected to first processing to obtain a first processed image; setting a display area based on the format information of the video image, and performing segmentation processing on the display area according to the first processing image; and carrying out second processing on the first processed image in the display area to obtain a segmented image. The method comprises the steps of performing first processing of cutting a video image, correspondingly dividing and marking a display area, and correspondingly binding a second processing of the cut video image to the marked display area, so that the division and marking of the image can be conveniently realized, and the image can be quickly controlled by controlling the marked display area.
Drawings
In order to more clearly illustrate the solution of the present application, the drawings needed for describing the embodiments of the present application will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and that other drawings can be obtained by those skilled in the art without inventive effort.
FIG. 1 is a flow diagram of one embodiment of a video image segmentation method according to the present application;
FIG. 2 is a flow diagram of one embodiment of a video image control method according to the present application;
FIG. 3 is a schematic block diagram of an embodiment of a video image segmentation apparatus according to the present application;
FIG. 4 is a schematic block diagram of one embodiment of a video image control apparatus according to the present application;
FIG. 5 is a schematic structural diagram of an image control system according to an embodiment of the present disclosure;
FIG. 6 is a schematic block diagram of one embodiment of a computer device according to the present application.
Detailed Description
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs; the terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application; the terms "including" and "having," and any variations thereof, in the description and claims of this application and the description of the above figures are intended to cover non-exclusive inclusions. The terms "first," "second," and the like in the description and claims of this application or in the above-described drawings are used for distinguishing between different objects and not for describing a particular order.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.
As shown in fig. 1, fig. 1 shows a flow chart of an embodiment of a video image segmentation method according to the present application. The video image segmentation method comprises the following steps:
In the embodiment of the present invention, the video image data may be obtained by a device with a camera function, such as a traffic probe, a computer camera, a mobile phone camera, or the like, automatically obtained in real time, or manually input through other visual interfaces such as GUI or WEB pages, or may be obtained by automatically reading video image data stored in an internal memory or an external memory by a program, and then performing audio/video separation.
The first processing includes decoding and cropping of an image, and the first processed image includes a plurality of decoded and cropped sub-images. Specifically, detecting a coding format of the obtained video image, and then performing corresponding decoding, for example, if the coding format of the video image is detected to be H264, performing decoding according to an H264 protocol to obtain a decoded video image and a timestamp of the image in the video; the video image is then cropped into a plurality of sub-images having the same size, for example, a frame of video image is cropped into 9 or 4 decoded sub-images having the same size.
And a step 102 of setting a display area based on the format information of the video image and dividing the display area according to the first processed image.
In an embodiment of the present invention, the display area may be a display screen of various electronic devices, such as a display screen carried by a mobile phone, a computer, a monitor, or the like, the format information of the video image includes resolution information of the video image, and the setting the display area based on the format information of the video image includes:
firstly, acquiring the resolution of the video image; the resolution may be read from the format information of the acquired video image, and may be, for example, 720p (720 × 1280), 1080p (1080 × 1920), 2k (2560 × 1440), or the like.
Then, setting the size of the display area based on the resolution; in this embodiment, the display area may be a display screen of a mobile phone, for example, the size of the display area may be set on a display screen of an Android mobile phone according to a resolution of the video image, so as to ensure that the length and the width of the display area are the same as the size of the acquired video image.
Further, the display area is equally divided into a plurality of sub-display areas corresponding to the plurality of sub-images of the first processed image. For example, if the first processed image includes 9 sub-images with the same size, the display area is averagely divided into corresponding 9 sub-display areas with the same size by calling OpenGL in the mobile phone on the display screen of the Android mobile phone, and a GLSurfaceView control is allocated to each sub-display area to monitor operation events such as sliding and clicking on the corresponding sub-display area.
And 103, performing second processing on the first processed image in the display area to obtain a segmented image.
In this embodiment, the second processing includes:
sequentially marking the plurality of sub-display areas to obtain a plurality of corresponding marked sub-display areas; specifically, an identifier may be sequentially allocated to the GLSurfaceView control of each sub-display area from left to right and from top to bottom on a display screen of the Android mobile phone and bound, so as to mark the plurality of sub-display areas and obtain a plurality of corresponding marked sub-display areas.
And correspondingly binding a plurality of sub-images of the first processed image into the mark sub-display area to obtain the segmented image, wherein the segmented image comprises a plurality of corresponding display area sub-images with marks. Specifically, the plurality of sub-images with the same size obtained by the first processing are respectively and correspondingly bound with the glsurface view control of the mark sub-display area, so that the plurality of divided display area sub-images with marks can be obtained, thereby realizing the division and marking of the video image, facilitating the control of the image according to the marked display area, and adjusting the resolution of the sub-images to conform to the size of the mark sub-display area if the sub-images are different from the size of the mark sub-display area.
In the embodiment of the invention, the video image is cut, the display area is correspondingly segmented and marked, and the cut video image is correspondingly bound to the marked display area, so that the segmentation and marking of the image can be conveniently realized, and the image can be rapidly controlled by controlling the marked display area.
Further, as shown in fig. 2, fig. 2 shows a flow chart of an embodiment of a video image control method according to the present application. The video image control method comprises the following steps:
201. acquiring at least one frame of video image;
202. based on the image segmentation method, segmenting each frame of video image of the at least one frame of video image to obtain a plurality of corresponding sequenced display area sub-images with marks, and acquiring the sequence of the sub-images;
203. carrying out disorder processing on the plurality of display area sub-images with marks;
204. acquiring an operation instruction for a display area, converting the display area sub-image with the mark according to the operation instruction until the sequence of the plurality of display area sub-images with the mark accords with the sequence of the sub-images, and stopping acquiring the operation instruction;
205. and repeating the steps and starting the control of the next frame of video image.
In the embodiment of the present invention, specifically, multiple frames of video images are continuously obtained, then each frame of video image is segmented by the image segmentation method, to obtain multiple sequenced display area sub-images with marks corresponding to each frame, and to obtain a sequence of the sub-images, that is, an identifier of the glsufaceview control in the sub-display area, and to obtain a timestamp of each frame of image in the original video, and to shuffle the sequence of the segmented sub-images, that is, to shuffle the identifiers of all the glsufaceview controls, for example, the initial sequence of the identifiers of the 9 glsufaceview controls corresponding to 9 sub-images is 1,2, 3,4,5,6,7,8,9, and to shuffle the sequence randomly is 2, 9, 5,8,4,6,3, 7, 1; then obtaining an operation instruction for the display area, wherein the operation instruction can be a sliding instruction, positioning to a specific sub-display area with a mark according to the sliding instruction, then sliding and converting the adjacent two sub-images with the mark, and exchanging the positions of the two sub-images, namely exchanging the two adjacent GLSurfaceView controls; and continuously acquiring the sliding instruction and the position of the exchanged GLSurfaceView control until the sequence of the plurality of sub-images with the marks in the display area accords with the sequence of the sub-images before the disturbance, namely the initial sequence, stopping acquiring the sliding instruction, and then starting the control of the next frame of video image. The multi-frame video image is continuously segmented by the video image segmentation method, the segmentation and marking of the image can be conveniently realized, and then the sequence of the sub-images can be controlled by controlling the marking of the sub-image display area after each frame of segmentation, so that the image can be rapidly controlled by controlling the marked display area.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random Access Memory (RAM).
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
With further reference to fig. 3, as an implementation of the video image segmentation method shown in fig. 1, the present application provides an embodiment of a video image segmentation apparatus, which corresponds to the embodiment of the method shown in fig. 1, and which is particularly applicable to various electronic devices.
As shown in fig. 3, the video image segmentation apparatus 300 according to the present embodiment includes:
the first processing module 301 is configured to obtain a frame of video image and perform first processing to obtain a first processed image;
a segmentation module 302, configured to set a display area based on format information of the video image, and perform segmentation processing on the display area according to the first processing image;
a second processing module 303, configured to perform second processing on the first processed image in the display area to obtain a segmented image.
The video image segmentation apparatus provided in the embodiment of the present application can implement each implementation manner in the method embodiment of fig. 1 and corresponding beneficial effects, and is not described herein again in order to avoid repetition.
With further reference to fig. 4, as an implementation of the video image control method shown in fig. 2, the present application provides an embodiment of a video image segmentation apparatus, which corresponds to the embodiment of the method shown in fig. 2, and which is particularly applicable to various electronic devices.
As shown in fig. 4, the video image control apparatus 400 according to the present embodiment includes:
an obtaining module 401, configured to obtain at least one frame of video image;
a segmentation module 402, configured to perform segmentation on each frame of video image of the at least one frame of video image based on the video image segmentation method to obtain a plurality of labeled display area sub-images in a sorted order, and obtain a sub-image order;
a disorder module 403, configured to perform disorder processing on the multiple marked display region sub-images;
a transformation module 404, configured to obtain an operation instruction for a display area, transform the labeled display area sub-image according to the operation instruction until the sequence of the plurality of labeled display area sub-images meets the sequence of the sub-images, and stop obtaining the operation instruction;
a repeat module 405, configured to repeat the above steps, and start control of the next frame of video image.
The video image control apparatus provided in the embodiment of the present application can implement each implementation manner in the method embodiment of fig. 2 and corresponding beneficial effects, and is not described herein again to avoid repetition.
Further, as shown in fig. 5, an embodiment of the present application further provides a video image control system 500, which includes a video image segmentation apparatus 501 and a video image control apparatus 502, where the video image segmentation apparatus 501 is used for the steps of the video image segmentation method and obtains image segmentation results, and the video image control apparatus 502 can execute the steps of the video image control method based on the image segmentation results obtained by the video image segmentation apparatus, so as to implement control over consecutive multi-frame video images. By the video image control system, the segmentation and marking of the image can be conveniently realized, and the image can be rapidly controlled.
In order to solve the technical problem, an embodiment of the present application further provides a computer device. Referring to fig. 6, fig. 6 is a block diagram of a basic structure of a computer device according to the present embodiment.
The computer device 6 comprises a memory 61, a processor 62, a network interface 63 communicatively connected to each other via a system bus. It is noted that only a computer device 6 having components 61-63 is shown, but it is understood that not all of the shown components are required to be implemented, and that more or fewer components may be implemented instead. As will be understood by those skilled in the art, the computer device is a device capable of automatically performing numerical calculation and/or information processing according to a preset or stored instruction, and the hardware includes, but is not limited to, a microprocessor, an Application Specific Integrated Circuit (ASIC), a Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), an embedded device, and the like.
The computer device can be a desktop computer, a notebook, a palm computer, a cloud server and other computing devices. The computer equipment can carry out man-machine interaction with a user through a keyboard, a mouse, a remote controller, a touch panel or voice control equipment and the like.
The memory 61 includes at least one type of readable storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, an optical disk, etc. In some embodiments, the memory 61 may be an internal storage unit of the computer device 6, such as a hard disk or a memory of the computer device 6. In other embodiments, the memory 61 may also be an external storage device of the computer device 6, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the computer device 6. Of course, the memory 61 may also comprise both an internal storage unit of the computer device 6 and an external storage device thereof. In this embodiment, the memory 61 is generally used for storing an operating system installed in the computer device 6 and various types of application software, such as program codes of the video image segmentation method and/or the video image control method. Further, the memory 61 may also be used to temporarily store various types of data that have been output or are to be output.
The processor 62 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data Processing chip in some embodiments. The processor 62 is typically used to control the overall operation of the computer device 6. In this embodiment, the processor 62 is configured to execute the program code stored in the memory 61 or process data, for example, execute the program code of the video image segmentation method or/and the video image control method.
The network interface 63 may comprise a wireless network interface or a wired network interface, and the network interface 63 is typically used for establishing a communication connection between the computer device 6 and other electronic devices.
The present application further provides another embodiment, which is to provide a computer readable storage medium storing a video image segmentation method or/and the video image control method program, which is executable by at least one processor to cause the at least one processor to perform the steps of the video image segmentation method or/and the video image control method as described above.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
It is to be understood that the above-described embodiments are merely illustrative of some, but not restrictive, of the broad invention, and that the appended drawings illustrate preferred embodiments of the invention and do not limit the scope of the invention. This application is capable of embodiments in many different forms and is provided for the purpose of enabling a thorough understanding of the disclosure of the application. Although the present application has been described in detail with reference to the foregoing embodiments, it will be apparent to one skilled in the art that the present application may be practiced without modification or with equivalents of some of the features described in the foregoing embodiments. All equivalent structures made by using the contents of the specification and the drawings of the present application are directly or indirectly applied to other related technical fields and are within the protection scope of the present application.
Claims (10)
1. A method for segmenting a video image, comprising:
acquiring a frame of video image and performing first processing to obtain a first processed image;
setting a display area based on the format information of the video image, and performing segmentation processing on the display area according to the first processing image;
and carrying out second processing on the first processed image in the display area to obtain a segmented image.
2. The method of claim 1, wherein the first processing comprises image decoding and cropping, the first processed image comprising a plurality of decoded and cropped sub-images.
3. The method according to claim 2, wherein the step of setting a display area based on format information of the video image and performing segmentation processing on the display area according to the first processed image includes:
acquiring the resolution of the video image;
setting a size of the display area based on the resolution;
and averagely dividing the display area into a plurality of corresponding sub-display areas according to a plurality of sub-images of the first processing image.
4. The method of claim 3, wherein performing a second processing on the first processed image in the display area to obtain a segmented image comprises:
sequentially marking the plurality of sub-display areas to obtain a plurality of corresponding marked sub-display areas;
and correspondingly binding a plurality of sub-images of the first processing image into the mark sub-display area to obtain the segmented image, wherein the segmented image comprises a plurality of corresponding display area sub-images with marks.
5. A video image control method, comprising:
acquiring at least one frame of video image;
segmenting each frame of video image of the at least one frame of video image based on the method according to any one of claims 1 to 4, resulting in a corresponding plurality of ordered tagged display area sub-images, and obtaining an order of the sub-images;
carrying out disorder processing on the plurality of display area sub-images with marks;
acquiring an operation instruction for a display area, transforming the display area sub-images with the marks according to the operation instruction until the sequence of the plurality of display area sub-images with the marks accords with the sequence of the sub-images, and stopping acquiring the operation instruction;
and repeating the steps and starting the control of the next frame of video image.
6. A video image segmentation apparatus, comprising:
the first processing module is used for acquiring a frame of video image and performing first processing to obtain a first processed image;
the segmentation module is used for setting a display area based on the format information of the video image and segmenting the display area according to the first processing image;
and the second processing module is used for carrying out second processing on the first processed image in the display area to obtain a segmented image.
7. A video image control apparatus, comprising:
the acquisition module is used for acquiring at least one frame of video image;
the segmentation module is used for segmenting each frame of video image of at least one frame of video image based on the video image segmentation method to obtain a plurality of corresponding sequenced display area sub-images with marks and acquiring the sequence of the sub-images;
the disorder module is used for carrying out disorder processing on the plurality of display area sub-images with marks;
the conversion module is used for acquiring an operation instruction for a display area, converting the display area sub-images with the marks according to the operation instruction until the sequence of the display area sub-images with the marks accords with the sequence of the sub-images, and stopping acquiring the operation instruction;
and the repeating module is used for repeating the steps and starting the control of the next frame of video image.
8. A video image control system, characterized by comprising a video image segmentation device and a video image control device, wherein the video image segmentation device is used for executing the steps of the video image segmentation method according to any one of claims 1 to 4 and obtaining the image segmentation result, and the video image control device can execute the steps of the video image control method according to claim 5 based on the image segmentation result obtained by the video image segmentation device, so as to realize the control of continuous multiframe video images.
9. Computer device, characterized in that it comprises a memory in which a computer program is stored and a processor which, when executing said computer program, implements the steps of a video image segmentation method according to any one of claims 1 to 4 or/and the steps of a video image control method according to claim 5.
10. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, carries out the steps of the video image segmentation method as defined in any one of claims 1 to 4 or/and the steps of the video image control method as defined in claim 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110129219.1A CN112911169A (en) | 2021-01-29 | 2021-01-29 | Video image segmentation method and device and video image control method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110129219.1A CN112911169A (en) | 2021-01-29 | 2021-01-29 | Video image segmentation method and device and video image control method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112911169A true CN112911169A (en) | 2021-06-04 |
Family
ID=76121351
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110129219.1A Pending CN112911169A (en) | 2021-01-29 | 2021-01-29 | Video image segmentation method and device and video image control method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112911169A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113596577A (en) * | 2021-07-22 | 2021-11-02 | 上海领路人照明工程有限公司 | Visual cutting and issuing method, device, medium and terminal of linkage video |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101764982A (en) * | 2008-12-23 | 2010-06-30 | 康佳集团股份有限公司 | Method and device for processing high-definition video image |
| CN206865640U (en) * | 2017-04-28 | 2018-01-09 | 西安诺瓦电子科技有限公司 | Image transmitting control system |
| CN108848324A (en) * | 2018-07-11 | 2018-11-20 | 深圳市东微智能科技股份有限公司 | The binding method of mosaic screen and video port, device and splicing screen display system |
| CN111836028A (en) * | 2020-07-07 | 2020-10-27 | 北京亿智诚科技有限公司 | Image processing method, readable storage medium, and electronic device |
| CN112163993A (en) * | 2020-08-21 | 2021-01-01 | 北京字节跳动网络技术有限公司 | Image processing method, device, equipment and storage medium |
-
2021
- 2021-01-29 CN CN202110129219.1A patent/CN112911169A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101764982A (en) * | 2008-12-23 | 2010-06-30 | 康佳集团股份有限公司 | Method and device for processing high-definition video image |
| CN206865640U (en) * | 2017-04-28 | 2018-01-09 | 西安诺瓦电子科技有限公司 | Image transmitting control system |
| CN108848324A (en) * | 2018-07-11 | 2018-11-20 | 深圳市东微智能科技股份有限公司 | The binding method of mosaic screen and video port, device and splicing screen display system |
| CN111836028A (en) * | 2020-07-07 | 2020-10-27 | 北京亿智诚科技有限公司 | Image processing method, readable storage medium, and electronic device |
| CN112163993A (en) * | 2020-08-21 | 2021-01-01 | 北京字节跳动网络技术有限公司 | Image processing method, device, equipment and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113596577A (en) * | 2021-07-22 | 2021-11-02 | 上海领路人照明工程有限公司 | Visual cutting and issuing method, device, medium and terminal of linkage video |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108596184B (en) | Training method of image semantic segmentation model, readable storage medium and electronic device | |
| CN112669515B (en) | Bill image recognition method and device, electronic equipment and storage medium | |
| CN110675940A (en) | Pathological image labeling method and device, computer equipment and storage medium | |
| CN107622504B (en) | Method and device for processing pictures | |
| CN111950353A (en) | Seal text recognition method and device and electronic equipment | |
| CN109389659B (en) | Rendering method and device of mathematical formula in PPT, storage medium and terminal equipment | |
| CN110765799A (en) | Client code scanning identification method, device, equipment and storage medium | |
| CN112686243A (en) | Method and device for intelligently identifying picture characters, computer equipment and storage medium | |
| CN113706555B (en) | Video frame processing method and device, electronic equipment and storage medium | |
| CN113283408A (en) | Monitoring video-based social distance monitoring method, device, equipment and medium | |
| CN112418206B (en) | Picture classification method based on position detection model and related equipment thereof | |
| CN112911169A (en) | Video image segmentation method and device and video image control method and device | |
| CN113592720B (en) | Image scaling processing method, device, equipment and storage medium | |
| CN116612518A (en) | Facial expression capturing method, system, electronic equipment and medium | |
| CN117315406B (en) | Sample image processing method, device and equipment | |
| CN114374872A (en) | Video generation method and device, electronic equipment and storage medium | |
| EP4075381A1 (en) | Image processing method and system | |
| CN110936026A (en) | Cutting method, cutting device, cutting equipment and storage medium for plate excess material | |
| CN112819694A (en) | Video image splicing method and device | |
| CN113947529B (en) | Image enhancement method, model training method, component identification method and related equipment | |
| CN110020983B (en) | Image processing method and device | |
| CN113810626B (en) | Video fusion method, device, equipment and storage medium based on three-dimensional map | |
| CN111464865B (en) | Video generation method and device, electronic equipment and computer readable storage medium | |
| CN111325656B (en) | Image processing method, image processing device and terminal equipment | |
| CN104574343B (en) | The method and apparatus of image is extracted in a kind of video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210604 |