CN111083413B - Image display method and device, electronic equipment and storage medium - Google Patents
Image display method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111083413B CN111083413B CN201911340966.9A CN201911340966A CN111083413B CN 111083413 B CN111083413 B CN 111083413B CN 201911340966 A CN201911340966 A CN 201911340966A CN 111083413 B CN111083413 B CN 111083413B
- Authority
- CN
- China
- Prior art keywords
- image
- cache
- images
- identification information
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000004891 communication Methods 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 17
- 230000009467 reduction Effects 0.000 claims description 9
- 230000001960 triggered effect Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 17
- 230000008569 process Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000004075 alteration Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440245—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses an image display method, an image display device, electronic equipment and a storage medium. According to the embodiment of the invention, the second image corresponding to the first image which is captured in the first cache is obtained according to the identification information of the image, the first image does not need to be decoded, the decoding time is reduced, the image display efficiency is improved, and the problem of partial information loss caused by discarding the image is relieved to a certain extent.
Description
Technical Field
The present invention relates to the field of image display technologies, and in particular, to an image display method and apparatus, an electronic device, and a storage medium.
Background
The network video recorder NVR is connected with the front-end network camera IPC, the IPC sends a video code stream to the NVR in real time, and when the IPC triggers an intelligent event, an intelligent image is pushed to the NVR. The pushing mode of the intelligent image is generally divided into two types: one is the background map + target map as shown in fig. 1, and the other is the background map + target map area coordinates as shown in fig. 2. After receiving the smart image, the NVR displays the smart image on the display in real time in a manner of an image list, as shown in fig. 3.
At present, an intelligent image pushed to NVR by IPC is in a JPEG format, and certain performance is consumed for decoding JPEG by NVR. Some time when IPC frequently triggers smart events and frequently reports smart images (e.g., 10 sheets per second), NVR will not be as good as decoding smart images due to insufficient performance. Particularly in the case of "background map + target small map area coordinates", it is necessary to decode the entire large map and then take out the small map from the large map based on the small map area coordinates. This situation can be more time consuming. When the situation that the intelligent image is reported frequently occurs, the current common technical scheme is to buffer the image in the cache, and directly discard the image after the cache is full. Discarding the images for non-display may cause the user to be unable to view the discarded intelligent images in the image list, thereby causing a loss of partial information.
Disclosure of Invention
The embodiment of the invention provides an image display method and device, electronic equipment and a storage medium, which are used for solving the problems that the image display real-time performance is poor and partial information is lost due to discarding of images in the prior art.
The embodiment of the invention provides an image display method, which comprises the following steps:
acquiring a first image captured by an IPC (Internet protocol camera), and determining identification information of the first image;
acquiring a second image of the identification information in a first cache corresponding to the video code stream according to the identification information;
and determining target object information according to the second image, adding the second image and the target object information to a second cache, and displaying the second image and the target object information when a display instruction is received.
Further, before the capturing the first captured image and determining the identification information of the first image, the method further includes:
and judging whether the second cache has available space, if so, executing the steps of acquiring a first image captured by snapshot and determining the identification information of the first image.
Further, if it is determined that the second cache has an available space, acquiring a first captured image, and before determining the identification information of the first image, the method further includes:
acquiring the time difference between the maximum time information and the minimum time information of the third image stored in the second cache;
determining the shortest time required for decoding the number of the third images according to the ratio of the number of the third images stored in the second cache to the maximum decoding speed of the third images;
and judging whether the time difference is greater than the shortest time or not, if so, executing the steps of acquiring a first image captured by snapshot and determining the identification information of the first image.
Further, the method further comprises:
and judging whether the continuous times of which the time difference is greater than the shortest time are greater than a preset time threshold value within a preset time length, if so, sending a resolution reduction instruction to the IPC, and controlling the IPC to reduce the resolution.
Further, if the second cache does not have available space, the method further comprises:
and discarding a preset number of third images in the second cache.
Further, the discarding a preset number of third images in the second buffer includes:
and identifying the third images appearing in the set according to the time information of each third image, and discarding a preset number of third images in the third images appearing in the set according to an interval discarding rule.
In another aspect, an embodiment of the present invention provides an image display apparatus, including:
the system comprises a determining module, a judging module and a judging module, wherein the determining module is used for acquiring a first image captured by an IPC (Internet protocol camera) and determining identification information of the first image;
the acquisition module is used for acquiring a second image of the identification information in a first cache corresponding to the video code stream according to the identification information;
and the display module is used for determining target object information according to the second image, adding the second image and the target object information to a second cache, and displaying the second image and the target object information when a display instruction is received.
Further, the apparatus further comprises:
and the first judging module is used for judging whether the second cache has available space, and if so, triggering the determining module.
Further, the apparatus further comprises:
the second judgment module is used for acquiring the time difference between the maximum time information and the minimum time information of the third image stored in the second cache; determining the shortest time required for decoding the number of the third images according to the ratio of the number of the third images stored in the second cache to the maximum decoding speed of the third images; and judging whether the time difference is greater than the shortest time or not, and if so, triggering the determining module.
Further, the apparatus further comprises:
and the control module is used for judging whether the continuous times of which the time difference is greater than the shortest time are greater than a preset time threshold value within a preset time length, and if so, sending a resolution reduction instruction to the IPC to control the IPC to reduce the resolution.
Further, the apparatus further comprises:
and the discarding module is used for discarding a preset number of third images in the second cache.
Further, the discarding module is specifically configured to identify third images appearing in the set according to the time information of each third image, and discard a preset number of third images in the third images appearing in the set according to an interval discarding rule.
On the other hand, the embodiment of the invention provides electronic equipment, which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
a memory for storing a computer program;
a processor for implementing any of the above method steps when executing a program stored in the memory.
In another aspect, an embodiment of the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the method steps of any one of the above.
The embodiment of the invention provides an image display method, an image display device, electronic equipment and a storage medium, wherein the method comprises the following steps: acquiring a first image captured by an IPC (Internet protocol camera), and determining identification information of the first image; acquiring a second image of the identification information in a first cache corresponding to the video code stream according to the identification information; and determining target object information according to the second image, adding the second image and the target object information to a second cache, and displaying the second image and the target object information when a display instruction is received.
In the embodiment of the invention, after the electronic device acquires the first captured image, the electronic device acquires the second image in the first cache storing the image obtained by decoding the video code stream according to the identification information of the first image, determines the target object information according to the second image, and displays the second image and the target object information. According to the embodiment of the invention, the second image corresponding to the first image which is captured in the first cache is obtained according to the identification information of the image, the first image does not need to be decoded, the decoding time is reduced, the image display efficiency is improved, and the problem of partial information loss caused by discarding the image is relieved to a certain extent.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 illustrates an intelligent image pushing method in the prior art;
FIG. 2 is a diagram illustrating another intelligent image pushing method in the prior art;
FIG. 3 illustrates a prior art intelligent image display;
fig. 4 is a schematic diagram of an image display process provided in embodiment 1 of the present invention;
fig. 5 is a flowchart for determining whether decoding is timely according to embodiment 1 of the present invention;
fig. 6 is a schematic diagram of an image discarding strategy provided in embodiment 1 of the present invention;
fig. 7 is a schematic diagram of a buffering total node according to embodiment 1 of the present invention;
fig. 8 is a schematic diagram of buffer fullness provided in embodiment 1 of the present invention;
FIG. 9 illustrates a prior art image decoding strategy;
FIG. 10 illustrates an image decoding strategy according to embodiment 1 of the present invention;
FIG. 11 is a flowchart of image display provided in embodiment 1 of the present invention;
fig. 12 is a schematic structural diagram of an image display device according to embodiment 2 of the present invention;
fig. 13 is a schematic structural diagram of an electronic device according to embodiment 3 of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the attached drawings, and it should be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1:
fig. 4 is a schematic diagram of an image display process provided in an embodiment of the present invention, where the process includes the following steps:
s101: the method comprises the steps of obtaining a first image captured by an IPC (Internet protocol Camera) and determining identification information of the first image.
S102: and acquiring a second image of the identification information in a first cache corresponding to the video code stream according to the identification information.
S103: and determining target object information according to the second image, adding the second image and the target object information to a second cache, and displaying the second image and the target object information when a display instruction is received.
The image display method provided by the embodiment of the invention is applied to electronic equipment, and the electronic equipment can be equipment such as a PC (personal computer), a tablet personal computer, a Network Video Recorder (NVR) and the like.
In the embodiment of the invention, the IPC sends the video code stream acquired in real time to the electronic equipment, and the electronic equipment decodes the video code stream in real time to obtain each frame of image, wherein the image obtained by decoding can be a YUV image. The electronic equipment stores each frame of image obtained by decoding processing in a first cache. And each frame of image obtained by decoding carries identification information. The identification information may be intelligent tag information or time stamp information. The intelligent mark information can be generated by IPC or electronic equipment, an intelligent mark can be added to the image when the video code stream is collected and the snapshot event is triggered, and the intelligent mark can be an incremental number or a special value calculated according to other related information. The timestamp information is information carried by each frame of image when the IPC collects the video code stream and triggers the snapshot event.
After the IPC triggers the snapshot event, the first image is snapshot and sent to the electronic equipment, and the electronic equipment acquires the first image and determines the identification information of the first image. And acquiring a second image of the identification information in a first cache corresponding to the video code stream. And the electronic equipment determines the target object information in the second image, adds the second image and the target object information to the second cache, and displays the second image and the target object information when receiving a display instruction.
In the embodiment of the invention, after the electronic device acquires the first captured image, the electronic device acquires the second image in the first cache storing the image obtained by decoding the video code stream according to the identification information of the first image, determines the target object information according to the second image, and displays the second image and the target object information. According to the embodiment of the invention, the second image corresponding to the first image which is captured in the first cache is obtained according to the identification information of the image, the first image does not need to be decoded, the decoding time is reduced, the image display efficiency is improved, and the problem of partial information loss caused by discarding the image is relieved to a certain extent.
In this embodiment of the present invention, before the acquiring a first captured image and determining identification information of the first image, the method further includes:
and judging whether the second cache has available space, if so, executing the steps of acquiring a first image captured by snapshot and determining the identification information of the first image.
The method comprises the steps that electronic equipment obtains a first image which is captured, before identification information of the first image is determined, whether a second cache has an available space is judged, if the available space exists, the first image which is captured is obtained, the identification information of the first image is determined, and if the available space does not exist, a preset number of third images in the second cache are discarded.
After determining that the second cache has the available space, the electronic device may determine whether decoding is in time according to the third image stored in the second cache, and if decoding is in time, an existing image decoding strategy may be adopted, that is, after the electronic device acquires the first image, the electronic device performs decoding processing on the first image. If the decoding is not timely, the rapid decoding strategy provided by the embodiment of the invention needs to be adopted, namely, a first image captured by the IPC is obtained, and the identification information of the first image is determined; acquiring a second image of the identification information in a first cache corresponding to the video code stream according to the identification information; and determining target object information according to the second image, adding the second image and the target object information to a second cache, and displaying the second image and the target object information when a display instruction is received.
The specific method for the electronic device to judge whether the decoding is in time is to acquire the time difference between the maximum time information and the minimum time information of the third image stored in the second cache; determining the shortest time required for decoding the number of the third images according to the ratio of the number of the third images stored in the second cache to the maximum decoding speed of the third images; and judging whether the time difference is larger than the shortest time or not, and if so, determining that the decoding is not timely.
Specifically, when the data in the second cache exceeds a preset threshold, a process of determining whether decoding is in time is performed, and if the data in the second cache does not exceed the preset threshold, an existing image decoding strategy may be adopted. For example, as shown in fig. 5, the capacity of the second buffer is N, the data stored in the second buffer is M, and the preset threshold may be half of the capacity of the second buffer, that is, N/2. When M > N/2, the judgment whether the decoding is in time is started. And setting the allowable fastest decoding speed of the electronic equipment to Smax, wherein the value can be obtained by combining empirical values, chip manufacturer parameters and measured data. The minimum required time Tmin required to decode M images is M/Smax. The Begin Time and the End Time are the Time of the third picture entering the second buffer at the earliest and the latest respectively, and the Time difference T between pictures entering the second buffer is the End Time-Begin Time. When T > Tmin, the image enters the second buffer faster than the decoding speed, and the decoding is determined to be not timely.
In the embodiment of the invention, if the decoding is not timely for a long time, the decoding speed is accelerated by reducing the resolution of the acquired image. In the preset time length, judging whether the continuous times of the time difference being larger than the shortest time are larger than a preset time threshold value, if so, sending a resolution reduction instruction to the IPC, and controlling the IPC to reduce the resolution.
The electronic equipment judges that the decoding is not timely for many times within a preset time length, then sends a resolution reduction instruction to the IPC, and after the IPC receives the resolution reduction instruction, the resolution of the self-collected image is reduced.
In addition, when the electronic device discards a preset number of third images, in order to keep image information as much as possible, the discarding of the preset number of third images in the second cache includes:
and identifying the third images appearing in the set according to the time information of each third image, and discarding a preset number of third images in the third images appearing in the set according to an interval discarding rule.
As shown in fig. 6, 20 images appear in the time period 21:30:02 to 21:30:05, and the number of images appearing in the remaining time period is significantly smaller, it is determined that 20 images in the time period 21:30:02 to 21:30:05 are the third images appearing in the set, and then a preset number of the third images are discarded in the third images appearing in the set according to the interval discarding rule. For example, the preset number is 5, and the 20 images are sequentially added with the markers 1, 2, 3. Images 4, 8, 12, 16 and 20 are deleted. This makes it possible to keep the image as uniform as possible, and to retain the image information to the greatest extent.
The image display process is explained in detail below.
As shown in FIG. 7, the total number of buffered nodes is N, and as shown in FIG. 8, when the fetch is not in time, N nodes are filled, and the buffer is full. The root cause of buffer fullness is "over demand", the speed of fetching cannot catch up with the speed of entering.
Fig. 9 shows a conventional image decoding strategy, and as shown in fig. 9, in the conventional decoding scheme, video decoding and image decoding are performed independently, and finally, a display module performs video layer fusion display. Such decoding strategy pictures are video-independent. Decoding resources are consumed for images and videos, when the images are reported frequently and need to be decoded, the decoding resources are insufficient, decoding is not timely, and finally the images are discarded.
Fig. 10 shows an image decoding strategy according to an embodiment of the present invention, as shown in fig. 10, since the image is displayed in real time, the video is also played in real time, and the video has a delay buffer of several hundred milliseconds to 1 second, which can increase the buffer and is designed as two parts, namely "displayed" and "not displayed". "displayed buffer" is used to buffer data that has been sent for display. After the image (jpeg) data is sent in, the identification information is directly held in the buffer of the video to find out the matching of the identification information of the image without decoding. After finding, it can be copied into the image buffer. This saves decoding time.
If the 'background picture + target small picture area coordinate' is met, the existing decoding strategy is to decode the background picture first and then deduct the small picture from the decoded background picture. By adopting the scheme provided by the embodiment of the invention, the work of decoding the background is replaced by finding the decoded background image in the video buffer, and directly copying the required area after finding the background image, and putting the area into the display buffer. The time for copying the data is less than the time for decoding the image, so the embodiment of the invention can accelerate the speed of decoding and displaying.
Compared with the existing decoding strategy, the fast decoding strategy provided by the embodiment of the invention multiplexes video decoding and shortens decoding time. The display effect is that the decoding is faster, and the CPU resource is more saved, so that the image display effect is improved, and the overall performance of the electronic equipment is improved. Compared with the existing image discarding method, the image discarding strategy is optimized, and the time period with more concentrated images is selected for discarding, so that the image display is more uniform in time, and the experience effect is better.
Fig. 11 is an image display flowchart according to an embodiment of the present invention, as shown in fig. 11, after a first image captured by the network camera IPC is acquired, whether a second cache is full is determined, if the second cache is full, an image discarding policy is executed, third images appearing in a set are identified according to time information of each third image, and a preset number of third images are discarded from the third images appearing in the set according to an interval discarding rule. If the decoding is not full, whether the decoding is not timely is judged, if not, the existing decoding strategy is executed, the image is displayed, and if so, the quick decoding strategy provided by the embodiment of the invention is executed. And when the decoding is not timely judged for a long time, sending a resolution reduction instruction to the IPC, and controlling the IPC to reduce the resolution.
Example 2:
fig. 12 is a schematic structural diagram of an image display device according to an embodiment of the present invention, where the image display device includes:
the determining module 121 is configured to acquire a first image captured by an IPC of a network camera, and determine identification information of the first image;
an obtaining module 122, configured to obtain, according to the identification information, a second image of the identification information in a first cache corresponding to a video code stream;
and the display module 123 is configured to determine target object information according to the second image, add the second image and the target object information to a second cache, and display the second image and the target object information when a display instruction is received.
The device further comprises:
a first determining module 124, configured to determine whether there is available space in the second cache, and if so, trigger the determining module 121.
The device further comprises:
a second determining module 125, configured to obtain a time difference between maximum time information and minimum time information of the third image stored in the second cache; determining the shortest time required for decoding the number of the third images according to the ratio of the number of the third images stored in the second cache to the maximum decoding speed of the third images; and judging whether the time difference is greater than the shortest time or not, and if so, triggering the determining module 121.
The device further comprises:
and the control module 126 is configured to determine whether the consecutive times that the time difference is greater than the shortest time is greater than a preset time threshold within a preset time length, and if so, send a resolution reduction instruction to the IPC to control the IPC to reduce the resolution.
The device further comprises:
and a discarding module 127, configured to discard a preset number of third images in the second buffer.
The discarding module 127 is specifically configured to identify the third images appearing in the set according to the time information of each third image, and discard a preset number of third images in the third images appearing in the set according to an interval discarding rule.
Example 3:
on the basis of the foregoing embodiments, an embodiment of the present invention further provides an electronic device, as shown in fig. 13, including: the system comprises a processor 301, a communication interface 302, a memory 303 and a communication bus 304, wherein the processor 301, the communication interface 302 and the memory 303 complete mutual communication through the communication bus 304;
the memory 303 has stored therein a computer program which, when executed by the processor 301, causes the processor 301 to perform the steps of:
acquiring a first image captured by an IPC (Internet protocol camera), and determining identification information of the first image;
acquiring a second image of the identification information in a first cache corresponding to the video code stream according to the identification information;
and determining target object information according to the second image, adding the second image and the target object information to a second cache, and displaying the second image and the target object information when a display instruction is received.
Based on the same inventive concept, the embodiment of the present invention further provides an electronic device, and as the principle of the electronic device for solving the problem is similar to the image display method, the implementation of the electronic device may refer to the implementation of the method, and repeated details are not repeated.
The electronic device provided by the embodiment of the invention can be a desktop computer, a portable computer, a smart phone, a tablet computer, a Personal Digital Assistant (PDA), a network side device and the like.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface 302 is used for communication between the above-described electronic apparatus and other apparatuses.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Alternatively, the memory may be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a central processing unit, a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an application specific integrated circuit, a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or the like.
When the processor executes the program stored in the memory in the embodiment of the invention, the first image captured by the IPC is acquired, and the identification information of the first image is determined; acquiring a second image of the identification information in a first cache corresponding to the video code stream according to the identification information; and determining target object information according to the second image, adding the second image and the target object information to a second cache, and displaying the second image and the target object information when a display instruction is received.
In the embodiment of the invention, after the electronic device acquires the first captured image, the electronic device acquires the second image in the first cache storing the image obtained by decoding the video code stream according to the identification information of the first image, determines the target object information according to the second image, and displays the second image and the target object information. According to the embodiment of the invention, the second image corresponding to the first image which is captured in the first cache is obtained according to the identification information of the image, the first image does not need to be decoded, the decoding time is reduced, the image display efficiency is improved, and the problem of partial information loss caused by discarding the image is relieved to a certain extent.
Example 4:
on the basis of the foregoing embodiments, an embodiment of the present invention further provides a computer storage readable storage medium, in which a computer program executable by an electronic device is stored, and when the program is run on the electronic device, the electronic device is caused to execute the following steps:
acquiring a first image captured by an IPC (Internet protocol camera), and determining identification information of the first image;
acquiring a second image of the identification information in a first cache corresponding to the video code stream according to the identification information;
and determining target object information according to the second image, adding the second image and the target object information to a second cache, and displaying the second image and the target object information when a display instruction is received.
Based on the same inventive concept, embodiments of the present invention further provide a computer-readable storage medium, and since a principle of solving a problem when a processor executes a computer program stored in the computer-readable storage medium is similar to that of an image display method, implementation of the computer program stored in the computer-readable storage medium by the processor may refer to implementation of the method, and repeated details are not repeated.
The computer readable storage medium may be any available medium or data storage device that can be accessed by a processor in an electronic device, including but not limited to magnetic memory such as floppy disks, hard disks, magnetic tape, magneto-optical disks (MOs), etc., optical memory such as CDs, DVDs, BDs, HVDs, etc., and semiconductor memory such as ROMs, EPROMs, EEPROMs, non-volatile memory (NAND FLASH), Solid State Disks (SSDs), etc.
The computer program is stored in a computer readable storage medium provided by the embodiment of the invention, and when being executed by a processor, the computer program realizes the acquisition of a first image captured by an IPC (Internet protocol Camera) and the determination of identification information of the first image; acquiring a second image of the identification information in a first cache corresponding to the video code stream according to the identification information; and determining target object information according to the second image, adding the second image and the target object information to a second cache, and displaying the second image and the target object information when a display instruction is received.
In the embodiment of the invention, after the electronic device acquires the first captured image, the electronic device acquires the second image in the first cache storing the image obtained by decoding the video code stream according to the identification information of the first image, determines the target object information according to the second image, and displays the second image and the target object information. According to the embodiment of the invention, the second image corresponding to the first image which is captured in the first cache is obtained according to the identification information of the image, the first image does not need to be decoded, the decoding time is reduced, the image display efficiency is improved, and the problem of partial information loss caused by discarding the image is relieved to a certain extent.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. An image display method, characterized in that the method comprises:
acquiring a first image captured by an IPC (Internet protocol camera), and determining identification information of the first image;
acquiring a second image of the identification information in a first cache corresponding to the video code stream according to the identification information;
determining target object information according to the second image, adding the second image and the target object information to a second cache, and displaying the second image and the target object information when a display instruction is received;
before the capturing the first captured image and determining the identification information of the first image, the method further includes:
judging whether the second cache has an available space, if so, executing the steps of acquiring a first image captured by snapshot and determining the identification information of the first image;
if the second cache is judged to have available space, the first image which is captured is obtained, and before the identification information of the first image is determined, the method further comprises the following steps:
acquiring the time difference between the maximum time information and the minimum time information of the third image stored in the second cache;
determining the shortest time required for decoding the number of the third images according to the ratio of the number of the third images stored in the second cache to the maximum decoding speed of the third images;
and judging whether the time difference is greater than the shortest time or not, if so, executing the steps of acquiring a first image captured by snapshot and determining the identification information of the first image.
2. The method of claim 1, wherein the method further comprises:
and judging whether the continuous times of which the time difference is greater than the shortest time are greater than a preset time threshold value within a preset time length, if so, sending a resolution reduction instruction to the IPC, and controlling the IPC to reduce the resolution.
3. The method of claim 1, wherein if the second cache does not have space available, the method further comprises:
and discarding a preset number of third images in the second cache.
4. The method of claim 3, wherein discarding the preset number of third images in the second buffer comprises:
and identifying the third images appearing in the set according to the time information of each third image, and discarding a preset number of third images in the third images appearing in the set according to an interval discarding rule.
5. An image display apparatus, characterized in that the apparatus comprises:
the system comprises a determining module, a judging module and a judging module, wherein the determining module is used for acquiring a first image captured by an IPC (Internet protocol camera) and determining identification information of the first image;
the acquisition module is used for acquiring a second image of the identification information in a first cache corresponding to the video code stream according to the identification information;
the display module is used for determining target object information according to the second image, adding the second image and the target object information to a second cache, and displaying the second image and the target object information when a display instruction is received;
the device further comprises:
the first judging module is used for judging whether the second cache has an available space or not, and if so, the determining module is triggered;
the device further comprises:
the second judgment module is used for acquiring the time difference between the maximum time information and the minimum time information of the third image stored in the second cache; determining the shortest time required for decoding the number of the third images according to the ratio of the number of the third images stored in the second cache to the maximum decoding speed of the third images; and judging whether the time difference is greater than the shortest time or not, and if so, triggering the determining module.
6. The apparatus of claim 5, wherein the apparatus further comprises:
and the control module is used for judging whether the continuous times of which the time difference is greater than the shortest time are greater than a preset time threshold value within a preset time length, and if so, sending a resolution reduction instruction to the IPC to control the IPC to reduce the resolution.
7. The apparatus of claim 5, wherein the apparatus further comprises:
and the discarding module is used for discarding a preset number of third images in the second cache.
8. The apparatus according to claim 7, wherein the discarding module is specifically configured to identify the third images appearing in the set according to the time information of each third image, and discard a preset number of the third images in the third images appearing in the set according to an interval discarding rule.
9. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any one of claims 1 to 4 when executing a program stored in the memory.
10. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911340966.9A CN111083413B (en) | 2019-12-23 | 2019-12-23 | Image display method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911340966.9A CN111083413B (en) | 2019-12-23 | 2019-12-23 | Image display method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111083413A CN111083413A (en) | 2020-04-28 |
| CN111083413B true CN111083413B (en) | 2022-02-18 |
Family
ID=70316852
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911340966.9A Active CN111083413B (en) | 2019-12-23 | 2019-12-23 | Image display method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111083413B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1526540A1 (en) * | 2003-10-22 | 2005-04-27 | Daewoo Electronics Corporation | Apparatus and method for searching playback start positions in a VCR |
| CN102148983A (en) * | 2010-02-08 | 2011-08-10 | 杨占昆 | Method for solving over-high occupancy of high-resolution image resource |
| CN103680137A (en) * | 2012-09-18 | 2014-03-26 | 浙江大华技术股份有限公司 | Method and device for obtaining images based on intelligent traffic monitoring system |
| CN104394319A (en) * | 2014-11-24 | 2015-03-04 | 广州市浩云安防科技股份有限公司 | Embedded HD network video recorder |
| CN105898204A (en) * | 2014-12-25 | 2016-08-24 | 支录奎 | Intelligent video recorder enabling video structuralization |
| CN106803936A (en) * | 2017-02-24 | 2017-06-06 | 深圳英飞拓科技股份有限公司 | Video capture method and device based on internal memory encoding mechanism |
| CN110087042A (en) * | 2019-05-08 | 2019-08-02 | 深圳英飞拓智能技术有限公司 | A kind of face snap method and system of real-time synchronization video flowing and metadata |
-
2019
- 2019-12-23 CN CN201911340966.9A patent/CN111083413B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1526540A1 (en) * | 2003-10-22 | 2005-04-27 | Daewoo Electronics Corporation | Apparatus and method for searching playback start positions in a VCR |
| CN102148983A (en) * | 2010-02-08 | 2011-08-10 | 杨占昆 | Method for solving over-high occupancy of high-resolution image resource |
| CN103680137A (en) * | 2012-09-18 | 2014-03-26 | 浙江大华技术股份有限公司 | Method and device for obtaining images based on intelligent traffic monitoring system |
| CN104394319A (en) * | 2014-11-24 | 2015-03-04 | 广州市浩云安防科技股份有限公司 | Embedded HD network video recorder |
| CN105898204A (en) * | 2014-12-25 | 2016-08-24 | 支录奎 | Intelligent video recorder enabling video structuralization |
| CN106803936A (en) * | 2017-02-24 | 2017-06-06 | 深圳英飞拓科技股份有限公司 | Video capture method and device based on internal memory encoding mechanism |
| CN110087042A (en) * | 2019-05-08 | 2019-08-02 | 深圳英飞拓智能技术有限公司 | A kind of face snap method and system of real-time synchronization video flowing and metadata |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111083413A (en) | 2020-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110832875B (en) | Video processing method, terminal device and machine-readable storage medium | |
| CN111163345B (en) | Image rendering method and device | |
| CN108062507B (en) | Video processing method and device | |
| EP4054190A1 (en) | Video data encoding method and device, apparatus, and storage medium | |
| CN108924574B (en) | Packet loss processing method, device, equipment and storage medium in recording and broadcasting system | |
| CN111447239B (en) | Video stream playing control method, device and storage medium | |
| US10681400B2 (en) | Method and device for transmitting video | |
| CN112530205A (en) | Airport parking apron airplane state detection method and device | |
| CN109597566B (en) | Data reading and storing method and device | |
| CN111083413B (en) | Image display method and device, electronic equipment and storage medium | |
| CN110912922B (en) | Image transmission method and device, electronic equipment and storage medium | |
| CN109829526B (en) | Bar code management method and device and electronic equipment | |
| JP6232828B2 (en) | Still image providing device | |
| CN113205079B (en) | Face detection method and device, electronic equipment and storage medium | |
| CN113395523B (en) | Image decoding method, device, equipment and storage medium based on parallel threads | |
| CN116132719A (en) | Video processing method, device, electronic equipment and readable storage medium | |
| CN113038261A (en) | Video generation method, device, equipment, system and storage medium | |
| JP2004289294A (en) | Data processing system, data processor, and data processing method | |
| CN112449209B (en) | Video storage method and device, cloud server and computer readable storage medium | |
| CN115002527B (en) | Data transmission optimization method, device, equipment and storage medium | |
| CN114143579B (en) | Video push method and system based on multithreading queue and array | |
| CN114710685B (en) | Video stream processing method and device, terminal equipment and storage medium | |
| CN116916095B (en) | Smooth display method, device and equipment of cloud video and storage medium | |
| CN112885102B (en) | Image shooting method, device, equipment and storage medium | |
| CN115409679A (en) | Data time sequence recovery method, system, equipment and medium based on thread processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |