CN108021345B - Image browsing method, system, equipment and computer storage medium - Google Patents

Image browsing method, system, equipment and computer storage medium Download PDF

Info

Publication number
CN108021345B
CN108021345B CN201711432244.7A CN201711432244A CN108021345B CN 108021345 B CN108021345 B CN 108021345B CN 201711432244 A CN201711432244 A CN 201711432244A CN 108021345 B CN108021345 B CN 108021345B
Authority
CN
China
Prior art keywords
browsing
area
image
browsed
sub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711432244.7A
Other languages
Chinese (zh)
Other versions
CN108021345A (en
Inventor
钱基业
何国军
房斌
杨维斌
邓帮飞
张先树
高晋
张盈
彭姝迪
岳鑫桂
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing University
Electric Power Research Institute of State Grid Chongqing Electric Power Co Ltd
State Grid Corp of China SGCC
Original Assignee
Chongqing University
Electric Power Research Institute of State Grid Chongqing Electric Power Co Ltd
State Grid Corp of China SGCC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing University, Electric Power Research Institute of State Grid Chongqing Electric Power Co Ltd, State Grid Corp of China SGCC filed Critical Chongqing University
Priority to CN201711432244.7A priority Critical patent/CN108021345B/en
Publication of CN108021345A publication Critical patent/CN108021345A/en
Application granted granted Critical
Publication of CN108021345B publication Critical patent/CN108021345B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Abstract

The invention discloses an image browsing method, a system, equipment and a computer storage medium, wherein the method comprises the following steps: determining a browsing area in the image to be browsed, wherein the browsing area is an area containing a browsing object in the image to be browsed; dividing each browsing area into corresponding browsing sub-areas, wherein each browsing sub-area can be completely displayed by the display area; and sequentially pushing each browsing sub-area to the display area so as to enable the outside to completely view the browsing sub-areas in the display area. The image browsing method disclosed by the invention realizes automatic pushing of the image to be browsed, and has better applicability compared with the prior art in which the image to be browsed is manually moved. In summary, the image browsing method disclosed by the invention has better applicability. The image browsing system, the image browsing device and the computer storage medium disclosed by the invention also solve the corresponding technical problems.

Description

Image browsing method, system, equipment and computer storage medium
Technical Field
The present invention relates to the field of computer technologies, and in particular, to an image browsing method, system, device, and computer storage medium.
Background
When viewing images with a computer, it is sometimes necessary to view a large number of large-sized images having a size much larger than the display area of the display device.
One conventional method for browsing a large-size image is to manually control a browsing area, i.e., manually move a local area of the large-size image to a display area of a display device.
However, in the conventional method for browsing a large-size image, a local area of the large-size image needs to be manually moved to a display area, which is inefficient and may leave important objects to be browsed; moreover, when a large-size image is manually browsed, a large number of areas which do not need to be browsed in the image can be browsed, and further the browsing efficiency is low; the existing method for browsing large-size images is low in applicability.
In summary, how to improve the applicability of the existing method for browsing large-size images is a problem to be solved urgently by those skilled in the art.
Disclosure of Invention
The invention aims to provide an image browsing method, which can solve the technical problem of improving the applicability of the existing method for browsing large-size images to a certain extent. The invention also provides an image browsing system, equipment and a computer storage medium.
In order to achieve the above purpose, the invention provides the following technical scheme:
an image browsing method, comprising:
determining a browsing area in an image to be browsed, wherein the browsing area is an area containing a browsing object in the image to be browsed;
dividing each browsing area into corresponding browsing sub-areas, wherein each browsing sub-area can be completely displayed by a display area;
and sequentially pushing each browsing subarea to the display area so as to enable the outside to completely view the browsing subareas in the display area.
Preferably, the determining a browsing area in the image to be browsed includes:
and identifying each browsing object of the image to be browsed based on a target detection algorithm, and taking an area containing each browsing object as a browsing area of the browsing object.
Preferably, the determining a browsing area in the image to be browsed includes:
and determining each browsing area in the image to be browsed based on an image segmentation algorithm.
Preferably, the determining a browsing area in the image to be browsed includes:
and receiving each browsing area in the image to be browsed marked by the outside.
Preferably, the dividing each browsing area into corresponding browsing sub-areas includes:
for each browsing area, determining a circumscribed rectangle of the browsing area;
dividing the circumscribed rectangle into a plurality of browsing sub-regions based on a dividing formula;
the dividing formula is as follows:
Figure BDA0001525158960000021
wherein the content of the first and second substances,
Figure BDA0001525158960000022
denotes rounding up, Nw×NhIndicates the total number of browsing subareas divided by the browsing area, wW-wΔRepresenting the width, h, of each of said browsing subareasW-hΔIndicating the height of each of said browsing sub-areas,
Figure BDA0001525158960000023
the width of the circumscribed rectangle representing the viewing area,
Figure BDA0001525158960000024
height, w, of a circumscribed rectangle representing the viewing areaWIndicates the width of the display area, hWIndicating the height of the display area, wx<wWAnd h isΔ<hW
Preferably, the sequentially pushing each browsing sub-area to the display area includes:
determining a reference point of each browsing sub-area;
determining a reference point of the display area;
and sequentially pushing each browsing subarea to the display area, and controlling the reference point of the browsing subarea to be coincided with the reference point of the display area.
Preferably, after dividing each browsing area into a corresponding browsing sub-area, and before sequentially pushing each browsing sub-area to the display area, the method further includes:
and for each browsing sub-region, judging whether the ratio of the area of the browsing region to which the browsing sub-region belongs in the browsing sub-region to the area of the browsing sub-region is greater than or equal to a preset area ratio threshold, and if not, not pushing the browsing sub-region to a display region.
Preferably, in the process of sequentially pushing each browsing sub-area to the display area, the method further includes:
and judging whether control information sent by the outside is received, if so, controlling the pushing of the browsing subarea according to the control information.
Preferably, in the process of sequentially pushing each browsing sub-area to the display area, the method further includes:
establishing two matrixes which are respectively marked as a time difference matrix T and an attention matrix A, wherein T and A are both w multiplied by h matrixes, w is the width of the image to be browsed, and h is the height of the image to be browsed;
recording the time for starting to browse the image to be browsed as tau0The time for starting to browse the image to be browsed is the time for any pixel in the image to be browsed to appear in the display area for the first time;
by means of the elements T in the time difference matrix Ti,jRecording the pixel I in the image to be browsed for the first timei,jTime of and τ0A difference of (d);
by means of the element A in the attention matrix Ai,jRecording a pixel I in the image to be browsedi,jThe browsing duration is pixel Ii,jThe total length of stay in the display area.
Preferably, in the process of sequentially pushing each browsing sub-area to the display area, the method further includes:
judging whether the browsing time length of the image pixel belonging to the browsing area is greater than or equal to a preset attention time length threshold value, if so, determining the image pixel as an effective browsing pixel;
determining the ratio of the total number of the effective browsing pixels to the total number of the image pixels belonging to the browsing area as the browsing rate of the image to be browsed;
judging whether the browsing rate is greater than or equal to a preset browsing rate threshold value, if so, determining that the image to be browsed has no browsing omission, and if not, determining that the image to be browsed has browsing omission.
Preferably, in the process of sequentially pushing each browsing sub-area to the display area, the method further includes:
determining the actual browsing duration of the image to be browsed;
and judging whether the actual browsing time length is greater than or equal to a preset image browsing time length threshold value, if so, judging that the browsing efficiency of the image to be browsed is high, and if not, judging that the browsing efficiency of the image to be browsed is low.
Preferably, the sequentially pushing each browsing sub-area to the display area includes:
determining a first pushing sequence of each browsing area;
determining a second pushing sequence of each browsing sub-area of each browsing area;
and sequentially taking each browsing area as a current browsing area according to the first pushing sequence, and sequentially pushing each browsing sub-area of the current browsing area to the display area according to the second pushing sequence of the current browsing area.
An image browsing system comprising:
the device comprises a determining module, a browsing module and a display module, wherein the determining module is used for determining a browsing area in an image to be browsed, and the browsing area is an area containing a browsing object in the image to be browsed;
the dividing module is used for dividing each browsing area into corresponding browsing sub-areas, and each browsing sub-area can be completely displayed by the display area;
and the pushing module is used for sequentially pushing each browsing subarea to the display area so as to facilitate the outside to completely view the browsing subareas in the display area.
An image browsing apparatus comprising:
a memory for storing a computer program;
a processor for implementing the steps of an image browsing method as described in any one of the above when executing the computer program.
A computer storage medium having a computer program stored thereon, the computer program, when executed by a processor, implementing the steps of an image browsing method as recited in any one of the above.
The invention provides an image browsing method, which comprises the steps of determining a browsing area in an image to be browsed, wherein the browsing area is an area containing a browsing object in the image to be browsed; dividing each browsing area into corresponding browsing sub-areas, wherein each browsing sub-area can be completely displayed by the display area; and sequentially pushing each browsing sub-area to the display area so as to enable the outside to completely view the browsing sub-areas in the display area. The image browsing method provided by the invention realizes automatic pushing of the image to be browsed according to the browsing object, and has better applicability compared with the prior art in which the image to be browsed is manually moved. In summary, the image browsing method provided by the invention has better applicability. The image browsing system, the image browsing device and the computer storage medium provided by the invention also solve the corresponding technical problems.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of an image browsing method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an image browsing system according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an image browsing apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The action execution subject of each step in the image browsing method provided by the embodiment of the present invention may be an image browsing system provided by the embodiment of the present invention, and the system may be built in a computer, a server, and the like. For convenience of description, the action execution subject of each step in the image browsing method provided by the embodiment of the present invention is set as an image browsing system provided by the embodiment of the present invention, which is simply referred to as an image browsing system.
Referring to fig. 1, fig. 1 is a flowchart illustrating an image browsing method according to an embodiment of the present invention.
The image browsing method provided by the embodiment of the invention can comprise the following steps:
step S101: and determining a browsing area in the image to be browsed, wherein the browsing area is an area containing a browsing object in the image to be browsed.
In practical applications, the image browsing system may first determine a browsing area in the image to be browsed, where the browsing area is an area including a browsing object in the image to be browsed, for example, for a power transmission line diagram, the browsing object of the diagram is an insulator, a vibration damper, or the like, a sky or the like in the diagram is not a browsing object, and correspondingly, the browsing area is an area including an insulator, an area including a vibration damper, or the like, and an area including a sky alone is not a browsing area of the diagram; in a specific application scenario, the browsing area may also be a fixed area that needs to be browsed and is preset in the image to be browsed, such as an area in a certain range in the center of the image. It should be noted that the number of browsing areas in the image to be browsed is determined by the number of browsing objects in the image to be browsed and a determination method, where the determination method is a method for determining browsing areas, and assuming that there are two browsing objects in the image to be browsed, if the determination method is that one browsing object corresponds to one browsing area containing the browsing object, the number of browsing areas in the image to be browsed is 2.
Step S102: and dividing each browsing area into corresponding browsing sub-areas, wherein each browsing sub-area can be completely displayed by the display area.
After the image browsing system determines the browsing area, each browsing area can be divided into corresponding browsing sub-areas, and each browsing sub-area can be completely displayed by the display area. Because the browsing area is an area containing the browsing object, the browsing sub-area divided by the browsing area is also a sub-area containing the browsing object; in addition, each browsing sub-area can be completely displayed by the display area, so that the number of the browsing sub-areas obtained by dividing any browsing area is determined by the browsing area, the display area and the dividing method, that is, after the browsing area, the display area and the dividing method are determined, the number of the browsing sub-areas obtained by dividing any browsing area is correspondingly determined. Certainly, the image browsing system can also receive a division rule input by the outside in the process of dividing the browsing area, and divides the browsing area according to the division rule input by the outside, so that the control requirement of the outside on the process of dividing the browsing area is met.
Step S103: and sequentially pushing each browsing sub-area to the display area so as to enable the outside to completely view the browsing sub-areas in the display area.
After obtaining all the browsing sub-regions, the image browsing system can sequentially push each browsing sub-region to the display region, so that the outside can completely view the browsing sub-regions located in the display region. In the process of pushing the browsing sub-regions, the image browsing system may sequence the browsing sub-regions first, and then sequentially push the browsing sub-regions to the display region according to a sequencing result, for example, sequencing from left to right, from top to bottom, and the like, where a sequencing rule may be determined according to actual needs, and taking an image to be browsed as an example of a power transmission line diagram, the sequencing rule may be to sequence the browsing sub-regions along an extension direction of the power transmission line.
The invention provides an image browsing method, which comprises the steps of determining a browsing area in an image to be browsed, wherein the browsing area is an area containing a browsing object in the image to be browsed; dividing each browsing area into corresponding browsing sub-areas, wherein each browsing sub-area can be completely displayed by the display area; and sequentially pushing each browsing sub-area to the display area so as to enable the outside to completely view the browsing sub-areas in the display area. The image browsing method provided by the invention realizes automatic pushing of the image to be browsed according to the browsing object, and has better applicability compared with the prior art in which the image to be browsed is manually moved. In summary, the image browsing method provided by the invention has better applicability.
In the image browsing method provided in the embodiment of the present invention, step S101 determines a browsing area in an image to be browsed, and specifically, the method may include:
and identifying each browsing object of the image to be browsed based on a target detection algorithm, and taking an area containing each browsing object as a browsing area of the browsing object.
In practical application, the image browsing system may identify each browsing object in the image to be browsed based on a target detection algorithm, and then take an area containing each browsing object as a browsing area of the browsing object; in a specific application scene, the minimum area containing each browsing object can be used as the browsing area of the browsing object, and because the browsing area is the minimum area containing the browsing object, the influence of non-browsing objects in the browsing area can be reduced to a certain extent, and the probability of outside browsing the non-browsing area is further reduced to a certain extent. Of course, the detailed relationship between the browsing area and the browsing object may be determined according to actual needs, for example, the browsing area is a rectangular area containing the browsing object, and the invention is not limited in this respect.
In the image browsing method provided in the embodiment of the present invention, step S101 determines a browsing area in an image to be browsed, and specifically, the method may include:
and determining each browsing area in the image to be browsed based on an image segmentation algorithm.
In practical application, the image browsing system can determine each browsing area in the image to be browsed based on the image segmentation algorithm, and the image browsing system can quickly determine the browsing area by means of the image segmentation algorithm, so that the browsing efficiency of the image browsing method provided by the embodiment of the invention is improved to a certain extent.
In the image browsing method provided in the embodiment of the present invention, step S101 determines a browsing area in an image to be browsed, and specifically, the method may include:
and receiving each browsing area in the image to be browsed marked by the outside.
In practical application, the browsing area may be determined by the outside in a form of a label, and at this time, the image browsing system may directly receive each browsing area in the image to be browsed labeled by the outside, so that the outside can plan the browsing area according to the intention of the outside.
In the image browsing method provided in the embodiment of the present invention, in the step S102, each browsing area is divided into corresponding browsing sub-areas, which may specifically be:
for each browsing area, determining a circumscribed rectangle of the browsing area;
dividing the circumscribed rectangle into a plurality of browsing sub-regions based on a dividing formula;
the division formula is as follows:
Figure BDA0001525158960000071
wherein the content of the first and second substances,
Figure BDA0001525158960000081
denotes rounding up, Nw×NhIndicates the total number of browsing subareas divided by the browsing area, wW-wΔIndicates the width, h, of each viewed sub-regionW-hΔThe height of each of the viewing sub-areas is indicated,
Figure BDA0001525158960000082
the width of the circumscribed rectangle representing the viewing area,
Figure BDA0001525158960000083
height, w, of a circumscribed rectangle representing the viewing areaWIndicates the width of the display area, hWIndicating the height of the display area, wΔ<wWAnd h isΔ<hW
In practical application, the display area is generally a rectangular area, and at this time, the shape of the browsing sub-area can also be set to be rectangular, and the browsing area is divided into rectangular browsing sub-areasThe process of the domain can refer to this embodiment, and is not described here. It should be noted that in the process of dividing the browsing area, the outside world can adjust wΔAnd hΔThe shape of the partitioned browsing sub-area is controlled by the value of (A); in addition, in a specific application scenario, a situation may occur in which the browsing area itself can be completely displayed by the display area, where N isw、NhIs less than 1, after rounding up, Nw、NhThe values of (1) are all 1, that is, one browsing area is divided into one browsing sub-area, and at this time, the browsing area can be directly used as the browsing sub-area.
In the image browsing method provided in the embodiment of the present invention, step S103 sequentially pushes each browsing sub-area to the display area, which may specifically be:
determining a reference point of each browsing subarea;
determining a reference point of the display area;
and sequentially pushing each browsing subarea to the display area, and controlling the reference point of the browsing subarea to coincide with the reference point of the display area.
In the case that the display area and the browsing sub-area are both rectangular areas, the process of pushing each browsing sub-area to the display area by the image browsing system may be as shown in the embodiment of the present invention, and in practical application, the image browsing system may also sequence the reference points of all browsing sub-areas belonging to the same browsing area, and store the sequenced reference points in the form of a point set; correspondingly, in the process of pushing each browsing sub-region to the display region, the browsing sub-regions can be pushed according to the sequence of the reference points in the point set.
In a specific application, the reference point in the embodiment of the present invention may be a central point, and correspondingly, the process of determining the central point of each browsing sub-area may specifically be:
determining a central point of each browsing sub-area based on a central point formula;
wherein, the formula of the central point is as follows:
Figure BDA0001525158960000084
Figure BDA0001525158960000091
coordinates representing any browsing subarea in the k browsing image relative to the browsing area;
Figure BDA0001525158960000092
indicating the width of the k-th browsing area,
Figure BDA0001525158960000093
indicating the height of the k-th browsing area; 1,2, …, Nw,j=1,2,…,Nh
In the image browsing method provided in the embodiment of the present invention, after dividing each browsing area into corresponding browsing sub-areas, and before sequentially pushing each browsing sub-area to the display area, the method may further include:
and for each browsing sub-region, judging whether the ratio of the area of the browsing region to which the browsing sub-region belongs in the browsing sub-region to the area of the browsing sub-region is greater than or equal to a preset area ratio threshold, and if not, not pushing the browsing sub-region to a display region.
In practical applications, in order to reduce the probability that the browsing effect is affected by the browsing sub-region containing a large number of non-browsing objects, the image detection system may not push the browsing sub-region containing a large number of non-browsing objects to the display region, and the specific implementation process may refer to this embodiment. For example, when a line passing through the diagonal of the image to be browsed is taken as the browsing area, if the browsing sub-area is not selectively avoided, the whole image to be browsed can be browsed, and if the browsing sub-area without the line can be avoided, the image can be browsed only along the line.
In the image browsing method provided in the embodiment of the present invention, in the process of sequentially pushing each browsing sub-area to the display area in step S103, the method may further include:
and judging whether control information sent by the outside is received, if so, controlling the pushing of the browsing subarea according to the control information.
In practical application, in order to meet the requirement that the outside world controls the display process of the browsing sub-regions in the display region according to actual needs, the image detection system can also judge whether control information sent by the outside world is received in real time in the process of sequentially pushing each browsing sub-region to the display region, if so, the pushing of the browsing sub-regions is controlled according to the control information, wherein the control information can be used for pausing, switching the current browsing sub-region, selecting a certain browsing sub-region to be directly displayed in the display region and the like.
In the image browsing method provided in the embodiment of the present invention, in the process of sequentially pushing each browsing sub-area to the display area in step S103, the method may further include:
establishing two matrixes which are respectively marked as a time difference matrix T and an attention matrix A, wherein T and A are both w multiplied by h matrixes, w is the width of an image to be browsed, and h is the height of the image to be browsed;
the time for starting to browse the image to be browsed is recorded as tau0The time for starting to browse the image to be browsed is the time for any pixel in the image to be browsed to appear in the display area for the first time;
by means of the elements T in the time difference matrix Ti,jRecording a pixel I in an image to be browsed in the first browsingi,jTime of and τ0A difference of (d);
by means of the element A in the attention matrix Ai,jRecording a pixel I in an image to be viewedi,jA browsing duration of pixel Ii,jThe total length of stay in the display area.
In practical application, the data in the image to be browsed may be recorded by using a matrix, and the specific process refers to this embodiment, but of course, other methods for recording the data in the image to be browsed may also be available, such as recording the occurrence time and departure time of each image pixel in the display area, and the present invention is not limited herein.
In the image browsing method provided in the embodiment of the present invention, in the process of sequentially pushing each browsing sub-area to the display area, the method may further include:
judging whether the browsing time length of the image pixel belonging to the browsing area is greater than or equal to a preset attention time length threshold value, if so, determining the image pixel as an effective browsing pixel;
determining the ratio of the total number of effective browsing pixels to the total number of image pixels belonging to the browsing area as the browsing rate of the image to be browsed;
and judging whether the browsing rate is greater than or equal to a preset browsing rate threshold value, if so, determining that the image to be browsed has no browsing omission, and if not, determining that the image to be browsed has browsing omission.
In practical application, the image browsing system can automatically analyze whether browsing omission exists in the image to be browsed in the process of pushing each browsing sub-region to the display region, and the specific process refers to the embodiment.
In a specific application scenario, the image browsing system may also analyze whether there is a browsing omission in the image to be browsed by means of a matrix, and the process may be as follows:
establishing two matrixes which are respectively marked as an area distribution matrix R and a browsing matrix V, wherein R and V are both matrixes of wx h, w is the width of an image to be browsed, and h is the height of the image to be browsed;
initializing the element values in both R and V to 0;
setting the element value of an image pixel belonging to the browsing area in R to be 1;
setting the element value of the image pixel with the browsing time length larger than the preset browsing time length threshold value in V as 1;
determining an image pixel having the same element value of 1 in R and V as an effective image pixel;
determining the ratio of the total number of effective image pixels to the total number of elements with the value of 1 in R as the browsing rate of the image to be browsed;
and judging whether the browsing rate is greater than or equal to a preset browsing rate threshold value, if so, determining that the image to be browsed has no browsing omission, and if not, determining that the image to be browsed has browsing omission.
In the image browsing method provided in the embodiment of the present invention, in the process of sequentially pushing each browsing sub-area to the display area in step S103, the method may further include:
determining the actual browsing duration of the image to be browsed;
and judging whether the actual browsing time length is greater than or equal to a preset image browsing time length threshold value, if so, judging that the browsing efficiency of the image to be browsed is high, and if not, judging that the browsing efficiency of the image to be browsed is low.
In practical application, the image browsing system may automatically analyze the browsing efficiency of the image to be browsed in the process of pushing each browsing sub-area to the display area, and the specific implementation process refers to this embodiment, where the actual browsing duration of the image to be browsed is also the time interval between when the image to be browsed first appears in the display area and when the image to be browsed finally leaves the display area, for example, in the above-mentioned matrices T and a, the browsing duration of the image to be browsed may be obtained by adding the maximum value of the element in T and the element value in a corresponding to the maximum value.
In the image browsing method provided in the embodiment of the present invention, step S103 sequentially pushes each browsing sub-area to the display area, which may specifically be:
determining a first pushing sequence of each browsing area;
determining a second pushing sequence of each browsing sub-area of each browsing area;
and taking each browsing area as a current browsing area in sequence according to the first pushing sequence, and sequentially pushing each browsing sub-area of the current browsing area to the display area according to the second pushing sequence of the current browsing area.
In practical application, the image browsing system may first push and sort the browsing areas, then push and sort the browsing sub-areas of each browsing area, and finally obtain the push and sort of all the browsing sub-areas in the image to be browsed, and finally push the browsing sub-areas to the display area according to the push and sort, where the specific implementation process may refer to this embodiment. It should be noted that, in the push process, in order to improve the visual effect of browsing, the image browsing system may also control the switching speed between browsing areas and between browsing sub-areas, and the specific speed switching value may be determined according to actual needs.
In a specific application scenario, this embodiment may be combined with the embodiment of the present invention that relates to a point set, and step S103 sequentially pushes each browsing sub-area to a display area, which may specifically be:
step S1031: and determining the pushing sequence of each browsing area.
When the number of the browsing areas is greater than 1, the pushing order of the browsing areas needs to be determined, for example, the pushing order may be obtained by sequencing the browsing areas from top to bottom and from left to right according to the positions of the browsing areas in the image to be browsed.
Step S1032: a reference point for each viewing sub-region is determined.
Step S1033: and sequencing the reference points of each browsing area to construct a browsing track.
Using R as the browsing areakIs represented bykThe reference points of the browsing subareas in the network are arranged according to a certain rule to construct a browsing area RkBrowsing track of
Figure BDA0001525158960000121
Browsing track
Figure BDA0001525158960000122
1 st point above, i.e. the starting point, is noted as
Figure BDA0001525158960000123
2 nd point is marked as
Figure BDA0001525158960000124
And so on, but the point on the browsing track does not exceed Nw×NhAnd (4) respectively. For the top to bottom leftBrowsing way to the right without avoiding browsing subareas and browsing track
Figure BDA0001525158960000125
The configuration of (a) may be as follows:
Figure BDA0001525158960000126
step S1034: a reference point of the display area is determined.
Step S1035: and taking each browsing area as a current browsing area in turn according to the pushing sequence of the browsing areas, pushing the current browsing area to a display area, and automatically moving the current browsing area according to the browsing track of the current browsing area so that each reference point in the browsing track is overlapped with the reference point of the display area.
The invention also provides an image browsing system which has the corresponding effect of the image browsing method provided by the embodiment of the invention. Referring to fig. 2, fig. 2 is a schematic structural diagram of an image browsing system according to an embodiment of the present invention.
An image browsing system provided in an embodiment of the present invention may include:
the determining module 101 is configured to determine a browsing area in the image to be browsed, where the browsing area is an area including a browsing object in the image to be browsed;
the dividing module 102 is configured to divide each browsing area into corresponding browsing sub-areas, where each browsing sub-area can be completely displayed by the display area;
the pushing module 103 is configured to sequentially push each browsing sub-area to the display area, so that the outside world can completely view the browsing sub-areas located in the display area.
In the image browsing system provided in the embodiment of the present invention, the more detailed working process of each module may refer to the corresponding content disclosed in the foregoing embodiment, and is not described herein again.
The invention also provides image browsing equipment and a computer storage medium, which have the corresponding effects of the image browsing method provided by the embodiment of the invention. Referring to fig. 3, fig. 3 is a schematic structural diagram of an image browsing apparatus according to an embodiment of the present invention.
An image browsing apparatus provided in an embodiment of the present invention may include:
a memory 201 for storing a computer program;
a processor 202, configured to implement the steps of an image browsing method as described in any of the above embodiments when executing the computer program.
In an embodiment of the present invention, a computer storage medium is provided, where a computer program is stored on the computer storage medium, and when the computer program is executed by a processor, the steps of the image browsing method described in any of the above embodiments are implemented.
For a description of a relevant part in an image browsing system, an image browsing device and a computer storage medium provided by the embodiments of the present invention, reference is made to detailed descriptions of a corresponding part in an image browsing method provided by the embodiments of the present invention, and details are not repeated here. In addition, parts of the above technical solutions provided in the embodiments of the present invention that are consistent with the implementation principles of the corresponding technical solutions in the prior art are not described in detail, so as to avoid redundant description.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. An image browsing method, comprising:
determining a browsing area in an image to be browsed, wherein the browsing area is an area containing a browsing object in the image to be browsed;
dividing each browsing area into corresponding browsing sub-areas, wherein each browsing sub-area can be completely displayed by a display area;
sequentially pushing each browsing subarea to the display area so as to enable the outside to completely view the browsing subareas in the display area;
wherein, the determining the browsing area in the image to be browsed comprises:
identifying each browsing object of the image to be browsed based on a target detection algorithm, and taking an area containing each browsing object as a browsing area of the browsing object;
wherein, in the process of sequentially pushing each browsing sub-area to the display area, the method further comprises: establishing two matrixes which are respectively marked as a time difference matrix T and an attention matrix A, wherein T and A are both w multiplied by h matrixes, w is the width of the image to be browsed, and h is the height of the image to be browsed; recording the time for starting to browse the image to be browsed as tau0The time for starting to browse the image to be browsed is the time for any pixel in the image to be browsed to appear in the display area for the first time; by means of the elements T in the time difference matrix Ti,jRecording the pixel I in the image to be browsed for the first timei,jTime of and τ0A difference of (d); by means of the element A in the attention matrix Ai,jRecording a pixel I in the image to be browsedi,jThe browsing duration is pixel Ii,jA total length of stay in the display area;
judging whether the browsing time length of the image pixel belonging to the browsing area is greater than or equal to a preset attention time length threshold value, if so, determining the image pixel as an effective browsing pixel;
determining the ratio of the total number of the effective browsing pixels to the total number of the image pixels belonging to the browsing area as the browsing rate of the image to be browsed;
judging whether the browsing rate is greater than or equal to a preset browsing rate threshold value, if so, determining that the image to be browsed has no browsing omission, and if not, determining that the image to be browsed has browsing omission.
2. The method of claim 1, wherein said dividing each of said browsing areas into respective browsing sub-areas comprises:
for each browsing area, determining a circumscribed rectangle of the browsing area;
dividing the circumscribed rectangle into a plurality of browsing sub-regions based on a dividing formula;
the dividing formula is as follows:
Figure FDA0002976442990000021
wherein the content of the first and second substances,
Figure FDA0002976442990000022
denotes rounding up, Nw×NhIndicates the total number of browsing subareas divided by the browsing area, wW-wΔRepresenting the width, h, of each of said browsing subareasW-hΔIndicating the height of each of said browsing sub-areas,
Figure FDA0002976442990000023
the width of the circumscribed rectangle representing the viewing area,
Figure FDA0002976442990000024
height, w, of a circumscribed rectangle representing the viewing areaWIndicates the width of the display area, hWIndicating the height of the display area, wΔ<wWAnd h isΔ<hW
3. The method of claim 2, wherein the pushing each of the browsing sub-regions to the display region in turn comprises:
determining a reference point of each browsing sub-area;
determining a reference point of the display area;
and sequentially pushing each browsing subarea to the display area, and controlling the reference point of the browsing subarea to be coincided with the reference point of the display area.
4. The method according to claim 1, wherein after dividing each browsing area into corresponding browsing sub-areas and before sequentially pushing each browsing sub-area to the display area, the method further comprises:
and for each browsing sub-region, judging whether the ratio of the area of the browsing region to which the browsing sub-region belongs in the browsing sub-region to the area of the browsing sub-region is greater than or equal to a preset area ratio threshold, and if not, not pushing the browsing sub-region to a display region.
5. The method according to claim 1, wherein in the process of sequentially pushing each browsing sub-area to the display area, the method further comprises:
and judging whether control information sent by the outside is received, if so, controlling the pushing of the browsing subarea according to the control information.
6. The method according to claim 1, wherein in the process of sequentially pushing each browsing sub-area to the display area, the method further comprises:
determining the actual browsing duration of the image to be browsed;
and judging whether the actual browsing time length is greater than or equal to a preset image browsing time length threshold value, if so, judging that the browsing efficiency of the image to be browsed is high, and if not, judging that the browsing efficiency of the image to be browsed is low.
7. The method according to any one of claims 1 to 6, wherein the sequentially pushing each browsing sub-area to the display area comprises:
determining a first pushing sequence of each browsing area;
determining a second pushing sequence of each browsing sub-area of each browsing area;
and sequentially taking each browsing area as a current browsing area according to the first pushing sequence, and sequentially pushing each browsing sub-area of the current browsing area to the display area according to the second pushing sequence of the current browsing area.
8. An image browsing system, comprising:
the device comprises a determining module, a browsing module and a display module, wherein the determining module is used for determining a browsing area in an image to be browsed, and the browsing area is an area containing a browsing object in the image to be browsed;
the dividing module is used for dividing each browsing area into corresponding browsing sub-areas, and each browsing sub-area can be completely displayed by the display area;
the pushing module is used for sequentially pushing each browsing subarea to the display area so as to facilitate the outside to completely view the browsing subareas in the display area;
wherein the determining module is specifically configured to: identifying each browsing object of the image to be browsed based on a target detection algorithm, and taking an area containing each browsing object as a browsing area of the browsing object;
the pushing module is further configured to establish two matrices, which are respectively marked as a time difference matrix T and an attention matrix a, in the process of sequentially pushing each browsing sub-region to the display region, where T and a are both w × h matrices, w is the width of the image to be browsed, and h is the height of the image to be browsed; recording the time for starting to browse the image to be browsed as tau0The time for starting to browse the image to be browsed is the time for any pixel in the image to be browsed to appear in the display area for the first time; by means of the elements T in the time difference matrix Ti,jRecording the pixel I in the image to be browsed for the first timei,jTime of and τ0A difference of (d); by means of the element A in the attention matrix Ai,jRecord the said waitBrowsing pixels I in an imagei,jThe browsing duration is pixel Ii,jA total length of stay in the display area;
the push module is further configured to: judging whether the browsing time length of the image pixel belonging to the browsing area is greater than or equal to a preset attention time length threshold value, if so, determining the image pixel as an effective browsing pixel; determining the ratio of the total number of the effective browsing pixels to the total number of the image pixels belonging to the browsing area as the browsing rate of the image to be browsed; judging whether the browsing rate is greater than or equal to a preset browsing rate threshold value, if so, determining that the image to be browsed has no browsing omission, and if not, determining that the image to be browsed has browsing omission.
9. An image browsing apparatus, characterized by comprising:
a memory for storing a computer program;
a processor for implementing the steps of an image browsing method as claimed in any one of claims 1 to 7 when executing said computer program.
10. A computer storage medium, having a computer program stored thereon, which, when being executed by a processor, carries out the steps of an image browsing method according to any one of claims 1 to 7.
CN201711432244.7A 2017-12-26 2017-12-26 Image browsing method, system, equipment and computer storage medium Active CN108021345B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711432244.7A CN108021345B (en) 2017-12-26 2017-12-26 Image browsing method, system, equipment and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711432244.7A CN108021345B (en) 2017-12-26 2017-12-26 Image browsing method, system, equipment and computer storage medium

Publications (2)

Publication Number Publication Date
CN108021345A CN108021345A (en) 2018-05-11
CN108021345B true CN108021345B (en) 2021-05-11

Family

ID=62071906

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711432244.7A Active CN108021345B (en) 2017-12-26 2017-12-26 Image browsing method, system, equipment and computer storage medium

Country Status (1)

Country Link
CN (1) CN108021345B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112748978A (en) * 2020-12-31 2021-05-04 北京达佳互联信息技术有限公司 Display area determination method and device and related equipment
CN113094535A (en) * 2021-04-01 2021-07-09 国网电力科学研究院有限公司 Power grid graph browsing method, system, device, computer equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002175135A (en) * 2000-12-05 2002-06-21 Mitsubishi Paper Mills Ltd Image display method for home page and image area designating method
CN102023836A (en) * 2010-11-26 2011-04-20 北京腾瑞万里科技有限公司 Display method of mobile terminal vector map and mobile terminal
CN104317520A (en) * 2014-10-23 2015-01-28 小米科技有限责任公司 Method and device for processing contents of display area
CN106339158A (en) * 2016-08-17 2017-01-18 东方网力科技股份有限公司 Dynamic display method and device for static images based on large data
CN106603838A (en) * 2016-12-06 2017-04-26 深圳市金立通信设备有限公司 Image processing method and terminal
CN107203971A (en) * 2017-07-28 2017-09-26 彭志勇 The gradual loading method of sampled images

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002175135A (en) * 2000-12-05 2002-06-21 Mitsubishi Paper Mills Ltd Image display method for home page and image area designating method
CN102023836A (en) * 2010-11-26 2011-04-20 北京腾瑞万里科技有限公司 Display method of mobile terminal vector map and mobile terminal
CN104317520A (en) * 2014-10-23 2015-01-28 小米科技有限责任公司 Method and device for processing contents of display area
CN106339158A (en) * 2016-08-17 2017-01-18 东方网力科技股份有限公司 Dynamic display method and device for static images based on large data
CN106603838A (en) * 2016-12-06 2017-04-26 深圳市金立通信设备有限公司 Image processing method and terminal
CN107203971A (en) * 2017-07-28 2017-09-26 彭志勇 The gradual loading method of sampled images

Also Published As

Publication number Publication date
CN108021345A (en) 2018-05-11

Similar Documents

Publication Publication Date Title
US20210201445A1 (en) Image cropping method
US10134165B2 (en) Image distractor detection and processing
US20200058270A1 (en) Bullet screen display method and electronic device
JP7146091B2 (en) Information embedding method in video, computer equipment and computer program
CN104394422A (en) Video segmentation point acquisition method and device
CN111260037B (en) Convolution operation method and device of image data, electronic equipment and storage medium
CN103530052A (en) Display method of interface content and user equipment
CN108509272B (en) Method and device for copying GPU (graphics processing Unit) video memory texture to system memory and electronic equipment
CN108021345B (en) Image browsing method, system, equipment and computer storage medium
CN104299186A (en) Method and device for conducting mosaic processing on picture
CN108875068B (en) Data information positioning method applied to smart television
CN112860163A (en) Image editing method and device
CN112714255A (en) Shooting method, shooting device, electronic equipment and readable storage medium
CN104754223A (en) Method for generating thumbnail and shooting terminal
WO2017113713A1 (en) Method and device for adjusting display interface
CN112200737B (en) Image processing method and device based on reinforcement learning and storage medium
CN103955713A (en) Icon recognition method and device
CN111835972A (en) Shooting method and device and electronic equipment
CN114419322B (en) Image instance segmentation method and device, electronic equipment and storage medium
CN114268803B (en) Live video display method, device, equipment and storage medium
CN111698548A (en) Video playing method and device
CN108668161A (en) Method of video image processing, computer installation and computer readable storage medium
CN111145108B (en) Image processing method, device, equipment and storage medium
CN111127310B (en) Image processing method and device, electronic equipment and storage medium
CN111966853B (en) Management method of remote sensing image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant