CN115469954A - Canvas-based image annotation method and Canvas-based image annotation system - Google Patents
Canvas-based image annotation method and Canvas-based image annotation system Download PDFInfo
- Publication number
- CN115469954A CN115469954A CN202211141073.3A CN202211141073A CN115469954A CN 115469954 A CN115469954 A CN 115469954A CN 202211141073 A CN202211141073 A CN 202211141073A CN 115469954 A CN115469954 A CN 115469954A
- Authority
- CN
- China
- Prior art keywords
- image
- canvas
- mouse click
- annotation
- click event
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/40—Filling a planar surface by adding surface attributes, e.g. colour or texture
Abstract
The invention provides an image annotation method and system based on Canvas, which relate to the technical field of image processing, and the method comprises the following steps: acquiring an image to be annotated according to the image display instruction, and displaying the image to be annotated in Canvas; monitoring a mouse click event in Canvas in real time, acquiring a mouse click event set, and drawing a labeled image according to the mouse click event set; monitoring a mouse click event in Canvas in real time, and moving, zooming or hiding the marked image; and performing label assignment on the labeled image by adopting a manual labeling or image identification mode. The invention is based on Canvas, the image to be marked is drawn on line through a browser, the position and the figure of the marked image are changed, multi-person collaborative marking or intelligent marking is carried out on the marked image, and the efficiency of image marking and classification is improved.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a Canvas-based image annotation method and system.
Background
With the development of science and technology, the internet has fully entered the artificial intelligence era, the current high-speed development of artificial intelligence depends on a technical mode combining big data and machine learning, and the prejudgment capability of a machine on a complex mode is strengthened through a machine learning mode on the basis of big data calculation. Artificial intelligence needs deep learning of training data sets in tens of millions or even hundreds of millions, and the deep learning needs a large amount of labeled data to support, so that a large amount of training data sets can be provided through data acquisition and labeling work. At present, most of data annotation works are image annotation, and image annotation is needed in the artificial intelligence fields of image recognition, face recognition, user behavior analysis and the like.
Most of the existing image labeling tools are manually based on image labeling, cannot perform image labeling based on an image recognition technology, cannot perform collaborative labeling during manual image labeling, and are low in image labeling efficiency and poor in flexibility.
Disclosure of Invention
In order to solve the problem of low efficiency of the conventional image annotation, the embodiment of the invention provides an image annotation method and system based on Canvas.
In a first aspect, an embodiment of the present invention provides a Canvas-based image annotation method, where the method includes the following steps:
acquiring an image to be annotated according to an image display instruction, and displaying the image to be annotated in a Canvas in a target browser;
monitoring a mouse click event in Canvas in real time, acquiring a mouse click event set in a preset time period, and drawing a labeled image according to the mouse click event set;
monitoring a mouse click event in Canvas in real time, judging whether the mouse click event occurs on a labeled image, if so, judging whether the mouse click event occurs on a preset control point, and if so, moving, zooming or hiding the labeled image according to the mouse click event;
and performing label assignment on the labeled image by adopting a manual labeling or image identification mode.
In the embodiment, the Canvas is accessed through the browser, the annotation image is drawn by monitoring the mouse click event based on the native Canvas, the annotation image is moved, zoomed or displayed and hidden, and the like, the manual image annotation and the intelligent image annotation can be performed, and the efficiency and the flexibility of the image annotation are improved.
As some optional embodiments of the present application, if the annotation image is a rectangle, the process of drawing the annotation image according to the mouse click event set is as follows:
obtaining the width and height of the marked image according to the starting point coordinate and the end point coordinate recorded in the mouse click event set;
and performing rectangle filling according to the width and the height through a rectangle drawing function of Canvas to generate an annotated image.
As some optional embodiments of the present application, if the annotation image is a circle, the process of drawing the annotation image according to the mouse click event set is as follows:
obtaining the diameter of the marked image according to the starting point coordinate and the end point coordinate recorded in the mouse click event set;
and performing circular filling according to the diameter through a rectangular drawing function of Canvas to generate an annotated image.
As some optional embodiments of the present application, if the annotated image is a polygon, the process of drawing the annotated image according to the set of mouse click events is as follows:
drawing a plurality of edges according to a series of point coordinates recorded in the mouse click event set;
and verifying the intersection condition of any two edges by adopting a projection method, and performing polygon filling through a path filling function of Canvas to generate an annotated image.
As some optional embodiments of the present application, the process of using manual labeling is as follows:
binding different shortcut key striking events with different label assignment parameters in advance;
and selecting the marked image through a mouse click event, acquiring a tag assignment parameter through a shortcut key click event, and fusing the tag assignment parameter and the marked image.
As some optional embodiments of the present application, the flow of image recognition is as follows:
acquiring a plurality of labeled images and corresponding label assignment parameters in advance to form a data set;
inputting the data set into a neural network model for model training to obtain a label assignment model;
and inputting the labeled image to be subjected to label assignment into the label assignment model, acquiring the label assignment parameters, and fusing the label assignment parameters and the labeled image.
As some optional embodiments of the present application, the manual annotation includes a personal annotation and a team annotation, that is, the efficiency of image annotation is improved in a multi-user collaborative annotation manner.
As some optional embodiments of the present application, the flow of team annotation is as follows:
creating a team, generating a team joining key, joining team members according to the key, recording the number of the team members, and presetting image labeling periods of different team members;
acquiring an image to be annotated, and distributing the image to be annotated according to the image annotation periods of different team members;
and respectively carrying out individual labeling on different team members, namely selecting a labeled image through a mouse click event, acquiring a label assignment parameter through a shortcut key click event, and fusing the label assignment parameter and the labeled image.
In a second aspect, the present invention provides a Canvas-based image annotation system, the system comprising:
the annotation image acquisition unit is used for acquiring an image to be annotated according to the image display instruction and displaying the image to be annotated in a Canvas in a target browser;
the mouse click event acquisition unit is used for monitoring a mouse click event in Canvas in real time, acquiring a mouse click event set in a preset time period and monitoring the mouse click event in the Canvas in real time;
the annotation image drawing unit is used for drawing an annotation image according to the mouse click event set;
the marked image changing unit is used for moving, zooming or hiding the marked image according to the mouse click event;
the system comprises a shortcut key striking event acquisition unit, a label evaluation unit and a label image fusion unit, wherein the shortcut key striking event acquisition unit is used for monitoring a shortcut key striking event in real time, acquiring a label evaluation parameter according to the striking event and fusing the label evaluation parameter with the label image;
the image identification unit is used for inputting the labeled image to be subjected to label assignment into the label assignment model, acquiring a label assignment parameter and fusing the label assignment parameter with the labeled image;
the label type selection unit is used for selecting a manual label or image identification mode to assign a label;
the annotation type selection unit comprises a personal annotation module, a team annotation module and a collaborative management module;
the personal labeling module is used for binding different shortcut key striking events with different label assignment parameters in advance; and selecting the marked image through a mouse click event, acquiring a tag assignment parameter through a shortcut key click event, and fusing the tag assignment parameter and the marked image.
The team marking module is used for creating a team and then generating a team joining key, team members join the team according to the key, recording the number of the team members, and presetting image marking periods of different team members; acquiring an image to be annotated, and distributing the image to be annotated according to the image annotation periods of different team members; and (3) manually labeling different team members respectively, namely selecting a labeled image through a mouse click event, acquiring a label assignment parameter through a shortcut key click event, and fusing the label assignment parameter and the labeled image.
The collaborative management module is used for presetting the priorities of different team members, and for the team member with higher priority, the team member with lower priority can be marked and checked.
In the embodiment, the image to be annotated is acquired through the annotation image acquisition unit, the mouse click event acquisition unit monitors the mouse click event to draw the annotation image, the shortcut key click event acquisition unit assigns the label to the annotation image to realize the fusion of the label assignment parameter and the annotation image, and meanwhile, the image identification unit identifies the label to the label image to fuse the label assignment parameter and the annotation image; the invention can carry out manual annotation or image identification selection through the annotation type selection unit, and can carry out individualized image annotation selection such as personal annotation and team annotation selection when carrying out manual annotation, so that the image annotation form is more flexible, and the annotation efficiency and the accuracy are higher.
In a third aspect, the present invention provides a computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor executing the Canvas-based image annotation method.
In a fourth aspect, the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the Canvas-based image annotation method.
The invention has the following beneficial effects: according to the method, the Canvas is accessed through the browser, based on the original Canvas, the marked image is drawn by monitoring the mouse click event, the marked image is moved, zoomed or displayed and hidden, and the like, and the manual image marking and the intelligent image marking can be carried out, so that the efficiency and the flexibility of image marking are improved; meanwhile, the method has a collaborative annotation function, and can be used for manually annotating the annotated image by multiple people, so that the annotation efficiency of the manual image is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
FIG. 1 is a diagram of the steps of a Canvas-based image annotation process, according to some embodiments of the invention.
FIG. 2 is a flow diagram of manual annotation and image recognition according to some embodiments of the invention.
FIG. 3 is a system block diagram of the Canvas-based image annotation system according to some embodiments of the invention.
Detailed Description
In order to better understand the technical solutions of the present invention, the following detailed descriptions of the technical solutions of the present invention are provided with the accompanying drawings and the specific embodiments, and it should be understood that the specific features in the embodiments and the examples of the present invention are the detailed descriptions of the technical solutions of the present invention, and are not limitations of the technical solutions of the present invention, and the technical features in the embodiments and the examples of the present invention may be combined with each other without conflict.
It should also be appreciated that in the foregoing description of embodiments of the invention, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of at least one embodiment of the invention. This method of disclosure, however, is not intended to suggest that the claimed subject matter requires more features than are expressly recited in the claims. Indeed, the embodiments may be characterized as having less than all of the features of a single embodiment disclosed above.
Example 1
The invention provides an image annotation method based on Canvas, please refer to fig. 1, the method comprises the following steps:
(1) Acquiring an image to be annotated according to an image display instruction, and displaying the image to be annotated in a Canvas in a target browser;
the image display instruction is generally a mouse click instruction, and meanwhile, the image display instruction can also be an external image transmission instruction; and the image to be annotated can be displayed in any target browser.
And when the image to be annotated is obtained according to the image display instruction, the image set to be annotated can be obtained through the image display instruction.
(2) Monitoring a mouse click event in Canvas in real time, acquiring a mouse click event set in a preset time period, and drawing a labeled image according to the mouse click event set;
the preset time period is generally 1 minute or 0.5 minute, and meanwhile, the preset time period can also be set according to the operation habit.
In the embodiment of the present invention, if the annotated image is a rectangle, the process of drawing the annotated image according to the mouse click event set is as follows:
(2.1) according to the starting point coordinate and the end point coordinate recorded in the mouse click event set, and subtracting the starting point coordinate from the end point coordinate to obtain the width and the height of the marked image;
(2.2) carrying out rectangular filling according to width and height through a rectangular drawing function Api (strokeRect) of Canvas to generate an annotated image;
the rectangular drawing function Api (strokeRect) is a function carried by the Canvas, namely, the rectangular drawing function Api (strokeRect) is called from a function library carried by the Canvas.
In the embodiment of the present invention, if the annotation image is a circle, the process of drawing the annotation image according to the mouse click event set is as follows:
(2.3) according to the starting point coordinate and the end point coordinate recorded in the mouse click event set, and subtracting the starting point coordinate from the end point coordinate to obtain the diameter of the marked image;
and (2.4) performing circular filling according to the diameter through a rectangular drawing function Api (arc) of a Canvas to generate an annotation image.
The rectangular drawing function Api (arc) is a function carried by the Canvas, namely, the rectangular drawing function Api (arc) can be called from a function library carried by the Canvas.
In the embodiment of the present invention, if the annotated image is a polygon, the process of drawing the annotated image according to the mouse click event set is as follows:
(2.5) drawing a plurality of edges according to a series of point coordinates recorded in the mouse click event set;
and (2.6) verifying the intersection condition of any two edges by adopting a projection method, and carrying out polygon filling through a path filling function Api (moveTo, lineTo, fill) of Canvas to generate an annotated image.
It should be noted that, when drawing the polygon annotation image, since the graph cannot be changed along with the movement of the mouse, the previous graph needs to be destroyed and a new graph needs to be redrawn continuously when the mouse clicks and moves, so that the drawing effect can be realized.
Specifically, the path filling function Api (moveTo, lineTo, file) is a function carried by the Canvas itself, that is, it is only required to be called from a function library carried by the Canvas itself.
(3) Monitoring a mouse click event in Canvas in real time, judging whether the mouse click event occurs on the labeled image, if so, judging whether the mouse click event occurs on a preset control point again, and if so, moving, zooming or hiding the labeled image again according to the mouse click event;
when moving, zooming or hiding is carried out, firstly, a mouse is required to click to select a marked image, rectangles and circles can be judged by adding or subtracting a drop point, a starting point and a terminal point, drop point detection of polygons can be carried out by using a turf.js geographic space analysis library, then control points are required to be drawn, the control points can indicate that the marked image is selected, and then the control points can be dragged to achieve the purpose of zooming the image; the control points of the rectangular annotation image need to be drawn by 8, so that the rectangular annotation image can be stretched in different directions, the control points of the circular annotation image need to be drawn by 4, the control points of the polygonal annotation image are points during drawing, and the stretching of the points of the polygonal annotation image only needs to change the currently selected points; and (4) after the labeled graph is selected, judging the type of the selected graph, filtering the data during drawing, and redrawing.
(4) And performing label assignment on the labeled image by adopting a manual labeling or image identification mode, wherein the manual labeling comprises personal labeling and team labeling.
In the embodiment of the present invention, please refer to fig. 2, the process of manual labeling is as follows:
(4.1) binding different shortcut key striking events with different label assignment parameters in advance;
and (4.2) selecting the marked image through a mouse click event, acquiring a label assignment parameter through a shortcut key click event, and fusing the label assignment parameter and the marked image.
The shortcut key is bound with the label assignment parameter when loading the label complex assignment parameter, the single keys a-z and 0-9 are bound with the label assignment parameter, and the unused key can be used as a standby shortcut key to be used after a newly added label or a fusion label is added subsequently.
In the embodiment of the present invention, referring to fig. 2, the process of image recognition is as follows:
(4.3) acquiring a plurality of marked images and corresponding label assignment parameters in advance to form a data set;
(4.4) inputting the data set into a neural network model for model training to obtain a label assignment model;
and (4.5) inputting the label image to be subjected to label assignment into the label assignment model, acquiring a label assignment parameter, and fusing the label assignment parameter and the label image.
In the embodiment of the present invention, referring to fig. 2, the process of team labeling is as follows:
(5.1) creating a team, generating a team joining key, joining the team by team members according to the key, recording the number of the team members, and presetting image annotation periods and team member priorities of different team members;
distributing images to be annotated according to different time periods, wherein a team comprises a member A, a member B and a member C, for example, one image to be annotated is distributed to the member A within 30 seconds, one image to be annotated is distributed to the member B within 20 seconds, one image to be annotated is distributed to the member C within 1 minute, and the priority of the team members is that the member A is greater than the member B and greater than the member C; the priority of the team members is preset and is set according to the accuracy of manual marking, namely the higher the accuracy is, the higher the priority of the team members is;
(5.2) acquiring images to be annotated, and distributing the images to be annotated according to the image annotation periods of different team members;
(5.3) carrying out individual marking on different team members respectively, namely selecting a marked image through a mouse click event, acquiring a label assignment parameter through a shortcut key click event, and fusing the label assignment parameter and the marked image.
For the team members with higher priority, the annotation verification can be performed on the team members with lower priority, namely, the annotation result of the team members with lower priority is spot-checked, so that the accuracy of image annotation is ensured.
Meanwhile, before manual labeling, the to-be-labeled images can be pre-labeled in an image identification mode, namely, the to-be-labeled images are preliminarily classified, then the to-be-labeled images of different types are distributed to different team members, manual labeling is carried out again through the team members, the image labeling efficiency is guaranteed while the image labeling accuracy is guaranteed, the to-be-labeled images of different types are distributed to different team members, and the difficulty of manual secondary verification can be reduced.
Example 2
The invention provides an image annotation system based on Canvas, please refer to fig. 3, the system includes:
the annotation image acquisition unit is used for acquiring an image to be annotated according to the image display instruction and displaying the image to be annotated in a Canvas in a target browser;
the mouse click event acquisition unit is used for monitoring a mouse click event in Canvas in real time, acquiring a mouse click event set in a preset time period and monitoring the mouse click event in the Canvas in real time;
the annotation image drawing unit is used for drawing an annotation image according to the mouse click event set;
the marked image changing unit is used for moving, zooming or hiding the marked image according to the mouse click event;
the system comprises a shortcut key striking event acquisition unit, a label evaluation unit and a label image fusion unit, wherein the shortcut key striking event acquisition unit is used for monitoring a shortcut key striking event in real time, acquiring a label evaluation parameter according to the striking event and fusing the label evaluation parameter with the label image;
the image identification unit is used for inputting the labeled image to be subjected to label assignment into the label assignment model, acquiring a label assignment parameter and fusing the label assignment parameter with the labeled image;
and the label type selection unit is used for selecting a manual label or image identification mode to assign a label.
The annotation type selection unit comprises a personal annotation module, a team annotation module and a collaborative management module;
the personal labeling module is used for binding different shortcut key striking events with different label assignment parameters in advance; and selecting the marked image through a mouse click event, acquiring a tag assignment parameter through a shortcut key click event, and fusing the tag assignment parameter and the marked image.
The team marking module is used for creating a team and then generating a team joining key, team members join a team according to the key, recording the number of the team members, and presetting image marking periods of different team members; acquiring an image to be annotated, and distributing the image to be annotated according to the image annotation periods of different team members; and (3) manually labeling different team members respectively, namely selecting a labeled image through a mouse click event, acquiring a label assignment parameter through a shortcut key click event, and fusing the label assignment parameter and the labeled image.
The cooperative management module is used for presetting the priorities of different team members, and for the team member with higher priority, the team member with lower priority can be labeled and checked.
In the embodiment, the image to be annotated is acquired through the annotation image acquisition unit, the mouse click event acquisition unit monitors the mouse click event to draw the annotation image, the shortcut key click event acquisition unit assigns the label to the annotation image to realize the fusion of the label assignment parameter and the annotation image, and meanwhile, the image identification unit identifies the label image to further fuse the label assignment parameter and the annotation image; meanwhile, the manual annotation or image identification selection can be carried out through the annotation type selection unit, and personalized image annotation selection such as individual annotation and team annotation selection can be carried out during manual annotation, so that the image annotation form is more flexible, and the annotation efficiency and accuracy are higher.
Example 3
The invention provides a computer device, which comprises a memory and a processor, wherein the memory stores a computer program, and the computer program executes the Canvas-based image annotation method of embodiment 1 when the processor runs.
The computer device provided in this embodiment may implement the method described in embodiment 1, and is not described herein again to avoid repetition.
Example 4
The invention provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the Canvas-based image annotation method of embodiment 1.
The computer-readable storage medium provided in this embodiment may implement the method described in embodiment 1, and is not described herein again to avoid repetition.
The processor may be a Central Processing Unit (CPU), other general purpose processor, a digital signal processor (digital signal processor), an Application Specific Integrated Circuit (Application Specific Integrated Circuit), an off-the-shelf programmable gate array (Field programmable gate array) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory can be used for storing the computer program and/or the module, and the processor can realize various functions of the printed circuit board defect detection device in the invention by operating or executing the data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a sound playing function, an image playing function, etc.), and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card, a secure digital card, a flash memory card, at least one magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
The Canvas-based image annotation system, if implemented in the form of a software functional unit and sold or used as a stand-alone product, can be stored in a computer-readable storage medium. Based on such understanding, all or part of the flow in the method of implementing the embodiments of the present invention may also be stored in a computer readable storage medium through a computer program, and when the computer program is executed by a processor, the computer program may implement the steps of the above-described method embodiments. Wherein the computer program comprises computer program code, an object code form, an executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying said computer program code, a recording medium, a usb-disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory, a random access memory, a point carrier signal, a telecommunications signal, a software distribution medium, etc. It should be noted that the computer readable medium may contain content that is appropriately increased or decreased as required by legislation and patent practice in the jurisdiction.
Having described the basic concept of the invention, it should be apparent to those skilled in the art that the foregoing detailed disclosure is to be considered merely as illustrative and not restrictive of the broad invention. Various modifications, improvements and adaptations to the present description may occur to those skilled in the art, although not explicitly described herein. Such modifications, improvements and adaptations are proposed in the present specification and thus fall within the spirit and scope of the exemplary embodiments of the present specification.
Also, the description uses specific words to describe embodiments of the description. Reference throughout this specification to "one embodiment," "an embodiment," and/or "some embodiments" means that a particular feature, structure, or characteristic described in connection with at least one embodiment of the specification is included. Therefore, it is emphasized and should be appreciated that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, some features, structures, or characteristics of one or more embodiments of the specification may be combined as appropriate.
Moreover, those skilled in the art will appreciate that aspects of the present description may be illustrated and described in terms of several patentable categories or situations, including any new and useful combination of processes, machines, manufacture, or materials, or any new and useful modification thereof. Accordingly, aspects of this description may be performed entirely by hardware, entirely by software (including firmware, resident software, micro-code, etc.), or by a combination of hardware and software. The above hardware or software may be referred to as "data block," module, "" engine, "" unit, "" component, "or" system. Furthermore, aspects of the present description may be represented as a computer product, including computer readable program code, embodied in one or more computer readable media.
The computer storage medium may comprise a propagated data signal with the computer program code embodied therewith, for example, on baseband or as part of a carrier wave. The propagated signal may take any of a variety of forms, including electromagnetic, optical, etc., or any suitable combination. A computer storage medium may be any computer-readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code on a computer storage medium may be propagated over any suitable medium, including radio, cable, fiber optic cable, RF, or the like, or any combination of the preceding.
Claims (11)
1. A Canvas-based image annotation method is characterized by comprising the following steps:
acquiring an image to be annotated according to the image display instruction, and displaying the image to be annotated in Canvas of a target browser;
monitoring a mouse click event in Canvas in real time, acquiring a mouse click event set in a preset time period, and drawing a labeled image according to the mouse click event set;
monitoring a mouse click event in Canvas in real time, judging whether the mouse click event occurs on a labeled image, if so, judging whether the mouse click event occurs on a preset control point, and if so, moving, zooming or hiding the labeled image according to the mouse click event;
and performing label assignment on the labeled image by adopting a manual labeling or image identification mode.
2. The Canvas-based image annotation method according to claim 1, wherein if the annotated image is rectangular, the process of drawing the annotated image according to the set of mouse click events is as follows:
obtaining the width and height of the marked image according to the starting point coordinate and the end point coordinate recorded in the mouse click event set;
and performing rectangular filling according to the width and the height through a rectangular drawing function of Canvas to generate a labeling image.
3. The Canvas-based image annotation method according to claim 1, wherein if the annotated image is a circle, the process of drawing the annotated image according to the set of mouse click events is as follows:
obtaining the diameter of the marked image according to the starting point coordinate and the end point coordinate recorded in the mouse click event set;
and performing circular filling according to the diameter through a rectangular drawing function of Canvas to generate an annotated image.
4. The Canvas-based image annotation method according to claim 1, wherein if the annotated image is a polygon, the process of drawing the annotated image according to the set of mouse click events is as follows:
drawing a plurality of edges according to a series of point coordinates recorded in the mouse click event set;
and verifying the intersection condition of any two edges by adopting a projection method, and performing polygon filling through a path filling function of Canvas to generate an annotated image.
5. The Canvas-based image annotation method according to claim 1, wherein the manual annotation process is as follows:
binding different shortcut key striking events with different label assignment parameters in advance;
and selecting the marked image through a mouse click event, acquiring a tag assignment parameter through a shortcut key click event, and fusing the tag assignment parameter and the marked image.
6. The Canvas-based image annotation method according to claim 5, wherein the image recognition is performed as follows:
acquiring a plurality of labeled images and corresponding label assignment parameters in advance to form a data set;
inputting the data set into a neural network model for model training to obtain a label assignment model;
and inputting the labeled image to be subjected to label assignment into the label assignment model, acquiring the label assignment parameters, and fusing the label assignment parameters and the labeled image.
7. The Canvas-based image annotation method according to claim 5, wherein the manual annotation comprises a person annotation and a team annotation.
8. The Canvas-based image annotation method according to claim 7, wherein the flow of team annotation is as follows:
creating a team, then generating a team joining key, joining team members according to the key, recording the number of the team members, and presetting image labeling periods of different team members;
acquiring an image to be annotated, and distributing the image to be annotated according to the image annotation periods of different team members;
and respectively carrying out individual marking on different team members, namely selecting a marked image through a mouse click event, acquiring a label assignment parameter through a shortcut key click event, and fusing the label assignment parameter and the marked image.
9. A Canvas-based image annotation system, the system comprising:
the annotation image acquisition unit is used for acquiring an image to be annotated according to the image display instruction and displaying the image to be annotated in a Canvas in a target browser;
the mouse click event acquisition unit is used for monitoring mouse click events in Canvas in real time, acquiring a mouse click event set in a preset time period and monitoring mouse click time in real time;
the annotation image drawing unit is used for drawing an annotation image according to the mouse click event set;
the marked image changing unit is used for moving, zooming or hiding the marked image according to the mouse click event;
the system comprises a shortcut key striking event acquisition unit, a label evaluation unit and a label image fusion unit, wherein the shortcut key striking event acquisition unit is used for monitoring a shortcut key striking event in real time, acquiring a label evaluation parameter according to the striking event and fusing the label evaluation parameter with the label image;
the image identification unit is used for inputting the label image to be subjected to label assignment into the label assignment model, acquiring label assignment parameters and fusing the label assignment parameters with the label image;
and the label type selection unit is used for selecting a manual label or image identification mode to assign a label.
10. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: the processor, when executing the computer program, implements a Canvas-based image annotation method as claimed in any one of claims 1-8.
11. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, implements a Canvas-based image annotation method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211141073.3A CN115469954A (en) | 2022-09-20 | 2022-09-20 | Canvas-based image annotation method and Canvas-based image annotation system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211141073.3A CN115469954A (en) | 2022-09-20 | 2022-09-20 | Canvas-based image annotation method and Canvas-based image annotation system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115469954A true CN115469954A (en) | 2022-12-13 |
Family
ID=84333087
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211141073.3A Pending CN115469954A (en) | 2022-09-20 | 2022-09-20 | Canvas-based image annotation method and Canvas-based image annotation system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115469954A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116580286A (en) * | 2023-07-12 | 2023-08-11 | 宁德时代新能源科技股份有限公司 | Image labeling method, device, equipment and storage medium |
| CN117115570A (en) * | 2023-10-25 | 2023-11-24 | 成都数联云算科技有限公司 | Canvas-based image labeling method and Canvas-based image labeling system |
-
2022
- 2022-09-20 CN CN202211141073.3A patent/CN115469954A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116580286A (en) * | 2023-07-12 | 2023-08-11 | 宁德时代新能源科技股份有限公司 | Image labeling method, device, equipment and storage medium |
| CN116580286B (en) * | 2023-07-12 | 2023-11-03 | 宁德时代新能源科技股份有限公司 | Image labeling method, device, equipment and storage medium |
| CN117115570A (en) * | 2023-10-25 | 2023-11-24 | 成都数联云算科技有限公司 | Canvas-based image labeling method and Canvas-based image labeling system |
| CN117115570B (en) * | 2023-10-25 | 2023-12-29 | 成都数联云算科技有限公司 | Canvas-based image labeling method and Canvas-based image labeling system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115469954A (en) | Canvas-based image annotation method and Canvas-based image annotation system | |
| US10599311B2 (en) | Layout constraint manipulation via user gesture recognition | |
| US9471872B2 (en) | Extension to the expert conversation builder | |
| US20110197165A1 (en) | Methods and apparatus for organizing a collection of widgets on a mobile device display | |
| US8775952B2 (en) | Intelligent roadmap navigation in a graphical user interface | |
| US20110145738A1 (en) | Nested roadmap navigation in a graphical user interface | |
| CN111752557A (en) | Display method and device | |
| US11221833B1 (en) | Automated object detection for user interface generation | |
| Benomar et al. | Visualizing software dynamicities with heat maps | |
| CN111957040A (en) | Method and device for detecting shielding position, processor and electronic device | |
| US20220222900A1 (en) | Coordinating operations within an xr environment from remote locations | |
| EP2911049B1 (en) | Method and system for generating crowd animation and computer-readable recording medium | |
| US20160132817A1 (en) | Project structure mapper | |
| Meolic | Demonstration of sorting algorithms on mobile platforms | |
| US20170285930A1 (en) | Document content replay | |
| CN114168019A (en) | Multi-application window level management method and device | |
| Baloukas | JAVENGA: JAva‐based visualization environment for network and graph algorithms | |
| Safer et al. | Comparing episodic and semantic interfaces for task boundary identification | |
| CN111258701A (en) | State icon control method, intelligent terminal and storage medium | |
| CN113626621A (en) | Course content generation system and editing device for online interactive teaching | |
| US20140288983A1 (en) | Systems and methods for using a designer/developer discipline map | |
| CN111104114B (en) | Method, system and equipment for realizing self-belt-state controllable carousel graph component | |
| CN107016044A (en) | A kind of method and device of data visualization processing | |
| Frosini et al. | ProtoSketchAR: Prototyping in Augmented Reality via Sketchings | |
| GROLAUX et al. | SketchADoodle: Engineering Touch-surface Multi-stroke Gestures by Bézier Curves |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |