CN113010069A - Switching method and device for picture labels, electronic device and storage medium - Google Patents

Switching method and device for picture labels, electronic device and storage medium Download PDF

Info

Publication number
CN113010069A
CN113010069A CN202110268817.7A CN202110268817A CN113010069A CN 113010069 A CN113010069 A CN 113010069A CN 202110268817 A CN202110268817 A CN 202110268817A CN 113010069 A CN113010069 A CN 113010069A
Authority
CN
China
Prior art keywords
picture
labeling
window
windows
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110268817.7A
Other languages
Chinese (zh)
Inventor
敬太洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Dahua Technology Co Ltd
Original Assignee
Zhejiang Dahua Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Dahua Technology Co Ltd filed Critical Zhejiang Dahua Technology Co Ltd
Priority to CN202110268817.7A priority Critical patent/CN113010069A/en
Publication of CN113010069A publication Critical patent/CN113010069A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Abstract

The application relates to a switching method, equipment, an electronic device and a storage medium of picture labels, wherein the switching method of the picture labels comprises the following steps: displaying a plurality of windows in a labeling interface for performing picture labeling, wherein the plurality of windows at least comprise a first window and a second window; displaying a first picture to be marked in a first window, and displaying a second picture to be marked in a second window; and after judging that the labeling of the first picture is finished, acquiring labeling information of a second picture in a second window. By the method and the device, the problems that in the related art, when the pictures are labeled, the pictures are downloaded and displayed in a serial mode, time consumption is high, and efficiency is low are solved, targets in the pictures are labeled quickly, and efficiency of labeling the pictures is improved effectively.

Description

Switching method and device for picture labels, electronic device and storage medium
Technical Field
The present application relates to the field of image processing technologies, and in particular, to a method, an apparatus, an electronic device, and a storage medium for switching image labels.
Background
The material often needs to be labeled before model training by the training server. If the material is a picture, the target in each picture needs to be labeled on the training server. In order to complete the model training once, people are often relied on to label a large amount of picture data. In the marking process, the training server and the corresponding client side are respectively operated on the two physical machines, and an operator of the training server marks the pictures through the client side. After the operator finishes the marking of one picture, the operator needs to click the operations of 'saving' and 'next' to display the next picture on the client, and then the operator marks the next picture.
In the labeling process, the downloading and displaying of the pictures are serial, and unnecessary time consumption exists. Especially, when the network signal is poor, the physical machine performance of the client is poor, or the resolution of the picture is large, unnecessary time consumption is more obvious. Therefore, it often takes a long time to manually label these picture data.
At present, no effective solution is provided for the problems that when pictures are labeled in the related art, the downloading and displaying of the pictures are serial, the time consumption is large, and the efficiency is low.
Disclosure of Invention
The embodiment of the application provides a switching method, equipment, an electronic device and a storage medium for picture labeling, and aims to at least solve the problems that when pictures are labeled in the related art, the downloading and displaying of the pictures are serial, the time consumption is high, and the efficiency is low.
In a first aspect, an embodiment of the present application provides a method for switching picture labels, including:
displaying a plurality of windows in a labeling interface for labeling pictures, wherein the plurality of windows at least comprise a first window and a second window;
displaying a first picture to be marked in the first window, and displaying a second picture to be marked in the second window;
and after judging that the labeling of the first picture is finished, acquiring labeling information of the second picture in the second window.
In some embodiments, after determining that the labeling of the first picture is completed, acquiring labeling information of the second picture in the second window includes:
acquiring the position of an input signal, and judging whether the first picture is marked or not according to the relative position relation between the position of the input signal and a picture area formed by the first picture, wherein the input signal is used for marking pictures in a plurality of windows;
and after the marking of the first picture is judged to be finished, obtaining the marking information of the second picture according to the matching relation between the position of the input signal and the picture area formed by the second picture.
In some embodiments, after determining that the labeling of the first picture is completed, acquiring labeling information of the second picture in the second window includes:
if the position of the input signal is located in a picture area formed by the first picture, acquiring the marking information of the first picture;
if the position of the input signal is not in a picture area formed by the first picture, judging that the first picture is labeled completely, and uploading labeled information of the first picture;
and if the position of the input signal is located in a picture area formed by the second picture, acquiring the marking information of the second picture in the second window.
In some embodiments, the displaying a plurality of windows in the annotation interface for annotating pictures includes:
acquiring network round trip time, and acquiring the number of windows in the labeling interface according to the network round trip time;
and simultaneously displaying a plurality of windows in the labeling interface according to the number of the windows.
In some embodiments, after displaying a plurality of windows in the annotation interface for performing the annotation of the picture, the method further includes:
and acquiring a round-robin sequence of the windows, and determining the first window and the second window according to the round-robin sequence.
In some embodiments, the obtaining a round robin order for the plurality of windows comprises:
acquiring the position of an input signal and a plurality of picture areas formed by a plurality of windows;
and matching the position of the input signal with the plurality of picture areas, and determining the polling sequence of the plurality of windows according to the matching result.
In some embodiments, the obtaining a round robin order for the plurality of windows comprises:
and determining the round-robin sequence of the windows according to the relative position relationship among the windows.
In some embodiments, after determining that the labeling of the first picture is completed, the method further includes:
acquiring a re-labeling instruction, and displaying a plurality of labeled pictures and/or picture information on the labeling interface, wherein the labeled pictures and/or picture information are arranged according to a time sequence;
acquiring a relabeling confirmation signal from the plurality of labeled pictures and/or picture information, and confirming a target picture according to the relabeling confirmation signal;
and acquiring the updated marking information of the target picture.
In some embodiments, after determining that the labeling of the first picture is completed, the method further includes:
acquiring a re-labeling instruction, and displaying an input box corresponding to the re-labeling instruction on the labeling interface;
acquiring picture information from the input frame, and confirming a target picture according to the picture information;
and acquiring the labeling information of the target picture.
In some embodiments, after determining that the labeling of the first picture is completed, the method further includes:
and displaying a third picture to be marked in the first window.
In a second aspect, an embodiment of the present application provides a switching device for picture labeling, including a display unit and an obtaining unit:
the display unit is used for displaying a plurality of windows in a labeling interface for performing image labeling, wherein the plurality of windows at least comprise a first window and a second window, a first image to be labeled is displayed in the first window, and a second image to be labeled is displayed in the second window;
the obtaining unit is configured to obtain the label information of the second picture in the second window after judging that the labeling of the first picture is completed.
In a third aspect, an embodiment of the present application provides an electronic apparatus, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor, when executing the computer program, implements the method for switching between image labels according to the first aspect.
In a fourth aspect, the present application provides a storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the method for switching between image labels according to the first aspect.
Compared with the related art, the switching method of the image annotation provided by the embodiment of the application displays a plurality of windows in the annotation interface for performing the image annotation, wherein the plurality of windows at least comprise a first window and a second window; displaying a first picture to be marked in a first window, and displaying a second picture to be marked in a second window; after the marking of the first picture is judged to be completed, the marking information of the second picture is obtained in the second window, the problems that when pictures are marked in the related technology, the downloading and displaying of the pictures are serial, the time consumption is high, and the efficiency is low are solved, the target in the pictures is marked quickly, and the picture marking efficiency is effectively improved.
The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below to provide a more thorough understanding of the application.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic application environment diagram of a switching method of image annotation according to an embodiment of the present application;
FIG. 2 is a flowchart of a method for switching image labels according to an embodiment of the present application;
FIG. 3 is a diagram illustrating another method for switching image labels according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a tagging interface for different window numbers according to an embodiment of the present application;
FIG. 5 is a flow chart of a method of re-labeling a picture according to an embodiment of the present application;
fig. 6 is a block diagram of a hardware structure of a terminal of a method for switching image labels according to an embodiment of the present application;
fig. 7 is a block diagram of a switching device for image annotation according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of ordinary skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms referred to herein shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar words throughout this application are not to be construed as limiting in number, and may refer to the singular or the plural. The present application is directed to the use of the terms "including," "comprising," "having," and any variations thereof, which are intended to cover non-exclusive inclusions; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or elements, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Reference to "connected," "coupled," and the like in this application is not intended to be limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. Reference herein to "a plurality" means greater than or equal to two. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. Reference herein to the terms "first," "second," "third," and the like, are merely to distinguish similar objects and do not denote a particular ordering for the objects.
The switching method for image labels provided by the present application can be applied to the application environment shown in fig. 1, and fig. 1 is an application environment schematic diagram of the switching method for image labels according to the embodiment of the present application, as shown in fig. 1. The client 102 and the corresponding training server 104 are respectively operated on two physical machines, and the client 102 and the training server 104 communicate with each other through a network. An operator of the training server 104 labels the picture through the client 102, and a plurality of windows are displayed in a labeling interface of the client 102, wherein the plurality of windows at least include a first window and a second window. An operator may label the first picture in the first window, and after the labeling is completed, the client 102 uploads the obtained labeling information to the training server, and at this time, the operator may label the second picture in the second window. The client 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the training server 104 is a device dedicated to training an algorithm model, and may be implemented by an independent server or a server cluster composed of a plurality of servers.
The embodiment provides a switching method of picture labels. Fig. 2 is a flowchart of a switching method of image labels according to an embodiment of the present application, and as shown in fig. 2, the method includes the following steps:
step S210, displaying a plurality of windows in a labeling interface for performing image labeling, where the plurality of windows at least include a first window and a second window.
In general, before model training, an operator labels a material picture to be labeled through a labeling interface on a client. A plurality of windows can be displayed simultaneously in the labeling interface of the client side, for example, two, three, four or more windows are displayed simultaneously on the labeling interface, and an operator can conveniently label pictures. The present embodiment is described by taking two windows as an example.
Step S220, a first picture to be labeled is displayed in the first window, and a second picture to be labeled is displayed in the second window.
When the image marking is carried out, each window of the marking interface can display the image to be marked, and specifically, when the marking is started, the images in all the windows can be downloaded from the training server in advance and displayed. Further, after the client acquires the labeling information of the picture, the client can automatically download the next picture to be labeled and display the next picture in the corresponding window.
In step S230, after the labeling of the first picture is determined to be completed, the labeling information of the second picture is obtained in the second window.
In the labeling process, an operator firstly labels a first picture in a first window, at this time, a client acquires labeling information for labeling the first picture, after the labeling is completed, the operator can click a 'confirm' button of a labeling interface to input the labeling completion information to the client, and in other embodiments, the input of the labeling completion information can be realized by continuously double-clicking a right mouse button or a left mouse button in the first window. After the client acquires the labeling completion information in the first window, the client can judge that the labeling of the first picture is completed, then an operator can label the second picture in the second window directly without waiting for loading the picture to be labeled in the first window, and at the moment, the client can also continue to acquire the labeling information of the second picture. The labeling information is information related to algorithm model training, such as the position, the type, the number, and the like of the target object in the picture.
Through the steps S210 to S230, in this embodiment, a plurality of windows are simultaneously displayed on the labeling interface, and a picture to be labeled is displayed on each window, after the operator labels the first picture in the first window, the operator can directly label the second picture in the second window, and in the whole labeling process, the client acquires the labeling information corresponding to the picture in real time. In the related art, only one window is displayed in the labeling interface, and after the client receives a "save" instruction and a "next" instruction input by an operator, the client needs to load the picture to be labeled and then display the next picture in the window, so that the time cost is high, and especially under the conditions of long network round-trip time, poor performance of a client physical machine and high picture resolution, the client needs to wait for the loading for a longer time. The marking interface in the application can simultaneously display a plurality of windows, and an operator can directly mark the second picture in the second window without clicking 'next' after marking the first picture, so that the marking time is saved, the target in the picture is quickly marked, and the picture marking efficiency is effectively improved.
Further, after the client acquires the labeling information of the first picture from the first window, the third picture is automatically downloaded from the training server, and after the downloading is completed, the third picture to be labeled is displayed in the first window to wait for the labeling of an operator. In this embodiment, the third picture can be downloaded in the first window in the process that the operator marks the second picture in the second window, and after the operator marks the second picture, the third picture can be directly marked without waiting for downloading, so that the marking time is saved, and the marking efficiency is improved.
In some embodiments, a target picture in a picture labeling process and whether labeling of a current picture is completed are determined according to a position relationship between a position of an input signal and a picture area formed by the picture, wherein the input signal is used for labeling the pictures in a plurality of windows. Specifically, taking the first picture and the second picture as an example, the position of the input signal is obtained first, and whether the first picture is labeled is judged according to the relative position relationship between the position of the input signal and the picture area formed by the first picture, where the position of the input signal may be the position of a mouse cursor on a labeling interface, and in the case that the labeling interface is a touch screen, the position of the input signal may also be the position of a human body part such as a fingertip on the labeling interface. And displaying the pictures to be marked in the first window and the second window, wherein the picture frame and the area formed inside the picture frame are the picture areas. Therefore, the relative position relationship between the input signal and the picture region includes that the input signal is in the picture region and the signal belongs to the picture region, in this embodiment, whether the labeling of the first picture is completed is determined according to the relative position relationship between the input signal and the picture region of the first picture, and after the labeling of the first picture is determined to be completed, the labeling information of the second picture is obtained according to the matching relationship between the position of the input signal and the picture region formed by the second picture. In the embodiment, whether the labeling of the picture is completed or not is judged according to the relative position relationship between the position of the input signal and the picture area, and the target picture in the labeling process is obtained to judge which picture corresponds to the current labeling information.
In some embodiments, fig. 3 is a schematic diagram of another switching method for image annotation according to the embodiments of the present application, and as shown in fig. 3, the method includes:
step S310, if the position of the input signal is located in a picture area formed by a first picture, obtaining the marking information of the first picture, wherein the input signal is used for marking the pictures in a plurality of windows;
step S320, if the position of the input signal is not in the picture area formed by the first picture, judging that the labeling of the first picture is finished, and uploading the labeling information of the first picture;
in step S330, if the position of the input signal is located in the picture area formed by the second picture, the label information of the second picture is obtained in the second window.
Through the steps S310 to S330, in the process of image labeling, according to the embodiment, it is determined whether the current target image to be labeled is the first image or the second image according to the position of the input signal, and after it is determined that labeling of the first image is completed, the currently obtained labeling information is uploaded to the training server for storage, and then the next target image is obtained according to the position of the input signal. Compared with the prior art, the uploading can be realized only by clicking the 'save' button by an operator, the judgment is directly carried out according to the position of the input information in the embodiment, the operator does not need to carry out additional operation, the operation time is further saved, and the labeling efficiency is improved.
In some embodiments, the number of windows of the multiple windows displayed simultaneously in the annotation interface can be set according to requirements or habits of operators. Further, the number of windows displayed in the annotation interface can be obtained by the following method: the method comprises the steps of obtaining a network Round-Trip Time (RTT for short), obtaining the number of windows in a labeling interface according to the network Round-Trip Time, and simultaneously displaying a plurality of windows in the labeling interface according to the number of the windows. In this embodiment, a plurality of network round-trip time ranges may be preset, each network round-trip time range corresponds to one window number, and after the network round-trip time is obtained, the network round-trip time is compared with the network round-trip time range to obtain the window number. For example, the number of windows is 2 when the network round trip time range is less than or equal to 200ms, 3 when the network round trip time range is greater than 200ms and less than or equal to 500ms, and 4 when the network round trip time range is greater than 500 ms. Fig. 4 is a schematic diagram of a labeling interface with different window numbers according to an embodiment of the present application, and as shown in fig. 4, the smaller the network round-trip time is, the shorter the picture downloading time is, so the number of windows is smaller, and as the network round-trip time is increased, the larger the number of windows is, the longer the time for completing one round of window polling is, and the longer the picture downloading time reserved for each window is. In the process of downloading the picture, the operator can label the picture in other windows, so that the time is not needed to be spent in the labeling process to wait for the completion of the downloading of the picture, the operation time is further saved, and the labeling efficiency is improved.
In some embodiments, a round-robin order among the windows needs to be determined, and an operation order of an operator to mark the picture is determined according to the round-robin order, that is, a first window and a second window are determined, so that the operator marks the picture.
One method for determining the round-robin order is to obtain a position of an input signal and a plurality of picture areas formed by a plurality of windows, match the position of the input signal with the plurality of picture areas, and determine the round-robin order of the plurality of windows according to a matching result, wherein the matching is to determine which picture area of the plurality of picture areas the position of the input signal is in. In this embodiment, the client for labeling pictures determines a round-robin order of the pictures according to a position of an input signal, the input signal is located in a picture area formed by one picture, the picture is labeled, when the input signal is not located in the picture area, the labeling information is uploaded, and a next target picture to be labeled is also determined according to the position of the input signal. In this embodiment, the polling sequence is determined by the position of the input signal, so that more flexible label selection can be provided for an operator, and the situation that some pictures still need to wait for too long loading time is avoided.
Another method for determining the round-robin order is to determine the round-robin order of the windows according to the relative position relationship between the windows, and the round-robin manner in this embodiment may be preset by an operator. For example, when there are four windows, the round-robin order may be an upper left window, an upper right window, a lower left window, and a lower right window, or may be an upper left window, a lower left window, an upper right window, and a lower right window. The round patrol sequence in the application can be preset to accord with the operation habit of an operator and improve the labeling efficiency.
In some embodiments, if the operator mislabels the pictures, the mislabeled pictures can be relabeled through a relabeling button on the labeling interface.
Fig. 5 is a flowchart of a method for re-labeling a picture according to an embodiment of the present application, and as shown in fig. 5, the method includes the following steps:
step S510, obtaining a re-labeling instruction, and displaying a plurality of labeled pictures and/or picture information on a labeling interface, wherein the labeled pictures and/or picture information are arranged according to a time sequence.
The method comprises the steps that an operator clicks a re-labeling button on a labeling interface to trigger a re-labeling instruction, and after receiving the re-labeling instruction, a client displays a labeled picture and/or picture information, wherein the picture can carry labeling information, or only displays the picture through a thumbnail, and the picture information comprises the acquisition time, the labeling time, the picture number and the like of the picture.
During displaying, the display quantity of the pictures and/or the picture information can be set according to actual conditions, for example, the display quantity can be set according to the size of a labeling interface, and the display sequence can be arranged according to a time sequence, including a forward sequence arrangement and a reverse sequence arrangement, so that an operator can find the wrongly labeled pictures conveniently.
Step S520, obtaining a relabeling confirmation signal from the labeled pictures and/or picture information, and confirming the target picture according to the relabeling confirmation signal.
The operator can input the relabeling confirmation signal by clicking the picture or the picture information, and the client selects the target picture to be relabeled according to the relabeling confirmation signal.
Step S530, obtaining updated annotation information of the target picture.
After confirming the target picture, the client may display the target picture in the window, and obtain labeling information for the operator to label the target picture again.
Through the steps S510 to S530, in the embodiment, the labeled picture and/or the picture information is directly displayed on the labeling interface, so that an operator can find a picture to be labeled again more intuitively and conveniently to correct the picture.
Further, after the client acquires the re-labeling instruction, an input box corresponding to the re-labeling instruction is displayed on the labeling interface, and an operator can enter picture information, such as the number of the picture, the acquisition time, the labeling time and the like, into the input box. The client acquires the picture information from the input box, confirms the target picture according to the picture information, and then displays the target picture in a window of the labeling interface to acquire the labeling information of the target picture. In other embodiments, if a plurality of target pictures are determined according to the picture information, the plurality of target pictures may be all displayed in the annotation interface for the operator to confirm again, where the display manner includes list display, icon display, and the like. In the embodiment, the image is re-marked through the input box, so that the method is quicker and saves time.
The embodiments of the present application are described and illustrated below by means of preferred embodiments.
And dividing the marking windows into 2, 3 or 4 on a marking interface of the client according to the network round-trip time. Specifically, the number of windows is 2 when the network is good, 3 when the network is general, and 4 when the network is poor, wherein the network is good, the network is general, and the network is poor can be determined according to the network round trip time. Taking the total number of the windows to be marked when the network is good as an example, firstly, the first window and the second window simultaneously download and display the pictures to be marked. After the pictures in the first window and the second window are downloaded and displayed, an operator starts to label the first window, after the labeling is finished, the operator does not need to click the storage window and the next window, the switching is directly switched to the second window for labeling, and the client can identify the switching process through the position of the input signal. After detecting that the operator marks the second window, the client automatically uploads the marking information of the first window to the training server in the background, then automatically downloads the next picture and displays the next picture on the marking interface of the first window, and waits for the next marking of the operator. And after the operator finishes marking on the second window, switching to the prepared first window for marking. Meanwhile, when the client detects that the operator marks the first window, the client automatically uploads the marking information of the second window to the training server in the background, then automatically downloads the next picture and displays the next picture on the marking interface of the second window, and waits for the next marking of the operator. This is repeated until the labeling is complete.
Under the condition that a plurality of windows are arranged on the labeling interface, the preferred round inspection mode is that an operator labels the pictures in all the windows on the labeling interface in sequence, and after all the pictures are labeled, a round inspection process is completed. In the round-robin process, i is used as a round-robin variable, after a window is marked, whether the value of i is smaller than the number of windows is judged, if the judgment result is yes, i is assigned to i +1, and if the judgment result is no, i is assigned to 1, and a new round of round-robin is started.
In the embodiment, a multi-window labeling method is adopted, so that the operation steps of operator labeling are reduced, the pictures to be labeled are downloaded and displayed in each window in advance, the labeling time is effectively shortened, and the labeling efficiency is improved. Compared with the prior art, the method for marking the multiple windows is adopted, the operations of clicking 'save' and clicking 'next' by an operator are omitted, the client can automatically upload marking information to the training server, automatically download the next picture to be marked and display the picture to be marked in the multiple windows, and the efficiency of marking the picture is effectively improved.
It should be noted that all operations performed on two windows in the present application are applicable to three or more windows. In general, the size of the window is adapted to the size of the picture to be marked, and when the sizes of the windows are not consistent, the larger size is used as a picture area for judgment. For example, in the case that the size of the window is larger than the size of the picture, the picture cannot fill the whole window, and then the marking of the current picture is determined to be completed in the case that the position of the input signal is located outside the window boundary.
It should be further noted that the steps illustrated in the above-described flow diagrams or in the flow diagrams of the figures may be performed in a computer system, such as a set of computer-executable instructions, and that, although a logical order is illustrated in the flow diagrams, in some cases, the steps illustrated or described may be performed in an order different than presented here.
The method embodiments provided in the present application may be executed in a terminal, a computer or a similar computing device. Taking the operation on the terminal as an example, fig. 6 is a hardware structure block diagram of the terminal of the switching method for picture marking according to the embodiment of the present application. As shown in fig. 6, the terminal 60 may include one or more (only one shown in fig. 6) processors 602 (the processor 602 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 604 for storing data, and optionally may also include a transmission device 606 for communication functions and an input-output device 608. It will be understood by those skilled in the art that the structure shown in fig. 6 is only an illustration and is not intended to limit the structure of the terminal. For example, terminal 60 may also include more or fewer components than shown in FIG. 6, or have a different configuration than shown in FIG. 6.
The memory 604 may be used to store a control program, for example, a software program and a module of an application software, such as a control program corresponding to the switching method of the picture marking in the embodiment of the present application, and the processor 602 executes various functional applications and data processing by running the control program stored in the memory 604, so as to implement the method described above. The memory 604 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 604 may further include memory located remotely from the processor 602, which may be connected to the terminal 60 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmitting device 606 is used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the terminal 60. In one example, the transmission device 606 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmitting device 606 can be a Radio Frequency (RF) module, which is used to communicate with the internet in a wireless manner.
The present embodiment further provides a switching device for image labeling, where the switching device is used to implement the foregoing embodiments and preferred embodiments, and details are not repeated after the description. As used hereinafter, the terms "module," "unit," "subunit," and the like may implement a combination of software and/or hardware for a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 7 is a block diagram of a switching device for image annotation according to an embodiment of the present application, and as shown in fig. 7, the switching device includes a display unit 71 and an acquisition unit 72: the display unit 71 is configured to display a plurality of windows in a labeling interface for performing image labeling, where the plurality of windows at least include a first window and a second window, a first image to be labeled is displayed in the first window, and a second image to be labeled is displayed in the second window; and the obtaining unit 72 is configured to obtain labeling information of the second picture in the second window after judging that labeling of the first picture is completed.
In this embodiment, the display unit 71 simultaneously displays a plurality of windows in the labeling interface, and displays the pictures to be labeled in each window, after the operator labels the first picture in the first window, the operator can label the second picture in the second window directly, and in the whole labeling process, the client obtains the labeling information corresponding to the pictures in real time through the obtaining module 72. In the related art, only one window is displayed in the labeling interface, and after the client receives a "save" instruction and a "next" instruction input by an operator, the client needs to load the picture to be labeled and then display the next picture in the window, so that the time cost is high, and especially under the conditions of long network round-trip time, poor performance of a client physical machine and high picture resolution, the client needs to wait for the loading for a longer time. The marking interface in the application can simultaneously display a plurality of windows, and an operator can directly mark the second picture in the second window without clicking 'next' after marking the first picture, so that the marking time is saved, the target in the picture is quickly marked, and the picture marking efficiency is effectively improved.
The above modules may be functional modules or program modules, and may be implemented by software or hardware. For a module implemented by hardware, the modules may be located in the same processor; or the modules can be respectively positioned in different processors in any combination.
The present embodiment also provides an electronic device comprising a memory having a computer program stored therein and a processor configured to execute the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
and S1, displaying a plurality of windows in a labeling interface for labeling pictures, wherein the plurality of windows at least comprise a first window and a second window.
And S2, displaying the first picture to be labeled in the first window, and displaying the second picture to be labeled in the second window.
And S3, after judging that the labeling of the first picture is finished, acquiring labeling information of the second picture in the second window.
It should be noted that, for specific examples in this embodiment, reference may be made to examples described in the foregoing embodiments and optional implementations, and details of this embodiment are not described herein again.
In addition, by combining the switching method of the picture labels in the above embodiments, the embodiments of the present application can provide a storage medium to implement. The storage medium having stored thereon a computer program; when executed by a processor, the computer program implements the method for switching the picture labels in any of the above embodiments.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (13)

1. A method for switching picture labels is characterized by comprising the following steps:
displaying a plurality of windows in a labeling interface for labeling pictures, wherein the plurality of windows at least comprise a first window and a second window;
displaying a first picture to be marked in the first window, and displaying a second picture to be marked in the second window;
and after judging that the labeling of the first picture is finished, acquiring labeling information of the second picture in the second window.
2. The method of claim 1, wherein after determining that the labeling of the first picture is completed, acquiring labeling information of the second picture in the second window comprises:
acquiring the position of an input signal, and judging whether the first picture is marked or not according to the relative position relation between the position of the input signal and a picture area formed by the first picture, wherein the input signal is used for marking pictures in a plurality of windows;
and after the marking of the first picture is judged to be finished, obtaining the marking information of the second picture according to the matching relation between the position of the input signal and the picture area formed by the second picture.
3. The method of claim 1, wherein after determining that the labeling of the first picture is completed, acquiring labeling information of the second picture in the second window comprises:
if the position of the input signal is located in a picture area formed by the first picture, acquiring the marking information of the first picture;
if the position of the input signal is not in a picture area formed by the first picture, judging that the first picture is labeled completely, and uploading labeled information of the first picture;
and if the position of the input signal is located in a picture area formed by the second picture, acquiring the marking information of the second picture in the second window.
4. The method for switching between image labels according to claim 1, wherein the displaying a plurality of windows in the label interface for image labeling comprises:
acquiring network round trip time, and acquiring the number of windows in the labeling interface according to the network round trip time;
and simultaneously displaying a plurality of windows in the labeling interface according to the number of the windows.
5. The method for switching between image labels as claimed in claim 1, wherein after displaying a plurality of windows in a label interface for image labeling, the method further comprises:
and acquiring a round-robin sequence of the windows, and determining the first window and the second window according to the round-robin sequence.
6. The method according to claim 5, wherein the obtaining the round-robin order of the plurality of windows comprises:
acquiring the position of an input signal and a plurality of picture areas formed by a plurality of windows;
and matching the position of the input signal with the plurality of picture areas, and determining the polling sequence of the plurality of windows according to the matching result.
7. The method according to claim 5, wherein the obtaining the round-robin order of the plurality of windows comprises:
and determining the round-robin sequence of the windows according to the relative position relationship among the windows.
8. The method for switching labeling of pictures according to any one of claims 1 to 7, wherein after determining that the labeling of the first picture is completed, the method further comprises:
acquiring a re-labeling instruction, and displaying a plurality of labeled pictures and/or picture information on the labeling interface, wherein the labeled pictures and/or picture information are arranged according to a time sequence;
acquiring a relabeling confirmation signal from the plurality of labeled pictures and/or picture information, and confirming a target picture according to the relabeling confirmation signal;
and acquiring the updated marking information of the target picture.
9. The method for switching labeling of pictures according to any one of claims 1 to 7, wherein after determining that the labeling of the first picture is completed, the method further comprises:
acquiring a re-labeling instruction, and displaying an input box corresponding to the re-labeling instruction on the labeling interface;
acquiring picture information from the input frame, and confirming a target picture according to the picture information;
and acquiring the labeling information of the target picture.
10. The method for switching labeling of pictures according to claim 1, wherein after determining that the labeling of the first picture is completed, the method further comprises:
and displaying a third picture to be marked in the first window.
11. The switching equipment of the picture labels is characterized by comprising a display unit and an acquisition unit:
the display unit is used for displaying a plurality of windows in a labeling interface for performing image labeling, wherein the plurality of windows at least comprise a first window and a second window, a first image to be labeled is displayed in the first window, and a second image to be labeled is displayed in the second window;
the obtaining unit is configured to obtain the label information of the second picture in the second window after judging that the labeling of the first picture is completed.
12. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the computer program to perform the method for switching annotation of pictures according to any one of claims 1 to 10.
13. A storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of the switching method of picture marking according to any one of claims 1 to 10 when running.
CN202110268817.7A 2021-03-12 2021-03-12 Switching method and device for picture labels, electronic device and storage medium Pending CN113010069A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110268817.7A CN113010069A (en) 2021-03-12 2021-03-12 Switching method and device for picture labels, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110268817.7A CN113010069A (en) 2021-03-12 2021-03-12 Switching method and device for picture labels, electronic device and storage medium

Publications (1)

Publication Number Publication Date
CN113010069A true CN113010069A (en) 2021-06-22

Family

ID=76405866

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110268817.7A Pending CN113010069A (en) 2021-03-12 2021-03-12 Switching method and device for picture labels, electronic device and storage medium

Country Status (1)

Country Link
CN (1) CN113010069A (en)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060228678A1 (en) * 2005-04-11 2006-10-12 Seiko Epson Corporation Data display method of data display apparatus, data display apparatus, data generation apparatus having the same, and sheet processing apparatus
CN103425690A (en) * 2012-05-22 2013-12-04 湖南家工场网络技术有限公司 Picture information labeling and displaying method based on cascading style sheets
CN106358092A (en) * 2015-07-13 2017-01-25 阿里巴巴集团控股有限公司 Information processing method and device
CN108876934A (en) * 2017-12-20 2018-11-23 北京旷视科技有限公司 Key point mask method, device and system and storage medium
CN110147701A (en) * 2018-06-27 2019-08-20 腾讯科技(深圳)有限公司 Key point mask method, device, computer equipment and storage medium
CN110377777A (en) * 2019-06-29 2019-10-25 苏州浪潮智能科技有限公司 A kind of multiple mask method of picture based on deep learning and device
CN110737785A (en) * 2019-09-10 2020-01-31 华为技术有限公司 picture labeling method and device
CN111291813A (en) * 2020-02-13 2020-06-16 腾讯科技(深圳)有限公司 Image annotation method and device, computer equipment and storage medium
CN111310667A (en) * 2020-02-18 2020-06-19 北京小马慧行科技有限公司 Method, device, storage medium and processor for determining whether annotation is accurate
CN111367445A (en) * 2020-03-31 2020-07-03 中国建设银行股份有限公司 Image annotation method and device
CN111460187A (en) * 2020-04-01 2020-07-28 重庆金山医疗技术研究院有限公司 Picture labeling method, device and equipment and readable storage medium
CN112131499A (en) * 2020-09-24 2020-12-25 腾讯科技(深圳)有限公司 Image annotation method and device, electronic equipment and storage medium

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060228678A1 (en) * 2005-04-11 2006-10-12 Seiko Epson Corporation Data display method of data display apparatus, data display apparatus, data generation apparatus having the same, and sheet processing apparatus
CN103425690A (en) * 2012-05-22 2013-12-04 湖南家工场网络技术有限公司 Picture information labeling and displaying method based on cascading style sheets
CN106358092A (en) * 2015-07-13 2017-01-25 阿里巴巴集团控股有限公司 Information processing method and device
CN108876934A (en) * 2017-12-20 2018-11-23 北京旷视科技有限公司 Key point mask method, device and system and storage medium
CN110147701A (en) * 2018-06-27 2019-08-20 腾讯科技(深圳)有限公司 Key point mask method, device, computer equipment and storage medium
CN110377777A (en) * 2019-06-29 2019-10-25 苏州浪潮智能科技有限公司 A kind of multiple mask method of picture based on deep learning and device
CN110737785A (en) * 2019-09-10 2020-01-31 华为技术有限公司 picture labeling method and device
CN111291813A (en) * 2020-02-13 2020-06-16 腾讯科技(深圳)有限公司 Image annotation method and device, computer equipment and storage medium
CN111310667A (en) * 2020-02-18 2020-06-19 北京小马慧行科技有限公司 Method, device, storage medium and processor for determining whether annotation is accurate
CN111367445A (en) * 2020-03-31 2020-07-03 中国建设银行股份有限公司 Image annotation method and device
CN111460187A (en) * 2020-04-01 2020-07-28 重庆金山医疗技术研究院有限公司 Picture labeling method, device and equipment and readable storage medium
CN112131499A (en) * 2020-09-24 2020-12-25 腾讯科技(深圳)有限公司 Image annotation method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN110162726B (en) Page resource loading method and device and storage medium
CN110333836B (en) Information screen projection method and device, storage medium and electronic device
CN106506960B (en) A kind of processing method and mobile terminal of image data
CN110852938B (en) Display picture generation method, device and storage medium
CN110837398B (en) Method and terminal for displaying card of quick application
CN108228293A (en) Interface skin switching method and device
CN112486444A (en) Screen projection method, device, equipment and readable storage medium
CN112911147A (en) Display control method, display control device and electronic equipment
CN110569008B (en) Screen data processing method and device and electronic equipment
CN110266926B (en) Image processing method, image processing device, mobile terminal and storage medium
CN113010069A (en) Switching method and device for picture labels, electronic device and storage medium
CN108268206B (en) Method and device for adjusting display result of object in interface and mobile equipment
CN106375862B (en) A kind of method, apparatus and terminal obtaining GIF picture
CN112698772A (en) Document template processing method and device and document creating method and device
CN107533566A (en) Method, portable electric appts and the graphic user interface retrieved to the content of picture
CN110572311B (en) Mail downloading method and terminal
CN110135422B (en) Dense target detection method and device
CN105513098B (en) Image processing method and device
CN105678608A (en) Picture matching method and apparatus
CN113093971B (en) Object display control method and device
CN113987241A (en) Image display method, image display device, electronic apparatus, and readable storage medium
CN112703534A (en) Image processing method and related product
CN111796733B (en) Image display method, image display device and electronic equipment
CN103699400A (en) Control method and electronic device
CN112423060A (en) Video image capturing method, system, device, terminal equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination