JP2017126210A - Recognition device, recognition system, recognition method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make a plotting function, a recognition function and a synthesis function cooperate with each other without altering processing.SOLUTION: A recognition device comprises: a first buffer; a plotting part; a first notification part; a recognition part; a second notification part; and an addition part. The plotting part performs first plotting processing for plotting a frame in the first buffer and second plotting processing for generating display information by performing plotting for adding additional information to the frame stored in the first buffer. The first notification part issues first plotting completion notification when first plotting processing is completed. The recognition part recognizes an object to be recognized from the frame when receiving the first plotting completion notification. The second notification part issues recognition completion notification including a recognition result when the recognition of the object to be recognized is completed. The addition part generates the additional information when receiving the recognition completion notification.SELECTED DRAWING: Figure 1

Description

  Embodiments described herein relate generally to a recognition apparatus, a recognition system, a recognition method, and a program.

  2. Description of the Related Art Conventionally, an image recognition technique for recognizing a person or object to be monitored included in a moving image as a recognition target is known. Further, there is known an image composition technique for recognizing a moving object moving in a moving image as a recognition target, and compositing additional information such as a rectangle that clearly indicates the area of the moving object with the moving image.

Japanese Patent No. 3873000

[Search on November 30, 2015], Internet <URL: http: // libccv. org />

  However, in the conventional technology, it is difficult to link a drawing process for drawing a moving image, a recognition process for recognizing a recognition target object from the moving image, and a combining process for synthesizing additional information with the moving image. For example, when rendering processing, recognition processing, and composition processing are realized by linking a plurality of existing applications, the existing applications have to be modified.

  The recognition apparatus according to the embodiment includes a first buffer, a drawing unit, a first notification unit, a recognition unit, a second notification unit, and an addition unit. The first buffer performs storage of a frame constituting the moving image and display information in which additional information that clearly indicates the recognition target is added to the recognition target included in the frame. The drawing unit generates the display information by performing first drawing processing for drawing the frame in the first buffer and drawing for adding the additional information to the frame stored in the first buffer. And performing a second drawing process. The first notification unit notifies the first drawing completion notification when the first drawing process is completed. The recognition unit recognizes a recognition target object from the frame when receiving the first drawing completion notification. The second notification unit notifies a recognition completion notification including a recognition result when the recognition of the recognition object is completed. The adding unit generates the additional information when the recognition completion notification is received.

The figure which shows the example of a function structure of the recognition apparatus of 1st Embodiment. The figure which shows the example of the display information of 1st Embodiment. The flowchart which shows the example of the recognition processing method of 1st Embodiment. The figure which shows the example of a structure of the recognition system of 2nd Embodiment. The flowchart which shows the example of the recognition processing method of 2nd Embodiment. The figure which shows the example of a function structure of the recognition apparatus of 3rd Embodiment. The figure for demonstrating the example of the drawing process of 3rd Embodiment, and a display control process. The flowchart which shows the example of the recognition processing method of 3rd Embodiment. The figure which shows the example of a structure of the recognition system of 4th Embodiment. The flowchart which shows the example of the recognition processing method of 4th Embodiment. The figure which shows the example of the hardware constitutions of the recognition apparatus of 1st and 3rd embodiment. The figure which shows the example of the hardware constitutions of the recognition apparatus of 2nd and 4th embodiment.

  Hereinafter, embodiments of a recognition device, a recognition system, a recognition method, and a program will be described in detail with reference to the accompanying drawings.

(First embodiment)
FIG. 1 is a diagram illustrating an example of a functional configuration of the recognition apparatus 100 according to the first embodiment. The recognition apparatus 100 according to the first embodiment includes an instruction unit 1, a drawing unit 2, a first buffer 3, a first notification unit 4, a recognition unit 5, a second notification unit 6, an addition unit 7, a copy unit 8, A second buffer 9, a display control unit 10, and a display unit 11 are provided.

  The instruction unit 1 issues a first drawing command for drawing a frame constituting a moving image, and inputs the first drawing command to the drawing unit 2.

  When the drawing unit 2 receives the first drawing command from the instruction unit 1, the drawing unit 2 performs a drawing process based on the first drawing command to generate a frame constituting the moving image. The drawing processing is, for example, decoding processing of moving image data to be drawn.

  When the drawing unit 2 stores the frame constituting the moving image in the first buffer 3, the drawing unit 2 sends a first drawing completion notification indicating that the frame is stored in the first buffer 3 to the first notification unit 4. input. Note that the notification method of the first drawing completion notification may be arbitrary.

  For example, when the drawing unit 2 is realized by an X server, by using an X extended function module, it is possible to hook a drawing command to the X server without modifying the X server. By hooking a drawing command to the X server, the timing at which the drawing command is issued, the type of the drawing command, the drawing area, the timing of completion of the drawing process, and the like are detected, and the execution of drawing is made to wait. It is possible. When the drawing unit 2 detects the completion of the drawing process based on the first drawing command for drawing the frame constituting the moving image by hooking the drawing command, the drawing unit 2 sends the first drawing completion notification to the first notification. You may input into the part 4. The drawing unit 2 may use any method for detecting the type of drawing command. For example, when the drawing command is an XPutImage drawing command for a drawing area larger than the threshold value t, the drawing unit 2 detects that the drawing command is a first drawing command for drawing a frame of a moving image.

  Upon receiving the first drawing completion notification from the drawing unit 2, the first notification unit 4 notifies the recognition unit 5 of the first drawing completion notification.

  When the recognition unit 5 receives the first drawing completion notification from the first notification unit 4, the recognition unit 5 performs a recognition process for recognizing a predetermined object from the frames constituting the moving image stored in the first buffer 3. . The predetermined object may be arbitrary. The predetermined object is, for example, a person, an object, a character, or the like. The object is, for example, a vehicle to be monitored. When the recognition process ends, the recognition unit 5 inputs a recognition completion notification including the recognition result of the recognition process to the second notification unit 6.

  The data format of the recognition completion notification may be arbitrary. The recognition completion notification includes, for example, coordinate information and information indicating the recognition target object. In the case of an image of 1024 × 768 pixels, the coordinate information is represented, for example, by a coordinate system in which the upper left of the image is (0, 0) and the lower right of the image is (1023, 767). The recognition unit 5 performs the recognition completion notification in a list format including a plurality of recognition results indicated by, for example, information indicating the position and size of the rectangular area and information indicating the recognition target object included in the rectangular area. 2 may be input to the second notification unit 6. Specifically, the list-type recognition completion notification is, for example, a first recognition result indicating that the monitoring target vehicle A has been recognized in a rectangular area having a width of 100 pixels and a height of 20 pixels from (30, 30). And a second recognition result indicating that the vehicle B to be monitored is recognized in a rectangular area having a width of 100 pixels and a height of 20 pixels from (100, 100).

  When receiving the recognition completion notification from the recognition unit 5, the second notification unit 6 notifies the addition unit 7 of the recognition completion notification.

  Upon receiving the recognition completion notification from the second notification unit 6, the adding unit 7 performs an adding process for generating additional information to be added to the frame constituting the moving image. The additional information is information that clearly indicates the recognition target object included in the frame constituting the moving image. Additional information may be arbitrary. The additional information is, for example, a balloon caption that clearly indicates the recognition target object by being added in the vicinity of the recognition target object. Further, for example, the additional information is a rectangle or the like that clearly indicates the recognition target object by giving the additional information so as to surround the recognition target object. When the adding process is completed, the adding unit 7 issues a second drawing command for adding the generated additional information to a frame constituting the moving image, and inputs the second drawing command to the drawing unit 2.

  When the drawing unit 2 receives the second drawing command from the adding unit 7, the drawing unit 2 performs a drawing process based on the second drawing command. Specifically, the drawing unit 2 generates display information by performing a drawing process (synthesizing process) for adding additional information to a frame constituting the moving image stored in the first buffer 3.

  FIG. 2 is a diagram illustrating an example of the display information 210 according to the first embodiment. The example of FIG. 2 shows a case where the drawing unit 2 generates display information 210 by adding a balloon caption as additional information 201 to a frame that forms a moving image including the vehicle A.

  In order to prevent flickering, the drawing unit 2 draws the moving image in the first buffer 3 as the background and the additional information as the overlay. For example, when the adding unit 7 is realized by a browser application and the drawing unit 2 is realized by an X server, CSS (Cascading Style Sheets) can be used. CSS is a style sheet for defining the appearance of web content. The drawing unit 2 can draw additional information by overlay display, for example, by drawing a frame constituting a moving image in full screen display, setting position as fixed, z-index as -100, and the like. The additional information can be added to a frame constituting a moving image by using, for example, a CSS box class and before and after pseudo-elements.

  Returning to FIG. 1, when the drawing unit 2 stores the display information 210 in the first buffer 3, the drawing unit 2 sends a second drawing completion notification indicating that the display information 210 is stored in the first buffer 3 to the first buffer 3. Input to the notification unit 4. The display information generation completion notification notification method may be arbitrary.

  For example, when the drawing unit 2 is realized by an X server, the drawing unit 2 sends a second drawing completion notification to the first notification unit 4 based on the type of drawing command detected by hooking the drawing command. May be entered.

  Upon receiving the second drawing completion notification from the drawing unit 2, the first notification unit 4 notifies the copy unit 8 of the second drawing completion notification.

  When the copy unit 8 receives the second drawing completion notification from the first notification unit 4, the copy unit 8 copies the display information 210 from the first buffer 3 to the second buffer 9. When the drawing unit 2 is realized by an X server, the display information 210 may be acquired directly from the first buffer 3 by including the copy unit 8 in the X extended function module. When the copy unit 8 is not included in the X extended function module, the display information 210 stored in the first buffer 3 may be acquired via the drawing unit 2 realized by the X server.

  The display control unit 10 controls the display unit 11 to display the display information 210 copied from the first buffer 3 to the second buffer 9 by the copy unit 8. The display unit 11 displays display information 210.

  Note that the first buffer 3 and the second buffer 9 described above may be arbitrary storage media. The first buffer 3 and the second buffer 9 are, for example, a RAM (Random Access Memory), a HDD (Hard Disk Drive), an optical disk, a memory card, and the like.

  Next, an example of the recognition processing method of the first embodiment will be described.

  FIG. 3 is a flowchart illustrating an example of the recognition processing method according to the first embodiment. First, the instruction unit 1 issues a first drawing command for drawing a frame constituting a moving image (step S1). Next, the drawing unit 2 performs a drawing process based on the first drawing command, thereby generating a frame constituting the moving image (step S2). Next, the drawing unit 2 stores the frames constituting the moving image in the first buffer 3 (step S3).

  Next, the first notification unit 4 notifies the recognition unit 5 of a first drawing completion notification (step S4). Next, when the recognizing unit 5 receives the first drawing completion notification from the first notifying unit 4, the recognizing unit 5 recognizes a predetermined object from the frames constituting the moving image stored in the first buffer 3. Processing is performed (step S5).

  Next, when the recognition process of the recognition unit 5 is completed, the second notification unit 6 notifies the addition unit 7 of a recognition completion notification (step S6). Next, when the addition unit 7 receives a recognition completion notification from the second notification unit 6, it performs an addition process for generating additional information to be added to a frame constituting the moving image (step S7). Next, the adding unit 7 issues a second drawing command for adding the additional information generated by the process of step S7 to the frame constituting the moving image (step S8). The drawing unit 2 generates display information 210 by performing a drawing process (synthesizing process) based on the second drawing command (step S9).

  Next, the first notification unit 4 notifies the copy unit 8 of a second drawing completion notification (step S10). Next, when the copy unit 8 receives the second drawing completion notification from the first notification unit 4, it copies the display information 210 from the first buffer 3 to the second buffer 9 (step S11).

  Next, the display control unit 10 performs control to display the display information 210 copied from the first buffer 3 to the second buffer 9 by the copy unit 8 on the display unit 11 (step S12).

  As described above, in the recognition apparatus 100 according to the first embodiment, the first notification unit 4 notifies the first drawing completion notification when the drawing process based on the first drawing command is completed. In addition, when the recognition unit 5 receives the first drawing completion notification, the recognition unit 5 recognizes the recognition target object from the frame. Further, when the recognition of the recognition target object is completed, the second notification unit 6 notifies the recognition completion notification including the recognition result. Further, when the adding unit 7 receives the recognition completion notification, the adding unit 7 generates additional information.

  Thereby, according to the recognition device 100 of the first embodiment, the drawing unit 2, the recognition unit 5, and the addition unit 7 can be linked without modification.

  Further, in the recognition apparatus 100 of the first embodiment, the first buffer 3 stores the frames constituting the moving image, and the display in which the additional information specifying the recognition object is added to the recognition object included in the frame. The information 210 is stored. Further, when the copy unit 8 receives the second drawing completion notification from the first notification unit 4, the display information 210 stored in the first buffer 3 is copied to the second buffer 9. Further, the display control unit 10 performs control to display the display information 210 stored in the second buffer 9 on the display unit 11.

  That is, in the recognition apparatus 100 of the first embodiment, the first buffer 3 used for the drawing process and the second buffer 9 used for the display process are separated.

  Thereby, according to the recognition apparatus 100 of 1st Embodiment, when additional information overlaps with a recognition target object, the problem that the recognition target target object of monitoring becomes invisible or a screen flickering can be prevented. .

  Note that the functions of the recognition apparatus 100 described above may be realized by software or hardware, or may be realized by combining software and hardware. Specifically, for example, the instruction unit 1 and the adding unit 7 may be realized by a browser application. For example, the drawing unit 2 may be realized by an X server. For example, the recognition unit 5 may be realized by an image recognition application.

  According to the recognition apparatus 100 of the first embodiment, for example, while analyzing a moving image with high speed and high accuracy using an image recognition application, it is possible to add advanced information designed by HTML5 using a browser application. It becomes possible. This makes it possible to achieve both performance and design.

(Second Embodiment)
Next, a second embodiment will be described. In the description of the second embodiment, a recognition system 200 including the recognition device 100 and the display device 110 will be described. In the description of the second embodiment, a description similar to that of the first embodiment is omitted.

  FIG. 4 is a diagram illustrating an example of the configuration of the recognition system 200 according to the second embodiment. The recognition system 200 according to the second embodiment includes a recognition device 100 and a display device 110. The recognition device 100 and the display device 110 are connected by wire or wireless.

  The recognition apparatus 100 according to the second embodiment includes an instruction unit 1, a drawing unit 2, a first buffer 3, a first notification unit 4, a recognition unit 5, a second notification unit 6, an addition unit 7, a copy unit 8, A second buffer 9 and a communication control unit 12 are provided. The description of the instruction unit 1, the drawing unit 2, the first buffer 3, the first notification unit 4, the recognition unit 5, the second notification unit 6, the addition unit 7, the copy unit 8, and the second buffer 9 is as follows. Since it is the same as description of 1 embodiment, it abbreviate | omits.

  The communication control unit 12 performs control to transmit the display information 210 copied from the first buffer 3 to the second buffer 9 by the copy unit 8 to the display device 110. Upon receiving the display information 210 from the recognition device 100, the display device 110 displays the display information 210.

  Next, an example of a recognition processing method according to the second embodiment will be described.

  FIG. 5 is a flowchart illustrating an example of a recognition processing method according to the second embodiment. The description of step S21 to step S31 is the same as the description of step S1 to step S11 (see FIG. 3) of the recognition processing method according to the first embodiment, and will be omitted.

  The communication control unit 12 performs control to transmit the display information 210 copied from the first buffer 3 to the second buffer 9 by the copy unit 8 to the display device 110 (step S32). Next, when the display device 110 receives the display information 210 from the recognition device 100, the display device 210 displays the display information 210 (step S33).

  The recognition system 200 of the second embodiment has the same effects as those of the first embodiment. That is, according to the recognition system 200 of the second embodiment, the drawing unit 2, the recognition unit 5, and the addition unit 7 can be linked without modification.

  In the recognition apparatus 100 of the first embodiment, the first buffer 3 used for the drawing process and the second buffer 9 used for the communication process are separated. As a result, according to the recognition system 200 of the second embodiment, as in the case of the first embodiment, the additional information overlaps with the recognition target object, so that the monitoring target recognition target object becomes invisible or the screen flickers. Problems that occur can be prevented.

(Third embodiment)
Next, a third embodiment will be described. In the description of the third embodiment, a case where the recognition apparatus 100 does not include the copy unit 8 and the second buffer 9 will be described.

  FIG. 6 is a diagram illustrating an example of a functional configuration of the recognition apparatus 100 according to the third embodiment. The recognition apparatus 100 according to the third embodiment includes an instruction unit 1, a drawing unit 2, a first buffer 3, a first notification unit 4, a recognition unit 5, a second notification unit 6, an addition unit 7, and a display control unit 10. And a display unit 11.

  The instruction unit 1 issues a first drawing command for drawing a frame constituting a moving image, and inputs the first drawing command to the drawing unit 2.

  When the drawing unit 2 receives the first drawing command from the instruction unit 1, the drawing unit 2 performs a drawing process based on the first drawing command to generate a frame constituting the moving image.

  When the drawing unit 2 stores the frame constituting the moving image in the first buffer 3, the drawing unit 2 sends a first drawing completion notification indicating that the frame is stored in the first buffer 3 to the first notification unit 4. input.

  Upon receiving the first drawing completion notification from the drawing unit 2, the first notification unit 4 notifies the recognition unit 5 of the first drawing completion notification.

  When the recognition unit 5 receives the first drawing completion notification from the first notification unit 4, the recognition unit 5 performs a recognition process for recognizing a predetermined object from the frames constituting the moving image stored in the first buffer 3. . When the recognition process ends, the recognition unit 5 inputs a recognition completion notification including the recognition result of the recognition process to the second notification unit 6.

  When receiving the recognition completion notification from the recognition unit 5, the second notification unit 6 notifies the addition unit 7 of the recognition completion notification.

  Upon receiving the recognition completion notification from the second notification unit 6, the adding unit 7 performs an adding process for generating additional information to be added to the frame constituting the moving image. When the adding process is completed, the adding unit 7 issues a second drawing command for adding the generated additional information to a frame constituting the moving image, and inputs the second drawing command to the drawing unit 2.

  When the drawing unit 2 receives the second drawing command from the adding unit 7, the drawing unit 2 generates display information 210 by performing a drawing process (synthesizing process) based on the second drawing command.

  When the drawing unit 2 stores the display information 210 in the first buffer 3, the drawing unit 2 inputs a second drawing completion notification indicating that the display information 210 is stored in the first buffer 3 to the first notification unit 4. To do.

  Upon receiving the second drawing completion notification from the drawing unit 2, the first notification unit 4 notifies the display control unit 10 of the second drawing completion notification.

  When receiving the second drawing completion notification from the first notification unit 4, the display control unit 10 performs display control processing for displaying the display information 210 stored in the first buffer 3 on the display unit 11. At this time, the display control unit 10 performs the display control process at a lower frequency than the frequency of the drawing process based on the first and second drawing commands performed by the drawing unit 2.

  FIG. 7 is a diagram for explaining an example of a drawing process and a display control process according to the third embodiment. First, the frame 209a constituting the moving image is drawn by the drawing unit 2, and the vehicle A included in the frame 209a is recognized by the recognition unit 5. Next, when the display information 210 a added to the frame 209 a by the addition unit 7 is drawn by the drawing unit 2, the display information 210 a is displayed on the display unit 11 by the display control unit 10. .

  Next, the frame 209b constituting the moving image is drawn by the drawing unit 2, and the vehicle A included in the frame 209b is recognized by the recognition unit 5. Next, when the display information 210 b added to the frame 209 b by the adding unit 7 is drawn by the drawing unit 2, the display information 210 b is displayed on the display unit 11 by the display control unit 10. .

  As illustrated in FIG. 7, the drawing unit 2 performs a drawing process of frames 209 (209a and 209b) constituting a moving image and a drawing process (synthesizing process) for generating display information 210 (210a and 210b). Do. The recognition process of the vehicle A by the recognition unit 5 is performed on the frame 209. Further, the display control process by the display control unit 10 is performed on the display information 210.

  That is, the display control unit 10 performs the display control process at the timing shown in FIG. 7, thereby performing the display control process at a lower frequency than the frequency of the drawing process performed by the drawing unit 2.

  The timing of the drawing process and the display control process may be arbitrary. For example, the timing of the drawing process and the display control process may be adjusted according to the refresh rate of the display unit 11. Specifically, when the refresh rate of the display unit 11 is 60 Hz, the display on the display unit 11 is updated 60 times per second. In this case, for example, the timing is adjusted as follows.

(1) The display control unit 10 performs display control processing 60 times per second by performing control to display display information at the refresh timing of the display unit 11.
(2) The drawing unit 2 draws the frame 209 constituting the moving image (drawing process based on the first drawing command) 60 times per second, and generates the display information 210 by adding the additional information. Drawing (drawing processing based on the second drawing command) is performed 60 times per second. That is, the drawing unit 2 performs the drawing process 120 times per second.

  Thereby, since the display control process can be performed at a frequency lower than the frequency of the drawing process performed by the drawing unit 2, the recognition target object to be monitored may not be visible due to the additional information overlapping the recognition target object. , Can prevent problems such as flickering of the screen.

  Next, an example of a recognition processing method according to the third embodiment will be described.

  FIG. 8 is a flowchart illustrating an example of a recognition processing method according to the third embodiment. In the example of FIG. 8, a case where the refresh rate of the display unit 11 is 60 Hz will be described as an example. First, the instruction unit 1 issues a first drawing command for drawing a frame constituting the moving image (step S41). Next, the drawing unit 2 performs a drawing process based on the first drawing command to generate a frame constituting the moving image (step S42). The drawing unit 2 performs the process of step S42 at a frequency of 60 times per second.

  The description of step S43 to step S48 is the same as the description of step S3 to step S8 (see FIG. 3) of the recognition processing method of the first embodiment, and will be omitted.

  Next, the drawing unit 2 generates display information 210 by performing a drawing process (synthesizing process) based on the second drawing command (step S49). The drawing unit 2 performs the process of step S49 at a frequency of 60 times per second.

  Next, the first notification unit 4 notifies the display control unit 10 of a second drawing completion notification (step S50). Next, when the display control unit 10 receives the second drawing completion notification from the first notification unit 4, it performs control to display the display information 210 stored in the first buffer 3 on the display unit 11 ( Step S51). The display control unit 10 performs the process of step S51 at a frequency of 60 times per second.

  The recognition device 100 according to the third embodiment has the same effects as those of the first embodiment. That is, according to the recognition device 100 of the third embodiment, the drawing unit 2, the recognition unit 5, and the addition unit 7 can be linked without modification.

  In the recognition apparatus 100 according to the third embodiment, the display control unit 10 performs the first operation at a lower frequency than the frequency of the drawing process (drawing process based on the first and second drawing commands) performed by the drawing unit 2. The display information 210 stored in the buffer 3 is controlled to be displayed on the display unit 11. As a result, it is possible to prevent the problem that the recognition target object to be monitored becomes invisible or the screen flickers due to the additional information overlapping the recognition target object.

(Fourth embodiment)
Next, a fourth embodiment will be described. In the description of the fourth embodiment, a recognition system 200 including the recognition device 100 and the display device 110 will be described. In the description of the fourth embodiment, descriptions similar to those of the third embodiment are omitted.

  FIG. 9 is a diagram illustrating an example of the configuration of the recognition system 200 according to the fourth embodiment. A recognition system 200 according to the fourth embodiment includes a recognition device 100 and a display device 110. The recognition device 100 and the display device 110 are connected by wire or wireless.

  The recognition apparatus 100 according to the fourth embodiment includes an instruction unit 1, a drawing unit 2, a first buffer 3, a first notification unit 4, a recognition unit 5, a second notification unit 6, an addition unit 7, and a communication control unit. 12 is provided. The description of the instruction unit 1, the drawing unit 2, the first buffer 3, the first notification unit 4, the recognition unit 5, the second notification unit 6, and the addition unit 7 is the same as the description of the third embodiment, and is omitted. .

  When the communication control unit 12 receives the second drawing completion notification from the first notification unit 4, the communication control unit 12 performs a transmission control process of transmitting the display information 210 stored in the first buffer 3 to the display device 110. At this time, the communication control unit 12 performs the display control process at a lower frequency than the frequency of the drawing process based on the first and second drawing commands performed by the drawing unit 2.

  Next, an example of a recognition processing method according to the fourth embodiment will be described.

  FIG. 10 is a flowchart illustrating an example of a recognition processing method according to the fourth embodiment. The description of step S61 to step S69 is the same as the description of step S41 to step S49 (see FIG. 8) of the recognition processing method of the third embodiment, and will be omitted.

  The first notification unit 4 notifies the communication control unit 12 of a second drawing completion notification (step S70). Next, when the communication control unit 12 receives the second drawing completion notification from the first notification unit 4, the communication control unit 12 performs control to transmit the display information 210 stored in the first buffer 3 to the display device 110 ( Step S71). The communication control unit 10 performs the process of step S71 at a frequency of 60 times per second. Next, when the display device 110 receives the display information 210 from the recognition device 100, the display information 210 is displayed (step S72).

  The recognition system 200 of the fourth embodiment has the same effects as those of the third embodiment. That is, according to the recognition system 200 of the fourth embodiment, the drawing unit 2, the recognition unit 5, and the addition unit 7 can be linked without modification.

  In the recognition device 100 of the fourth embodiment, the communication control unit 12 performs the first operation at a frequency lower than the frequency of the drawing process (drawing process based on the first and second drawing commands) performed by the drawing unit 2. The display information 210 stored in the buffer 3 is controlled to be transmitted to the display device 110. Thereby, according to the recognition system 200 of the fourth embodiment, as in the case of the third embodiment, when the additional information overlaps the recognition target object, the recognition target object to be monitored becomes invisible or the screen flickers. Problems that occur can be prevented.

  Finally, an example of the hardware configuration of the recognition apparatus 100 according to the first to fourth embodiments will be described.

  FIG. 11 is a diagram illustrating an example of a hardware configuration of the recognition apparatus 100 according to the first and third embodiments. The recognition device 100 according to the first and third embodiments includes a control device 301, a main storage device 302, an auxiliary storage device 303, an input device 304, and a display device 305. The control device 301, main storage device 302, auxiliary storage device 303, input device 304, and display device 305 are connected via a bus 310.

  The control device 301 executes the program read from the auxiliary storage device 303 to the main storage device 302. The main storage device 302 is a memory such as a ROM and a RAM. The auxiliary storage device 303 is a memory card, an SSD (Solid State Drive), or the like.

  The input device 304 receives input of information. The input device 304 is, for example, a keyboard and a mouse. The display device 305 displays information. The display device 305 is, for example, a liquid crystal display. Note that the input device 304 and the display device 305 may be a liquid crystal touch panel that has both an input function and a display function.

  FIG. 12 is a diagram illustrating an example of the hardware configuration of the recognition apparatus according to the second and fourth embodiments. The recognition device 100 according to the second and fourth embodiments includes a control device 301, a main storage device 302, an auxiliary storage device 303, an input device 304, and a communication device 306. The control device 301, main storage device 302, auxiliary storage device 303, input device 304, and communication device 306 are connected via a bus 310.

  The control device 301, the main storage device 302, the auxiliary storage device 303, and the input device 304 of the second and fourth embodiments are described in the control device 301, the main storage device 302, and the auxiliary storage device 303 of the first and third embodiments. And the description of the input device 304 (see FIG. 11) is omitted. The communication device 306 communicates with other devices such as the display device 110.

  A program executed by the recognition apparatus 100 according to the first to fourth embodiments is an installable or executable file, and is a computer such as a CD-ROM, a memory card, a CD-R, and a DVD (Digital Versatile Disk). Stored in a readable storage medium and provided as a computer program product.

  The program executed by the recognition apparatus 100 according to the first to fourth embodiments may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. The program executed by the recognition apparatus 100 according to the first to fourth embodiments may be provided via a network such as the Internet without being downloaded.

  Moreover, you may comprise so that the program executed with the recognition apparatus 100 of 1st thru | or 4th embodiment may be provided by previously incorporating in ROM etc.

  The program executed by the recognition apparatus 100 according to the first to fourth embodiments has a module configuration including functions that can be realized by the program among the functional configurations of the recognition apparatus 100 according to the first to fourth embodiments. Yes.

  Functions realized by the program are loaded into the main storage device 302 by the control device 301 reading the program from a storage medium such as the auxiliary storage device 303 and executing the program. That is, the function realized by the program is generated on the main storage device 302.

  Note that some or all of the functions of the recognition apparatus 100 according to the first to fourth embodiments may be realized by hardware such as an IC (Integrated Circuit).

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 Instruction part 2 Drawing part 3 1st buffer 4 1st notification part 5 Recognition part 6 2nd notification part 7 Addition part 8 Copy part 9 2nd buffer 10 Display control part 11 Display part 12 Communication control part 100 Recognition Device 110 Display device 200 Recognition system 301 Control device 302 Main storage device 303 Auxiliary storage device 304 Input device 305 Display device 306 Communication device

Claims (9)

A first buffer that performs storage of a frame constituting a moving image, and storage of display information in which additional information that clearly indicates the recognition target is added to the recognition target included in the frame;
A first drawing process for drawing the frame in the first buffer; and a second drawing for generating the display information by performing drawing for adding the additional information to the frame stored in the first buffer. A drawing unit for performing drawing processing;
A first notification unit for notifying a first drawing completion notification when the first drawing process is completed;
A recognition unit that recognizes a recognition target object from the frame when the first drawing completion notification is received;
A second notification unit that notifies a recognition completion notification including a recognition result when recognition of the recognition object is completed;
An additional unit that generates the additional information when the recognition completion notification is received;
A recognition device comprising: A second buffer for storing the display information;
A copy unit that copies the display information stored in the first buffer to the second buffer;
The first notification unit includes:
When the second drawing process is completed, a second drawing completion notification is notified,
The copy unit copies the display information stored in the first buffer to the second buffer when receiving the second drawing completion notification;
The recognition device according to claim 1. A display control unit that performs control to display the display information stored in the second buffer on a display unit;
The recognition apparatus according to claim 2. A transmission control unit that performs control to transmit the display information stored in the second buffer to a display device;
The recognition apparatus according to claim 2. A display control unit that performs control to display the display information stored in the first buffer at a lower frequency than the frequency of the drawing process performed by the drawing unit;
The recognition device according to claim 1, further comprising: A transmission control unit that performs control to transmit the display information stored in the first buffer to the display device at a lower frequency than the frequency of the drawing process performed by the drawing unit;
The recognition device according to claim 1, further comprising: A recognition system comprising a recognition device and a display device,
The recognition device is
A first buffer that performs storage of a frame constituting a moving image, and storage of display information in which additional information that clearly indicates the recognition target is added to the recognition target included in the frame;
A first drawing process for drawing the frame in the first buffer; and a second drawing for generating the display information by performing drawing for adding the additional information to the frame stored in the first buffer. A drawing unit for performing drawing processing;
A first notification unit for notifying a first drawing completion notification when the first drawing process is completed;
A recognition unit that recognizes a recognition target object from the frame when the first drawing completion notification is received;
A second notification unit that notifies a recognition completion notification including a recognition result when recognition of the recognition object is completed;
An additional unit that generates the additional information when the recognition completion notification is received;
A transmission control unit that performs control to transmit the display information stored in the first buffer to the display device at a frequency lower than the frequency of the drawing process performed by the drawing unit;
When the display device receives the display information from the recognition device, the display device displays the display information.
Recognition system. Recognition of a recognition apparatus comprising a first buffer that performs storage of a frame constituting a moving image and storage of display information in which additional information specifying the recognition target is added to the recognition target included in the frame A method,
The recognition device generates the display information by performing a first drawing process for drawing the frame in the first buffer and drawing for adding the additional information to the frame stored in the first buffer. Performing a second drawing process,
A recognition device notifying a first drawing completion notification when the first drawing process is completed;
A step of recognizing a recognition object from the frame when the recognition device receives the first drawing completion notification;
A recognition device notifying a recognition completion notification including a recognition result when recognition of the recognition object is completed;
When the recognition device receives the recognition completion notification, generating the additional information;
A recognition method comprising: A computer comprising a first buffer that performs storage of a frame constituting a moving image and storage of display information in which additional information that clearly indicates the recognition target is added to the recognition target included in the frame.
A first drawing process for drawing the frame in the first buffer; and a second drawing for generating the display information by performing drawing for adding the additional information to the frame stored in the first buffer. A drawing unit for performing drawing processing;
A first notification unit for notifying a first drawing completion notification when the first drawing process is completed;
A recognition unit that recognizes a recognition target object from the frame when the first drawing completion notification is received;
A second notification unit that notifies a recognition completion notification including a recognition result when recognition of the recognition object is completed;
An additional unit that generates the additional information when receiving the recognition completion notification;
Program to function as.

Images