JP6725853B2 - Network camera system, information processing method, program - Google Patents

Description

The present invention relates to a network camera system, an information processing method, and a program.

In recent years, for the purpose of crime prevention, avoidance of troubles, and the like, a surveillance camera is installed in the store to photograph the inside of the store.

Especially for security purposes, it is set so that you can focus on shooting at the entrance of the shop or around the cash register.

Patent Document 1 describes a technique in which a camera is provided in an amount display section of a cash register, and a transaction customer is photographed at the timing when the total amount is displayed.

JP-A-2000-99826

As described above, in retail stores, there are many troubles around the cash register, for example, there is a problem that the customer mistakenly recognizes the amount paid and makes a mistake in the change amount.

In order to solve such a trouble, it is necessary to confirm what kind of exchange (payment of money) was made between the store and the customer.

On the other hand, it is not realistic to record and store all the images taken by the surveillance camera, because the data capacity becomes huge. Therefore, it is desirable to leave only the necessary data without leaving unnecessary data for troubleshooting.

Therefore, an object of the present invention is to provide a mechanism capable of recording the state of money transfer at a cash register and reducing the amount of data recorded.

The network camera system of the present invention includes a photographing means for photographing a moving image, an acquiring means for acquiring a notification that a receipt is issued by a cashier terminal, and a moving image photographed by the photographing means for a notification acquired by the acquiring means. It is characterized by further comprising: a creating unit that creates moving image data by dividing the data based on the division, an accounting process related to the receipt issuance, and a storage unit that stores the moving image data created by the creating unit in association with each other.

Further, the present invention is an information processing method in a network camera system, wherein the photographing means of the network camera system captures a moving image and the acquisition means of the network camera system issues a receipt by a cashier terminal. An acquisition step of acquiring the notification, and a creation step of creating video data by dividing the video captured by the imaging step based on the notification acquired by the acquisition step, by the creation means of the network camera system, The storage means of the network camera system is provided with a storage process of storing the accounting process relating to the receipt issuance and the moving image data created by the creating process in association with each other.

Further, the present invention is a program executable in a network camera system, wherein the network camera system includes a photographing means for photographing a moving image, an acquisition means for obtaining a notice issued by a cashier terminal, and the photographing means. The creating means for creating moving image data by dividing the moving image shot by the means based on the notification obtained by the obtaining means, the accounting process for issuing the receipt, and the moving image data created by the creating means It is characterized in that it functions as a storage means for attaching and storing.

According to the present invention, it is possible to record the state of money transfer at a cash register and reduce the amount of data recorded.

The figure which shows an example of a structure of the information processing system of this invention. Diagram showing an example of the hardware configuration of the cashier terminal 101 and the display terminal 103 The figure which shows an example of the hardware constitutions of the network camera 102. Flowchart showing an example of video extraction and storage processing Flowchart showing an example of still image acquisition processing Flowchart showing an example of moving image/still image display processing Flowchart showing the storage process of moving images and still images in the second embodiment Figure showing an image of video/still image displayed on the display terminal Diagram showing payment at stores Diagram illustrating an example of still image acquisition conditions An example of a table in which an event is registered at a cashier terminal An example of a table in which moving image files and still image files are registered in association with identification information

An outline of the information processing system of the present invention will be described with reference to FIG.

The information processing system of the present invention has a configuration including a cashier terminal 101, a network camera 102 (imaging device), and a display terminal 103. The cashier terminal 101 and the network camera 102 are communicably connected to each other, and the network camera 102 The display terminal 103 is communicably connected.

A moving image or a still image captured by the network camera 102 may be stored in a storage area included in the network camera 102, or may be controlled to be stored in an external storage device. When storing in an external storage device, the network camera 102 and the storage device are communicably connected, and the moving image or the still image stored in the storage device is displayed on the display terminal 103.

A system including the network camera 102 having a moving image shooting function and an information processing device (not shown) having a storage unit and a function of editing/analyzing a moving image as described above is referred to as a network camera system.

Next, an example of the hardware configuration of the cashier terminal 101 and the display terminal 103 shown in FIG. 1 will be described with reference to FIG.

In FIG. 2, reference numeral 201 denotes a CPU, which centrally controls each device and controller connected to the system bus 204. Further, the ROM 203 or the external memory 211 is necessary to realize a control program of the CPU 201, such as a BIOS (Basic Input/Output System), an operating system program (hereinafter, OS), and a function executed by each server or each PC. Various programs and the like are stored.

A RAM 202 functions as a main memory and a work area of the CPU 201. The CPU 201 loads various programs necessary for executing the processing from the ROM 203 or the external memory 211 into the RAM 202 and executes the loaded programs to realize various operations.

An input controller 205 controls input from the input device 209 and the like. A video controller 206 controls display on a display device 210 such as a liquid crystal display. The display device is not limited to the liquid crystal display, and may be a CRT display or the like. These are used by the client as needed.

A memory controller 207 is connected to a hard disk (HD) storing a boot program, various applications, font data, user files, edit files, various data, etc., a flexible disk (FD), or a PCMCIA card slot via an adapter. The access to the external memory 211 such as the CompactFlash (registered trademark) memory is controlled.

A communication I/F controller 208 connects and communicates with an external device via a network (for example, the LAN 400 shown in FIG. 1) and executes communication control processing on the network. For example, communication using TCP/IP is possible.

The CPU 201 enables display on the display device 210, for example, by executing outline font rasterization processing in the display information area in the RAM 202. Further, the CPU 201 enables a user instruction with a mouse cursor or the like (not shown) on the display device 210.

Various programs operating on the hardware are recorded in the external memory 211, and are executed by the CPU 201 by being loaded into the RAM 202 as necessary.

The printer controller 212 controls a printing machine such as the thermal dot line printer 213.

The scanner controller 214 controls a discriminator such as the scanner 215.

It should be noted that not all devices are provided with these configurations, and it is sufficient that they are provided with necessary components.

Next, an example of the hardware configuration of the network camera 102 shown in FIG. 1 will be described with reference to FIG.

In FIG. 3, the network camera 102 is composed of a so-called digital video camera or the like, and has a lens 301 for photographing, an image pickup element (hereinafter, referred to as “CCD”) 302, and an analog-digital converter (hereinafter, referred to as “ADC”) 303. , Image processing unit 304, controller 310, buffer memory 311, flash ROM 312 (storage unit), interface circuit (hereinafter referred to as “I/F circuit”) 313, card holder 314, memory card 315 (storage unit), display driver 316, the USB driver 318, and the operation part 320 are provided.

The network camera 102 generates an image in response to the pressing of the shooting button 323 (shutter button). In the present embodiment, the image is taken according to the pressing of the shooting button 323 (shutter button), but the shooting button 323 (shutter button) is not provided, and the shooting is performed when the user gives a shooting instruction on the touch panel. It is also possible to do so.

The lens 301 includes an objective lens, a zoom lens, a focus lens, and the like. The zoom lens and the focus lens are driven in the optical axis direction by a drive mechanism (not shown). The CCD 302 is composed of a CCD image sensor that forms an optical image incident through the lens 301, converts it into an electric signal (analog signal), and outputs the electric signal. The ADC 303 has a function of converting an electric signal (analog signal) output from the CCD 302 into a digital signal.

The image processing unit 304 includes a pre-processing unit 305, a YC processing unit 306, an electronic zoom processing unit 307, a compression unit 308, and an expansion unit 309, generates image data from a digital signal output from the ADC 303, and performs various types of image processing. Has the function of performing.

The preprocessing unit 305 has a function of performing white balance processing for adjusting the white balance of an image based on input image data and gamma correction processing for the image. The white balance process is a process of adjusting the hue of an image so as to be close to the hue of an actual object, or adjusting an appropriate color that matches a light source (fluorescent lamp, sunlight, etc.). The gamma correction process is a process of adjusting the contrast of an image. The preprocessing unit 305 can also perform image processing other than white balance processing and gamma correction processing.

The YC processing unit 306 has a function of separating an image based on input image data into luminance information “Y”, luminance signal and blue color difference information “Cb”, and luminance signal and red color difference information “Cr”. Have. The electronic zoom processing unit 307 has a function of trimming a part (for example, the central portion) of the image to a predetermined size and enlarging the trimmed image to the size of the original image by signal processing. The electronic zoom processing unit 307 can cut out an image of 1024×768 dots in the center from the photographed image of 1600×1200 dots, and enlarge it to a size of 1600×1200 dots while performing data interpolation.

The compression unit 308 has a function of compressing image data in a compression format such as a JPEG (Joint Photographic Expert Group) system. The decompression unit 309 has a function of decompressing compressed image data. For example, when compressing image data by the JPEG method, first, a discrete cosine transform process for digitizing the ratio of the high frequency component and the low frequency component of the image data is performed (DCT process). Next, a quantization process is performed in which the gradation of the image and the stage of expressing the gradation are expressed by a numerical value (quantization bit number). Finally, the Huffman encoding process compresses the image data. Specifically, the signal character string of the image data is divided into fixed bits, and a shorter code is given to the character string having a high appearance frequency. In the case of the method of recording the image data without performing the compression process, the compression unit 308 and the decompression unit 309 can be omitted. Further, the compression format of the image data is not limited to the JPEG format, and the same processing can be performed even if it is a GIF (Graphical Interchange Format) format or the like.

The controller 310 is connected to the image processing unit 304, the buffer memory 311, the flash ROM 312, the I/F circuit 313, the display driver 316, the USB driver 318, and the operation unit 320. Further, the controller 310 has, as a functional configuration, a control unit (not shown) that outputs a control signal for controlling the operation of each unit in accordance with an input signal from the operation unit 320, and an authentication unit (which authenticates the user). (Not shown).

Image data is temporarily stored in the buffer memory 311 when the image processing unit 304 performs image processing. Various setting information of the network camera 102 is stored in the flash ROM 312. The I/F circuit 313 converts the image data output from the controller 310 into a data format recordable in the memory card 315. The I/F circuit 313 also converts the image data and the like read from the memory card 315 into a data format that can be processed by the controller 310.

The card holder 314 has a mechanism that allows the memory card 315, which is a storage medium, to be attached to and detached from the network camera 102, and also has an electrical contact that enables data communication with the memory card 315. The card holder 314 has a structure according to the type of storage medium used in the network camera 102. The memory card 315 is a card-type storage medium that incorporates a semiconductor storage element such as a flash memory and is attachable to and detachable from the card holder 314. Image data captured by the network camera 102 can be recorded in the memory card 315. Note that, in the present embodiment, description will be given assuming that only the network camera 102 is configured, but the memory card 315 may be replaced by a storage unit provided in an information processing device or the like that can communicate with the network camera 102. The communication method between the network camera 102 and the information processing device is not particularly limited. It may be wired or wireless. In this case, the network camera 102 includes a communication interface controller, and communicates with the information processing device through the communication interface controller.

The display driver 316 converts the image data output from the controller 310 into a signal that can be displayed on the liquid crystal display 317. Specifically, the display driver 316 performs a process of converting digital image data output from the controller 310 into an analog image signal, and then sets the image size to a size suitable for the size of the displayable area of the liquid crystal display 317. Perform the conversion process.

The operation unit 320 includes a power switch 321, a mode dial 322, a shooting button 323 (shutter button), a cursor key 324, a zoom button 325, and a browse (playback) button 326, and accepts an operation input from the user, and the operation content. To the controller 310. The operation unit 320 includes operation buttons other than the illustrated operation buttons, but the description thereof will be omitted.

The mode dial 322 is a rotatable dial for switching the shooting operation mode. The user rotates the mode dial 322 to perform a plurality of shooting operations including an administrator mode capable of restricting access to image data stored in the memory card 315 and a shooting operation mode other than the administrator mode. It is possible to select the mode.

The shooting operation mode other than the administrator mode is, for example, an Auto mode or a night view mode in which the shooting settings (white balance, shutter speed, etc.) held by the network camera 102 in advance can be easily selected by the user, or the user arbitrarily selects. There is a manual mode that allows you to set shooting settings.

The browse button 326 is a button for switching to a browse mode (image reproduction mode) for browsing captured image data. When the browse button 326 is pressed, the shooting mode is switched to the browse mode. The method of switching to the browsing mode is not limited to the pressing of the browsing button 326, and may be a transition method using a touch panel (not shown) on the liquid crystal display 317.

In the browsing mode, the controller 310 reads the setting information and the image data from the memory card 315 mounted on the card holder 314 via the I/F circuit 313. The setting information includes the number of images recorded on the currently mounted memory card 315 and the amount of recorded image data. The read image data is, for example, image data for one image or thumbnail data. The image data read from the memory card 315 is compressed in the predetermined compression format as described above.

The image data read from the memory card 315 is input to the display driver 316 via the I/F circuit 313 and the controller 310. The display driver 316 causes the liquid crystal display 317 to display the input image data.

The cursor key 324 is a key for the user to perform a predetermined instruction and a function selection with respect to the image capturing apparatus. The user can input various setting information and user authentication information for the network camera 102 with the cursor key 324. Further, with the cursor key 324, a menu screen can be displayed on the liquid crystal display 317, or a predetermined function of the network camera 102 can be selected.
Next, the moving image extraction processing will be described with reference to FIG.

Note that steps S401 to S403 of the process shown in the flowchart of FIG. 4 are processes in which the CPU 201 of the cashier terminal 101 reads and executes a predetermined control program, and steps S404 to S406 are performed by the controller 310 of the network camera 102 in a predetermined manner. This is a process for reading out and executing the control program.

In step S401, the CPU 201 of the cashier terminal 101 performs an accounting process. Specifically, it is a process of reading the barcode attached to the product and acquiring the price of the product.

In step S402, the CPU 201 of the cashier terminal 101 accepts an instruction to issue a receipt and issues a receipt when the payment process for the last product is completed and the payment method is confirmed.

At this time, information for identifying the accounting process related to the receipt is printed on the receipt. Specifically, the identification information is described by an identification number, a bar code, a two-dimensional code, or the like.

In step S403, the CPU 201 of the cashier terminal 101 transmits to the network camera 102 a notification that a receipt has been issued.

The notification transmitted here includes information such as the identification information described in the receipt, the end time of the accounting process in step S401, and the receipt issue time in step S402. The end time of the accounting process can be specified by the time at which the accounting process of the last product (the most recent accounting process from the time of receipt issuance) is performed.

In step S404, the network camera 102 receives the notification transmitted from the cashier terminal 101 in step S403.

In step S405, the network camera 102 extracts, from the moving images captured by the network camera 102, one moving image file from the end time of the accounting process received in step S404 to the time of issuing the receipt. It is assumed that the network camera 102 is always shooting a moving image, and in step S405, a process of extracting a moving image to be left as a record from the captured moving images.

In the present embodiment, the time from the end time of the accounting process to the time of issuing the receipt is extracted as one moving image file, but the time from the start time of the accounting process to the time of issuing the receipt may be extracted as one moving image file.

In step S406, the moving image file extracted in step S405 and the identification information received in step S404 are stored in association with each other. FIG. 12 shows an example of data stored in association with each other.

In the present embodiment, the moving image file and the identification information are stored in the network camera 102, but they may be stored in an external storage device communicatively connected to the network camera 102.
Then, the processing of this flowchart ends.

In the present embodiment, the network camera 102 has been described as performing the moving image extraction and storage processing, but an information processing device (not shown) having a function of editing and analyzing a moving image captured by the network camera 102 may be used. May be processed.

Next, a still image acquisition process executed by the network camera 102 will be described with reference to FIG.

In step S501, the network camera 102 acquires the moving image data stored in step S406.

In step S502, the network camera 102 determines whether a predetermined still image acquisition condition is satisfied for the scene included in the moving image acquired in step S501.

If the scene satisfies the predetermined condition (step S502: YES), the process proceeds to step S503.

If the scene does not satisfy the predetermined condition (step S502: NO), the process proceeds to step S504.

In step S503, the network camera 102 acquires and saves as a still image the scene that is determined to satisfy the predetermined condition in step S502. At this time, the identification number associated with the moving image data is also stored in association with the scene. FIG. 12 shows an example of data stored in association with each other.

In step S504, the network camera 102 determines whether the determination process of step S502 has been executed for all the scenes of the moving image acquired in step S501.

If the processing has been executed for all the scenes (step S504: YES), the processing shown in this flowchart ends.

When there remains a scene for which the process has not been executed (step S504: NO), the process proceeds to step S502.

In the present embodiment, the network camera 102 has been described as executing the still image acquisition process, but the information processing device (not shown) having a function of editing and analyzing a moving image captured by the network camera 102 performs the process. You may.

Further, it may be left as a still image for a predetermined time before and after the scene that satisfies the condition. For example, a process of acquiring still images may be performed at 1 second intervals from 5 seconds before to 5 seconds after the scene that satisfies the condition. In this way, by leaving a plurality of images as still images, when a trouble or the like occurs, it is possible to grasp the context of the still image, which is useful for solving the trouble.

Here, the still image acquisition condition in step S502 will be described with reference to FIGS. 9 and 10.

FIG. 9 is a diagram showing how money is paid at the time of accounting. As shown in FIG. 9, it is assumed that the network camera 102 is photographing an area (for example, a tray for money transfer) on which money is placed (passes).

FIG. 10 is a view for explaining the still image acquisition condition, and is an enlarged view of the area where the money is placed in FIG. 9.

The still image acquisition condition is, for example, a condition that money is reflected in the captured image. In this case, the image data of money is registered in advance, the similarity between the object shown in the photographed image and the image data of the registered money is calculated, and if the predetermined similarity is satisfied, the object is Judge that it is money and shoot a still image.

It is also possible to make a determination based on the shape of the object shown in the captured image. For example, it is possible to judge whether it is a bill by judging whether it is a rectangular object or not. It is also possible to judge a bill based on conditions such as whether or not the object has edges and edges.

Further, whether or not to acquire a still image may be determined depending on whether or not an object moving in a predetermined direction is detected. For example, the example of FIG. 10 shows an image in the case of determining whether an object has passed a predetermined detection line in a predetermined direction. More specifically, in the diagram of FIG. 10, it is determined whether or not a moving object (for example, a customer's hand or money) has passed from the bottom to the top (from the customer side to the clerk side).

In this way, by detecting whether the customer has made a payment act based on whether or not the object has passed the predetermined detection line, it is possible to detect payment by a credit card, for example. Further, by judging whether the object has passed in a predetermined direction, it is possible to judge whether the hand of the clerk has passed or the hand of the customer. That is, it becomes possible to determine whether an object has come out from the clerk side or the customer side.

Next, a display process of a moving image and a still image by the display terminal 103 and the network camera 102 will be described with reference to FIG.

In the process shown in the flowchart of FIG. 6, steps S601, S602, S606, and S607 are processes in which the CPU 201 of the display terminal 103 reads and executes a predetermined control program, and steps S603 to S605 are the network camera. This is the process executed by 102.

In step S601, the CPU 201 of the display terminal 103 acquires the identification information described in the receipt issued in step S402. For example, the identification information is acquired by reading a barcode or a two-dimensional code.

In step S602, the CPU 201 of the display terminal 103 transmits to the network camera 102 a moving image/still image acquisition request including the identification information acquired in step S601.

In step S603, the network camera 102 receives the acquisition request including the identification information transmitted from the display terminal 103 in step S602.

In step S604, the network camera 102 searches for the moving image/still image stored in association with the identification information based on the identification information included in the moving image/still image acquisition request received in step S603.

In step S605, the network camera 102 transmits the moving image/still image searched in step S604 to the display terminal 103.

In step S606, the CPU 201 of the display terminal 103 receives the moving image/still image transmitted from the network camera 102 in step S605.

In step S607, the CPU 201 of the display terminal 103 displays the moving image/still image received in step S606 on the display unit. Then, the processing shown in this flowchart is ended.

Note that, in the present embodiment, it has been described that the moving image and the still image are acquired from the network camera 102 and displayed on the display terminal on the assumption that the moving image and the still image data are stored in the network camera 102. As described above, when the moving image or the still image data is stored in the external device, the processing subject in steps S603 to S605 is not the network camera 102, but the device storing the data or the device can be operated. It becomes a device.

FIG. 8 is a diagram showing how a moving image and a still image are displayed on the display terminal 103.

In FIG. 8, a so-called smartphone or tablet terminal is assumed as the display terminal 103. The display terminal 103 may be a smartphone or a tablet terminal as shown in FIG. 8, a personal computer (PC), a television, or any terminal capable of displaying a moving image or a still image.

Although the moving image and the still image are simultaneously displayed on one screen in FIG. 8, they may be displayed separately. That is, the screen for playing the moving image and the screen for displaying the still image may be different screens, and the display may be switched to check the moving image and the still image.

As shown in FIG. 8, it is composed of a moving image reproduction area 801 and a still image display area 802.

In the moving image reproduction area 801, the moving image captured by the network camera and stored in the data table of FIG. 12 is reproduced. In the still image display area 802, an image acquired as a scene that satisfies the still image acquisition condition is displayed. As shown in the still image display area 802, a plurality of still images are displayed in time series. By displaying in this way, for example, even when a trouble occurs, the context of the trouble can be grasped by the still image.

Further, a control bar 803 is provided, and by operating the control bar 803 left and right, the playback position of the moving image can be adjusted.
<Second Embodiment>

In the first embodiment, the process of creating a file or acquiring a still image of moving image data that has already been captured by the network camera 102 and stored has been described.

In the second embodiment, a configuration will be described in which the network camera 102 performs moving image shooting and data storage processing in response to processing in the cashier terminal 101.

FIG. 7 is a flowchart showing the processing executed by the network camera 102 according to the second embodiment.

Among the processes shown in FIG. 7, steps S701 to S703 are processes in which the CPU 201 of the cashier terminal 101 reads and executes a predetermined control program, and steps S704 to S711 are executed by the controller 310 of the network camera 102 in a predetermined control program. Is a process of reading and executing.

First, the flow of processing in the cashier terminal 101 will be described.

In step S701, the cashier terminal 101 performs an accounting process. The accounting process refers to a series of processes for accounting for a product by reading a barcode attached to the product.

In step S702, the cashier terminal 101 issues a receipt for the accounting process in step S701.

In step S703, the cashier terminal 101 transmits information for identifying the accounting process in step S701 to the network camera 102.
Then, the processing of this flowchart ends.
Next, the processing in the network camera 102 will be described.

In step S<b>704, it is determined whether the accounting process in the cashier terminal 101 has started.

When the start of the accounting process in the cashier terminal 101 is detected (step S704: YES), the process proceeds to step S705.

In step S705, the network camera 102 starts shooting a moving image.

In step S706, the network camera 102 determines whether or not an event that satisfies a predetermined still image acquisition condition has occurred in the image being captured. A specific example of the still image acquisition condition is the same as that in step S502 in the first embodiment, so description thereof will be omitted here.

When an event that satisfies the still image acquisition condition occurs (step S706: YES), the process proceeds to step S707.

When the event that satisfies the still image acquisition condition has not occurred (step S706: NO), the process proceeds to step S708.

In step S707, the network camera 102 captures a still image of the event determined to satisfy the conditions in step S706. Regarding the still image acquisition in step S707, a plurality of still images may be acquired within a predetermined range before and after, as in step S503.

In step S<b>708, the network camera 102 determines whether the receipt issuing process has been performed by the cashier terminal 101.

When the receipt issuance by the cashier terminal 101 is detected (step S708: YES), the process proceeds to step S709.

When the receipt issuance by the cashier terminal 101 is not detected (step S708: NO), the process proceeds to step S706.

In step S709, the network camera 102 ends the moving image shooting process.

That is, the moving image shooting is continued until the receipt is issued by the cashier terminal 101, and when an event that satisfies the still image acquisition condition occurs during the moving image shooting, a process of shooting the event as a still image is performed. Then, when the receipt issuance by the cashier terminal 101 is detected, the moving image shooting is ended.

In step S710, the network camera 102 acquires information for identifying the accounting process transmitted from the cashier terminal 101.

In step S711, the network camera 102 associates the captured moving image data and the still image captured in step S707 with the identification information acquired in step S710 in the storage area of the network camera 102 or the storage area of the external device. Remember. FIG. 12 shows an example of data stored in association with each other.

In the present embodiment, it is determined in step S704 whether the accounting process has started. However, it is determined that the accounting process has ended (the accounting process for the last product has been performed), and the moving image shooting starts (step S705) may be performed.

The moving image reproduction processing is the same as the processing shown in the flowchart of FIG. 6 and the display screen of FIG. 8 in the second embodiment as well, and thus the description thereof will be omitted.
The above is the processing content in the second embodiment of the present invention.

FIG. 11 is data in which an event that has occurred in the cashier terminal 101 is associated with the event occurrence date and time.

The event that occurred in steps S401, S402, S701, S702, etc. is registered in association with the date and time of occurrence. For example, in the example shown in FIG. 11, the time when the accounting process is started (the first accounting process after issuing the last receipt) and the ending time of the accounting process (accounting process for the last product (accounting process immediately before issuing the receipt)). ) And the receipt issuance time are registered.

In step S403, the event, the data of the event occurrence date and time, and the identification information shown in FIG. 11 are transmitted from the cashier terminal 101 to the network camera 102.

FIG. 12 is an example of a data table in which moving image files and still image files captured by the network camera 102 are registered in association with identification information.

For example, when the identification information indicating the accounting process in FIG. 11 (the process started at 10:15 on June 25, 2014 and issued at 10:17:30 on the same day) is “0001”, the corresponding process is performed. The moving image and the still image related to are “0001.mp4” and “0001.jpg”.

That is, in the case of a configuration in which the moving image from the start of the accounting process to the receipt is stored, the moving image file “0001.mp4” is stored between 10:15:30 on June 25, 2014 and 10:17:30 on the same day. It becomes the data of the moving image for 2 minutes and 30 seconds.

Further, “0001.jpg” is still image data of a scene that satisfies the still image acquisition condition in the moving image data.

As described above, based on the receipt issuance timing by the cashier terminal, moving images taken by the network camera 102 are separated to create moving image data, and the moving image data and the accounting process by the cashier terminal are stored in association with each other. Thus, it becomes possible to easily search which video is which video for which accounting processing. That is, since the receipt issuance is a process that is performed after the accounting process is completed and the payment is made, it is possible to store a series of accounting processes as one moving image by dividing the receipt process at this timing.

Further, by storing the timing from the start or end of the accounting process by the cashier terminal to the receipt issuance as a single moving image file, unnecessary moving images are not stored and the capacity can be reduced. ..

For example, in the example of FIG. 11, a receipt is issued at 10:22:40 on June 25, and the next accounting process starts at 10:50:20. In this case, from 10:22:40 to 10:50:20 is the time when no processing was performed, and it is meaningless to leave a moving image at this time. Therefore, by executing the processing of the present invention, it is possible to leave only the moving image in the necessary time zone without leaving the moving image in the useless time zone, which can contribute to the capacity reduction.

In addition, by acquiring a scene that satisfies the specified conditions as a still image in the captured video, it is possible to grasp the context of the still image when a problem occurs, which is useful for troubleshooting. You can At this time, the scenes before and after the scene satisfying the predetermined condition are left as still images, so that a series of flows can be grasped by the still images, which is useful for troubleshooting.

Further, by printing the identification information on the receipt issued from the cashier terminal and storing the identification information and the moving image/still image in association with each other, the accounting process related to the receipt is performed based on the identification information described on the receipt. It becomes possible to efficiently search for moving images and still images.

It is needless to say that the structure and contents of the various data described above are not limited to this, and may be composed of various structures and contents according to the use and purpose.

Further, the program in the present invention is a program that causes a computer to execute the processes of FIGS. 4 to 7. The program according to the present invention may be a program for each process of FIGS. 4 to 7.

As described above, the recording medium recording the program that realizes the functions of the above-described embodiments is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus executes the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing.

In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium recording the program constitutes the present invention.

As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, non-volatile memory card, ROM, EEPROM, silicon. A disk or the like can be used.

Further, not only the functions of the above-described embodiments are realized by executing the program read by the computer, but also the OS (operating system) running on the computer is actually executed based on the instructions of the program. It goes without saying that a case where a part or all of the processing is performed and the functions of the above-described embodiments are realized by the processing is also included.

Furthermore, after the program read from the recording medium is written in the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer, the function expansion board is instructed based on the instruction of the program code. Needless to say, this also includes the case where the CPU or the like included in the function expansion unit performs some or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

Further, the present invention may be applied to a system including a plurality of devices or an apparatus including a single device. Further, it goes without saying that the present invention can be applied to the case where it is achieved by supplying a program to a system or an apparatus. In this case, by reading the recording medium storing the program for achieving the present invention into the system or device, the system or device can enjoy the effects of the present invention.

Furthermore, by downloading and reading a program for achieving the present invention from a server, a database or the like on a network using a communication program, the system or device can enjoy the effects of the present invention. It should be noted that the present invention also includes all configurations that combine the above-described embodiments and modifications thereof.

101 cashier terminal 102 network camera 103 display terminal

Claims (10)

A network camera system capable of communicating with an accounting system that performs accounting processing and issues an accounting record including identification information for identifying the accounting processing,
Shooting means for shooting a moving image relating to accounting processing by the accounting system,
A scene in which a moving object that moves in a predetermined direction is detected is identified as a scene in which money is exchanged, and the identified scene is acquired as a still image in the moving image related to the accounting process photographed by the photographing means. Still image acquisition means,
Management means for managing the still image acquired by the still image acquisition means in association with identification information for identifying accounting processing relating to the moving image from which the still image is acquired;
A network camera system comprising: A network camera system capable of communicating with an accounting system that performs accounting processing and issues an accounting record including identification information for identifying the accounting processing,
Shooting means for shooting a moving image relating to accounting processing by the accounting system,
Of the moving images relating to the accounting process photographed by the photographing means, the scene in which the moving object passes through the detection line in the photographing area is specified as the scene where the money is transferred, and the specified scene is regarded as the still image. A still image acquisition means for acquiring,
A management unit that manages the still image acquired by the still image acquisition unit in association with identification information that identifies accounting processing related to the moving image from which the still image is acquired;
A network camera system comprising: The network camera system according to claim 1 or 2, wherein the still image acquisition unit further acquires a still image relating to a scene in which an image similar to the image data registered in advance is captured. 4. The still image acquiring unit further acquires still images of the scenes before and after the scene related to the still image acquired by the still image acquiring unit, according to any one of claims 1 to 3. The described network camera system. Further comprising an acquisition unit for acquiring a notification that accounting processing has started or ended from the accounting system,
The management means further manages as a moving image of an accounting processing unit by dividing the moving image shot by the image capturing means based on the notification of the start or end acquired by the acquiring means. Item 5. The network camera system according to any one of items 1 to 4. The acquisition means further acquires a notification that an accounting record has been issued from the accounting system,
The network camera system according to claim 5, wherein the management unit further manages the moving image acquired by the acquisition unit from the start or end of the accounting process to the issuance of the accounting record as one file. An information processing method in a network camera system capable of communicating with an accounting system that performs an accounting process and issues an accounting record including identification information for identifying the accounting process,
A photographing step in which the photographing means photographs a moving image relating to accounting processing by the accounting system;
Still picture acquisition means, among videos according to captured accounted by the photographing step, the scene has been detected moving object moving object in a predetermined direction, identified as money transfer is performed scene was the specific scene And a still image acquisition process that acquires as a still image,
A managing step in which the managing means manages the still image acquired in the still image acquiring step in association with identification information for identifying accounting processing related to the moving image from which the still image is acquired;
An information processing method comprising: An information processing method in a network camera system capable of communicating with an accounting system that performs an accounting process and issues an accounting record including identification information for identifying the accounting process,
A photographing step in which the photographing means photographs a moving image relating to accounting processing by the accounting system;
The still image acquisition means identifies the scene in which the moving object has passed the detection line in the shooting area in the moving image related to the accounting process shot in the shooting step, as the scene where the money transfer is performed, and the scene is identified. A still image acquisition process that acquires the captured scene as a still image,
A managing step in which the managing means manages the still image acquired in the still image acquiring step in association with identification information for identifying accounting processing related to the moving image from which the still image is acquired;
An information processing method comprising: A network camera system capable of communicating with an accounting system that performs accounting processing and issues an accounting record including identification information that identifies the accounting processing,
Shooting means for shooting a moving image relating to accounting processing by the accounting system,
A scene in which a moving object that moves in a predetermined direction is detected is identified as a scene in which money is exchanged, and the identified scene is acquired as a still image in the moving image related to the accounting process photographed by the photographing means. Still image acquisition means,
A program for causing a still image acquired by the still image acquisition unit to function as a management unit that manages the still image in association with identification information that identifies accounting processing related to the moving image from which the still image is acquired. A network camera system capable of communicating with an accounting system that performs accounting processing and issues an accounting record including identification information that identifies the accounting processing,
Shooting means for shooting a moving image relating to accounting processing by the accounting system,
Of the moving images relating to the accounting process photographed by the photographing means, a scene in which the moving object passes through the detection line in the photographing area is specified as a scene where money is transferred, and the specified scene is regarded as a still image. A still image acquisition means for acquiring,
A program for causing a still image acquired by the still image acquisition unit to function as a management unit that manages the still image in association with identification information that identifies accounting processing related to the moving image from which the still image is acquired.

Images