WO2016194275A1 - Système d'analyse de ligne de flux, dispositif de caméra et procédé d'analyse de ligne de flux - Google Patents

Système d'analyse de ligne de flux, dispositif de caméra et procédé d'analyse de ligne de flux Download PDF

Info

Publication number
WO2016194275A1
WO2016194275A1 PCT/JP2016/001686 JP2016001686W WO2016194275A1 WO 2016194275 A1 WO2016194275 A1 WO 2016194275A1 JP 2016001686 W JP2016001686 W JP 2016001686W WO 2016194275 A1 WO2016194275 A1 WO 2016194275A1
Authority
WO
WIPO (PCT)
Prior art keywords
flow line
visitor
image
information
line analysis
Prior art date
Application number
PCT/JP2016/001686
Other languages
English (en)
Japanese (ja)
Inventor
高橋　秀明
哲生 田山
隆恵 小口
晋平 萩巣
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2015110225A external-priority patent/JP5909709B1/ja
Priority claimed from JP2015151075A external-priority patent/JP5909712B1/ja
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Publication of WO2016194275A1 publication Critical patent/WO2016194275A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present disclosure relates to a flow line analysis system, a camera apparatus, and a flow line analysis method for generating a flow line analysis image in which a person's staying information or passage information is superimposed on an image obtained by imaging with a camera device.
  • Patent Document 1 is known as a prior art for displaying an activity level of a person for each hour at a shooting site where a camera device is installed as a heat map image.
  • an activity level is calculated by analyzing a flow line of a person at a shooting site where a security camera connected via a network is installed, and a sensor detection result is superimposed on a floor plan of the shooting site. It is disclosed to generate a heat map image and display the heat map image on a browser screen corresponding to the security camera. Thereby, by browsing the heat map image displayed on the screen of the browser, it becomes possible to grasp the activity level of the person at the shooting site.
  • Patent Document 1 By the way, assuming that the system configuration of Patent Document 1 is used in a store, it is possible to display a person's action trajectory on a store map (that is, equivalent to a floor plan of a shooting site).
  • a layout change such as display is performed, the correlation between the layout and the person's action trajectory cannot be overlooked after the layout change. That is, the store map does not change even if the arrangement of the goods is changed, but the movement of the person (for example, a visitor, an employee) changes, and it is difficult to look down on these correlations.
  • Non-Patent Document 1 by displaying a person's action trajectory on an image captured by the camera device instead of the store map, the layout after the camera device changes even if there is a layout change Therefore, it is possible to look down on the correlation between the layout and the person's action trajectory.
  • the present disclosure accurately grasps a visitor's behavior trajectory even if there is a layout change while protecting privacy in a store where visitors and employees are mixed. It is an object of the present invention to provide a flow line analysis system, a camera device, and a flow line analysis method.
  • the present disclosure is a flow line analysis system in which a camera device and a server device are connected to each other, and the camera device captures an imaging area and repeatedly generates a background image corresponding to the captured image of the captured imaging area.
  • the captured image of the captured imaging area and the generated background image are transmitted to the server device at each predetermined transmission cycle, and the server device captures the captured image of the imaging area and the background image transmitted from the camera device.
  • visitor flow line information regarding the staying position or passing position in the imaging area of the visitor identification information that is possessed by the visitor or attached to the visitor's use object Extracting, using the extracted visitor flow line information as a visitor's action trajectory, generating a first flow line analysis image superimposed on the background image, and displaying the generated first flow line analysis image on the display unit Make To provide a flow line analysis system.
  • the present disclosure is a camera device that is connected to a server device and used in a flow line analysis system, and repeatedly generates an imaging unit that captures an imaging area and a background image corresponding to the captured image of the captured imaging area. And, based on the captured image of the imaging area, extract the visitor flow line information regarding the staying position or the passing position in the imaging area of the visitor identification information that is possessed by the visitor or attached to the visitor's use object, Generated at each predetermined transmission cycle, a processor that generates a flow line analysis image superimposed on the generated background image using the extracted visitor flow line information as a visitor's action trajectory for each predetermined transmission cycle And a transmission unit that transmits the flow line analysis image to a server device that displays the flow line analysis image.
  • the present disclosure is a flow line analysis method in a flow line analysis system in which a camera device and a server device are connected to each other, and the camera device captures an imaging area and corresponds to a captured image of the imaging area.
  • the image is repeatedly generated, and the captured image and background image of the imaging area are transmitted to the server device at every predetermined transmission cycle, and the captured image and background image of the imaging area transmitted from the camera device are received at the server device.
  • a flow line analysis method for generating a first flow line analysis image superimposed on a background image using the visitor flow line information as a visitor's action trajectory and displaying the first flow line analysis image on a display unit To provide.
  • FIG. 1 is a block diagram showing a schematic configuration of the sales management system of the present embodiment.
  • FIG. 2 is a diagram illustrating an outline of a plurality of camera devices, a BLE receiving terminal, and a BLE transmitting terminal of the sales management system of the present embodiment.
  • FIG. 3 is a block diagram showing in detail the functional internal configuration of each of the camera device and the server device of the sales management system of the present embodiment.
  • FIG. 4 is a time chart for explaining the operation timing of each process of image input, background image generation, and flow line information analysis of the camera device of the sales management system of this embodiment.
  • FIG. 5A is a diagram illustrating an example of a captured image input to the image input unit of the camera device of the sales management system of the present embodiment.
  • FIG. 5A is a diagram illustrating an example of a captured image input to the image input unit of the camera device of the sales management system of the present embodiment.
  • FIG. 5B is a diagram illustrating an example of the background image generated by the background image generation unit of the camera device of the sales management system according to the present embodiment.
  • FIG. 6 is a diagram illustrating an example of a flow line analysis image generated in the server device of the sales management system according to the present embodiment.
  • FIG. 7 is a flowchart for explaining processing until the position information of the visitor is grasped and the action trajectory of the visitor is superimposed on the background image in the server device of the sales management system of the present embodiment.
  • FIG. 8 is a flowchart for explaining transaction ID generation / termination processing for superimposing a visitor's action locus on a background image in the server device of the sales management system of the present embodiment.
  • FIG. 9 is a diagram for assisting in explanation of transaction ID generation / termination processing in the server device of the sales management system of the present embodiment.
  • FIG. 10 is a block diagram illustrating in detail a functional internal configuration of a camera device according to a modification of the present embodiment.
  • FIG. 11 is a block diagram showing in detail the respective functional internal configurations in a modified example of the camera device and the server device shown in FIG.
  • FIG. 12 is a flowchart for explaining the process from extracting the visitor flow line information to superimposing the visitor flow line information on the background image as an action trajectory in the camera apparatus and server apparatus shown in FIG.
  • FIG. 13 is a block diagram showing in detail a functional internal configuration in a modification of the camera apparatus shown in FIG.
  • the present embodiment specifically discloses a flow line analysis system, a camera device, and a flow line analysis method according to the present disclosure
  • the present embodiment specifically discloses a flow line analysis system, a camera device, and a flow line analysis method according to the present disclosure
  • the present embodiment will be described in detail with reference to the drawings as appropriate.
  • more detailed description than necessary may be omitted.
  • detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.
  • the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the claimed subject matter.
  • FIG. 1 is a block diagram illustrating a schematic configuration of a sales management system 1000 according to the present embodiment.
  • a sales management system 1000 of this embodiment includes a flow line analysis system 500A, 500B, 500C,... Installed in a plurality of stores A, B, C,. 700, a cloud computer 800, and a setting terminal device 900.
  • Flow line analysis systems 500A, 500B, 500C,... Installed in a plurality of stores A, B, C,... Mutually communicate with server device 600, smartphone 700, cloud computer 800, and setting terminal device 900 via network NW. It is connected.
  • the network NW is a wireless network or a wired network.
  • the wireless network is, for example, a wireless LAN (Local Area Network), a wireless WAN (Wide Area Network), 3G, LTE (Long Term Evolution), or WiGig (Wireless Gigabit).
  • the wired network is, for example, an intranet or the Internet.
  • a flow line analysis system 500A installed in the store A includes a plurality of camera devices 100, 100A,..., 100N installed on the floor 1 of the store A, a recorder 200, a server device 300, an input device 400, and a monitor. 450.
  • Camera devices 100, 100A,..., 100N, recorder 200, and server device 300 installed on floor 1 of store A are connected to network NW.
  • a plurality of camera devices 100, 100A,..., 100N are installed on the floor 2 of the store A as well as the floor 1, and illustration of the camera devices in the floor 2 is omitted.
  • the internal configuration of each of the camera devices 100, 100A,... 100N is the same, and details thereof will be described later with reference to FIG.
  • the flow line analysis system 500A installed in the store A further includes a plurality of (1-n, n is an integer) BLE transmission terminals (location information) that are carried by customers who visit the store A (hereinafter referred to as “customers”). And a plurality of (1-m, m are integers) BLE receiving terminals (position information receiving devices) 160 installed in the store A. These terminals can be provided as functions in portable terminals having a near field communication (NFC) function. A plurality of BLE receiving terminals 160 are installed for each floor.
  • the BLE transmitting terminal 150 and the BLE receiving terminal 160 are terminals compliant with the short-range wireless communication standard (Bluetooth (registered trademark) Low Energy).
  • the BLE transmission terminal 150 is desirably small and thin so that the BLE transmission terminal 150 can be attached to a visitor's goods (shopping cart, cart, portable terminal, etc.).
  • the BLE transmission terminal 150 transmits the position information of the visitor who possesses (indirectly or directly possesses) the BLE transmission terminal 150, and the BLE reception terminal 160 receives the position information of the visitor transmitted from the BLE transmission terminal 150.
  • the number of BLE receiving terminals 160 installed on each floor is determined in advance according to the scale of the store, but the number of BLE transmitting terminals 150 varies depending on the number of visitors.
  • All the BLE receiving terminals 160 installed in the store A are connected to the network NW.
  • Visits also have a BLE transmission terminal 150, and a plurality of BLE reception terminals 160 are installed for each floor.
  • FIG. 2 shows an overview of the camera devices 100, 100A,... And the BLE receiving terminal 160 installed on the floor 1 of the store A, and the BLE transmitting terminal 150 possessed by the visitor 152 on the floor 1 of the store A.
  • FIG. As shown in the figure, each of a plurality of camera devices 100, 100A,... And a plurality of BLE receiving terminals 160 are connected to a network NW.
  • each camera apparatus 100,100A, ... images the floor 1 (predetermined imaging region) of the store A.
  • the recorder 200 is configured using, for example, a semiconductor memory or a hard disk device, and images (hereinafter referred to as camera devices) obtained by imaging the camera devices 100, 100A,..., 100N installed in the store A.
  • the image obtained by imaging is stored as “captured image”).
  • the captured image stored in the recorder 200 is used for monitoring work such as crime prevention.
  • the server apparatus 300 is configured using, for example, a PC (Personal Computer), and refers to a user who operates the input device 400 (for example, a user of a flow line analysis system and includes an employee 151 including a store manager of the store A, and so on. ) Is notified to the camera apparatus 100 that a predetermined event (for example, a change in the layout of the sales floor on the floor 1 of the store A) has occurred.
  • a predetermined event for example, a change in the layout of the sales floor on the floor 1 of the store A
  • the server device 300 generates, on the monitor 450, a flow line analysis image superimposed on the background image of the captured image using the flow line information of the visitor 152 in the store A as an action trajectory. Let Details of the internal configuration of the server apparatus 300 will be described later with reference to FIG.
  • the input device 400 is configured using, for example, a mouse, a keyboard, a touch panel, or a touch pad, and outputs a signal corresponding to a user input operation to the camera device 100 or the server device 300.
  • an arrow is shown only between the input device 400 and the camera apparatus 100, but the input device 400 and other camera apparatuses (for example, the camera apparatuses 100 ⁇ / b> A and 100 ⁇ / b> N).
  • An arrow may be shown between the two.
  • the monitor 450 is configured using, for example, an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence-ence), and displays a flow line analysis image generated by the server device 300.
  • the monitor 450 is provided as an external device different from the server device 300, but may be configured to be included in the server device 300.
  • the server device 600 of the operation headquarters is a flow line analysis system 500A installed in each store A, B, C,... According to an input operation of an employee (for example, an officer) of the operation headquarters who operates the server device 600. , 500B, 500C,... Browsing apparatus for acquiring and displaying the flow line analysis image generated.
  • the smartphone 700 is a flow line analysis system 500A, 500B, installed in each store A, B, C,... According to an input operation of an employee (for example, a sales representative) of the operation headquarters who operates the smartphone 700. It is a browsing apparatus for acquiring and displaying the flow line analysis image generated in 500C,.
  • the cloud computer 800 is an online storage that stores the flow line analysis images generated in the flow line analysis systems 500A, 500B, 500C,... Installed in the stores A, B, C,.
  • the setting terminal device 900 is configured by using a PC, for example, and is dedicated for displaying a setting screen of the camera device of the flow line analysis systems 500A, 500B, 500C,... Installed in each store A, B, C,. Browser software can be executed.
  • the setting terminal device 900 displays the setting screen of the camera device (for example, CGI (Common Gateway Interface)) according to the input operation of the employee of the operation headquarters operating the device (for example, the system administrator of the sales management system 1000).
  • the setting information of the camera device is edited (modified, added, deleted) and set.
  • FIG. 3 is a block diagram illustrating in detail the functional internal configurations of the camera device 100 and the server device 300 of the present embodiment.
  • the camera devices installed in the stores A, B, C,... Have the same configuration.
  • the camera device 100 includes an imaging unit 10, an image input unit 20, a background image generation unit 30, a flow line information analysis unit 40, a schedule management unit 50, a transmission unit 60, and an event information reception unit. 70, a background image storage unit 80, a passage / staying analysis information storage unit 90, a visitor information acquisition unit 170, and a visitor passage / staying analysis information storage unit 171.
  • the imaging unit 10 has at least a lens and an image sensor (not shown).
  • the lens collects light (light rays) incident from the outside of the camera device 100 and forms an image on a predetermined imaging surface of the image sensor.
  • a fish-eye lens or a wide-angle lens capable of obtaining an angle of view of, for example, 140 degrees or more is used.
  • the image sensor is, for example, a CCD (Charged-Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) solid-state imaging device, and converts an optical image formed on the imaging surface into an electrical signal.
  • the image input unit 20 is configured using, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a DSP (Digital Signal Processor), and performs predetermined signal processing using an electrical signal from the imaging unit 10. Then, a captured image (frame) defined by RGB (Red Green Blue) or YUV (luminance / color difference) recognizable by humans is generated and output to the background image generation unit 30 and the flow line information analysis unit 40.
  • a CPU Central Processing Unit
  • MPU Micro Processing Unit
  • DSP Digital Signal Processor
  • the background image generation unit 30 includes an input image learning unit 31, a moving body separation unit 32, and a background image extraction unit 33, and repeatedly generates a background image of the captured image in the imaging region.
  • the background image generation unit 30 is configured by using, for example, a CPU, MPU, or DSP, and for each captured image (frame) output from the image input unit 20 at a predetermined frame rate (for example, 30 fps (frame per second)).
  • a background image from which a moving body (a person, mainly an employee 151 and a visitor 152) included in the captured image is excluded is generated and stored in the background image storage unit 80.
  • the background image generation processing in the background image generation unit 30 can use, for example, the method disclosed in the following reference patent document, but is not limited to the method disclosed in this reference patent document.
  • FIG. 4 is an explanatory diagram of an outline of the operation of the background image generation unit 30 of the camera device 100 of the present embodiment.
  • FIG. 5A is a diagram illustrating an example of a captured image input to the image input unit 20.
  • FIG. 5B is a diagram illustrating an example of a background image generated by the background image generation unit 30.
  • FIG. 4 the generation results of the input image learning unit 31, the moving body separation unit 32, and the background image extraction unit 33 are schematically shown from the left side to the right side of the page orthogonal to the time axis from the upper side to the lower side of the page. It is shown that a store visitor carries one cardboard out of four cardboards containing beverages.
  • the input image learning unit 31 displays the distribution state of the pixel luminance and color difference values for each pixel in a plurality of captured image frames output from the image input unit 20 (for example, the respective frames FM1 to FM5 shown in FIG. 4). analyse.
  • the moving body separation unit 32 uses the learning result of the input image learning unit 31 (that is, the analysis result of the luminance and color difference distribution state for each same pixel between a plurality of frames (for example, the time axis direction shown in FIG. 4)).
  • the information is separated into information on the moving body (for example, refer to frames FM1a to FM5a) and information other than the moving body (for example, background) (for example, refer to frames FM1b to FM5b).
  • the luminance and color difference values corresponding to the pixels of the cardboard carried by the person are along the time axis direction (for example, see FIG. 4). Since it changes, the moving body separating unit 32 regards the cardboard carried by the person as the moving body.
  • the background image extraction unit 33 uses the frames FM1b to FM5b in which information other than the moving body is reflected among the information separated by the moving body separation unit 32, and the background images of the frames FM1 to FM5 of the captured image output from the image input unit 20.
  • the frames FM1c to FM5c are extracted and stored in the background image storage unit 80.
  • the frame FM10a of the captured image shown in FIG. 5A for example, a person who provides food in a cafeteria and a person who receives food in a tray are shown as moving bodies.
  • the background image frame FM10c generated by the background image generation unit 30 in contrast to the frame FM10a of the captured image shown in FIG. 5A, a person serving food in the same canteen as a moving object People who receive food are excluded so that they do not appear.
  • the above is the outline of the operation of the background image generation unit 30.
  • the flow line information analysis unit 40 includes a target detection unit 41, a flow line information acquisition unit 42, and a passage / staying state analysis unit 43.
  • the flow line information analysis unit 40 is configured using, for example, a CPU, MPU, or DSP, and for each captured image (frame) output from the image input unit 20 at a predetermined frame rate (for example, 10 fps), The flow line information relating to the staying position or passing position of the moving body included is extracted and stored in the passing / staying analysis information accumulating unit 90.
  • the moving bodies included in the captured image are mainly employees 151 and visitors 152.
  • the object detection unit 41 performs predetermined image processing (for example, person detection processing, face detection processing) on the frame of the captured image output from the image input unit 20, so that the moving object included in the frame of the captured image is detected. Detect the presence or absence.
  • the target detection unit 41 detects a moving body included in the frame of the captured image
  • the target detection unit 41 outputs information (for example, coordinate information of the frame) regarding the detection area of the moving body to the frame of the captured image to the flow line information acquisition unit 42. To do.
  • the object detection part 41 outputs the information (for example, predetermined null information) regarding the detection area
  • the flow line information acquisition unit 42 is based on the information on the detection area of the moving object output from the target detection unit 41, and the information on the captured image output from the image input unit 20 and the information on the detection area of the past moving object. (For example, captured image information and coordinate information) are used to link information on the current and past detection areas, and pass / stay status as flow line information (for example, the amount of change in the coordinate information of the detection area of the moving object).
  • the data is output to the analysis unit 43.
  • the passage / staying state analyzing unit 43 is based on the flow line information output from the flow line information acquiring unit 42 for a plurality of captured images, and the flow line information regarding the staying position or the passing position of the moving body in the frame of the captured image. (For example, “target position information”, “flow line information”, and “information about passage status or stay status”) are extracted and generated. Further, the passage / staying state analyzing unit 43 uses the extraction result of the flow line information regarding the staying position or the passing position of the moving body, and the color portion of the flow line analyzing image generated in the display image generating unit 350 of the server device 300. The visualized image may be generated.
  • the passage / staying state analysis unit 43 uses the flow line information for the frames of the plurality of captured images, so that the position where the moving body stays or the position where it has passed in the frames of the captured image output from the image input unit 20. It is possible to extract and generate the accurate flow line information regarding.
  • the visitor information acquisition unit 170 is configured using, for example, a CPU, MPU, or DSP, and based on the output of the BLE receiving terminal 160, the movement related to the staying position or the passing position of the visitor in the imaging area included in the captured image of the imaging area.
  • the line information is detected and stored in the visitor pass / stay analysis information storage unit 171.
  • the schedule management unit 50 is configured using, for example, a CPU, MPU, or DSP, and the background image stored in the background image storage unit 80 and the staying information or passage of the moving object stored in the passage / staying analysis information storage unit 90
  • a predetermined transmission cycle for periodically transmitting to the server device 300 the extraction result of the flow line information related to the information and the flow line information of the visitor stored in the visitor passage / staying analysis information storage unit 171 is transmitted.
  • the unit 60 is instructed.
  • the predetermined transmission period is, for example, 15 minutes, 1 hour, 12 hours, 24 hours, etc., but is not limited to these time intervals.
  • the transmission unit 60 stores the background image stored in the background image storage unit 80 and the moving object stored in the passage / staying analysis information storage unit 90.
  • the flow line information extraction result regarding the stay information or the passage information and the visitor flow line information stored in the visitor pass / stay analysis information storage unit 171 are acquired and transmitted to the server apparatus 300.
  • the event information receiving unit 70 receives (acquires) notification of detection of a predetermined event (for example, a change in the layout of the sales floor of the floor 1 of the store A) from the server device 300 or the input device 400, and notification of detection of the predetermined event ,
  • a predetermined event for example, a change in the layout of the sales floor of the floor 1 of the store A
  • the transmission instruction to the server apparatus 300 of the flow line information of the visitor stored in the pass / stay analysis information storage unit 171 is output to the transmission unit 60.
  • the background image storage unit 80 is configured using a semiconductor memory such as an SD memory card or a hard disk device, for example, and stores the background image (frame) generated by the background image generation unit 30.
  • the passage / staying analysis information accumulating unit 90 is configured using, for example, a semiconductor memory or a hard disk device, and the flow line information extraction result (for example, the moving position staying or passing position of the moving object generated by the flow line information analyzing unit 40 (for example, "Target position information", "Flow line information", and "Information relating to passage status or stay status") are stored.
  • the visitor passing / staying analysis information accumulating unit 171 is configured using, for example, a semiconductor memory or a hard disk device, and the flow line information regarding the staying position or passing position in the imaging area of the visitor acquired by the visitor information acquiring unit 170.
  • the camera apparatus 100 illustrated in FIG. 3 may include a scene identification unit SD instead of the event information reception unit 70.
  • the scene identification unit SD as an example of the image change detection unit detects whether there is a change in the captured image output from the image input unit 20 (for example, an event that the layout of the sales floor on the floor 1 of the store A has changed).
  • the scene identification unit SD detects a change in the captured image
  • the background image stored in the background image storage unit 80 and the staying information or passage information of the moving object stored in the passage / staying analysis information storage unit 90 are displayed.
  • a transmission instruction to the server apparatus 300 is transmitted to the result of extracting the flow line information regarding the flow line information regarding the stay position or the pass position in the imaging area of the visitor stored in the visitor pass / stay analysis information storage unit 171.
  • the camera apparatus 100 shown in FIG. 3 may further include a person counting unit CT.
  • the person counting unit CT as an example of the moving body detection unit performs predetermined image processing (for example, person detection processing) on the captured image output from the image input unit 20, so that the moving body included in the captured image is detected. Count the number of detections.
  • the person count unit CT outputs information related to the number of detected moving bodies included in the captured image to the transmission unit 60.
  • the (Server device) 3 includes an event information reception unit 310, a notification unit 320, a reception unit 330, a reception information storage unit 340, a display image generation unit 350, and a report generation output unit 360. is there.
  • the event information receiving unit 310 receives, from the input device 400, information indicating that a predetermined event (for example, a change in the layout of the sales floor on the floor 1 of the store A) has occurred for each corresponding camera device (for example, the camera device 100). If so, a notification of detection of a predetermined event is received.
  • the event information receiving unit 310 outputs to the notification unit 320 that a notification of detection of a predetermined event has been received.
  • the information indicating that a predetermined event has occurred includes an identification number of a camera device that captures an image of a location where the predetermined event has occurred.
  • the notification unit 320 transmits a notification of detection of a predetermined event output from the event information reception unit 310 to a corresponding camera device (for example, the camera device 100).
  • the receiving unit 330 receives data transmitted from the transmission unit 60 of the camera device 100 (that is, the background image stored in the background image storage unit 80, the staying information of the moving object stored in the passage / staying analysis information storage unit 90, or
  • the received information storage unit 340 receives the flow line information extraction result related to the passing information and the flow line information related to the staying position or passing position in the imaging area of the visitor stored in the visitor passing / staying analysis information storage unit 171. And output to the display image generation unit 350.
  • the reception information storage unit 340 is configured using, for example, a semiconductor memory or a hard disk device, and the data received by the reception unit 330 (that is, the background image stored in the background image storage unit 80, the pass / stay analysis information storage unit 90). Extraction result of the flow line information related to the staying information or passing information of the stored moving body, and the flow line information related to the staying position or passing position in the imaging area of the visitor stored in the visitor passing / staying analysis information accumulating unit 171 ) Is memorized.
  • the received information storage unit 340 also stores information that can specify the captured image such as the date and time and the imaging location with respect to the installation positions of the camera devices 100, 100A,.
  • the display image generation unit 350 is configured using, for example, a CPU, MPU, or DSP, and the background image of the captured image acquired from the reception unit 330 or the reception information storage unit 340, the flow line information of the moving body, and the flow line information of the visitor Among them, the flow line analysis image is generated using the background image of the captured image and the flow line information of the visitor. That is, the display image generation unit 350 generates a flow line analysis image superimposed on the background image of the captured image using the flow line information of the visitor as an action trajectory. Then, the generated flow line analysis image is displayed on the monitor 450. In addition to the generated flow line analysis image, the display image generation unit 350 causes the monitor 450 to display an icon indicating the flow line information of the visitor.
  • the icons here are, for example, “shopping cart”, “cart”, “mobile terminal” icons, “customer” icons, and the like.
  • the display image generation unit 350 corresponds to an image generation unit and a display control unit.
  • the flow line analysis image is a background image that is excluded from the captured image captured by the camera device 100 so that the employee 151 and the visitor 152 that are moving objects are not reflected in the captured area corresponding to the captured image.
  • the flow line information visually indicating where the 152 has stayed or where it has passed is an image that is quantitatively visualized like a heat map. Further, the display image generation unit 350 displays the generated flow line analysis image on the monitor 450.
  • the report generation / output unit 360 is configured using, for example, a CPU, MPU, or DSP, and generates a flow line analysis report when a flow line analysis report generation instruction is input from the input device 400.
  • the report generation / output unit 360 displays the generated flow line analysis report on the monitor 450.
  • FIG. 6 is a diagram showing an example of a flow line analysis image showing a visitor's behavior pattern.
  • a shopping cart icon 180 a visitor 152 icon 181, a trajectory 185 through which the shopping cart passes, and a trajectory 186 through which the visitor 152 passes are added to the background image 176. It is superimposed. Since the BLE transmission terminal 150 is attached to the shopping cart, the shopping cart is displayed as an icon 180. When the visitor 152 starts moving with the shopping cart in hand, a trajectory 185 is displayed along with the movement. On the other hand, when the visitor 152 has the BLE transmission terminal 150 itself or a portable terminal having the function of the BLE transmission terminal 150, an icon 181 indicating the visitor is displayed.
  • a trajectory 186 is displayed accordingly. Further, when it is desired to know the details of the visitor 152, detailed information is displayed by designating the locus 186 and performing a predetermined operation (for example, by clicking with the mouse). For example, a recorded video of the corresponding date and time is reproduced, and a face photograph of the visitor 152 appears on the icon 181. FIG. 6 shows a state where a facial photograph of the visitor 152 appears. By viewing the playback video, the gender and estimated age of the visitor 152 can be confirmed.
  • the behavior trajectory of only the visitor 152 can be grasped even in a store where the employee 151 and the visitor 152 are mixed. And since the action locus
  • the server device 300 has three functions for performing icon display, locus display, and the like. The three functions are listed below.
  • Action pattern display function (time zone) ⁇ Draw a behavior pattern for a specified time period. ⁇ Draw an icon to show what action pattern.
  • the icons are “visitor” and “shopping basket” as described above.
  • Action locus display function (time zone) Transactions-A start position and an end position are set in advance, and when a shopping cart moves to the corresponding location, for example, the start position and the end position are saved, and one transaction is recognized and recorded. -By drawing only one transaction in a specified time period, only the action trajectory of a specific visitor can be drawn accurately.
  • Function (3) Clicking the playback link / action trajectory can play back the recorded video of the corresponding date and time of the camera device capturing the corresponding location.
  • the recorded video is recorded in the recorder 200, and the server device 300 accesses the recorder 200 when reproducing the recorded video.
  • FIG. 7 is a flowchart for explaining processing until the position information of the visitor 152 is grasped and the action trajectory of the visitor 152 is superimposed on the background image.
  • a background image an image obtained by deleting a person from a captured image
  • a camera device for example, the camera device 100
  • regular time slots for example, every 15 minutes
  • the camera device 100 generates a background image and temporarily holds it, and then transmits the background image to the server device 300.
  • the camera device 100 acquires the location information of the visitor 152 and transmits it to the server device 300.
  • the server device 300 acquires the background image transmitted from the camera device 100, acquires the location information of the visitor 152, and stores it in the received information storage unit 340 (steps S2 and S3).
  • the display image generation unit 350 of the server device 300 refers to the reception information storage unit 340, and acquires the background image of the date and time designated by the user and the location information of the visitor 152 (step S5).
  • the display image generation unit 350 acquires the background image of the date and time designated by the user and the position information of the visitor 152, and then generates a flow line analysis image in which the flow line information of the visitor 152 is superimposed on the background image.
  • the display image generation unit 350 generates display information for performing an overlay display of an icon associated with a preset visitor 152 (step S6). Then, the generated flow line analysis image and icon are displayed on the monitor 450 (step S7).
  • FIG. 8 is a flowchart for explaining a transaction ID generation / termination process for superimposing the action locus of the visitor 152 on the background image.
  • FIG. 9 is a diagram for assisting in explanation of transaction ID generation / termination processing.
  • the transaction ID generation / termination process is performed by the display image generation unit 350 of the server device 300.
  • the display image generation unit 350 displays a store image on the monitor 450 (step S10).
  • an area for starting the transaction is set and displayed on the background image (step S11). That is, as shown in FIG. 9, the start position area 182 is displayed in the vicinity of the store entrance of the background image.
  • the setting of the area for starting the transaction is performed by the input device 400. Note that a plurality of transaction start position areas can be set. Further, in the area of the start position of the transaction, “start position” indicating the start position may be displayed as shown in the figure.
  • the display image generation unit 350 sets the transaction end position area and displays it on the background image (Step S1). S12). That is, as shown in FIG. 9, the end position area 183 is displayed near the register of the background image. A plurality of transaction end position areas can be set. Further, in the area of the transaction end position, “end position” indicating the end position may be displayed as shown.
  • the display image generation unit 350 sets the area 183 of the transaction end position and performs display on the background image
  • the shopping cart, cart, or mobile terminal attached with the BLE transmission terminal 150 is moved to the transaction start position. It is arranged in the area 182.
  • the display image generation unit 350 considers that a new transaction has occurred and assigns a transaction ID (Ste S13).
  • the display image generation unit 350 regards the transaction as being ended, resets the transaction ID, A state is reached (step S14). The processes in steps S13 and S14 are repeated until the business hours of the store end.
  • the BLE transmission terminal 150 is possessed by the customer 152, the BLE reception terminal 160 is installed in various places in the store, and the customer transmitted from the BLE transmission terminal 150 is transmitted.
  • the position information 152 is received by the BLE receiving terminal 160.
  • the camera device 100 images a store floor, repeatedly generates a background image of the captured image of the floor, and based on the location information of the visitor 152 received by the BLE receiving terminal 160, the visitor included in the captured image
  • the flow line information regarding the staying position or the passing position on the floor of the person 152 is acquired. Then, the generated background image and the acquired flow line information of the visitor 152 are transmitted to the server device 300 at every predetermined transmission cycle.
  • the server device 300 receives the background image transmitted from the camera device 100 and the flow line information of the visitor 152, and uses the flow line information of the visitor 152 as a trajectory of action to superimpose the flow line analysis image on the background image. 175 is generated, and the generated flow line analysis image 175 is displayed on the monitor 450.
  • the behavior trajectory of only the visitor 152 can be grasped even in the store where the employee 151 and the visitor 152 are mixed. And since the action locus
  • privacy can be protected by using a background image obtained by removing a person from a captured image obtained by capturing with the camera device 100.
  • the bird's-eye view of the correlation between the layout change and the visitor's 152 action trajectory can be obtained.
  • FIG. 10 is a block diagram illustrating in detail a functional internal configuration of a camera device 100S according to a modification of the present embodiment.
  • the camera device 100S shown in FIG. 10 includes an imaging unit 10, an image input unit 20, a background image generation unit 30, a flow line information analysis unit 40, a schedule management unit 50, a transmission unit 60S, and an event information reception unit. 70, a background image storage unit 80, a passage / staying analysis information storage unit 90, a display image generation unit 350S, a visitor information acquisition unit 170, and a visitor pass / stay analysis information storage unit 171.
  • the display image generation unit 350S stores the background image stored in the background image storage unit 80 and the visitor pass / stay analysis information storage unit 171 in response to an instruction from the schedule management unit 50 or the event information reception unit 70.
  • the flow line analysis image is generated using the flow line information regarding the staying position or the passing position in the imaging area of the visitor and is output to the transmission unit 60S. That is, the display image generation unit 350S generates a flow line analysis image superimposed on the background image of the captured image using the visitor's flow line information as an action trajectory, and outputs the generated flow line analysis image to the transmission unit 60S.
  • display image generation unit 350S outputs a visitor's flow line information icon (icon of shopping cart, cart, portable terminal, visitor, etc.) to transmission unit 60S.
  • the transmission unit 60S transmits the flow line analysis image and the icon generated by the display image generation unit 350S to the server device 300.
  • the camera device 100S generates the background image of the captured image in the predetermined imaging area, and based on the output of the BLE receiving terminal 160, the imaging area of the visitor included in the captured image
  • the flow line analysis is obtained by using the background image and the visitor's flow line information as the action trajectory and superimposing on the background image of the captured image using the background image and the visitor's flow line information. Generate an image.
  • the behavior trajectory of only the visitor 152 can be grasped even in a store where the employee 151 and the visitor 152 are mixed. And since the action locus
  • the camera device 100S executes the process up to the generation process of the flow line analysis image and transmits the flow line analysis image as the generation result to the server apparatus 300, for example, when the processing load on the server apparatus 300 is considerably high, the camera apparatus 100S Since it is not necessary for the server apparatus 300 to execute the line analysis image generation process, an increase in the processing load of the server apparatus 300 can be suppressed.
  • a background image in which a person is deleted from a captured image obtained by capturing with a camera device is used, but privacy is not considered.
  • a captured image that is, a captured image that does not erase a person may be used as a background image.
  • the visitor 152 may simply have the visitor identification information (for example, a color barcode described later) or be attached to a use item used in the store, and therefore the BLE transmission terminal 150 may not be provided. Therefore, the convenience of the customer 152 when using the store is improved.
  • the visitor identification information for example, a color barcode described later
  • FIG. 11 is a block diagram showing in detail the respective functional internal configurations in a modification of the camera device 100 and the server device 300 shown in FIG.
  • the same components as those of the camera device 100 and the server device 300 illustrated in FIG. explain.
  • the video transmission unit 60V transmits the data of the captured image output from the image input unit 20 (for example, video data of the floor in the store captured by the camera device 100V) to the server device 300V.
  • the video transmission unit 60V is configured separately from the transmission unit 60 in the camera device 100V, but the video transmission unit 60V may be configured integrally with the transmission unit 60. In other words, the transmission unit 60 may transmit the captured image data output from the image input unit 20 to the server device 300V.
  • the video reception unit 330V receives the captured image data transmitted from the video transmission unit 60V and outputs the data to the visitor flow line information generation processing unit 370.
  • the video receiving unit 330V may be configured integrally with the receiving unit 330.
  • the receiving unit 330 may receive the captured image data transmitted from the video transmission unit 60V and output it to the visitor flow line information generation processing unit 370.
  • the visitor flow line information generation processing unit 370 performs image processing for each frame of the captured image data based on the captured image data output from the video reception unit 330V and is held by the visitor 152 or the visitor Visitor identification information attached to the 152 usage items is detected and extracted.
  • the visitor flow line information generation processing unit 370 as an example of the visitor flow line extraction unit temporally extracts the visitor identification information extracted for each frame over the number of frames of the captured image data output from the video reception unit 330V.
  • the flow line information (hereinafter referred to as “customer flow line information”) relating to the staying position or passing position on the floor of the customer 152 in the store is generated and extracted.
  • the visitor flow line information generation processing unit 370 stores the visitor flow line information in the reception information storage unit 340.
  • the display image generation unit 350 reads the background image data and the visitor flow line information of the visitor 152 from the reception information storage unit 340 and superimposes the visitor flow line information of the visitor 152 on the background image data. Generate an analysis image.
  • the display image generation unit 350 displays display information (for example, see FIG. 6) in which an icon corresponding to the set visitor 152 that is stored in advance in a memory in the server device 300V (not shown) is overlaid on the flow line analysis image. ) Is generated. Further, the display image generation unit 350 as an example of the display control unit causes the monitor 450 to display the flow line analysis image and the icon indicating the visitor 152 so as to be associated with each other.
  • the BLE transmission terminal 150 is carried by a visitor 152 or attached to a use item (for example, a shopping basket or a cart) when the visitor 152 uses the store, and further, BLE transmission is performed.
  • a BLE receiving terminal 160 for receiving a signal transmitted from the terminal 150 (that is, location information of the floor of the customer 152 in the store) was provided. That is, in the flow line analysis system shown in FIG. 3, in order for the camera apparatus 100 to acquire the location information of the floor in the store of the visitor 152, a special transmitter and receiver (that is, the BLE transmission terminal 150 and the BLE reception). Terminal 160) was required.
  • the visitor identification information represented by a color barcode is carried by the visitor 152, or is attached to a use item when the visitor 152 uses the store.
  • the server device 300V detects and extracts store visitor identification information (for example, a color barcode) from the frame of the captured image data transmitted from the camera device 100V by image processing, and temporally extracts an extraction result corresponding to the number of frames. By connecting, the flow line information of the visitor 152 is generated and extracted.
  • the color barcode is identifiable information composed of a plurality of color patterns using various colors such as cyan, magenta, yellow, and black (CMYK).
  • CMSYK cyan, magenta, yellow, and black
  • the visitor flow line information generation processing unit 370 determines the detection position of the color barcode in the captured image data composed of a plurality of frames. Is generated as store visitor flow line information relating to the staying position or passing position of the visitor 152 corresponding to.
  • the server apparatus 300V transmits from the camera apparatus 100V without requiring a special transmitter and receiver such as the BLE transmitting terminal 150 and the BLE receiving terminal 160. By performing image processing on the captured image data, it is possible to accurately generate and extract visitor flow line information regarding the staying position or passing position of the floor of the customer 152 in the store.
  • FIG. 12 is a flowchart for explaining the process from extracting the visitor flow line information to superimposing the visitor flow line information on the background image as an action trajectory in the camera apparatus 100V and the server apparatus 300V shown in FIG. is there.
  • the processes in steps S21 to S23 and the processes in steps S24 to S26 are performed in parallel in time. In other words, steps S24 to S26 are not performed before or after steps S21 to S23.
  • the camera device 100 ⁇ / b> V periodically and repeatedly generates a background image (that is, an image in which a person appearing within the angle of view is erased from the captured image) corresponding to the captured image in the imaging area (for example, a store floor). To do.
  • the camera device 100V temporarily stores the generated background image data in the background image storage unit 80 in the camera device 100 in a regular time period (for example, every 15 minutes) (step S21).
  • the camera device 100V extracts and generates the flow line information of the moving body including the visitor 152 in the frame of the captured image for each frame of the captured image data in the imaging area (for example, the floor of the store).
  • the camera device 100V temporarily holds the generated movement line data of the moving body in the passage / staying analysis information accumulation unit 90 in the camera device 100 in a regular time period (for example, every 15 minutes) (step S22).
  • the camera device 100V transmits the data of the background image temporarily stored in step S21 and step S22 and the flow line information of the moving body to the server device 300V.
  • the server device 300V receives the background image data and the movement line information of the moving body transmitted from the camera device 100V and stores them in the reception information storage unit 340 (step S23).
  • the camera device 100V images an imaging area (for example, a store floor), and transmits captured image data (that is, video of the imaging area) to the server device 300V (step S24).
  • captured image data that is, video of the imaging area
  • the server device 300V performs image processing for each frame of the captured image data based on the captured image data transmitted from the camera device 100V, and is carried by the visitor 152 or attached to the use object of the visitor 152.
  • the customer identification information (for example, color barcode) is detected and extracted.
  • the server device 300V temporally connects the visitor identification information extracted for each frame over the number of frames of the captured image data, so that the flow line information about the stay position or the passage position on the floor in the store of the visitor 152 (Customer flow line information) is generated and extracted (step S25).
  • the server device 300V stores the generated visitor flow line information in the reception information storage unit 340 (step S26).
  • step S27 A date and time for which a flow line analysis is desired is designated (step S27). 3 and 11, the arrows between the input device 400 and the display image generation unit 350 are not shown in order to avoid complication of the drawings.
  • the display image generation unit 350 of the server device 300 refers to the reception information storage unit 340, and obtains the background image data and the visitor flow line information of the visitor 152 specified by the user. Obtain (step S28).
  • the display image generation unit 350 obtains the background image data of the date and time specified by the user and the visitor flow line information of the visitor 152, and then superimposes the visitor flow line information of the visitor 152 on the background image. A flow line analysis image is generated. Further, the display image generation unit 350 generates display information for performing an overlay display of an icon associated with a preset visitor 152 (step S29). Then, the display image generation unit 350 displays the generated flow line analysis image and the icon on the monitor 450 so as to be associated with each other (step S30).
  • FIG. 13 is a block diagram showing in detail a functional internal configuration in a modification of the camera device 100S shown in FIG.
  • the same components as those of the camera device 100 ⁇ / b> S illustrated in FIG. 10 are denoted by the same reference numerals, description thereof is omitted, and different contents are described.
  • the visitor flow line information generation processing unit 370SV performs image processing for each frame of the captured image data based on the captured image data output from the image input unit 20, and is held by the visitor 152 or the visitor Visitor identification information attached to the 152 usage items is detected and extracted.
  • the visitor flow line information generation processing unit 370SV as an example of the visitor flow line extraction unit temporally outputs the visitor identification information extracted for each frame over the number of frames of the captured image data output from the image input unit 20.
  • the flow line information (visitor flow line information) regarding the staying position or the passing position on the floor of the customer 152 in the store is generated and extracted.
  • the visitor flow line information generation processing unit 370SV stores the visitor flow line information in the visitor pass / stay analysis information storage unit 171SV.
  • the visitor pass / stay analysis information storage unit 171SV is configured by using, for example, a flash memory or a hard disk, and stores the visitor flow line information of the visitor 152 generated by the visitor flow line information generation processing unit 370SV. Similarly, the visitor passing / staying analysis information accumulating unit 171 shown in FIG. 3 and FIG.
  • the display image generation unit 350SV reads the visitor flow line information of the visitor 152 from the visitor pass / stay analysis information storage unit 171SV, and further reads the background image data from the background image storage unit 80.
  • the display image generation unit 350SV generates a flow line analysis image in which the visitor flow line information of the visitor 152 is superimposed on the background image. Further, the display image generation unit 350SV displays display information (for example, a diagram) in which an icon corresponding to the set visitor 152, which is stored in advance in a memory in the camera device 100SV (not shown), is overlaid on the flow line analysis image. 6).
  • the transmission unit 60SV transmits the flow line analysis image generated by the display image generation unit 350SV or the data of the flow line analysis image on which the icon indicating the visitor 152 is superimposed to the server device 300.
  • the server device 300V is possessed by the visitor 152 based on the captured image data transmitted from the camera device 100V. Alternatively, it detects and extracts visitor identification information (for example, a color barcode) attached to the usage of the visitor 152.
  • the server apparatus 300V generates the visitor flow line information of the visitor 152 by temporally connecting the extracted visitor identification information over the number of frames of the captured image data, and the visitor flow line information is generated.
  • a flow line analysis image superimposed on the background image is generated and displayed on the monitor 450.
  • the flow line analysis system including the camera device 100V and the server device 300V shown in FIG. 11 is designed to protect the privacy of the visitor 152 while protecting the privacy of the visitor 152 in a store where the visitor 152 and the employee 151 are mixed.
  • the action trajectory of 152 can be accurately grasped, and an accurate flow line analysis image obtained by superimposing staying information or passing information of a person (for example, a visitor 152) on a background image updated at a predetermined timing by a layout change or the like can be obtained. Can be generated.
  • the camera device 100V extracts the moving body flow line information of the moving body including the visitor 152 included in the captured image of the store floor that is the imaging area.
  • the server apparatus 300V generates a moving line analysis image in which the moving body flow line information of the moving body transmitted from the camera apparatus 100V and the visitor flow line information of the visitor 152 extracted by the server apparatus 300V are superimposed on the background image.
  • the server device 300V is capable of confirming on the background image the flow line information of the moving body (including both the employee 151 and the visitor 152) appearing on the floor of the store and the flow line information of the visitor 152.
  • a line analysis image can be generated, and evidence image data contributing to user marketing can be obtained.
  • the server device 300V uses the color barcode as the store visitor flow line information, so that the server device 300V has the BLE transmission terminal 150 and the BLE reception terminal 160 shown in FIG.
  • the customer visits the store or the passing position of the floor in the store of the visitor 152 by performing image processing on the data of the captured image transmitted from the camera device 100V without requiring a special transmitter and receiver as described above.
  • Customer flow line information can be accurately generated and extracted.
  • the server device 300V generates a flow line analysis image in which the visitor 152 or an icon indicating the visitor 152 uses is superimposed on the background image.
  • the server device 300V allows the user to accurately grasp the flow line situation in the store floor for the visitor 152 (for example, an important customer such as a customer) who is a specific target of interest. it can.
  • the camera device 100SV In the flow line analysis system including the camera device 100SV shown in FIG. 13, the camera device 100SV generates a background image of the captured image in the imaging area and detects the visitor identification information of the visitor 152 included in the captured image. And extract.
  • the camera device 100SV acquires flow line information related to the stay position or the passing position, and uses the background image and the flow line information of the visitor to superimpose the flow line information of the visitor on the background image of the captured image as an action trajectory.
  • the flow line analysis image is generated and transmitted to a server device (for example, the server device 300 shown in FIG. 3) that displays the flow line analysis image on the monitor 450.
  • the camera device 100SV can generate a flow line analysis image that can grasp the behavior trajectory of only the visitor 152 even in a store where the employees 151 and the visitor 152 are mixed.
  • the behavior trajectory of only the visitor 152 can be grasped, the marketing information can be grasped easily.
  • the camera device 100SV can protect the privacy of the person who appears in the imaging area by using the background image obtained by removing the person from the captured image obtained by imaging.
  • the layout change such as a display in the store, the correlation between the layout change and the action trajectory of the visitor 152 can be overlooked.
  • the camera device 100SV executes the generation processing of the flow line analysis image and transmits the flow line analysis image as a generation result to the server device 300, for example, when the processing load on the server device 300 is considerably high, Since it is not necessary for the server apparatus 300 to execute the line analysis image generation process, an increase in the processing load of the server apparatus 300 can be suppressed.
  • the present disclosure has an effect of being able to grasp the behavior trajectory of a visitor while protecting privacy in a store where visitors and employees are mixed, and has a background image updated at a predetermined timing.
  • the present invention is useful as a flow line analysis system, a camera device, and a flow line analysis method for generating an accurate flow line analysis image in which human residence information or passage information is superimposed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Finance (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)

Abstract

La présente invention permet à des trajectoires d'action de visiteurs d'être déterminées tout en protégeant la confidentialité des visiteurs dans un magasin où les visiteurs et les employés sont mélangés. Un dispositif de caméra (100), lors de la capture d'une image d'un sol de magasin, génère de manière répétée une image d'arrière-plan pour l'image capturée du sol, et acquiert des informations de ligne de flux concernant des positions d'immobilité sur le sol ou des positions de passage des visiteurs compris dans l'image capturée sur la base d'informations de position de visiteur qui sont reçues par un terminal de réception basse fréquence Bluetooth (160). Le dispositif de caméra (100) transmet l'image d'arrière-plan générée et les informations de ligne de flux de visiteurs acquises à un dispositif de serveur (300) dans chaque période de transmission prédéterminée. Le dispositif de serveur (300), lors de la réception de l'image d'arrière-plan et des informations de ligne de flux de visiteurs transmises à partir du dispositif de caméra (100), génère une image d'analyse de ligne de flux dans laquelle les informations de ligne de flux de visiteurs sont superposées sous la forme de trajectoires d'action sur l'image d'arrière-plan, et amène l'image d'analyse de ligne de flux générée à être affichée sur un dispositif de surveillance (450).
PCT/JP2016/001686 2015-05-29 2016-03-23 Système d'analyse de ligne de flux, dispositif de caméra et procédé d'analyse de ligne de flux WO2016194275A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2015-110225 2015-05-29
JP2015110225A JP5909709B1 (ja) 2015-05-29 2015-05-29 動線分析システム、カメラ装置及び動線分析方法
JP2015151075A JP5909712B1 (ja) 2015-07-30 2015-07-30 動線分析システム、カメラ装置及び動線分析方法
JP2015-151075 2015-07-30

Publications (1)

Publication Number Publication Date
WO2016194275A1 true WO2016194275A1 (fr) 2016-12-08

Family

ID=57440392

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/001686 WO2016194275A1 (fr) 2015-05-29 2016-03-23 Système d'analyse de ligne de flux, dispositif de caméra et procédé d'analyse de ligne de flux

Country Status (1)

Country Link
WO (1) WO2016194275A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018131214A1 (fr) * 2017-01-13 2018-07-19 パナソニックＩｐマネジメント株式会社 Dispositif et procédé de prédiction
JP2018128895A (ja) * 2017-02-09 2018-08-16 富士電機機器制御株式会社 支援システム、支援装置、支援方法及びプログラム
WO2019135754A1 (fr) * 2018-01-04 2019-07-11 Xinova, LLC Augmentation de trajectoire d'objet sur un flux vidéo nouvellement affiché
CN112001232A (zh) * 2020-07-09 2020-11-27 北京北大千方科技有限公司 含个体特征的机场客流出行链精准感知装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
TAIKI YAMAMOTO: "Sports Eizo deno Shudan Ryoiki Suitei to Sebango Ninshiki o Mochiita Senshu Tsuiseki Oyobi Shikibetsu", SSII2013 THE 19TH SYMPOSIUM ON SENSING VIA IMAGE INFORMATION KOEN RONBUNSHU, June 2013 (2013-06-01), pages IS 3 - 26-1 to IS 3-26-4 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018131214A1 (fr) * 2017-01-13 2018-07-19 パナソニックＩｐマネジメント株式会社 Dispositif et procédé de prédiction
JPWO2018131214A1 (ja) * 2017-01-13 2019-01-17 パナソニックＩｐマネジメント株式会社 予測装置及び予測方法
JP2018128895A (ja) * 2017-02-09 2018-08-16 富士電機機器制御株式会社 支援システム、支援装置、支援方法及びプログラム
JP7011801B2 (ja) 2017-02-09 2022-01-27 株式会社アットソリューションズ 支援システム、支援装置、支援方法及びプログラム
WO2019135754A1 (fr) * 2018-01-04 2019-07-11 Xinova, LLC Augmentation de trajectoire d'objet sur un flux vidéo nouvellement affiché
CN112001232A (zh) * 2020-07-09 2020-11-27 北京北大千方科技有限公司 含个体特征的机场客流出行链精准感知装置
CN112001232B (zh) * 2020-07-09 2023-10-13 北京北大千方科技有限公司 含个体特征的机场客流出行链精准感知装置

Similar Documents

Publication Publication Date Title
WO2016002173A1 (fr) Système d'analyse de ligne de flux, dispositif de caméra et procédé d'analyse de ligne de flux
US10956722B2 (en) Moving information analyzing system and moving information analyzing method
US10602080B2 (en) Flow line analysis system and flow line analysis method
US10546199B2 (en) Person counting area setting method, person counting area setting program, moving line analysis system, camera device, and person counting program
JP6268498B2 (ja) 警備システム及び人物画像表示方法
WO2016194275A1 (fr) Système d'analyse de ligne de flux, dispositif de caméra et procédé d'analyse de ligne de flux
JP6268497B2 (ja) 警備システム、及び人物画像表示方法
WO2016203678A1 (fr) Système d'analyse de ligne de flux et procédé d'affichage de ligne de flux
JP5909712B1 (ja) 動線分析システム、カメラ装置及び動線分析方法
JP5909709B1 (ja) 動線分析システム、カメラ装置及び動線分析方法
JP2017123026A (ja) 動線分析システム及び動線分析方法
WO2016189785A1 (fr) Système d'analyse de files de circulation, dispositif de caméra et procédé d'analyse de files de circulation
JP6485707B2 (ja) 動線分析システム及び動線分析方法
JP5909710B1 (ja) 動線分析システム、カメラ装置及び動線分析方法
JP6439934B2 (ja) 動線分析システム、カメラ装置、動線分析方法及びプログラム
WO2017029779A1 (fr) Système de sécurité, procédé d'affichage d'image de personne, et procédé de création de rapport
WO2023162016A1 (fr) Système de surveillance, dispositif de surveillance, procédé de surveillance et support d'enregistrement
JP6268496B2 (ja) 警備システム及び画像表示方法
JP6421936B2 (ja) 動線分析システム及び動線分析方法
JP6421937B2 (ja) 動線分析システム及び動線分析方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16802723

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16802723

Country of ref document: EP

Kind code of ref document: A1