JP2003256843A - Measurement system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To measure and analyze the spatial tendency of a person which used to be difficult to measure by image-processing a video obtained by automatically tracing and photographing all persons in a prescribed range by an arranged camera, and to output the result in easily understandable configurations in order to utilize it as marketing information valid for the change of store layout or the like. <P>SOLUTION: This measurement system is provided with an image pickup means having a camera for photographing a prescribed range, an analyzing means having an image processor and an analytic data storing device, and a display means having a display device for working and displaying the analytic data to be outputted by the analyzing means in desired configurations. The image processor is provided with a person tracking part for tracking a person in a store on the basis of a video, a traffic line data storing part for storing the traffic line result as the traffic line data of the person, and a data processing part for analyzing and working the traffic line data in desired configurations. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a measuring system.

[0002]

2. Description of the Related Art Conventionally, in stores such as convenience stores, shops such as supermarkets, restaurants such as restaurants, coffee shops, bars and the like, POS (Point of Point)
By introducing a system such as f Sales) and inputting information such as sales amount, sales item, sales date and time into the POS terminal as the terminal using an input device such as a bar code reader, The customer trend is measured, and the customer trend in the store is analyzed based on the measurement result.

In this case, when the customer pays the price of the purchased product at the cash register, the salesclerk of the store simply reads the bar code attached to the product or the order voucher with a bar code reader to obtain the sales amount and sales. Information such as items and sales dates and times are automatically measured and automatically transmitted to a computer that controls the entire system. Then, the computer automatically analyzes the trend of the customer measured with respect to sales amount, sales item, sales date and time in the store.

Further, if necessary, by manually counting the number of customers who visit the store and checking the state of the customers, such as by a store clerk or a part-time worker, the trend of the customers in the store can be more accurate. Can be measured.

Thus, it is possible to analyze the customer movements in the store in detail and obtain marketing information useful for operating the store.

[0006]

However, in the above-mentioned conventional system, although it is possible to measure the customer trend regarding the product purchased by the customer and the ordered service, the customer does not purchase the product or orders the service. It was not possible to measure customer trends for customers who did not. In addition, it is not possible to measure the trajectory of the customer in the store. Therefore, by analyzing the trends of all customers in the store,
I couldn't get any truly useful marketing information to run a store.

Of course, it is possible to manually count the number of customers visiting the store or check the state of the customers manually by a clerk or a part-time worker, but in this case,
In order to measure the trends of all customers who visit the store, an extremely large number of manpower is required, resulting in high labor costs. Therefore, normally, the trend of the customer is limited to being measured by dividing the time zone or narrowing down the customers to be measured, that is, by conducting the sampling survey. In this case, it is not possible to accurately measure the trends of all customers.

Further, the analyzed trends of customers are simply output in a state in which numbers are listed. Therefore, the person who operates the store cannot intuitively grasp the trend of the customer, and it is difficult to appropriately reflect the analyzed trend of the customer as marketing information in the operation of the store. .

The present invention solves the above-mentioned conventional problems,
All the people within a specified range are automatically tracked by the provided cameras, and the video images taken are image-processed to measure and analyze the spatial trends of people, which was difficult to measure in the past. At the same time, it is an object of the present invention to provide a measurement system that can be utilized as useful marketing information for changing the store layout, etc. by outputting in a form that can be easily grasped.

[0010]

To this end, in the measuring system of the present invention, a camera for photographing a predetermined range,
And an imaging means having a first video recording device for recording the captured video on a recording medium, and a second video recording device, an image processing device and an analysis data storage device for reading the video recorded on the recording medium. The image processing apparatus includes an analyzing unit provided and a display unit having a display device for processing and displaying the analysis data output by the analyzing unit in a desired form, and the image processing device is within the predetermined range based on the video. A person tracking unit that tracks a person, a flow line data storage unit that stores the result of tracking as the flow line data of the person, and a data processing unit that analyzes the flow line data and processes it into a desired form.

In another measuring system of the present invention, a camera for photographing within a predetermined range, an image pickup means provided with a video transmission device for compressing and transmitting the photographed video, an image processing device, and the image The analysis device includes an analysis data storage device that stores data output by the processing device, and a display device that includes a display device that processes and displays the analysis data output by the analysis device in a desired form. The processing device is a decoder that expands the compressed image received from the image capturing unit, a person tracking unit that tracks a person within the predetermined range based on the expanded image, and the tracking result is the movement line data of the person. A flow line data storage unit that stores the data and a data processing unit that analyzes the flow line data and processes the flow line data into a desired form are provided.

In still another measuring system of the present invention, a camera for photographing a predetermined range, an image pickup means having a first image recording device for recording the photographed image on a recording medium, and the recording medium are provided. A display provided with an analysis means including a second video recording device for reading the recorded video, an image processing device and an analysis data storage device, and a display device for processing and displaying the analysis data output by the analysis device in a desired form. The image processing device includes an encoder that compresses the video and stores the video in the analysis data storage device, a person tracking unit that tracks a person within the predetermined range based on the video, and a tracking result. The display device is provided with a compressed flow line data storage unit that stores the flow line data of the person, and a data processing unit that analyzes the flow line data and processes it into a desired form. A decoder for expanding an image, an analysis data processing unit for processing the analysis data into a desired form, and an image in which the flow line data of the person synchronized with the expanded video is displayed as an overlay and combined with the processed analysis data. And a display combining unit for displaying.

In still another measuring system of the present invention, a camera for photographing within a predetermined range, an image pickup means having a video transmission device for compressing and transmitting the photographed video, an image processing device, and Analysis means including an analysis data storage device for storing the data output by the image processing device and the compressed video received from the image pickup means, and a display for processing and displaying the analysis data output by the analysis means in a desired form. A display unit having a device, and the image processing device tracks a person within the predetermined range based on the expanded image, the decoder expanding the compressed image stored in the analysis data storage device. A person tracking unit, a flow line data storage unit that stores the tracking result as the flow line data of the person, and a data processing unit that analyzes the flow line data and processes it into a desired form. The display device includes a decoder for expanding the compressed video, an analysis data processing unit for processing the analysis data into a desired form, and an overlay display of the flow line data of the person synchronized with the expanded video. A display combining unit is provided that combines and displays the image with the processed analysis data.

In still another measuring system of the present invention, the display synthesizing unit further displays the image in which the flow line data is accumulated so as to be synchronized with the reproduction of the video imaged in the set time period. To generate.

In still another measuring system of the present invention, the data processing unit further calculates the number of visitors, the number of persons leaving the store, and the number of opportunity losses based on the flow line data.

In still another measuring system of the present invention, the data processing unit further measures the seating time and the leaving time of each seat within the predetermined range based on the flow line data, and the display device. Sets an arbitrarily set set of seats as a table, sets an arbitrarily set set of the table as an area, and based on the seating time and leaving time of each seat, the seat, the table, and While calculating and displaying the occupancy rate and rotation speed for each area,
Calculate and display the group rate for a table that can be used by multiple people at the same time.

In still another measurement system of the present invention, the display device further generates and displays an image in which the flow line data is accumulated in a set time section.

In still another measuring system of the present invention, the display device further includes: the layout of the seat, the table and the area, the occupancy rate and the rotational speed of each of the seat, the table and the area, and the set value. Images with accumulated flow line data in the time interval are displayed simultaneously.

[0019]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a diagram showing the configuration of a measuring system according to the first embodiment of the present invention.

As shown in the figure, the measuring system includes an image pickup means 1 for taking an image of a predetermined area such as a store.
0, an analysis unit 20 for analyzing the image captured by the image pickup unit 10, and a display unit 30 for displaying the analysis result via the network 40. The image capturing means 10 includes a camera 11 installed in a store or the like, and
A video recording device 12 for recording the video of the camera 11 is provided. The camera 11 and the video recording device 12 may each be single or plural. That is, the camera 11 and the video recording device 12 may be any number as long as they are one or more, but here, the camera 11 includes two cameras 11a and 11b, and two video recording devices 12 are provided. The case of including the video recording device 12a and the video recording device 12b will be described.

The measuring system according to the present embodiment automatically processes all the persons such as customers who visit the store by the camera 11 arranged in the store to perform image processing on the images captured by the persons. The spatial trend of is measured and analyzed, and is output in a form that can be easily grasped. Thereby, the person who operates the store can utilize it as marketing information useful for changing the store layout and the like.

The above-mentioned stores are, for example, stores of commercial facilities such as convenience stores, supermarkets, department stores, home centers, shopping centers, etc., restaurants of restaurants, etc. Good. Furthermore, the measurement system is
It can be applied to any facility other than stores, for example, financial institutions such as banks and credit unions, railway stations, railway vehicles, underpasses, buses, transportation facilities such as airfields, theaters, theme parks, and amusement parks. Recreational facilities such as places, hotels, lodging facilities such as inns, schools, public facilities such as government offices, individual housing, housing facilities such as collective housing, entrance halls for general structures, inside buildings such as elevators, construction sites, factories It is a work facility such as a museum, an exhibition facility such as a museum, an exhibition hall, etc., but may be any other type of facility. In this case, the measurement system can measure the movement of a person such as a customer in various facilities. In the present embodiment, for convenience of explanation, a case where the measurement system is applied to a store will be described.

In this case, the store may be operated independently or may be operated as a store belonging to a store organization such as a chain store. In addition, the person who operates the store may be any person such as an individual, a company, or a group.

Then, the person who operates the measurement system concludes a contract with the person who operates the store in advance,
The trend of customers who visit the store is measured and analyzed, and the result is provided to the person who operates the store. Further, the person who operates the measurement system may be any person such as an individual, a company, a group, etc., and may be the same person as the person who operates the store.

Here, as the camera 11, an industrial surveillance camera is generally used. However, as long as it has a function of taking a moving image as a surveillance image, even if it is a surveillance camera for a broadcast station, May be a video camera for
It may be in any form. In the present embodiment, the camera 11a and the camera 11b are ordinary television cameras, and photograph a predetermined range and output an analog video signal. Then, the video recording device 1
2a and video recording device 12b are also VCRs or DVs
It is a normally commercially available video device such as a D recorder, and is a device having a function of recording and reproducing video images captured by the cameras 11a and 11b on a recording medium, respectively.

Further, the camera 11 and the video recording apparatus 1
2 is arranged in the store. In the present embodiment, the case where the camera 11 and the video recording device 12 are arranged in a store such as a convenience store as a store or a restaurant such as a cafeteria or a restaurant will be described.

The analyzing means 20 is the image pickup means 10.
A video recording device 21 for reproducing the video image captured and recorded by the image processing device 22, for processing the reproduced video image,
An analysis data storage device 23 for storing the processing result as analysis data and storing the processing result is provided with a storage unit such as a semiconductor memory and a magnetic disk. The video recording device 21, like the video recording device 12a and the video recording device 12b, is a commercially available video device such as a VCR or a DVD recorder.
It is a device having a function of recording and reproducing images captured by a and the camera 11b on a recording medium, respectively. Further, the display means 30 is a CRT for processing and displaying the analysis data stored in the analysis data storage device 23.
Display device 3 such as liquid crystal display and LED display
1 is provided. The display device 31 is used by a person who operates a store as a user (analysis request source) of the measurement system.

The analyzing means 20 may be arranged at any place, but it is generally arranged in an office, an operation room or the like of a person who operates the measurement system. Further, the display means 30 may be arranged in any place, but is arranged in an office, an operation room or the like of a person who operates the store so that the person who operates the store can easily use it. Is desirable.

Here, the image pickup means 10 and the analysis means 20.
Is not communicably connected, and the image captured and recorded by the image capturing means 10 is captured while being stored in a recording medium such as a semiconductor memory, a magnetic tape, a magnetic disk, a CD-ROM, or a DVD. Means 10 to analysis means 20
Be moved to. That is, the video imaged and recorded by the image capturing means 10 is transferred off-line from the image capturing means 10 disposed in the store to the analyzing means 20 disposed in the office, operation room, etc. of the person who operates the measurement system. It is supposed to be transferred.

Further, the display means 30 arranged in the office or operation room of the person operating the store, and the analysis data storage device arranged in the office, operation room or the like of the person operating the measurement system. The network 23 is communicatively connected to the network 23. Here, the network 40 is a wired or wireless dedicated communication line network, public communication line network, public telephone network, portable telephone network, Internet, intranet, LAN (Local Area) as long as it can perform data communication.
Network), WAN (Wide Area Ne)
network), VPN (Virtual Private)
e Network) or any type of network, or a combination of a plurality of types of networks as appropriate.

Next, the structure of the image processing device 22 will be described in detail.

FIG. 2 is a block diagram showing the arrangement of the image processing apparatus according to the first embodiment of the present invention.

As shown in FIG. 2, the image processing device 22
Includes a person tracking unit 22a, a flow line data storage unit 22b, and a data processing unit 22c. Here, the person tracking unit 22a is configured to execute a person extraction process S1 for extracting a person region from a video image and a person tracking process S2 for tracking a moving person.

In this case, the person extracting process S1 can be realized by, for example, a method based on background difference (see Japanese Patent Laid-Open No. 11-096376: Moving Object Tracking Device and Method). In addition, the person tracking process S2 is performed by, for example, a region matching method (“Moving Object”).
Detection and Event Reco
gnition Algorithms for Sm
art Cameras ", Thomas J. Ol.
son and Frank Z. Brill, Pr
oc. DARPA Image Understan
ding Workshop, pp. 159-175,
1997) or a template is created from a moving object area and template matching is used (see JP-A-11-096376: Moving Object Tracking Device and Method). Furthermore, the person extraction process S1 and the person tracking process S2 can also be executed (Japanese Patent Application No. 2001-145960: monitoring device, and
See Japanese Patent Application No. 2001-271162: Monitoring System and Method).

The flow line data storage unit 22b is composed of a storage means such as a semiconductor memory or a magnetic disk, and stores the trajectory of the person's movement obtained by the person tracking process S2, that is, the flow line.

Then, the data processing unit 22c analyzes the flow line data of the person stored in the flow line data storage unit 22b and processes the data into numerical data.
Is designed to run. In this case, the numerical data is stored in the analysis data storage device 23 as analysis data.

Next, the operation of the measuring system having the above structure will be described. Here, the case where the store is a restaurant equipped with a table and seats will be described.

FIG. 3 is a diagram showing an example of flow line data in the first embodiment of the present invention, and FIG. 4 is a number of visitors, a number of people leaving the store and a number of opportunity losses in the first embodiment of the present invention. FIG. 5 is a diagram showing an example of data of sitting time and leaving time for each seat in the first embodiment of the present invention, and FIG. 6 is a first embodiment of the present invention. FIG. 7 is a first diagram showing a display example of analysis data in FIG. 7, FIG. 7 is a second diagram showing a display example of analysis data in the first embodiment of the present invention, and FIG. 8 is a first embodiment of the present invention. 7 is a diagram showing a seat layout in FIG. 7, FIG. 9 is an enlarged view of a portion A of FIG. 7, and FIG. 9 is a diagram showing an example of an image in which a flow line of a visitor is accumulated according to the first embodiment of the present invention, and FIG. FIG. 10 is an enlarged view of a part, and FIG. 10 is a occupancy rate for each seat, table, and area in the first embodiment of the present invention and when in use A C part enlarged view of there 7 in table showing.

First, the cameras 11a and 11b of the image pickup means 10 automatically photograph a predetermined range in a store (not shown) and output analog video signals. The video recording device 12a and the video recording device 12b receive the analog video signals output from the cameras 11a and 11b, respectively, and record the video on a semiconductor memory, a magnetic tape, a magnetic disk, a CD-ROM, a DVD, or the like. Record on media.

Subsequently, the recording medium is manually taken out from the video recording device 12a and the video recording device 12b and transferred, and set in the video recording device 21 of the analyzing means 20. Then, the analyzing means 20 reproduces the video recorded on the recording medium by the video recording device 21, and the image processing device 22 performs the image processing of the reproduced video.

In this case, the person tracking section 22a executes a person extracting process S1 for extracting a person region from a video image and a person tracking process S2 for tracking a moving person. Then, the flow line data storage unit 22b stores the flow line of the person obtained by the person tracking process S2 as flow line data.

Here, the flow line data can be expressed as data as shown in FIG. 3, for example. In FIG. 3, time represents a cumulative time when the processing start time is 0. The ID is a number uniquely assigned to the person area in the video, and the person area of the same person continuously holds the same ID. Thereby, each person in the video can be identified by the ID. Further, the data of each person area is represented by a rectangular shape circumscribing the area, and the flow line of the person can be restored by connecting the coordinates indicating the center of gravity or the position of the feet of the person area in time series. .

Then, the data processing unit 22c analyzes the flow line data of the person stored in the flow line data storage unit 22b, and executes a data analysis / processing process S3 for processing into numerical data. As a result, for example, as shown in FIG. 4, the number of visitors, the number of persons leaving the store, and the number of opportunity losses are calculated and output, and stored in the analysis data storage device 23 as numerical data. Here, the number of visitors is the number of visitors per unit time (every 1 minute, etc.) from a certain reference time, and the number of people leaving the store is every unit time from a certain reference time (every 1 minute, etc.). ) Is the number of people leaving the store, and the number of opportunity losses is the number of people leaving the store per unit time (every 1 minute etc.) from a certain reference time without purchasing anything (without going through the cash register). The number of customers who made

Further, in the case of a store having a seat such as a restaurant,
For example, as shown in FIG. 5, the seating time and the leaving time for each seat are output and stored in the analysis data storage device 23 as numerical data. Here, the seat ID is a number uniquely assigned to each seat in the store. When the seating time and the leaving time are measured based on the flow line data, it is determined that the user is seated when the flow line data is retained for a predetermined time or longer within a preset seat area. Further, when the flow line data goes out of the seat area determined to be seated, it is determined that the user has left the seat.

Then, the processing result of the data analysis / modification processing S3 is accumulated and saved in the analysis data accumulating device 23 as analysis data. Subsequently, the display device 31 accesses the analysis data storage device 23 via the network 40, acquires the stored analysis data, and displays it on the screen. Access to the analysis data is protected so that only the display device 31 used by a user designated in advance can access it. For example, the user can access by entering a password or the like given to the user. As a result, it is possible to prevent the analysis data relating to the trends of customers in the store from being acquired by a person who operates another store.

In this case, when the user inputs a desired date, time and sampling interval (three minutes, five minutes, one hour, etc.), the analysis data at the designated time is downloaded to the analysis data storage device 23, Data is re-aggregated at designated sampling intervals, and as shown in FIG. 6, the number of visitors, the number of persons leaving the store, and the number of opportunity losses are bar graphs,
It is displayed on the display device 31 as a graph such as a line graph. The bar graph shown in FIG. 6 is an example when the sampling interval is designated as five minutes.

Further, the analysis data may be displayed on the display device 31, as shown in FIG.
In this case, on one screen, a diagram showing a layout of seats in a store (arrow A part), a diagram showing accumulation of a visitor's flow line (arrow B), and occupancy rate for each seat, table and area And a table (arrow C part) showing the usage time are displayed at the same time, so that the user can intuitively grasp the trend of the customer in the store and also accurately grasp the numerical value indicating the trend of the customer. be able to. Therefore, the user can easily and accurately grasp the spatial trend of the customer, which was difficult to grasp in the past, and the analysis data is used as marketing information useful for changing the store layout and the like. Can be utilized.

Here, in the diagram (arrow A portion) showing the layout of the seats in the store, as shown in FIG. 8, a unique ID number is given to each seat. The I
The D number is the same number as the seat ID shown in FIG.
Further, the table and the area can be arbitrarily set by the user. A unique ID number is assigned to the table and area as well as the seat.

In the table (arrow C part) showing the occupancy rate and usage time for each seat, table and area, FIG.
As shown in 0, the occupancy rate as the operating rate for each seat is calculated as the ratio of the total time when the seat is occupied to the total measurement time (for example, 5 hours). In this case, the occupancy rate for each seat is displayed numerically in correspondence with the ID of each seat, and a graph showing the occupancy time of the seat is displayed.

The occupancy rate as the operating rate of each table is displayed numerically at the top of the frame corresponding to each table, and a graph showing the occupancy time of the table is also displayed correspondingly. In FIG. 10, for example, the occupation rate of the table of ID = 1 in the area of ID = 1 is 77, ID =
The occupancy of the table of No. 2 is 40, and the occupancy of the table of ID = 3 is 80. The occupancy time of the table is the OR of the graphs representing the occupancy times of all seats belonging to the table. That is, when any one of the seats belonging to the table is occupied, the occupied time is measured as if the table was occupied. Then, the ratio of the occupied time to the total measurement time is the occupied ratio.

Further, the occupation rate as the operating rate for each area is displayed numerically at the top of the frame corresponding to each area,
Further, a graph showing the occupied time of the area is displayed correspondingly. In FIG. 10, for example, the occupation rate of the area with ID = 1 is 97. The occupation time of an area is the OR of graphs indicating the occupation times of all the tables belonging to the area. That is, if any one of all the tables belonging to the area is occupied,
The occupied time is measured as if the area was occupied. Then, the ratio of the occupied time to the total measurement time is the occupied ratio.

In addition to the operating rate, the number of rotations, which is the number of seats, tables, and areas used for a predetermined time or unit time, and the number of times two or more groups simultaneously used the number of rotations. It is also possible to calculate data such as a group rate that is a ratio (measurement is possible only in a table that can be used by two or more people at the same time).

Then, in the diagram (arrow B part) showing the accumulation of the flow line of the visitor, as shown in FIG. 9, an image in which the flow line of the person in the set time interval is accumulated is displayed. In this case, in the accumulated image, all pixels are initially initialized to the initial value 0 (white). Then, the flow line data of the person measured in the set time interval is extracted from the analysis data, and the value of the pixel corresponding to each extracted flow line is incremented by 1, for example. As a result, an image in which the flow line of the person in the set time section is accumulated is generated.

Here, in the diagram showing the accumulation of the flow lines of the visitors, it is shown that passages with light color and few line segments have little traffic, and passages with dark color and many line segments have many traffic. Shows. Furthermore, since the pixel value increases by a certain value when one person passes by, it is possible to calculate the number of people who pass each passage from the pixel value.

As described above, in this embodiment, the images in the store automatically taken by the cameras 11a and 11b are analyzed to measure the number of visitors, the number of customers who have left the store, the number of lost opportunities, and the like. Occupancy rate of seats from flow line data,
In addition, it is possible to measure spatial data that could not be acquired in the past, such as a table that can be arbitrarily set by the user, an operating rate of an area, a rotation speed, and a group rate, so that it is more useful. You can get marketing data.

Next, a second embodiment of the present invention will be described. In addition, about the thing and the same operation which have the same structure as 1st Embodiment, the description is abbreviate | omitted by giving the same code | symbol.

FIG. 11 is a diagram showing the configuration of a measuring system according to the second embodiment of the present invention, and FIG. 12 is the second embodiment of the present invention.
It is a figure which shows the structure of the image processing apparatus in embodiment of this.

In the present embodiment, the measuring system is
As shown in FIG. 11, the image captured by the image capturing unit 50 for capturing the inside of the store is transmitted via the network 45 in a compressed state, and the analyzing unit 60 expands and restores the image to perform image processing. As a result, it is possible to process the video of one day without the limitation of the recording medium. Further, it has a display means 30 for displaying the analysis result of the analysis means 60 via the network 40.
Like the network 40, the network 45 may be a wired or wireless dedicated communication line network, a public communication line network, a public telephone network, a form telephone network, the Internet, an intranet, as long as it can perform data communication. ,
It may be any type of network such as LAN, WAN, or VPN, or may be a combination of a plurality of types of networks as appropriate.

The image pickup means 50 comprises a video transmission device 52 for compressing and transmitting the video captured by the camera 11 installed in the store. The camera 11 and the video transmission device 52 may each be single or plural. That is, the camera 11 and the video transmission device 52 may be any number as long as they are one or more, but here, the camera 11 includes two cameras 11a and 11b, and the video transmission device 52 is A case where two video transmission devices 52a and 52b are provided will be described. Then, the video transmission device 52a and the video transmission device 52b perform image compression processing by a commonly used method such as MPEG4 format,
Analyzing means 6 for analyzing the video compressed via the network 45
It is designed to send to 0.

Further, the analyzing means 60 expands and restores the image compressed and transmitted from the image pickup means 50 to perform image processing, and the image processing device 62.
The analysis data storage device 23 is provided for storing the result of the analysis by. Here, as shown in FIG. 12, the image processing device 62 includes a person tracking unit 22a, a flow line data storage unit 22b, a data processing unit 22c, and a decoder 62d.
Equipped with. Then, the compressed video received from the image pickup means 50 is decompressed by the decoder 62d to be restored to the video before being compressed, and is transmitted to the person tracking unit 22a. The person tracking unit 22a, the flow line data storage unit 22b, the data processing unit 22c, and the analysis data storage device 23 are the same as those in the first embodiment, and the description thereof will be omitted.

Further, the network 40 and the display means 3
Since 0 is also the same as that in the first embodiment, description thereof will be omitted.

Next, the operation of the measuring system having the above configuration will be described.

First, the camera 11a and the camera 11b of the image pickup means 50 are ordinary television cameras, which photograph a predetermined range and output an analog video signal. Then, the video transmission device 52a and the video transmission device 52b perform image compression and transmit the compressed video to the analysis unit 60 via the network 45.

Therefore, in the first embodiment, since the video is once recorded on the recording medium, it is necessary to replace the recording medium at every maximum recording time of the recording medium. On the other hand, in the present embodiment, since it is not necessary to replace the recording medium, it is possible to continuously process a video for a long time (for example, one day), which is convenient. It is possible to improve the sex.
In the first embodiment, the recording medium is manually recorded by the video recording device 12a and the video recording device 1.
2b is taken out and transferred, and is set in the video recording device 21 of the analysis means 20, whereas in the present embodiment, it is not necessary to manually transfer the recording medium, so labor can be saved. .

Further, the analyzing means 60 restores the compressed image transmitted from the image pickup means 50 to the image before being expanded by the decoder 62d and compressed, and transmits it to the person tracking section 22a. Then, the reproduced image is processed in the person tracking unit 22a to generate the same analysis data as in the first embodiment. The operations of the person tracking unit 22a, the flow line data storage unit 22b, and the data processing unit 22c are the same as those in the first embodiment, so description thereof will be omitted.

Then, the result analyzed by the image processing device 62 is accumulated and stored in the analysis data accumulating device 23.
The operation of the display means 30 is also the same as in the first embodiment.

The analysis of the image data depends on the processing capacity of the image processing device 62, but if possible, one camera 11 is used.
Alternatively, it is desirable to allocate one image processing device 62 to each video transmission device 52.

As described above, in the present embodiment, the analyzing means 60 analyzes the photographed image via the network 45.
By transmitting to, the long-time video data can be analyzed seamlessly without being limited by the recording time of the recording medium as in the case of using the recording medium, and the convenience is significantly improved. be able to.

Next, a third embodiment of the present invention will be described. In addition, about the thing and the same operation which have the same structure as 1st and 2nd Embodiment, the description is abbreviate | omitted by giving the same code | symbol.

FIG. 13 is a view showing the arrangement of an image processing apparatus according to the third embodiment of the present invention, and FIG. 14 is the third embodiment of the present invention.
It is a figure which shows the structure of the display apparatus in the embodiment.

In this embodiment, by linking the image and the flow line data of the person, the movement of the person in the passage can be grasped. In this case, the configurations of the image processing device and the display device are different from those of the first and second embodiments. That is, as shown in FIG. 13, the image processing device 22 includes an encoder 22d.
Is provided. Further, the display device 31, as shown in FIG. 14, has an analysis data processing unit 31a, a decoder 31b,
Also, the display combining unit 31c is provided.

Next, the operation of the measuring system having the above configuration will be described.

FIG. 15 is a diagram showing a display example of analysis data in the third embodiment of the present invention, and FIG. 16 is a third example of the present invention.
FIG. 16 is a diagram showing a layout of a seat in the embodiment of the present invention, and FIG. 17 is an enlarged view of a portion D of FIG. 15, and FIG. 17 is a diagram showing an example of an image in which a flow line of a visitor is accumulated in the third embodiment of the present invention. FIG. 18 is an enlarged view of an E portion of FIG. 15, and FIG. 18 is an enlarged view of an F portion of FIG. 15, which is a table showing the occupancy rate and usage time for each seat, table, and area in the third embodiment of the present invention.

In this case, the operation of the image pickup means 10 is the same as that of the first embodiment, and therefore its explanation is omitted.

First, in the analyzing means 20, the camera 1
The video image captured by No. 1 is reproduced by the video recording device 21, and the video is processed by the image processing device 22 and analyzed. Here, the video reproduced by the video recording device 21 is
It is transmitted to the person tracking unit 22a and the encoder 22d.
The operations of the person tracking unit 22a, the flow line data storage unit 22b, and the data processing unit 22c are the same as those in the first embodiment, so description thereof will be omitted.

Further, the encoder 22d compresses the input video and stores the compressed video in the analysis data storage device 23. The video compression is realized by a commonly used compression method such as MPEG4 format.

When the video is compressed, a time code is added to each frame of the video. The time code is a time code based on the time when the image pickup means 10 starts shooting, and the shooting start time is externally given to the encoder 22d as a parameter. Note that the processing of the person tracking unit 22a and the encoder 2 are started.
It is assumed that the processing is started in synchronization with 2d.

The display means 30 is the network 4
The analysis data storage device 23 is accessed via 0 to obtain the stored analysis data and compressed video. In this case, the analysis data processing unit 31a processes the numerical data as the analysis data, and the decoder 31b expands and restores the compressed video. Subsequently, the display combining unit 31c
In step 15, the numerical data and the restored image are combined in a form desired by the user and displayed on the screen as shown in FIG.

In this case, on one screen, a diagram showing the layout of seats in the store (arrow D part), a diagram showing the accumulation of the flow line of the visitor (arrow E), and each seat, table and area Since the table showing the occupancy rate and the usage time (arrow F part) is displayed at the same time, the user can intuitively grasp the trend of the customer in the store, and the numerical value indicating the trend of the customer can be accurately determined. Can be grasped. Therefore, the user can easily and accurately grasp the spatial trend of the customer, which was difficult to grasp in the past, and the analysis data is used as marketing information useful for changing the store layout and the like. Can be utilized.

Here, in the diagram (arrow D part) showing the layout of the seats in the store, as shown in FIG.
A unique ID number is assigned to each seat. Further, the table and the area can be arbitrarily set by the user. A unique ID number is assigned to the table and area as well as the seat. Then, in the present embodiment, an image showing the layout of the seats in the store restored by the decoder 31b is displayed, and the analysis data processing unit 31a is displayed.
The flow line of the person (indicated by a thick line in FIG. 16) in the current image created in step 3 is displayed in overlay. Further, the image and the numerical data can be synchronized based on the time record. The analysis data is the first
As shown in FIG. 3 in the embodiment, even if the accumulated time from the start of processing and the time record of the image data are the shooting execution time, both processing start times are easy because they are synchronized. Can be synchronized.

Further, in the figure showing the accumulation of the flow line of the visitor (arrow E part), as shown in FIG. 17, an image in which the flow line of the person is accumulated from the time when the processing is started on the display device 31. Is displayed. In this case, in the accumulated image, all pixels are initially initialized to the initial value 0 (white). Then, in the accumulated image, the value of the pixel corresponding to the latest flow line (the flow line of the difference between the previous flow line and the current flow line) of the flow lines overlaid in FIG. It is generated by incrementing by 1.

Here, in the figure showing the accumulation of the flow line of the visitor, it is shown that there are few pedestrians in the passages that are light in color and the number of line segments is small, and there are many pedestrians in the passages that are dark and have many line segments. Shows. Furthermore, since the pixel value increases by a certain value when one person passes by, it is possible to calculate the number of people who pass each passage from the pixel value.

In the table (arrow portion F) showing the occupancy rate and the usage time for each seat, table, and area, FIG.
As shown in FIG. 8, the occupancy rate as the operating rate for each seat is calculated as the ratio of the total time when the seat is occupied to the total measurement time (for example, 5 hours). Further, the occupancy rate as the operation rate for each table and the occupancy rate as the operation rate for each area are calculated and shown. The seat, the table, and the table showing the occupancy rate and the usage time for each area are the same as those in the first embodiment.

The decoder 31b also has functions such as random access to the compressed video, fast-forward reproduction, etc., so that reproduction from an arbitrary time or data of one day can be reproduced in several tens of minutes or several hours. It is desirable to be able to. Further, similarly, the overlay-displayed flow line and the image in which the flow line is accumulated have a function of creating and displaying the flow line in accordance with the image reproduction time and the image reproduction speed.

As described above, in the present embodiment, the video is compressed and stored together with the analysis data obtained by analyzing the captured video, and the image and the analysis data are processed and combined into a form desired by the user during reproduction. It is designed to be displayed. Therefore, not only the numerical data but also the factors of the numerical data can be easily observed with an image, and more useful marketing data can be provided.

Next, a fourth embodiment of the present invention will be described. In addition, about the thing and the same operation which have the same structure as 1st-3rd embodiment, the description is abbreviate | omitted by giving the same code | symbol.

FIG. 19 is a diagram showing the configuration of the measuring system according to the fourth embodiment of the present invention, and FIG. 20 is the fourth embodiment of the present invention.
It is a figure which shows the structure of the image processing apparatus in embodiment of this.

In this embodiment, the measuring system is
By setting the image capturing means and the analyzing means online, all systems can be realized on the network.

As shown in FIG. 19, the measurement system includes an image pickup means 50 for photographing the inside of a store (not shown) with at least one or more cameras 11, an analysis means 60 for analyzing an image photographed by the image pickup means 50, And the display unit 30 for displaying the analysis result via the network 40.

The image pickup means 50 is provided with a video transmission device 52 for compressing and transmitting the video of the camera 11 installed in the store. The camera 11 and the video transmission device 52 may each be single or plural. That is, the camera 11 and the video transmission device 52
There can be any number as long as it is one or more, but here,
The camera 11 includes two cameras 11a and 11b.
And the video transmission device 52 includes two video transmission devices 5
2A and the video transmission device 52b will be described. Then, the video transmission device 52a and the video transmission device 52b perform image compression by a commonly used method such as MPEG4 format, and transmit the compressed video to the analysis means 60 via the network 45. It is like this.

The analyzing means 60 is the image pickup means 50.
An analysis data storage device 63 that stores the video that is compressed and transmitted from the image processing device 62 and that stores the result of analysis performed by the image processing device 62, and expands and processes the compressed video image that is stored in the analysis data storage device 63. The image processing device 62 is provided. Here, as shown in FIG. 20, the image processing device 62 includes a person tracking unit 22a and a flow line data storage unit 22.
b, a data processing unit 22c and a decoder 62d.
Then, the compressed video received from the image pickup means 50 is decompressed by the decoder 62d to be restored to the video before being compressed, and is transmitted to the person tracking unit 22a. Since the person tracking unit 22a, the flow line data storage unit 22b, and the data processing unit 22c are the same as those in the first embodiment, description thereof will be omitted.

Furthermore, the network 40 and the display means 3
Since 0 is also the same as that in the first embodiment, description thereof will be omitted.

Next, the operation of the measuring system having the above structure will be described.

First, the camera 11a and the camera 11b of the image pickup means 50 are ordinary television cameras, which photograph a predetermined range and output an analog video signal. Then, the video transmission device 52a and the video transmission device 52b perform image compression and transmit the compressed video to the analysis unit 60 via the network 45.

Therefore, in the first embodiment, since the video is once recorded on the recording medium, it is necessary to replace the recording medium at every maximum recording time of the recording medium. On the other hand, in the present embodiment, it is not necessary to replace the recording medium, and it is possible to continuously process images for a long time (for example, one day), which improves convenience. be able to. In addition, in the first embodiment, the recording medium is manually taken out from the video recording device 12a and the video recording device 12b and transferred, and the video recording device 21 of the analyzing means 20 is transferred.
On the other hand, in the present embodiment,
Since it is not necessary to manually transfer the recording medium, labor can be saved.

Further, the analyzing means 60 temporarily analyzes the compressed image received from the image pickup means 50 by using the analysis data storage device 6
Accumulate to 3. And the stored compressed video is
The decoder 62d decompresses and restores, and the person tracking unit 62a performs image processing to generate analysis data similar to those in the first to third embodiments. The person tracking unit 22
The operations of a, the flow line data storage unit 22b, and the data processing unit 22c are the same as those in the first embodiment, so description thereof will be omitted.

Then, the result analyzed by the image processing device 62 is the same as that of the compressed image and is stored in the analysis data storage device 63.
Will be recorded and saved in. The operation of the display means 30 is the same as that of the third embodiment, so the explanation is omitted.

Further, the analysis of the image data may be carried out on the compressed and completed video, or may be carried out in parallel with the storage of the compressed video. However, depending on the processing capacity of the image processing device 60, it is desirable to allocate one image processing device 62 to each camera 11 or video transmission device 52, if possible.

As described above, in the present embodiment, the captured image is compressed and transmitted via the network 45, so that the recording time of the recording medium is limited as in the case of using the recording medium. Since it is possible to analyze video data for a long time (for example, one day) without a break, the convenience can be significantly improved.

The present invention is not limited to the above-mentioned embodiments, but can be variously modified within the scope of the present invention, and they are not excluded from the scope of the present invention.

[0102]

As described above in detail, according to the present invention, the spatial trend of the customer is measured and analyzed, and the output is output in a form that can be easily grasped. It can be utilized as useful marketing information for changing the layout.

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration of a measurement system according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a configuration of an image processing apparatus according to the first embodiment of the present invention.

FIG. 3 is a diagram showing an example of flow line data according to the first embodiment of the present invention.

FIG. 4 shows the number of visitors in the first embodiment of the present invention,
It is a figure which shows the example of the data of the number of people who have left the store and the number of opportunity losses.

FIG. 5 is a diagram showing an example of seating time and leaving time data for each seat according to the first embodiment of the present invention.

FIG. 6 is a first diagram showing a display example of analysis data according to the first embodiment of the present invention.

FIG. 7 is a second diagram showing a display example of analysis data according to the first embodiment of the present invention.

FIG. 8 is a diagram showing a layout of a seat in the first embodiment of the invention and is an enlarged view of a portion A in FIG. 7.

FIG. 9 is a diagram showing an example of an image in which the flow line of a visitor is accumulated according to the first embodiment of the present invention, and is an enlarged view of a portion B in FIG. 7.

FIG. 10 is a table showing the occupancy rate and usage time for each seat, table, and area in the first embodiment of the present invention, and is an enlarged view of part C of FIG. 7.

FIG. 11 is a diagram showing a configuration of a measurement system according to a second embodiment of the present invention.

FIG. 12 is a diagram showing a configuration of an image processing apparatus according to a second embodiment of the present invention.

FIG. 13 is a diagram showing a configuration of an image processing apparatus according to a third embodiment of the present invention.

FIG. 14 is a diagram showing a configuration of a display device according to a third embodiment of the present invention.

FIG. 15 is a diagram showing a display example of analysis data according to the third embodiment of the present invention.

FIG. 16 is a diagram showing a layout of a seat in the third embodiment of the invention and is an enlarged view of a portion D of FIG. 15.

FIG. 17 is a diagram showing an example of an image in which a flow line of a visitor is accumulated according to the third embodiment of the present invention, and is an enlarged view of an E portion in FIG. 15.

FIG. 18 is a table showing the occupancy rate and usage time for each seat, table, area in the third embodiment of the present invention, and is an enlarged view of part F of FIG. 15.

FIG. 19 is a diagram showing a configuration of a measurement system according to a fourth embodiment of the present invention.

FIG. 20 is a diagram showing a configuration of an image processing apparatus according to a fourth embodiment of the present invention.

[Explanation of symbols]

10, 50 Imaging means 11, 11a, 11b cameras 12, 12a, 12b, 21 Video recording device 20, 60 Analytical means 22, 62 Image processing device 22a person tracking unit 22b Flow line data storage unit 22c Data processing unit 22d encoder 23, 63 Analysis data storage device 30 display means 31 Display 31a Analysis data processing unit 31b, 62d decoder 31c Display composition section 52, 52a, 52b Video transmission device

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G06F 17/60 170 G06F 17/60 170A 5L096 G06T 1/00 340 G06T 1/00 340B H04N 7/18 H04N 7 / 18 G K F Term (reference) 2F065 AA01 AA17 AA20 BB05 BB15 CC16 DD06 FF04 FF28 JJ03 JJ05 JJ26 QQ24 QQ28 QQ31 SS02 SS13 2F070 AA01 AA04 CC01 CC11 DD06 DD12 DD15 GG07 GG08 HH08 20812 CB20 DA08 DA17 DB02 5C054 CD03 CE16 CG02 EA01 EA05 EA07 FC12 FC15 FC16 HA05 HA14 5L096 CA04 HA02 HA05

Claims (9)

[Claims] 1. (a) a camera for photographing a predetermined range, and an image pickup means having a first image recording device for recording the photographed image on a recording medium; and (b) recording on the recording medium. Analysis means including a second video recording device for reading video, an image processing device, and an analysis data storage device; and (c)
Display means provided with a display device for processing and displaying the analysis data output by the analysis means in a desired form, (d)
The image processing device, a person tracking unit that tracks a person within the predetermined range based on the video, a flow line data storage unit that stores a tracking result as flow line data of the person, and
A measurement system comprising a data processing unit that analyzes the flow line data and processes it into a desired form. 2. (a) an image pickup means having a camera for photographing a predetermined range and a video transmission device for compressing and transmitting the photographed video; (b) an image processing device; and the image processing device. And (c) display means having a display device for processing and displaying the analysis data output by the analysis means in a desired form. d) The image processing device includes a decoder that expands the compressed video received from the imaging unit, a person tracking unit that tracks a person within the predetermined range based on the expanded video, and a tracking result of the person. A measurement system comprising: a flow line data storage unit that stores the flow line data; and a data processing unit that analyzes the flow line data and processes the data into a desired form. 3. (a) a camera for photographing a predetermined range, and an image pickup means provided with a first image recording device for recording the photographed image on a recording medium; and (b) recorded on the recording medium. Analysis means including a second video recording device for reading video, an image processing device, and an analysis data storage device; and (c)
Display means provided with a display device for processing and displaying the analysis data output by the analysis means in a desired form, (d)
The image processing device is an encoder that compresses the video and stores the compressed data in the analysis data storage device, a person tracking unit that tracks a person within the predetermined range based on the video, and the tracking result is the movement line data of the person. And a data processing unit for analyzing the flow line data and processing it into a desired form, (e) the display device includes a decoder for expanding a compressed image, and the analysis unit. An analysis data processing unit for processing the data into a desired form, and a display composition unit for compositing and displaying the overlay display image of the flow line data of the person synchronized with the decompressed image together with the processed analysis data. A measurement system characterized by comprising. 4. (a) a camera for photographing a predetermined range, and an image pickup means having a video transmission device for compressing and transmitting the photographed video, (b) an image processing device, and the image processing device. Analysis means including an analysis data storage device for storing the data output by and the compressed image received from the imaging means, and (c) a display for processing and displaying the analysis data output by the analysis means in a desired form. (D) the image processing device includes a decoder for expanding the compressed image stored in the analysis data storage device, and a person within the predetermined range based on the expanded image. And a data processing unit that analyzes the flow line data and processes the flow line data into a desired form. )Previous The display device displays a decoder for decompressing a compressed video, an analysis data processing unit for processing the analysis data into a desired form, and an image in which the flow line data of the person synchronized with the expanded video is displayed in overlay. A measurement system comprising: a display combining unit that combines and displays the processed analysis data. 5. The measurement according to claim 3, wherein the display synthesizing unit generates an image in which the flow line data is accumulated so as to be synchronized with reproduction of an image captured in a set time period. system. 6. The measurement system according to claim 1, wherein the data processing unit calculates the number of visitors to the store, the number of persons leaving the store, and the number of opportunity losses based on the flow line data. 7. The data processing unit measures seating time and leaving time for each seat within the predetermined range based on the flow line data, and the display device displays a set of seats set arbitrarily. Set as a table, set an arbitrarily set of the tables as an area, and calculate an occupancy rate and a rotation speed for each seat, table and area based on the seating time and leaving time of each seat. The measurement system according to any one of claims 1 to 6, wherein a group rate is calculated and displayed for a table that can be simultaneously used by a plurality of people. 8. The measurement system according to claim 1, wherein the display device generates and displays an image in which flow line data is accumulated in a set time period. 9. The display device stores an image of the layout of the seat, the table and the area, the occupancy rate and the rotation speed of each of the seat, the table and the area, and the flow line data in the set time section. The measurement system according to claim 7 or 8, which displays simultaneously.