JP2019159998A - Server device, in-commercial facility information system, and method for presenting action history - Google Patents

Abstract

To provide a server device, an in-commercial facility information system, and a method for presenting an action history for presenting, to a shopper in a store, his or her own action history.SOLUTION: In an in-commercial facility information system 100, a server device 1 is configured so as to be communicable with a portable terminal allocated to one user and at least one in-store camera installed in one store for photographing an in-store image of the store, and for transmitting the in-store image. The server device comprises: means for determining a person included in the in-store image as a registered user on the basis of a user image of the preliminarily registered user to whom the portable terminal is allocated; means for recording an action history in the store of the registered user; and means for transmitting information on the action history to the portable terminal in response to a first request from the portable terminal.SELECTED DRAWING: Figure 1

Description

  The present invention relates to recording of a customer's behavior history in a store. In addition, the present invention relates to the provision of own behavior history in the store for shoppers.

  Generally, a department store, a shopping center, a shopping mall, and a complex commercial facility in which a shopping center is provided with a dining facility, a movie theater, a game hall, and the like accommodate a plurality of stores. These commercial facilities are collectively referred to herein simply as commercial facilities. In general, commercial facilities are vast compared to a single store. In commercial facilities, similar products are often handled at a plurality of sales floors and stores, and the sales floors and stores tend to be confused.

  On the other hand, when shopping, there are shoppers who follow a procedure such as checking a product that they are interested in after going around the store, and then considering a product to be purchased among the checked products.

  A shopper who performs such a study needs to remember where he / she saw the checked item. In modern times, many shoppers carry mobile terminals with built-in cameras such as smartphones and mobile phones. For this reason, it is conceivable to record an item of interest by taking a picture with the camera of the mobile terminal. However, shooting of products is not necessarily permitted, and some stores prohibit shooting. For this reason, it is not always possible to use a technique in which the shopper himself captures and records with the camera of the portable terminal.

International Publication No. 2015/033575

  A technique related to the present invention is disclosed in Patent Document 1. According to Patent Document 1, it is described that information related to a product that a shopper is currently picking up is notified to the shopper using an information presentation device installed on the spot.

  Further, according to Patent Document 1, information related to a product is presented to a shopper using an information presentation device. The information presentation device is a stationary device that is installed at a position where a shopper can visually recognize (can hear).

  However, Patent Document 1 does not describe recording a product taken by the shopper or browsing the record later by the shopper.

  According to Patent Document 1, according to Patent Document 1, a shopper cannot browse information at a place away from the information presentation device. For example, a shopper cannot view information related to a product at a cafe, restaurant, rest area, or the like away from the store that handles the product.

  According to Patent Document 1, since a stationary information presentation device is used, it is difficult to use it for notification of information destined for a specific shopper. For example, a store or a complex commercial facility may provide a service that presents a different discount rate depending on the purchase performance of a shopper. In such a case, it is difficult to display the discount rate presented to one shopper on a stationary information presentation device that can be browsed by other shoppers.

  This invention is made | formed in view of such a condition, and the subject which this invention tends to solve is providing the system which presents own action history with respect to the shoppers in a shop.

  In order to solve the above-described problems, the present invention has, as one aspect thereof, at least one portable terminal assigned to one user and one store, and captures the in-store image by taking an in-store image of the store. Means for determining a person included in the in-store image as a registered user based on a user image of a user who is pre-registered and assigned the mobile terminal, and capable of communicating with the in-store camera for transmission; There is provided a server device comprising means for recording an action history of a registered user in the store and means for transmitting information relating to the action history to the portable terminal in response to a first request from the portable terminal.

  As another aspect, the present invention provides, as another aspect, a portable terminal assigned to one user and an in-store camera that is installed in at least one store, shoots an in-store image of the store, and transmits the in-store image. And a management server communicable with the mobile terminal and the in-store camera, and the management server is included in the in-store image based on a user image of a user who has been registered in advance and assigned the mobile terminal. In response to a first request from the portable terminal, a means for determining a person as a registered user, a means for recording an action history of the registered user in the store, and information on the behavior history is transmitted to the portable terminal. A commercial facility information system comprising: means.

  In addition, as another aspect of the present invention, at least one portable terminal assigned to one user and one store installed in the store, taking a store image of the store, and transmitting the store image Means for determining, as a registered user, a person included in the in-store image based on a user image of a user assigned with the mobile terminal that is registered in advance and is executed in a management server capable of communicating with the camera; A program for causing the management server to function as means for recording an action history of the user in the store and means for transmitting information related to the action history to the portable terminal in response to a first request from the portable terminal. provide.

  As another aspect of the present invention, a person included in an in-store image captured by an in-store camera installed in a store based on a user image of a mobile terminal registered in advance in the management server is stored in the management server. The management server records information regarding the behavior history in response to a first request from the portable terminal and a step of recording the behavior history of the registered user in the store by the management server. And providing a behavior history presentation method including the step of transmitting to the portable terminal.

  ADVANTAGE OF THE INVENTION According to this invention, an own action log | history can be shown with respect to the shoppers in a shop.

It is a block diagram for demonstrating the information system in a commercial facility which is the 1st Embodiment of this invention. It is a block diagram for demonstrating an in-store camera. It is a block diagram for demonstrating a portable terminal. It is a block diagram for demonstrating the user application performed with a portable terminal. It is an example of the menu screen of a user application. It is an example of a screen when a user application displays a store entry / exit history. It is an example of a screen when a user application displays a check product history. It is an example of a screen when a user application displays product details. It is an example of a screen when a user application displays a list of similar products. It is a flowchart for demonstrating operation | movement of the information system in a commercial facility at the time of registering the user screen of a portable terminal with a management server. It is a flowchart for demonstrating operation | movement of the information system in a commercial facility at the time of recording that the user of a portable terminal entered / exited the store. It is a flowchart for demonstrating operation | movement of the information system in a commercial facility at the time of recording the goods which the user of the portable terminal checked in the store. It is a flowchart for demonstrating operation | movement of the information system in a commercial facility at the time of the user of a portable terminal browsing own action history. It is a flowchart for demonstrating operation | movement of the information system in a commercial facility at the time of browsing the list of the goods checked in the store with the user of a portable terminal. It is a flowchart for demonstrating operation | movement of the information system in a commercial facility at the time of browsing the goods detailed information of the goods checked in the shop with the user of a portable terminal, and the goods detailed information of the goods similar to the goods.

  A commercial facility information system 100 according to an embodiment of the present invention will be described with reference to FIG. The commercial facility information system 100 is a system for the commercial facility 200 and the stores 200A, 200B, 200C,... Accommodated in the commercial facility 200 to provide information to shoppers who have visited the store.

  The commercial facility 200 is a commercial facility that houses a plurality of stores that handle similar products. Examples of the commercial facility 200 include a shopping center, a shopping mall, a department store, a shopping building, a station building, and a fashion building. The commercial facility 200 may be a complex commercial facility with a restaurant, a movie theater, a playground, and the like. Note that similar products referred to in this specification include the same products.

  The commercial facility 200 accommodates a plurality of stores 200A, 200B, 200C,. Stores 200A, 200B, 200C,... Include stores that handle the same or similar products. In this embodiment, the complex commercial facility 200 accommodates a plurality of stores that handle female clothes.

  The commercial facility information system 100 includes a management server 1, an in-store camera 2, and a mobile terminal 3.

  The management server 1 manages user information 11, store information 12, and product information 13. The management server 1 includes a readable / writable storage device for storing such information. The storage device is, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

  The user information 11 is information relating to each user, that is, each shopper. The user information includes an image 11A of the user's face. The image 11A is called a user image. The user image 11A is image data of an arbitrary format. As will be described later, the user image 11 </ b> A is uploaded from the mobile terminal 3 to the management server 1.

  The user information 11 includes an action history 11B. The action history 11 </ b> B is history information of actions performed by the user in the commercial facility 200.

  The store information 12 is information relating to each store accommodated in the commercial facility 200. The store information 12 includes identification information (store identification information) for identifying the store, information about products handled by the store (handled product information), and identification information for identifying the in-store camera 2 installed in the store ( Store camera identification information).

  The store identification information includes, for example, the name of the store, the location of the store in the commercial facility 200 (for example, 3-A when in the A block on the third floor in the building of the commercial facility 200), and other individual stores. It is the identification information given beforehand for every store so that it can be identified.

  The handling product information is information related to the product handled by the store. The handling product information includes product identification information (described later) of the product handled by the store, the price of the product, and the number of stocks of the product.

  The in-store camera identification information is, for example, the IP address of the in-store camera 2.

  The merchandise information 13 is information relating to merchandise handled by all stores of the commercial facility 200. Information about all products handled by the stores 200A, 200B, 200C,... Is included in the product information 13. The product information 13 includes the name of the product, the product identification information (product identification information), the price of the product, the store identification information of the store that handles the product, the information indicating the product attribute (product attribute information), and the like. . The product information 13 includes an image 13A of the product, that is, a product image 13A.

  The product identification information is identification information given in advance so that each product can be identified from other products. For example, an EAN (European Article Number) code or a JAN (Japanese Article Number) code may be used as the product identification information. A combination of the JAN code and the in-store code issued in the commercial facility 200 or in the store may be used as the product identification information.

  As the product attribute information, the size, color, pattern, material, brand name of the product, or a combination thereof can be considered. Moreover, it is good also as including the category of the goods containing the goods as goods attribute information.

  In addition, the management server 1 includes a data collection unit 14. The data collection unit 14 includes a communication device that performs data communication with the in-store camera 2 and the mobile terminal 3.

  The data communication line connecting the data collection unit 14 and the in-store camera 2 may be wired or wireless. For example, the data collection unit 14 may be connected to the in-store camera 2 via a LAN (Local Area Network) cable or a USB (Universal Serial Bus) cable, or may be connected via a wireless LAN line.

  The data collection unit 14 performs data communication with the in-store camera 2 and receives an image from the in-store camera 2. The image of the in-store camera 2 is called an in-store image. The data collection unit 14 outputs the in-store camera identification information of the in-store camera 2 that is the transmission source of the in-store image to the data extraction unit 15 together with the in-store image.

  The data communication line connecting the data collection unit 14 and the portable terminal 3 is basically a wireless line. The wireless line may be a mobile phone network such as an LTE (Long Term Evolution) line. Alternatively, this wireless line may be based on a wireless LAN installed in the commercial facility 200.

  The data collection unit 14 performs data communication with the mobile terminal 3 and receives an image obtained by capturing the face of the user of the mobile terminal 3 from the mobile terminal 3. The data collection unit 14 records this image in the user information 11 as the user image 11 </ b> A in association with the user of the mobile terminal 3 that is the transmission source.

  The data collection unit 14 receives data destined for a specific mobile terminal 3 from the data extraction unit 15 and transmits the data to the mobile terminal 3 that is the destination.

  Furthermore, the management server 1 includes a data extraction unit 15. The data extraction unit 15 includes a data processing device and an image processing device. The data extraction unit 15 specifies the in-store camera 2 indicated by the in-store camera identification information based on the store information 12. At that time, the data extraction unit 15 identifies the store where the in-store camera 2 is installed based on the store information 12.

  Further, the data extraction unit 15 identifies a user included in the in-store image based on the user image 11A.

  Further, the data extraction unit 15 identifies a product included in the in-store image based on the product image 13A included in the product information 13 of the store where the in-store camera 2 is installed.

  The data extraction unit 15 also updates the action history 11B of the identified user. For example, in the user's action history 11B, store identification information of a store where the user has entered, store entry and time of the store, product identification information of a product checked by the user at the store, exit from the store And add the time.

  Further, the data extraction unit 15 transmits a part or all of the behavior history 11 </ b> B of the identified person to the portable terminal 3 of the person via the data collection unit 14.

  Further, the data extraction unit 15 acquires information about the product related to the product from the product information 13 based on the product recorded as being checked by the user in the action history 11B. The data extraction unit 15 transmits the acquired information to the user's mobile terminal 3 of the action history 11B via the data collection unit 14.

  This will be described with reference to FIG. The in-store cameras 2A, 2B, 2C,... Have the same structure. These are collectively referred to as the in-store camera 2. The in-store camera 2 includes a camera 21, an image processing unit 22, and a communication unit 23. Note that at least one in-store camera 2 is installed in each of the stores 200A, 200B, 200C,.

  The number of in-store cameras 2 installed in each store is determined for each store and varies depending on the size of the store, the number of products handled, the size of the products, and the like. An in-store camera 2 for photographing the store entrance is installed in each store. In addition, a number of in-store cameras 2 that can shoot all the products displayed in the store are installed for each store.

  The camera 21 is a solid-state image sensor. For example, a CCD (Charge-Coupled Device) camera or a CMOS (Complementary Metal-Oxcide-Semiconductor) image sensor can be used as the camera 21. The camera 21 is a camera that photographs the inside of the store where the in-store camera 2 is installed and outputs an in-store image of the store. For example, the in-store camera 2A outputs an in-store image of the store 200A. The camera 21 outputs a predetermined number of in-store images every sufficiently short time. As a result, the camera 21 outputs a substantially real-time image.

  The image processing unit 22 performs image processing on the image data output from the camera 21. The image recognition process includes a face recognition process and an object recognition process.

  The image processing unit 22 performs face recognition processing on the in-store image and detects a person entering or leaving the store. When detecting the entrance / exit of a person, the image processing unit 22 transmits the in-store image to the management server 1 via the communication unit 23 together with time information indicating the time.

  The image processing unit 22 determines whether a person in the store is checking the product. If it is determined that the image is checked, the image processing unit 22 transmits the in-store image to the management server 1 via the communication unit 23.

The determination as to whether or not a person in the store is checking the product is performed as follows, for example. The image processing unit 22, based on the store image P _1, the human in the store if it is determined that touching the product, and records the time t _1. The same determination is performed based on the subsequent in-store images P _{2 to} P _x-1 (X is a natural number). Assume that when the same determination is made based on the in-store image _Px , it is determined that the person is not touching the product. At this time, the image processing unit 22 obtains a difference t _d between the time t _x and the time t ₁ and compares the difference t _d with a predetermined threshold value t _t . When the difference t _d is larger than the threshold value t _t , the image processing unit 22 determines that the person has checked the product. In response to this determination, the image processing unit 22 transmits some or all of the in-store images P _{1 to} P _x to the management server 1 via the communication unit 23.

  The communication unit 23 is a communication device that communicates with the data collection unit 14 of the management server 1. As described above, the data communication line connecting the data collection unit 14 and the communication unit 23 may be wired or wireless. For example, the communication unit 23 may be connected to the management server 1 via a LAN cable or a USB cable, or may be connected via a wireless LAN line.

  The communication unit 23 performs data communication with the data collection unit 14 and receives an image from the in-store camera 2. The image of the in-store camera 2 is called an in-store image. The data collection unit 14 outputs the in-store camera identification information of the in-store camera 2 that is the transmission source of the in-store image to the data extraction unit 15 together with the in-store image.

  The portable terminal 3 is an information processing apparatus that is portable and capable of wireless communication. Each shopper who visits the commercial facility 200 travels within the commercial facility 200 by carrying the mobile terminal 3. For example, a smart phone, a tablet, a laptop computer, a PDA (Personal Data Assistant), or the like can be used as the mobile terminal 3. A typical example of the portable terminal 3 is a smartphone or a tablet owned by the shopper.

  The mobile terminal 3 includes a control unit 31, a display unit 32, an input unit 33, a camera 34, a recording unit 35, and a wireless communication unit 36.

  The control unit 31 includes a CPU (Central Processing Unit) and controls the operation of each unit of the mobile terminal 3. In addition, the control unit 31 executes an operating system (OS) and then executes an application program. The type of operating system is arbitrary, for example, Google Android, Apple iOS, Microsoft Microsoft Windows 10 Mobile.

  The display unit 32 is a display device such as a liquid crystal display device or an organic EL (Electro-Luminescence) display device.

  The input unit 33 is an input device such as a keyboard and a pointing device. As the touch display device, the display unit 32 and the input unit 33 may be integrally configured.

  The camera 34 is a solid-state image sensor. Similar to the camera 21, for example, a CCD camera or a CMOS image sensor can be used as the camera 34.

  The recording unit 35 is a storage device. The recording unit 35 stores various data generated by the OS executed on the control unit 31. The recording unit 35 stores an application program downloaded from the outside. The recording unit 35 stores various data generated by the control unit 31 and an application program executed on the OS. The recording unit 35 stores an image generated by the camera 34.

  In particular, the recording unit 35 stores a dedicated application program that operates in cooperation with the management server 1. Hereinafter, this application program is referred to as a user application 37. As shown in FIG. 4, the user application 37 includes a user registration process 41, an action history process 42, a product information process 43, a favorite process 44, and a point process 45, and causes the control unit 31 to execute these processes. Here, the display unit 32 and the input unit 33 will be described as being mounted on the portable terminal 3 as a touch display.

  When the user application 37 is executed, the control unit 31 causes the display unit 32 to display a menu screen 50 as shown in FIG. "Register face" 51, "Display action history" 52, "Display favorites" 53, and "Display points" 54 are buttons displayed on the touch display, respectively. The process proceeds to the user registration process 41 in response to the tap of “Register face” 51. In response to the tap “display action history” 52, the process proceeds to action history processing 42. In response to the tap of “display favorite” 53, the process proceeds to favorite processing 44. In response to the tap of “display point” 54, the process proceeds to point processing 45.

  The user registration process 41 is a process for registering the user of the mobile terminal 3 in the management server 1. In the user registration process 41, the control unit 31 receives user information input using the input unit 33 and the camera 34 and transmits the user information to the management server 1 by the wireless communication unit 36.

  As user information input using the input unit 33, for example, one's name, gender, age, address, telephone number, e-mail address, credit card number, membership number issued by the commercial facility 200, and the like can be considered. User information input using the camera 34 includes a face image generated by photographing a user's own face.

  The control unit 31 transmits these pieces of user information to the management server 1 using the wireless communication unit 36. In the management server 1, when the data collection unit 14 receives user information, the data extraction unit 15 stores the user information in the user information 11 in association with user identification information given in advance to the user. In particular, the face image is stored as the user image 11A.

  The action history process 42 is a process for acquiring the action history of the user of the mobile terminal 3 recorded in advance in the management server 1 and displaying it on the display unit 32. When “display action history” 52 is tapped, the control unit 31 uses the wireless communication unit 36 to inquire the management server 1 about the action history. The management server 1 refers to the user information 11, reads the behavior history 11 </ b> B of the user of the mobile terminal 3, and transmits it to the mobile terminal 3. When the wireless communication unit 36 receives the behavior history 11 </ b> B, the control unit 31 displays the entrance / exit history using the display unit 32.

  An example of the entrance / exit history screen is shown in FIG. In the table of FIG. 6, a cell in the “IN” column describes a value indicating the time when the user of the mobile terminal 3 entered the store. In the cell in the “OUT” column, a value indicating the store exit time when the user of the mobile terminal 3 exits the store is described. In the cell in the “store name” column, a character string indicating the name of the store is described. The store names “XX”, “ΔΔ”, and “□□” are the store names of the stores 200A, 200B, and 200C, respectively. In the cell in the “checked product” column, a value indicating the number of products checked by the user of the mobile terminal 3 at the store and a character string “display details” are described. The string “show details” is a link. When the user selects a link “display details” on the input unit 33 (for example, taps the touch display), the control unit 31 displays a screen to be displayed on the display unit 32 from a store entry / exit history shown in FIG. Switch to 7 check product history.

  In the entrance / exit history illustrated in FIG. 6, it is recorded that the user of the mobile terminal 3 stayed at the store name “XX” (store 200A) from 10:40 to 11:00 and checked three items. Has been. In addition, it is recorded that the same user stayed at the store name “ΔΔ” (store 200B) from 11:13 to 11:20 and checked one product. Further, it is recorded that the same user stayed at the store name “□□” (store 200C) from 11:30 to 12:05 and checked three items.

  As described above, when a link “display details” is tapped in the entrance / exit history, a screen displaying a list of products checked by the user of the mobile terminal 3 at the store, that is, a check product history is displayed. Referring to FIG. 7, a heading “Products checked at XX store” is displayed at the top of the screen. Under the heading, a list of products checked by the user of the mobile terminal 3 with the store name “XX” (store 200A) is displayed. In the cell in the “No” column, a number indicating the order in which the user checked the product is described. In the cell in the “product name” column, the name of the product checked by the user and the link “display details” are described. For example, when the user taps the link “display details” on the touch display, the control unit 31 performs product information processing 43 that specifies the corresponding product. The merchandise information processing 43 will be described later.

  In the check product history illustrated in FIG. 7, it is recorded that the user of the mobile terminal 3 first checks “long sleeve blouse” in the store name “XX” (store 200A). In the same manner, it is recorded that “鞄”, “shoes”, “hat”, and “jeans” are checked in the second to fifth places.

  When the product information processing 43 is executed, the control unit 31 requests the management server 1 for detailed product information about the specified product. In response to this, the management server 1 acquires the detailed product information of the specified product from the product information 13 and transmits it to the mobile terminal 3. The product detail information includes the product image, the name of the checked store, the product name, the price, the color, the size, and the inventory.

  Here, an example of a screen displayed when the link “display details” described in the check product history in FIG. 7 is tapped will be described. The product details in FIG. 8 are screens that are displayed in response to the tap “show details” described in FIG. 7 and the first “long sleeve blouse”. Product detail information is displayed under the heading “Product Details”. A “view similar products” button 81 is displayed below the detailed product information. Below the “View Similar Items” button 81, a “Register to Favorites” button 82 and a “Return” button 83 are displayed. When the user taps the “Register to Favorites” button 82, the process proceeds to the favorites process 44 described later. When the user taps the “return” button 82, the screen returns to the check product history screen of FIG.

  When the user taps the “view similar product” button 81 or the like, the control unit 31 displays the product detailed information of the product similar to the first “long sleeve blouse” in FIG. To the management server 1 via

  In the management server 1, the data collection unit 14 receives this request. In response to this request, the data extraction unit 15 acquires the product detail information of the corresponding product from the product information 13 and transmits it to the mobile terminal 3 via the data collection unit 14.

  At this time, the data extraction unit 15 searches the product information 13 for a product similar to the product specified from the mobile terminal 3. Similarity between products may be predetermined in the product information 13. For example, it is conceivable that product identification information of a product similar to the product is recorded in advance as the product detail information of each product. In this case, the data extraction unit 15 searches the product information 13 for product detailed information in which the product specified from the mobile terminal 3 is recorded as a similar product.

  Further, for example, one or more attribute information may be given in advance to each product included in the product information 13, and the attribute information of the product may be recorded as the detailed product information of each product. In this case, the data extraction unit 15 searches the product information 13 for one or more recorded product detailed information for the same attribute information as that given to the product specified from the mobile terminal 3.

  In the similar product list screen of FIG. 9, four rectangular areas 91 to 94 are described, and product detailed information of one product is described in each of the rectangular regions 91 to 94. The rectangular area 91 describes the product shown in FIG. In the rectangular areas 92 to 94, product detail information of different products similar to the product of FIG. 8 is described. When the user taps the “return” button in the rectangular area 95, the control unit 31 returns the display on the display unit 32 to the product details shown in FIG.

  Note that the store names described in the rectangular areas 92 to 94 are different from the store name “XX store” in the rectangular area 91. By looking at this screen, the user of the mobile terminal 3 can know that there is a product similar to the product that he / she checked at “XX store” at another store in the commercial facility 200. At that time, the amount of money and the number of stocks at each store can be known.

  In the rectangular area 91, the characters “coupon” are highlighted. This reverse display indicates that the user of the mobile terminal 3 has a coupon that can be used at the store “XX store” in the rectangular area 91. Coupons are issued electronically for each store, and are stored in the management server 1 as user information 11, for example. In this way, by displaying the store where the user possesses the coupon on the similar product list screen, it is possible to provide the user with information for determining the product purchase.

  Management server 1 is good also as issuing a coupon to a user according to action history 11B. For example, it is conceivable that the management server 1 extracts the number of times the user has entered each store, the number of times the product has been checked, and the time from the action history 11B, and makes a decision regarding the coupon based on these values. That is, the management server 1 determines whether or not to issue a coupon to the user and the type and number of coupons to be issued. Further, the management server 1 may issue a coupon based on the purchase history of the user and the action history 11B in cooperation with a store POS (Point Of Sales) system.

  When the user taps the “Register to Favorites” button 82 in FIG. 8, the control unit 31 executes the favorite process 44. According to the favorite process 44, the control unit 31 registers the product displayed on the product detail screen as a favorite product. At this time, the control unit 31 designates the product identification information of the product and transmits a request for registering the product as a favorite to the management server 1 via the wireless communication unit 36. In the management server 1, when the data collection unit 14 receives this request, the data extraction unit 15 updates the user information 11 and adds the product identification information to the favorite 11C of the user.

  When the user taps the “display favorite” button 53 on the menu screen of FIG. 5, the control unit 31 requests the management server 1 for a product registered as a favorite via the wireless communication unit 36. In the management server 1, when the data collection unit 14 receives this request, the data extraction unit 15 reads the product identification information recorded as the favorite 11C of the user. The data extraction unit 15 reads out the detailed product information corresponding to the product identification information from the product information 13 and transmits it to the mobile terminal 3 that is the transmission source of the request via the data collection unit 14. When the wireless communication unit 36 receives the product detail information, the control unit 31 displays the product detail information on the display unit 32.

  Next, the operation of the commercial facility information system 100 will be described. It is assumed that one individual user U has the portable terminal 3. First, user registration of the user U will be described with reference to FIG.

  The user U operates the input unit 33 of the mobile terminal 3 to activate the user application 37. In response to this operation, the control unit 31 reads the user application 37 from the recording unit 35 and executes it. In accordance with the user application 37, the control unit 31 displays the menu screen 50 on the display unit 32. When the user U selects the “Register face” button 51 on the input unit 33, the control unit 31 executes a user registration process 41 (step S1).

  The user U performs an operation of photographing his / her face using the camera 34 of the mobile terminal 3. With this operation, the camera 34 generates a face image of the user U (step S2).

  The control unit 31 transmits a face image to the management server 1 using the wireless communication unit 36 (step S3). The face image transmission path at this time may be via a mobile phone network or via a wireless LAN provided in the commercial facility 200.

  In the management server 1, when the data collection unit 14 receives the face image (step S4), the data extraction unit 15 records the face image as the user image 11A of the user U of the mobile terminal 3 that is the transmission source (step S4). S5). A user who registers a face image as a user image 11A in the management server 1 in this way is called a registered user.

  Next, the operation of the information system 100 in the commercial facility when the registered user U enters the commercial facility 200 and enters any of the stores 200A, 200B, 200C,... Will be described with reference to FIG. Since the operation is the same regardless of which store has entered, the user U will be described as having entered the store 200 in which the in-store camera 2 is installed.

  The camera 21 of the in-store camera 2 repeatedly shoots the inside of the store 200 at a sufficiently short time interval (for example, once every 5 seconds), and outputs an image to the image processing unit 22. The image processing unit 22 determines whether each image includes a person.

  When the image processing unit 22 determines that a person is included in the image (step S11), the image processing unit 22 sends the image and the shooting time of the image to the management server 1 using the communication unit 23. Transmit (step S12).

  In the management server 1, the data collection unit 14 receives the image and the shooting time (step S13). In response to this reception, the data extraction unit 15 compares the received image with the user image 11A to determine whether the person included in the image is a registered user (step S14).

  Here, it is assumed that the data extraction unit 15 determines that the user included in the image is the registered user U. At this time, the data extraction unit 15 records that the user U entered the store where the in-store camera 2 that is the image transmission source is installed, that is, the store 200, as the action history 11B of the user U. At that time, the shooting time of the image is recorded as the store entry time when the user U entered the store 200 (step S15). The store entry time recorded here corresponds to the time in the “IN” cell of FIG.

  The operation when a person leaves the store 200 is basically the same. In the case of a store exit, the store exit time recorded here corresponds to the time in the “OUT” cell of FIG.

  The camera 21 of the in-store camera 2 repeatedly captures the inside of the store 200 at a sufficiently short time interval (for example, once every 5 seconds) to generate an image. After detecting the presence of a person in step S11, the in-store camera 2 transmits the captured and generated image to the management server 1 together with the shooting time (steps S11 and S12).

  In the management server 1, the data collection unit 14 receives the image and the shooting time (step S13). In response to this reception, the data extraction unit 15 compares the received image with the user image 11A to determine whether the person included in the image is a registered user (step S14).

  Here, it is assumed that the registered user U is not included in the registered users that the data extraction unit 15 determines to be included in the image. That is, it is assumed that the data extraction unit 15 determines that no registered user is included in the image. Alternatively, it is assumed that the data extraction unit 15 determines that the registered user U in which only the store entry time is recorded in the action history 11B and the store exit time is not recorded is not included in the image.

  At this time, the data extraction unit 15 records, as the user's U action history 11B, that the user U has left the store where the in-store camera 2 that is the image transmission source is installed, that is, the store 200. At that time, the shooting time of the image is recorded as the store leaving time when the user U left the store 200 (step S15). The store exit time recorded here corresponds to the time in the “OUT” cell of FIG.

  Next, with reference to FIG. 12, the operation of the commercial facility information system 100 when the registered user U records an arbitrary product Z in the store 200 in the action history 11B will be described.

  It is assumed that the image processing unit 22 detects that the user U has touched the product Z in the store 200 based on the image output from the camera 21 (step S21). At this time, the image processing unit 22 records the shooting time t1 of the image (step S22).

  Next, it is assumed that the image processing unit 22 detects that the user U has released his / her hand from the product Z based on another image output from the camera 21 (step S23). At this time, the image processing unit 22 records the shooting time t2 of the image (step S24).

  Next, the image processing unit 22 calculates the difference t2-t1 and compares it with a predetermined threshold value td (step S25). When the difference t2−t1 is larger than the threshold value td, the image processing unit 22 determines that the user U has checked the product Z. Then, the image processing unit 22 transmits an image including the product Z to the management server 1 together with a message indicating that the user U has checked the product via the communication unit 23 (step S26).

  In the management server 1, when the data collection unit 14 receives the image (step S27), the data extraction unit 15 identifies the product checked by the user U, that is, the product Z based on the received image (step S28). ). That is, the data extraction unit 15 specifies the product Z by comparing the received image with the product image 13A of the product of the store 200 that is the transmission source of the image.

  Receiving this identification result, the data extraction unit 15 records that the user U checked the product Z at the store 200 as the action history 11B (step S29).

  Thereafter, steps S21 to S29 are repeated while the user U stays in the store 200. The products Z recorded here are the five products described in the “product name” cell in FIG. 7, that is, “long sleeve blouse”, “heel”, “shoes”, “hat”, and “jeans”. Corresponding to In the example of FIGS. 6 and 7, the user has checked these five items from entering the store XX (10:40) until leaving the store (11:00). It is recorded in 11C.

  Next, the operation of the commercial facility information system 100 when the user U confirms his / her action history with the mobile terminal 3 will be described with reference to FIG.

  In the mobile terminal 3, when the user U operates the input unit 33 to activate the user application 37, the control unit 31 subsequently operates according to the user application 37. First, the control unit 31 displays the menu screen 50 on the display unit 32 (step S31). Next, when the user U performs an operation of selecting the “display action history” button 52 using the input unit 33, the control unit 31 proceeds to the action history process 42 (step S32). In the action history process 42, the control unit 31 transmits a request for transmission of the action history of the user U to the management server 1 using the wireless communication unit 36 (step S33).

  In the management server 1, when the data collection unit 14 receives a request from the portable terminal 3 (step S34), the data extraction unit 15 acquires the action history of the user U from the action history 11B (step S35). More specifically, among the stores in the commercial facility 200, information including the entry time, the exit time, the store name, and the number of the checked products (see below) This information is referred to as an entry / exit history) from the action history 11B. The data collection unit 14 transmits the entry / exit history of the user U acquired from the behavior history 11B to the mobile terminal 3 (step S36).

  Returning to the portable terminal 3, when the wireless communication unit 36 receives the entry / exit history of the user U (step S37), the control unit 31 displays the received entry / exit history on the display unit 32 (step S38). ). An example of the screen at this time is shown in FIG. By viewing this screen, the user U can confirm from what time to what time he was in which store in the commercial facility 200.

  After the entry / exit history is displayed, if the user U wishes, the products checked by himself / herself can be confirmed at each store. The operation of the commercial facility information system 100 at this time will be described with reference to FIG.

  Similar to step S38, the display unit 32 displays the store entrance / exit history (step S41). From this state, the user U uses the input unit 33 to perform an operation of designating the link “display details” described in the “checked product” cell of the store where the history of the checked product is to be confirmed. In response to this operation, the control unit 31 requests the management server 1 for information on the product checked by the user U in the designated store (hereinafter, this information is referred to as “checked product history”) via the wireless communication unit 36. (Step S42).

  In the management server 1, when the data collection unit 14 receives this request (step S43), the data extraction unit 15 acquires the check product history of the user U at the selected store from the action history 11B (step S44). The data collection unit 14 transmits the check product history to the mobile terminal 3 (step S45).

  Returning to the mobile terminal 3, when the wireless communication unit 36 receives the check product history (step S46), the control unit 31 displays the check product history as shown in FIG. 7 on the display unit 32 (step S47).

  After the check product history is displayed, if the user U desires, the product displayed in the check product history and information on products similar to the product can be viewed. The operation of the commercial facility information system 100 at this time will be described with reference to FIG.

  Similar to step S48, the display unit 32 displays the check product history (step S51). From this state, the user U uses the input unit 33 to perform an operation of designating the link “display details” described in the “product name” cell of the product for which the product detail information is to be browsed. Here, it is assumed that the user U designates the product D. In response to this operation, the control unit 31 requests the management server 1 for the product detail information of the product D via the wireless communication unit 36 (step S52). Here, the detailed product information includes the name of the store that sells the product, the product name, the price, the color, the size, and the number of stocks.

  In the management server 1, when the data collection unit 14 receives this request (step S53), the data extraction unit 15 acquires the product detail information of the product D from the product information 13 (step S54). The data collection unit 14 transmits the detailed product information to the mobile terminal 3 (step S55).

  Returning to the portable terminal 3, when the wireless communication unit 36 receives the detailed product information (step S56), the control unit 31 displays the detailed product information as shown in FIG. 8 on the display unit 32 (step S57).

  From this state, it is assumed that the user U desires to browse a product similar to the product D. At this time, the user U operates the “view similar products” button 81 using the input unit 33. In response to this operation, the control unit 31 requests the management server 1 for detailed product information (hereinafter referred to as similar product information) of each product similar to the product D (step S58).

  In the management server 1, when the data collection unit 14 receives this request (step S59), the data extraction unit 15 acquires the product detail information of the product similar to the product D from the product information 13 (step S60). The number of products similar to the product D is not limited to one, and a plurality of products may exist. As a method of determining similarity, as described above, it is conceivable to record the product identification number of a product similar to the product in association with the product detailed information of each product.

  Here, it is assumed that the products R1, R2, and R3 are similar. At this time, the data extraction unit 15 acquires the product detail information of the products R1, R2, and R3 from the product information 13. The data collection unit 14 transmits the product detail information of the products R1, R2, and R3 to the mobile terminal 3 (Step S61).

  Returning to the portable terminal 3, the wireless communication unit 36 receives the detailed product information of the products R1, R2, and R3 from the management server 1 (step S62). In response to this, the display unit 32 collectively displays the detailed product information of the products D, R1, R2, and R3 as shown in FIG. 9 (step S63). In FIG. 9, the rectangular area 91 displays the product detail information of the product D. The rectangular areas 92 to 94 display the detailed product information of the products R1 to R3, respectively.

  In this way, the user U can confirm the detailed product information of the product actually checked at the store where he / she entered after leaving the store.

  In addition, the user U can know that there is not only the checked product but another product similar to the checked product in the commercial facility 200. The similarity determination between products is basically performed regardless of whether or not the user U has entered the store. For this reason, it is possible to inform the user U of the products sold by the store that the user U has not visited in the commercial facility 200. For example, the store “XX store” of the product displayed in the rectangular area 93 in FIG. 9 has never been performed by the user U according to the store / ingress history of FIG. However, by operating the “view similar product” button 81, the user U can notice that “XX shop” sells this product.

  As described above, according to the present embodiment, the shopper of the commercial facility 200 can later confirm his / her action history in the commercial facility 200 using the mobile terminal 3. That is, the shopper can confirm the store where he / she entered / leaved after leaving the store. At that time, the shopper can confirm the time of entering the store, the time of leaving the store, and the score of the checked product.

  In particular, in a large commercial facility that accommodates a large number of stores, a shopper may forget which store he / she visited when walking across various stores. Even in such a case, according to the present embodiment, the shopper can check the store where he / she has visited.

  Further, the shopper can browse the detailed information of the checked product using the mobile terminal 3. Thereby, the shopper can easily confirm which store is the store that saw the item of interest. For this reason, the shopper can easily specify the store where the item he / she was interested in. In addition, the shopper can check the products he / she is interested in at each store and then move to, for example, a cafe, a restaurant, a resting place, etc., and slowly review the checked products.

  Further, according to the present embodiment, the shopper can easily browse not only the detailed product information of the checked product itself but also the detailed product information of the product similar to the product. Even if the product is not checked at the store visited by the shopper or the product at a store where the shopper has not visited, the product is presented to the mobile terminal 3 of the shopper as a similar product. For this reason, a shopper is less likely to miss a favorite product in the commercial facility 200.

  Furthermore, according to the present embodiment, the store entrance / exit history and the check product history of the shopper are accumulated in the management server 1 as the action history 11B. For this reason, the administrator of the management server 1 can analyze the behavior of the shopper based on the behavior history 11B. For example, the administrator can use the action history 11B as a material for determining store arrangements and product arrangements. As a result, the manager can examine various measures that lead to an increase in sales of the commercial facility 200 as a whole, based on the behavior history 11B.

  The present invention is not limited to the above-described embodiment, and various modifications can be made.

  For example, in the commercial facility information system 100, when the in-store camera 2 detects the presence of a person, the image is transmitted to the management server 1, and the management server 1 identifies the person in the image.

  Instead of such a configuration, all images taken by the in-store camera 2 may be transmitted to the management server 1, and the management server 1 may both detect and identify the presence of a person. According to such a configuration, the configuration of the in-store camera 2 can be simplified.

  Or it is good also as performing both detection and identification of a person with each camera 2 in a shop. If comprised in this way, the processing load of the management server 1 can be reduced and a structure can be simplified.

  Similarly, in the commercial facility information system 100, the management server 1 identifies the product checked by the user. Alternatively, the in-store camera 2 may identify the product. For example, a storage device storing the product image 13A of the product of the store is arranged in each store, and the image processing unit 22 compares the image captured by the camera 21 with the product image 13A stored in the storage device. It may be possible to identify the product.

  Further, in the commercial facility information system 100, when identifying the product checked by the user, the product image 13A previously captured is compared with the image captured by the in-store camera 2, and based on the comparison result. Identification was performed.

  Instead of such a method, another method may be used. For example, the following method can be considered. As a part of the store information 12 or the product information 13, it is recorded in advance where the product is displayed in the store. Based on the image taken by the in-store camera 2, the user's line-of-sight direction is estimated. The time when the user's line of sight is directed to the display position of a certain product is measured. The measurement time is compared with a predetermined threshold, and if the measurement time exceeds the threshold, the user determines that the product has been checked.

  In addition, a so-called point program that gives a user points according to the purchase price of the user and a user application 37 may be linked. The user application 37 notifies the information with each mobile terminal 3 as a destination. For this reason, the point can be notified only to the destination user without being known to a third party. Further, a notification from the operator of the point program to the user, for example, a promotional coupon, may be transmitted to the user via the user application 37.

  In the above-mentioned commercial facility information system 100, the user application 37 displays the store entrance / exit history and the check product history recorded in the management server 1 as they are. However, the user application 37 is configured so that a part of the store recorded in the entrance / exit history and a part of the product recorded in the check product history can be set to be hidden on the display unit 32. Also good. For example, the product purchased by the user is less likely to be displayed on the display unit 32 as the check product history screen of FIG. In addition, it is preferable that the number of points to be displayed is smaller in order to maintain the viewability of the check product history screen.

  A part or all of the above embodiments may be described as in the following supplementary notes, but is not limited thereto.

(Appendix 1)
At least one portable terminal assigned to one user and at least one in a store is capable of communicating with an in-store camera for taking an in-store image of the store and transmitting the in-store image,
Means for determining a person included in the in-store image as a registered user based on a user image of a user who is pre-registered and assigned the mobile terminal;
Means for recording an action history of the registered user in the store;
A server apparatus comprising: means for transmitting information related to the action history to the portable terminal in response to a first request from the portable terminal.

(Appendix 2)
Means for recording, as the action history of the registered user in the store, information relating to the check of the product performed by the registered user in the store based on the in-store image;
Means for transmitting information related to the check of the product to the portable terminal in response to a second request from the portable terminal;
The server device according to claim 1, further comprising:

(Appendix 3)
The server apparatus according to appendix 2, further comprising means for transmitting, to the mobile terminal, product detail information of the product that is the object of the check in response to a third request from the mobile terminal.

(Appendix 4)
The server apparatus according to appendix 3, further comprising means for transmitting, to the mobile terminal, information on a product similar to the product to be checked in response to a fourth request from the mobile terminal.

(Appendix 5)
The store is one of stores stored in a commercial facility that stores a plurality of stores,
At least one in-store camera is installed in each of the plurality of stores,
Means for recording the action history of the registered user in each of the plurality of stores;
Additional means to transmit the information regarding the action history of the registered user in the plurality of stores to the portable terminal in response to a fifth request from the portable terminal. The server device described in 1.

(Appendix 6)
A mobile device assigned to one user,
An in-store camera installed in at least one store, taking an in-store image of the store, and transmitting the in-store image;
A management server capable of communicating with the portable terminal and the in-store camera;
The management server is
Means for determining a person included in the in-store image as a registered user based on a user image of a user who is pre-registered and assigned the mobile terminal;
Means for recording an action history of the registered user in the store;
Means for transmitting information related to the action history to the portable terminal in response to a first request from the portable terminal;
An information system in a commercial facility.

(Appendix 7)
The management server is
Based on the in-store image, the registered user records information related to product checks performed in the store as the action history of the registered user in the store,
In response to a second request from the mobile terminal, information on the product check is transmitted to the mobile terminal.
The information system in a commercial facility according to appendix 6.

(Appendix 8)
8. The information system in a commercial facility according to appendix 7, wherein the management server transmits product detail information of the product subject to the check to the mobile terminal in response to a third request from the mobile terminal.

(Appendix 9)
The information system in a commercial facility according to appendix 8, wherein the management server transmits information on a product similar to the product to be checked to the mobile terminal in response to a fourth request from the mobile terminal. .

(Appendix 10)
The store is one of stores stored in a commercial facility that stores a plurality of stores,
At least one in-store camera is installed in each of the plurality of stores,
The management server records the action history of the registered user in each of the plurality of stores,
In response to a fifth request from the mobile terminal, the management server transmits information regarding the action history of the registered user in the plurality of stores to the mobile terminal.
The information system in a commercial facility according to any one of appendix 6 to appendix 9.

(Appendix 11)
At least one portable terminal assigned to one user, and installed in one store, take an in-store image of the store, and executed by a management server capable of communicating with the in-store camera for transmitting the in-store image,
Means for determining a person included in the in-store image as a registered user based on a user image of a user who is pre-registered and assigned the mobile terminal;
Means for recording an action history of the registered user in the store;
A program for causing the management server to function as means for transmitting information related to the action history to the portable terminal in response to a first request from the portable terminal.

(Appendix 12)
Means for recording, as the action history of the registered user in the store, information relating to the check of the product performed by the registered user in the store based on the in-store image;
Means for transmitting information related to the check of the product to the portable terminal in response to a second request from the portable terminal;
The program according to appendix 11, wherein the program further causes the management server to function.

(Appendix 13)
13. The program according to appendix 12, further causing the management server to function as means for transmitting product detail information of the product to be checked to the mobile terminal in response to a third request from the mobile terminal.

(Appendix 14)
14. The program according to appendix 13, further causing the management server to function as means for transmitting product information similar to the product to be checked to the mobile terminal in response to a fourth request from the mobile terminal. .

(Appendix 15)
The store is one of stores stored in a commercial facility that stores a plurality of stores,
At least one in-store camera is installed in each of the plurality of stores,
Further causing the management server to function as means for recording the action history of the registered user in each of the plurality of stores,
In response to a fifth request from the mobile terminal, the management server further functions as means for transmitting information related to the action history of the registered user in the plurality of stores to the mobile terminal.
15. The program according to any one of appendix 11 to appendix 14.

(Appendix 16)
Based on the user image of the mobile terminal registered in advance in the management server, the management server determines a person included in the in-store image taken by the in-store camera installed in the store as a registered user, and the registered user's A stage in which the management server records an action history in the store;
The management server presents a method of presenting an action history in response to a first request from the portable terminal, wherein the management server transmits information related to the action history to the portable terminal.

(Appendix 17)
The management server records, as the action history of the registered user in the store, information related to a check of the product performed by the registered user in the store based on the in-store image;
The behavior history presentation method according to appendix 16, further comprising a step in which the management server transmits information related to the check of the product to the mobile terminal in response to a second request from the mobile terminal.

(Appendix 18)
The action history record according to appendix 17, further comprising a step in which, in response to a third request from the mobile terminal, the management server transmits product detail information of the product to be checked to the mobile terminal. Presentation method.

(Appendix 19)
The behavior according to appendix 18, further comprising a step in which the management server transmits product information similar to the product to be checked to the mobile terminal in response to a fourth request from the mobile terminal. How to present history.

(Appendix 20)
The store is one of stores stored in a commercial facility that stores a plurality of stores,
At least one in-store camera is installed in each of the plurality of stores,
The management server records the action history of the registered user in each of the plurality of stores,
In response to a fifth request from the mobile terminal, the management server transmits information regarding the action history of the registered user in the plurality of stores to the mobile terminal.
The action history presentation method according to any one of Supplementary Note 16 to Supplementary Note 19.

DESCRIPTION OF SYMBOLS 1 Management server 2 In-store camera 3 Portable terminal 11 User information 11A User image 11B Action history 12 Store information 13 Product information 13A Product image 14 Data collection part 15 Data extraction part 21, 34 Camera 22 Image processing part 23 Communication part 31 Control part 32 Display unit 33 Input unit 35 Recording unit 36 Wireless communication unit 37 User application 41 User registration processing 42 Action history processing 43 Product information processing 44 Favorite processing 45 Point processing 100 Commercial facility information system 200 Commercial facility

Claims (10)

At least one portable terminal assigned to one user and at least one in a store is capable of communicating with an in-store camera for taking an in-store image of the store and transmitting the in-store image,
Means for determining a person included in the in-store image as a registered user based on a user image of a user who is pre-registered and assigned the mobile terminal;
Means for recording an action history of the registered user in the store;
A server apparatus comprising: means for transmitting information related to the action history to the portable terminal in response to a first request from the portable terminal. Means for recording, as the action history of the registered user in the store, information relating to the check of the product performed by the registered user in the store based on the in-store image;
Means for transmitting information related to the check of the product to the portable terminal in response to a second request from the portable terminal;
The server device according to claim 1, further comprising:   The server apparatus according to claim 2, further comprising means for transmitting, to the mobile terminal, detailed product information of the product that is the target of the check in response to a third request from the mobile terminal.   The server apparatus according to claim 3, further comprising means for transmitting product information similar to the product to be checked to the mobile terminal in response to a fourth request from the mobile terminal. The store is one of stores stored in a commercial facility that stores a plurality of stores,
At least one in-store camera is installed in each of the plurality of stores,
Means for recording the action history of the registered user in each of the plurality of stores;
5. The apparatus according to claim 1, further comprising: a unit configured to transmit, to the portable terminal, information related to the action history of the registered user in the plurality of stores in response to a fifth request from the portable terminal. The server device according to one item. A mobile device assigned to one user,
An in-store camera installed in at least one store, taking an in-store image of the store, and transmitting the in-store image;
A management server capable of communicating with the portable terminal and the in-store camera;
The management server is
Means for determining a person included in the in-store image as a registered user based on a user image of a user who is pre-registered and assigned the mobile terminal;
Means for recording an action history of the registered user in the store;
Means for transmitting information related to the action history to the portable terminal in response to a first request from the portable terminal;
An information system in a commercial facility. The management server is
Based on the in-store image, the registered user records information related to product checks performed in the store as the action history of the registered user in the store,
In response to a second request from the mobile terminal, information on the product check is transmitted to the mobile terminal.
The information system in a commercial facility according to claim 6.   The information system in a commercial facility of Claim 7 which the said management server transmits the goods detailed information of the goods used as the said check object to the said portable terminal according to the 3rd request | requirement from the said portable terminal. At least one portable terminal assigned to one user, and installed in one store, take an in-store image of the store, and executed by a management server capable of communicating with the in-store camera for transmitting the in-store image,
Means for determining a person included in the in-store image as a registered user based on a user image of a user who is pre-registered and assigned the mobile terminal;
Means for recording an action history of the registered user in the store;
A program for causing the management server to function as means for transmitting information related to the action history to the portable terminal in response to a first request from the portable terminal. Based on the user image of the mobile terminal registered in advance in the management server, the management server determines a person included in the in-store image taken by the in-store camera installed in the store as a registered user, and the registered user's A stage in which the management server records an action history in the store;
The management server presents a method of presenting an action history in response to a first request from the portable terminal, wherein the management server transmits information related to the action history to the portable terminal.

Images