JP2014164594A - Portable terminal, information system, information collection method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To collect information with a small amount of user burden.SOLUTION: A camera unit 110 has an imaging function and images a variety of advertisement media. A dictionary database 130 manages a data string in which image feature quantity of each commodity and a commodity name are associated with each other. An image analysis unit 120 compares an image which is imaged by the camera unit 110 with the feature quantity of each commodity stored in the dictionary database 130 and recognizes which commodity is imaged. Then, the image analysis unit 120 acquires a recognized commodity name from the dictionary database 130 and temporarily stores the acquired data and an advertisement medium being an imaging object in association with each other. A data input unit 140 transmits the temporarily stored data to a customer information database 210.

Description

  The present invention relates to a portable terminal, an information system, an information collection method, and a program.

  Users acquire information through various media such as newspapers, magazines, flyers, signboards, and television commercials. Here, in order to grasp the needs such as what kind of purchase the user made after referring to each medium, interviews and questionnaires (web questionnaires and questionnaires using paper media) are generally performed Met.

  However, methods based on interviews and questionnaires may lack real-time properties and information may become obsolete. Further, when it is desired to acquire a lot of information from the user, the content of the question becomes large and complicated. Therefore, the problem that the burden on the user increases and the problem that the accuracy of information decreases due to the decrease in the collection rate of the questionnaire have occurred.

  Note that Patent Document 1 discloses an information search system capable of continuating a procedure from a user's concern about a certain product to purchase. This information search system has a function of analyzing a product photographed by a user and transmitting data corresponding to the product to the user terminal. However, Patent Document 1 does not mention any analysis of user needs from a user search process.

JP 2005-215922 A

Image recognition service GAZIRU, [Search February 14, 2013], Internet <URL: http://jpn.nec.com/solution/cloud/gazou/>

  As described above, the current user needs analysis method has a problem that a user burden such as an answer to a questionnaire is large.

  Therefore, the present invention has been made in view of the above-described problems, and a main object thereof is to provide a mobile terminal, an information system, an information collection method, and a program that enable information collection with a low user burden.

One aspect of the portable terminal according to the present invention is:
A camera unit having an imaging function and imaging various advertising media;
A dictionary database that holds a data string in which product image feature quantities and product names are associated;
The product acquired by comparing the image acquired by the camera unit and the feature quantity stored in the dictionary database is recognized, and the product name related to the product and the advertising medium captured by the camera unit An image analysis unit that acquires a photographed product data string that is a data string associated with a type;
A data input unit for storing the photographed product data string in a customer information database;
It is what has.

One aspect of the information system according to the present invention is:
An information system having a server and a mobile terminal,
The server
Have a customer information database,
The portable terminal is
A camera unit having an imaging function and imaging various advertising media;
A dictionary database that holds a data string in which product image feature quantities and product names are associated;
The product acquired by comparing the image acquired by the camera unit and the feature quantity stored in the dictionary database is recognized, and the product name related to the product and the advertising medium captured by the camera unit An image analysis unit that acquires a photographed product data string that is a data string associated with a type;
A data input unit for storing the photographed product data string in a customer information database.

One aspect of the information collecting method according to the present invention is:
An imaging step having an imaging function and imaging various advertising media;
A dictionary database that holds a data string in which product image feature quantities and product names are associated;
The image acquired in the imaging step and the feature quantity of the product image recorded in advance are recognized to recognize the imaged product, the product name related to the product is acquired from the database, and the imaged advertisement An image analysis step of obtaining a photographed product data sequence that is a data sequence associated with a medium type;
A transmission step of transmitting the photographed product data string to a server having a customer information database.

One aspect of the program according to the present invention is as follows:
On the computer,
An imaging step having an imaging function and imaging various advertising media;
A dictionary database that holds a data string in which product image feature quantities and product names are associated;
The image acquired in the imaging step and the feature quantity of the product image recorded in advance are recognized to recognize the imaged product, the product name related to the product is acquired from the database, and the imaged advertisement An image analysis step of obtaining a photographed product data sequence that is a data sequence associated with a medium type;
Transmitting the photographed product data string to a server having a customer information database;
Is to execute.

  In the present invention, it is possible to provide a mobile terminal, an information system, an information collection method, and a program that enable information collection with low user burden.

1 is a block diagram showing a configuration of an information system 1 according to a first exemplary embodiment. 3 is a flowchart showing an operation of the mobile terminal 10 according to the first exemplary embodiment. FIG. 3 is a diagram illustrating an operation concept of the information system 1 according to the first exemplary embodiment. It is a block diagram which shows the structure of the information system 1 concerning this invention.

<Embodiment 1>
Embodiments of the present invention will be described below with reference to the drawings. First, a configuration example of the information system according to this exemplary embodiment will be described with reference to FIG. The information system 1 includes a mobile terminal 10 and a server 20. Although only one mobile terminal 10 is displayed in FIG. 1, there are actually a plurality of mobile terminals 10.

  The mobile terminal 10 is assumed to be a communication terminal suitable for gripping of a user such as a smartphone or a tablet terminal. The mobile terminal 10 has a communication function by Internet connection.

  The mobile terminal 10 includes a camera unit 110, an image analysis unit 120, a dictionary database 130, a data input unit 140, and a browser 150. The server 20 is configured to have a customer information database 210. The portable terminal 10 and the server 20 are connected via the Internet and are configured to be able to communicate with each other.

  The camera unit 110 acquires a subject in the lens direction as an image. The camera unit 110 includes hardware such as a lens and software that controls the hardware.

  The dictionary database 130 is a database that stores the shapes and colors of various products that can be placed on advertising media such as flyers as feature quantities. The dictionary database 130 also holds information such as the names of the products in association with each other. Furthermore, the dictionary database 130 associates and holds each product and a URL (Uniform Resource Locator) for displaying information on the product. That is, the dictionary database 130 manages a data string in which each product name, an image feature amount of each product, and a URL of each product are associated. Data can be added to the dictionary database 130 at an arbitrary timing, and data downloaded via the Internet can be reflected.

  The image analysis unit 120 compares the feature amount information extracted from the image captured by the camera unit 110 with the feature amount information of various products in the dictionary database 130. Here, the comparison of feature amounts includes processing such as comparison of RGB values of pixels. The image analysis unit 120 recognizes what the product captured by the camera unit 110 is based on the comparison. The comparison process performed by the image analysis unit 120 may be a technique used in a general image processing apparatus, or may be a technique similar to the technique used in the system described in Non-Patent Document 1. In the following description, it is referred to as “image recognition” that the image analysis unit 120 determines that the subject imaged by the camera unit 110 matches the specific product in the dictionary database 130.

  The image analysis unit 120 compares the subject captured by the camera unit 110 with each product in the dictionary database 130 at regular intervals, and when the image is recognized, “product name” and “product are described”. Associate advertising media. Note that the image analysis unit 120 may acquire “advertisement medium on which a product is described” by image analysis, or may acquire it according to user input. For example, when the image analysis unit 120 recognizes the image of the product A once, the product B twice, and the product C only once within a predetermined time, (product A, flyer), (product B, flyer), (product B , Flyer), (product C, flyer).

  Each time the image analysis unit 120 recognizes an image, the image analysis unit 120 acquires the URL of the product related to the image recognition from the dictionary database 130 and displays it on the display of the mobile terminal 10 in a link format. The user starts the browser 150 by tapping the link, and can display a product reference page (or purchase page) on the browser 150 screen.

  The data input unit 140 includes a data string (for example, (product A, flyer), (product B, flyer), (product B, flyer), (product C, flyer)) acquired by the image analysis unit 120 through image recognition. The information is transmitted to be input to the customer information database 210 in association with information for identifying the user (for example, information indicating the name, age, gender, etc. of the user, described as user information below). Here, the data input unit 140 preferably transmits data at the timing when the web page related to the product is browsed by the browser 150. However, the data input unit 140 is not limited thereto, and may transmit a data string at regular intervals.

  A data string (a data string including a product name, an advertising medium on which a product is posted, and user information) input to the customer information database 210 is also referred to as a photographed product data string. The user information may be acquired from, for example, input authentication information when using the information system 1. The data input unit 140 deletes the transmitted data string from the portable terminal 10 after transmitting the data string.

  The server 20 is a general server device arranged in the Internet environment. The server 2 has a customer information database 210. Data strings are input to the customer information database 210 from various portable terminals 10. That is, browsing records of various user products are input to the customer information database 210.

  Each data string stored in the customer information database 210 is used as appropriate for the investigation of user needs. As described above, the data string stored in the customer information database 210 includes data on “product name”, “advertisement medium on which the product is described”, and “user information”. These data are used to analyze the product browsing status by age and the movement status of each user to the purchase page, that is, user needs, by an arbitrary analysis method.

  The data input unit 140 may transmit only the data (the product name and the advertising medium on which the product is posted) acquired by the image analysis unit 120 through image recognition according to the product characteristics, but is associated with the user information. A more detailed analysis of the needs using the customer database 210 becomes possible by transmitting.

  Then, with reference to FIG. 2, operation | movement of the portable terminal 10 concerning this Embodiment is demonstrated. FIG. 2 is a flowchart showing the operation of the mobile terminal 10. First, the mobile terminal 10 starts an imaging operation of the camera unit 110 by starting an application (S1).

  The camera unit 110 images a subject in the direction of the camera lens at regular intervals. Then, the image analysis unit 120 compares the feature amount calculated from the image captured by the camera unit 110 with the feature amount of each product stored in the dictionary database 130 (S2). When the image recognition is performed (S3: Yes), the image analysis unit 120 acquires the corresponding product name and advertisement medium type from the dictionary database 130, and associates the acquired data (product name data and advertisement). The medium type data is temporarily stored as one set (S4). Then, the image analysis unit 120 acquires the URL associated with the acquired product from the dictionary database 130 and displays it on the display of the mobile terminal 10 (S5).

  When the displayed URL is selected by tapping or the like (S6: Yes), the browser 150 displays the web page indicated by the URL on the display (S7). Then, the data input unit 140 transmits the data temporarily stored in S4 after displaying the web page to the customer database 210 in association with the user information (S8). Thereafter, the data input unit 140 deletes all the data strings temporarily stored in S4 from the mobile terminal 10 (S9).

  The above-described processing (S2 to S8) is continuously executed until the activation source application ends (S10). After the application is terminated (S10: Yes), if the data temporarily stored in S4 remains, the data string is deleted from the mobile terminal 10 (S11).

  Next, an operation example of the information system 1 according to the present embodiment will be described with reference to FIG. FIG. 3 is a diagram conceptually illustrating the operation of the mobile terminal 10 according to the present embodiment. In the following description, an example in which a leaflet of company X is recognized using the portable terminal 10 of person Y will be described.

  The camera unit 110 in the mobile terminal 10 captures images at regular time intervals. The image analysis unit 120 performs image recognition processing by comparing the captured image with the dictionary database 130. In this example, a comparison process with the products A, B, and C displayed on the leaflet of the company X is performed.

  Each time image recognition is performed, the image analysis unit 120 temporarily stores a product name (any one of the products A to C) and an advertising medium on which the product is posted (X company flyer) in association with each other. For example, when image recognition is performed once for product A, twice for product B, and once for product C, the image analysis unit 120 (product A, flyer), (product B, flyer), (product B, flyer), ( Data “product C, flyer” is temporarily stored.

  Further, every time image recognition is performed, the image analysis unit 120 acquires the URL of the product from the dictionary database 130 and displays it on the display of the mobile terminal 10 or the like. When the user taps this URL, the browser 150 displays a web page related to this URL. For example, a purchase site for the product A is displayed.

  After displaying the web page, the data input unit 140 stores the data string ((product C, flyer), (product B, flyer), (product B, flyer), (product A, flyer)) and user Y temporarily stored. Are input to the customer information database 210 in association with each other. As a result, a data string that identifies which advertising medium the user Y has acquired the merchandise information is input to the customer information database 210. In addition, it is possible to grasp how many times each product has been photographed based on the data stored in the customer information database 210.

  Then, the effect of the information system 1 concerning this Embodiment is demonstrated. A technique such as a questionnaire requires a large amount of questions in order to obtain appropriate information. Due to the large number of questions and the complexity of questions, the collection rate of questionnaires has been low, and there have been cases where information cannot be collected sufficiently. On the other hand, in the information system according to the present embodiment, the processing performed by the user is only the imaging processing by the camera unit 110, so the burden on the user can be reduced and the information collection rate can be increased.

  Moreover, in survey methods such as questionnaires, there are cases where there are users who write lies, and this makes it impossible to collect highly accurate information. In this embodiment, since information is collected based on mechanical processing by image recognition, it is possible to collect information with high accuracy.

  As described above, the mobile terminal 10 according to the present embodiment performs image recognition using the dictionary database 130 and sequentially inputs the product and advertisement medium data obtained by the image recognition into the customer information database 210. As a result, in the customer information database 210, data capable of analyzing the purchase characteristics of the user is immediately stored. That is, real-time information collection can be realized.

  In particular, since data transmission to the customer information database 210 is performed after tapping the URL, it is possible to grasp from which advertising medium the product URL is referred. That is, the purchase route can be grasped with high accuracy.

  In addition, the number of times each user performs image recognition for each product can be grasped from the data string in the customer information database 210. This also makes it possible to grasp the user's deep psychology.

  The data input unit 140 appropriately deletes the data string transmitted from the mobile terminal 10 after transmitting the data string. As a result, it is possible to avoid compression of the data area in the mobile terminal 10 and to avoid a situation in which unnecessary personal information remains in the mobile terminal 10.

  The above-described embodiments are merely examples relating to application of technical ideas obtained by the present inventors. That is, the technical idea is not limited to the above-described embodiment, and various changes can be made.

  Various processes in the mobile terminal 10 (imaging control processing in the camera unit 110, processing in the image analysis unit 120, processing in the data input unit 140, and processing in the browser 150) can be realized as a program that operates in an arbitrary computer. it can. The program may be stored using various types of non-transitory computer readable media and supplied to a computer. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / W and semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)) are included. The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

  Finally, the outline of the present invention will be described again with reference to FIG. FIG. 4 is a block diagram showing a characteristic part of the mobile terminal 10 of the present invention. The camera unit 110 has an imaging function and images various advertising media. The dictionary database 130 manages a data string that associates the image feature quantity of each product with the product name.

  The image analysis unit 120 compares the image captured by the camera unit 110 with the feature amount of each product stored in the dictionary database 130, and recognizes what product is captured. Then, the image analysis unit 120 acquires data such as product names from the dictionary database 130, and temporarily stores the acquired data in association with the advertising medium to be imaged. The data input unit 140 transmits the temporarily stored data to the customer information database 210.

  Thus, when collecting information using the mobile terminal 10, the user only performs processing related to shooting. Thereby, information collection with a small user's load can be performed.

DESCRIPTION OF SYMBOLS 1 Information system 10 Portable terminal 110 Camera part 120 Image analysis part 130 Dictionary database 140 Data input part 150 Browser 20 Server 210 Customer information database

Claims (10)

A camera unit having an imaging function and imaging various advertising media;
A dictionary database that holds a data string in which product image feature quantities and product names are associated;
The product acquired by comparing the image acquired by the camera unit and the feature quantity stored in the dictionary database is recognized, and the product name related to the product and the advertising medium captured by the camera unit An image analysis unit that acquires a photographed product data string that is a data string associated with a type;
A data input unit for storing the photographed product data string in a customer information database;
Mobile terminal having.   The mobile terminal according to claim 1, wherein the data input unit inserts user information, which is information relating to a user who uses the mobile terminal, into the photographed product data string and stores the user information in the customer information database.   The mobile terminal according to claim 1, wherein the data input unit deletes the photographed product data string from the mobile terminal after data input to the customer information database. The dictionary database associates and stores a feature value of an image of a product, a product name, and a URL that refers to a web page related to the product,
The image analysis unit acquires a URL related to the recognized product from the dictionary database at the time of product recognition of the image captured by the camera unit, displays the URL on the display unit of the mobile terminal,
The portable terminal according to any one of claims 1 to 3, wherein the data input unit stores the photographed product data string in a customer information database when a URL displayed on the display unit is selected. An information system having a server and a mobile terminal,
The server
Have a customer information database,
The portable terminal is
A camera unit having an imaging function and imaging various advertising media;
A dictionary database that holds a data string in which product image feature quantities and product names are associated;
The product acquired by comparing the image acquired by the camera unit and the feature quantity stored in the dictionary database is recognized, and the product name related to the product and the advertising medium captured by the camera unit An image analysis unit that acquires a photographed product data string that is a data string associated with a type;
A data input unit for storing the photographed product data string in a customer information database.   The information system according to claim 5, wherein the data input unit inserts user information, which is information relating to a user who uses the mobile terminal, into the photographed product data string and stores the user information in the customer information database.   The information system according to claim 5 or 6, wherein the data input unit deletes the photographed product data string from the portable terminal after data input to the customer information database. The dictionary database associates and stores a feature value of an image of a product, a product name, and a URL that refers to a web page related to the product,
The image analysis unit acquires a URL related to the recognized product from the dictionary database at the time of product recognition of the image captured by the camera unit, displays the URL on the display unit of the mobile terminal,
The information system according to any one of claims 5 to 7, wherein the data input unit stores the photographed product data string in a customer information database when a URL displayed on the display unit is selected. An imaging step having an imaging function and imaging various advertising media;
A dictionary database that holds a data string in which product image feature quantities and product names are associated;
The image acquired in the imaging step and the feature quantity of the product image recorded in advance are recognized to recognize the imaged product, the product name related to the product is acquired from the database, and the imaged advertisement An image analysis step of obtaining a photographed product data sequence that is a data sequence associated with a medium type;
A transmission step of transmitting the photographed product data string to a server having a customer information database. On the computer,
An imaging step having an imaging function and imaging various advertising media;
A dictionary database that holds a data string in which product image feature quantities and product names are associated;
The image acquired in the imaging step and the feature quantity of the product image recorded in advance are recognized to recognize the imaged product, the product name related to the product is acquired from the database, and the imaged advertisement An image analysis step of obtaining a photographed product data sequence that is a data sequence associated with a medium type;
Transmitting the photographed product data string to a server having a customer information database;
A program that executes