JP2014021772A - Evaluation system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an evaluation system by which an evaluator can actively evaluate an object in a real world.SOLUTION: The evaluation system includes: a program 114 that causes a computer 12 to function as specific operation detection means 35 for detecting a predetermined specific operation, identification information acquisition means 21 and 38 for acquiring identification information of an evaluation object, identification information storage means 34 for storing the identification information of the evaluation object acquired by the identification information acquisition means in a storage unit, and transmission means 32 for transmitting the identification information stored in the storage unit to an external device summing up evaluation information of the evaluation object when receiving predetermined signals from the outside at a position where the identification information acquisition means can acquire the identification information; and an external device 13 that has evaluation information update means 25 for updating, upon receiving the identification information, the evaluation information of the evaluation object associated with the identification information.

Description

  The present invention relates to an evaluation system that allows an evaluator to evaluate an object in the real world.

  In order to promote sales of their own products and services, the providers of products and services carry out various sales promotion activities. On the other hand, with advances in communication technology, customers and other recipients (hereinafter referred to simply as “evaluators”) can evaluate products and services, and each evaluator can share the evaluation results on the Web, etc. It has become. For example, there is a Web site where an arbitrary evaluator can post a review article for a specific product. Potential buyers interested in products and services tend to emphasize not only the information provided by the provider but also the evaluation results of the evaluator.

  On the Internet, a technique for publicizing evaluation results of various types of information by an arbitrary evaluator is known (see, for example, Patent Document 1). Patent Document 1 describes that a message is evaluated by pressing a predetermined button, and the evaluation is notified to a message sender or displayed on a list.

  However, evaluation of goods and services by such an evaluator is possible only for information on the Web. When posting a review article for a specific product, a website dedicated to the product is prepared in advance.

  In addition, a technique for judging an evaluator's evaluation of an object existing in the real world, not information on the Web is frequently seen (see, for example, Patent Document 2). According to Patent Document 2, the behavior of a visitor is picked up, returned, brought into a fitting room, purchased, or not purchased by an IC tag attached to the product and an antenna for identifying the tag. Analyzing as a type, the visitor's behavior is associated with the store visitor and time to make a series of purchase behavior, and weighting is set in advance via the input / output means according to the type of behavior included in the purchase behavior A product information providing system is disclosed that aggregates the results and adds the results of the aggregation and the purchase behavior or behavior that is the basis of the aggregation to the input / output means in response to a request from the input / output means.

  However, the product information providing system disclosed in Patent Document 2 has a problem that the store visitor cannot actively give evaluation to the product. That is, the product information providing system disclosed in Patent Document 2 does not take into account that the customer's actions are automatically evaluated and the customer intentionally gives the product an evaluation.

  As described above, in the conventional technology, there is no mechanism in which an evaluator actively gives an evaluation to a product or service that exists in the real world or shares the evaluation.

  By the way, in the real world, a technique for limiting the reception range of radio waves is known (for example, see Patent Document 3). Patent Document 3 discloses a wireless LAN access point device that improves security during wireless LAN setting by transmitting and receiving wireless LAN setting information using directional electromagnetic waves. There is a possibility that places where products and services can be evaluated can be restricted by such a technique.

  However, the reception range limiting method described in Patent Document 3 has a problem that if a radio wave from a certain direction can be received, the wireless LAN device can communicate.

  In view of the above problems, an object of the present invention is to provide an evaluation system that restricts places where evaluation can be performed and enables an evaluator to actively give evaluations to a target in the real world.

  The present invention provides a computer with a specific operation detection unit that detects a predetermined specific operation, an identification information acquisition unit that acquires identification information of an evaluation target according to a result of the specific operation detection unit, An identification information storage unit that stores the identification information of the evaluation target acquired by the identification information acquisition unit in a storage unit, and receives a predetermined signal from the outside at a location where the identification information acquisition unit can acquire the identification information. When the identification information is received, the identification information stored in the storage unit is transmitted to an external device that aggregates the evaluation information to be evaluated, and the identification information is received. An evaluation system comprising: an external device having evaluation information updating means for updating the evaluation information to be evaluated, which is associated with information. Subjected to.

  It is possible to provide an evaluation system that limits the places where evaluation can be performed and enables the evaluator to actively give evaluations to the object in the real world.

It is an example of the figure which shows the schematic procedure of the evaluation system of a present Example. It is an example of the figure which shows the schematic procedure of the evaluation system of a present Example. It is an example of the schematic block diagram of an evaluation system. It is an example of the hardware block diagram of an evaluation device. It is an example of the hardware block diagram of a server. It is an example of a functional block diagram of an evaluation system including an evaluation device. It is a figure which shows an example of ID displayed on the display part. It is an example of the schematic block diagram of an irradiation apparatus and a light-receiving device. It is an example of the figure which illustrates lighting intensity which changes with time typically. It is an example of the figure which shows an evaluation result table and an object specific table typically. It is a figure which shows an example of related information. It is a figure which shows an example of the top page displayed on the browsing client. It is an example of the flowchart figure which shows the procedure in which an evaluation device evaluates object. It is an example of the flowchart figure which shows the procedure in which an operation | movement detection part detects gesture operation | movement. It is an example of the flowchart figure which shows the procedure in which a server receives ID. It is an example of the flowchart figure which shows the procedure in which a browsing client requests | requires evaluation data with respect to a server. It is an example of the figure which shows another structural example of the functional block diagram of an evaluation system. It is an example of the figure which shows another structural example of the functional block diagram of an evaluation system. It is an example of the figure which shows the schematic procedure of an evaluation system (Example 2). It is an example of the figure which shows the schematic procedure of an evaluation system (Example 2). It is an example of the schematic block diagram of an evaluation system (Example 2). It is an example of functional block diagrams, such as an evaluation device (Example 2). It is an example of the figure which illustrates image data DB typically. It is an example of the figure which illustrates the outline of a visual search typically. It is a figure which shows an example of the document image by which skew correction was carried out. It is an example of the figure which illustrates grouping based on a word boundary typically. It is an example of the figure explaining the feature-value which makes 0 and 1 a feature-value. It is a figure which shows the example of calculation of the angle which a word boundary forms. It is an example of the figure explaining the feature-value based on word length. It is an example of the figure which shows the specific example about how a vertical layout is integrated with a horizontal layout. FIG. 26 is an example of a diagram illustrating a method for combining horizontal and vertical trigram information obtained in FIG. 25. It is an example of the flowchart figure which shows the procedure in which an evaluation device transmits image data to a search server.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. 1 and 2 are examples of diagrams showing a schematic procedure of the evaluation system of the present embodiment.
(1) The evaluator carries the evaluation device 12. The evaluation device 12 is, for example, a portable communication terminal. When an evaluator encounters an evaluation object 11 of interest while moving in the real world, the evaluator generally walks and stops slowly.
(2) The evaluation device 12 continuously detects the evaluation target 11 capable of wireless communication. If communication is possible, the evaluation device 12 communicates with the evaluation target 11 and receives the ID. The ID is identification information for specifying the evaluation target 11.
(3) When the evaluator wants to evaluate the evaluation target 11 with an interest, the evaluator performs a predetermined specific operation. The specific action is arbitrary as long as it is an action that the evaluator consciously takes at the time of evaluation (it may not be an action that occurs unconsciously). For example, the evaluation device is moved in the space (gesture), voice input, operation of the evaluation device 12 or the like.
(4) A highly directional infrared ray or visible light is irradiated at a position where an evaluation target can be evaluated. The device that emits infrared light and visible light is referred to as an irradiation device 16. The irradiation device 16 transmits installation information using infrared rays or visible light, and the evaluation device 12 cannot use the ID without receiving the installation information. That is, the evaluator cannot evaluate the evaluation target unless the evaluation device 12 is placed within the irradiation range of the irradiation device 16.
(5) When the evaluation device 12 detects the specific operation and receives the installation information, the evaluation device 12 transmits at least an ID (or along with the installation information) to the server 13. The server 13 identifies the evaluation target 11 based on the ID and totals the number of evaluations. The tabulation of the evaluation number is to count up the evaluation number of the received ID every time the same ID is received. Therefore, it means that the evaluation target 11 having an ID with a large number of evaluations compiled by the server 13 is evaluated by many evaluators. When the evaluation means “good thing”, it means that the evaluation target 11 is evaluated as being better by many evaluators.

  Thus, in the evaluation system of the present embodiment, the evaluator can actively evaluate products and services in the real space. Further, if the evaluation device 12 does not receive the installation information from the irradiation device 16, the evaluator cannot evaluate the evaluation target, so that the position and place where the evaluation is performed can be limited.

[Configuration example]
FIG. 3 shows an example of a schematic configuration diagram of the evaluation system 500 of the present embodiment. The evaluation system 500 includes an evaluation target (wireless communication chip 15) 11, an evaluation device 12, an irradiation device 16, and a server 13. The browsing client 14 may be added to the evaluation system 500. In addition, although the person who carries the evaluation device 12 is referred to as an evaluator, the evaluator may be any person or a person who is given a certain qualification.

<Target of evaluation and wireless communication chip>
A wireless communication chip 15 is arranged on the evaluation target 11. The wireless communication chip 15 is, for example, an IC tag using, for example, RFID (Radio Frequency Identification). The IC tag has a relatively small chip and an antenna, and stores at least an ID. The IC tag reads out and transmits the ID when it receives radio waves or electromagnetic waves, or spontaneously. In general, the wireless communication chip 15 can be identified with the evaluation target 11. That is, it may be physically integrated with the evaluation target 11 and may be difficult to separate. However, it need not be physically integrated or difficult to separate.

  The wireless communication chip 15 is created by, for example, a semiconductor manufacturing process. Such a three-dimensional wireless communication chip 15 is affixed or embedded on the surface of a three-dimensional object or a flat object. The wireless communication chip 15 can be formed using a printing technique. The printing may be performed by any printing technique, for example, screen printing, flexographic printing, an inkjet method, or the like. Such a planar wireless communication chip 15 is formed directly on the surface of a three-dimensional object or a planar object, or attached after being formed by printing.

  The wireless communication chip 15 as an IC tag may be any type, such as a passive type that does not have a battery, an active type that has a battery and spontaneously transmits radio waves, or a semiconductor that has a battery but does not spontaneously transmit radio waves. Any of passive type may be used. The radio frequency band may be defined by national or regional standards, but the frequency band is not limited. For example, there are frequency bands such as 135 kHz or less, 13.56 MHz, UHF band (860 M to 960 M), and 2.45 GHz. Further, an IC tag of a specific standard such as NFC (Near Field Communication) or Transfer Jet (registered trademark) can be used.

  For example, the active or semi-passive wireless communication chip 15 has a communication distance of around 100 meters. The wireless communication chip 15 that communicates at a UHF band frequency even in the passive type has a communication distance of 10 meters or more. For this reason, it is advantageous when evaluating the object 11 of the distant evaluation as viewed from the evaluator. On the other hand, since the wireless communication chip 15 that communicates at a frequency of 13.56 MHz has a communication distance of several centimeters, it is advantageous when an evaluator selectively evaluates a specific evaluation target 11 from many evaluation targets 11. It is.

  The ID is numbers, symbols, alphabets, or identification information in which these are combined. As product ID codes, JAN (Japanese Article Number) codes, EAN codes (European Article Number), and UPC (Universal Product Code) codes are known. The ID is preferably unique in the whole world, the whole country, or the country or region. However, since the ID is assigned by the provider of the evaluation target 11, the ID may be duplicated depending on the scale of the evaluation system 500. There is also. However, the IC tag stores not only the ID but also information to be evaluated. Information stored in the IC tag is arbitrary information for facilitating management, and includes various information such as a product name, a provider name, a product size, a color, and a lot number. Therefore, the ID and other information hardly match. When the IDs overlap, the server 13 determines whether or not other information matches. If the other information does not match, the server 13 determines that the ID is another evaluation target 11. In this case, a branch number is assigned separately from the ID, and the uniqueness of the ID can be managed on the server side.

  On the other hand, when the evaluation system 500 is deployed in a specific range such as an exhibition or a department store, it is only necessary to count the number of evaluations in a specific range, so it is unique only in a specific range such as an exhibition or a product department. If it is enough.

  The wireless communication chip 15 may be a Bluetooth (registered trademark), a wireless LAN, or the like in addition to the IC tag.

  The evaluation target 11 only needs to have the wireless communication chip 15 and may be a tangible or intangible object. In the case of a tangible object, any object such as a product, an exhibit, a loaned item, a property owned by oneself or another person, a single item, a waste item, a feature fixed on a road, or a building can be an object 11 to be evaluated. Intangible objects include services (services), sightseeing spots, sights, places, spaces, etc., but can be evaluated because the wireless communication chip 15 can be placed by being linked to some tangible object. For example, services include restaurants, beauty salons, cleaning, repairs, human resource introduction, education, transportation, infrastructure services, administrative services such as ward / city halls, and medical institutions. In the case of service, the provider can arrange the wireless communication chip 15 at a service providing place, a place with a shop name, a table in a store, a cashier counter, a terminal of a store clerk, and the like. In the case of a sightseeing spot, a sight, a place, or a space, it can be placed on the nearest station, a bus stop, a signboard for explaining a sightseeing spot, or the like.

<Evaluation device>
The evaluation device 12 only needs to have a communication device capable of communicating with the wireless communication chip 15 and the server 13. For example, in the case of a smartphone, tablet, straight PC, mobile phone, PDA (Personal Digital Assistant), notebook PC, etc., the evaluator carries the evaluation frequently without using a specific evaluation device 12 because the evaluator carries it frequently. The object 11 can be evaluated. Further, as will be described later, the evaluator evaluates the evaluation target 11 with a specific operation, and therefore, the evaluation device 12 can be an object having a shape that facilitates the specific operation. For example, in the case of a baton, the evaluator can evaluate the evaluation object 11 simply by swinging down the baton. Further, a name tag is provided to visitors at an exhibition or the like, and this name tag can be used as the evaluation device 12.

  The evaluation device 12 periodically searches for the wireless communication chip 15 and receives an ID from the wireless communication chip 15 when the wireless communication chip 15 is detected. The fact that the wireless communication chip 15 has transmitted the ID may be recorded. When the evaluation device 12 detects the specific operation after receiving the ID, the evaluation device 12 transmits the ID to the server 13. When the ID is received but no specific operation is detected, the ID of the evaluation device 12 is finally discarded.

  As another example of the communication procedure, the evaluation device 12 may search for the wireless communication chip 15 when detecting a specific operation, and receive an ID from the wireless communication chip 15 when the wireless communication chip 15 is detected. . Upon receiving the ID, the evaluation device 12 transmits the ID to the server 13.

  The evaluation device 12 preferably stores the transmitted ID. Thereby, when the evaluator carrying the evaluation device 12 operates the browsing client 14, the evaluated ID can be input to the browsing client 14 to check the evaluation number of the evaluation target 11 evaluated by the evaluator 11. . Alternatively, the evaluation device 12 can be operated to check the evaluation number of the evaluation target 11 evaluated by the server 13 itself.

  The evaluation device 12 executes a program 114 (application), which will be described later, and performs processing characteristic of the present embodiment. The program 114 is downloaded from the server 13 or a file server operated by the server 13.

<Irradiation device>
The irradiation device 16 irradiates radio waves with high directivity such as infrared rays and visible rays. The range in which the irradiation device 16 irradiates infrared rays and visible light is controlled, but it is arbitrary whether the irradiation range is widened or narrowed. For example, the irradiation range may be widened so that many evaluation devices 12 can receive at one time, or the irradiation range for one device can be set so that the evaluation device 12 can be specified. However, in any case, the range in which the ID can be received and the range in which the radio wave can be received overlap, and the evaluation device 12 can receive the ID in the server 13 only in the overlapping range. The transmission may be after leaving the overlapping range.

  The irradiation range may be arranged as an independent device, but it can also be used as, for example, a ceiling lighting device. Infrared rays are not visible, and blinking of visible light cannot be detected by human eyesight, so the evaluator hardly feels discomfort.

  Moreover, the evaluation device may acquire the position information of the evaluator using an IMES (Indoor Messaging System) GPS signal transmitter (transmitting a satellite positioning signal) as the irradiation device 16. In other words, the evaluation device is allowed to evaluate when the position information is received.

  Further, the irradiation device 16 can transmit data (installation information) by modulating infrared rays or visible rays. The installation information is, for example, communication permission information, store ID, area code, and the like. The irradiation device 16 repeatedly transmits these data.

<Server>
The evaluation device 12 communicates with the server 13 via a network. The network is a network in which, for example, a mobile phone network, a wireless LAN network, or WiMAX is combined with an IP network (a network that communicates using an Internet protocol). That is, a mobile phone network or a WiMAX communication carrier gateway is connected to the IP network, and a wireless LAN access point is connected to the IP network via a router. The evaluation device 12 is connected to a mobile phone network or a WiMAX base station, communicates with the server 13 via a gateway, or is connected to a wireless LAN access point, and is connected to the server 13 from the access point via a router. ing.

  The IP address of the server 13 is registered in advance in the program 114 executed by the evaluation device 12. The evaluation device 12 may be given a global IP address in advance, or a base station or an access point may temporarily give a local IP address.

  The server 13 has two functions. One is a function for totaling evaluations (hereinafter referred to as a totaling function 21), and the other is a function for providing the number of evaluations to the browsing client 14 (hereinafter referred to as a providing function 22). The number of evaluations is the sum of the number of received IDs for each ID, or a weight for one reception (for example, one reception is counted twice, or the number of one reception is determined by the strength of the gesture. It is the sum of the results.

  In the providing function, the server 13 provides the evaluation number to the browsing client 14. The browsing client 14 is an arbitrary information processing apparatus, but the evaluation device 12 may become the browsing client 14 as it is. The browsing client 14 and the server 13 are connected via a network. The browsing client 14 connects to the server 13 via a browser, for example, receives and displays the evaluation number, and receives and displays the evaluation number transmitted as an e-mail. The URL (or IP address) of the server 13 is known to the browsing client 14 or is provided by a DNS (Domain Name Server).

  When the evaluation device 12 operates as the browsing client 14, the evaluation number can be received as a response to the transmitted ID. That is, the program 114 operating on the evaluation device 12 is responsible for communication.

  Thus, the viewer who operates the browsing client 14 can confirm what kind of evaluation object 11 has a high evaluation and how much the evaluation object 11 he / she has evaluated has received. . In addition, since the provider of the evaluation target 11 knows or at least obtains the ID of the evaluation target 11 provided by himself, the number of evaluations of the evaluation target 11 provided by inputting the ID into the browsing client 14 Can be confirmed.

[Hardware configuration diagram]
FIG. 4 shows an example of a hardware configuration diagram of the evaluation device 12. The evaluation device 12 includes a CPU 101, ROM 102, RAM 103, flash ROM 104, display unit 105, operation unit 106, media I / F unit 107, wireless LAN communication unit 108, carrier communication unit 109, camera 110, microphone 111, acceleration sensor 112, A short-range wireless communication unit 113 and a light receiving device 115 are included.

  The CPU 101 controls the overall operation of the evaluation device 12 by executing a program 114 stored in the flash ROM 104. The ROM 102 stores IPL (Initial Program Loader) and static data. The RAM 103 is used as a work area when the CPU 101 executes the program 114.

  The flash ROM 104 stores an OS executed by the CPU 101 (for example, Android (registered trademark), iOS (registered trademark), Windows (registered trademark)), middleware, and a program 114 that provides the following functions of the evaluation device 12. ing. The program 114 may be called an application.

  The display unit 105 is a liquid crystal, an organic EL, or a projector, and displays a UI (User Interface) screen. A graphic control unit (not shown) interprets a drawing command written in the video RAM by the CPU 101 and displays various information such as a window, a menu, a cursor, a character, or an image on the display unit 105. Note that the display unit 105 integrally has a touch panel and displays various soft keys that accept user operations.

  The operation unit 106 is a hard key that accepts an evaluator's operation, a touch panel, or a soft key displayed on the touch panel. The operation details of the hard key, the touch panel, and the soft key are notified to the CPU 101.

  The media I / F 107 controls reading or writing (storage) of data with respect to a recording medium such as a flash memory.

  The program 114 is a file in an installable or executable format, and is distributed on a computer-readable recording medium. Further, the program 114 is distributed to the evaluation device 12 in a file that can be installed from the server 13 or can be executed, for example.

  The wireless LAN communication unit 108 transmits and receives data by controlling the modulation method, transmission speed, frequency, and the like based on IEEE802.11b / 11a / 11g / 11n. When data is received, the received radio wave is converted into a digital signal, and when data is transmitted, data requested to be transmitted from the CPU 101 is modulated according to a communication standard and transmitted as a radio wave.

  The carrier communication unit 109 performs various communications by a telecommunications carrier contracted by an evaluator of the evaluation device 12. The telecommunications carrier is, for example, a mobile phone carrier, a WiMax carrier, or the like that communicates with a communication standard such as CDMA or LTE. The carrier communication unit 109 is equipped with a SIM (Subscriber Identity Module Card) card. The SIM card is an IC card that stores contractor information issued by a telecommunications carrier to a contractor, and mainly stores a unique number called IMSI (International Mobile Subscriber Identity), a mobile phone number, and the like. .

  The carrier communication unit 109 performs modulation or the like according to a communication method determined by a telecommunications carrier and communicates with a base station (not shown) connected to the Internet. The base station is connected to the carrier server 13 of the telecommunication carrier, and the carrier server gives a temporary IP address to the evaluation device 12 and transmits the ID to the IP network via the gateway.

  The camera 110 is a color image pickup unit including a CCD or CMOS photoelectric conversion element. When the camera 110 is a stereo camera or has a distance measuring function using ultrasonic waves or the like, the distance to the evaluation target 11 is known, and therefore the size of the evaluation target 11 can be estimated from the focal length of the lens. In this case, discrimination based on the image of the evaluation target 11 is facilitated.

  The microphone 111 collects the evaluator's voice and converts it into an electrical signal. In addition, the program 114 operating on the evaluation device 12 performs so-called speech recognition that converts this electrical signal into text data.

  The acceleration sensor 112 is a sensor that detects acceleration in the x-axis, y-axis, and z-axis directions. The acceleration sensor 112 detects the direction of the evaluation device 12 and detects the moving direction in space. In addition to the acceleration sensor 112, a gyro sensor, a geomagnetic sensor, a fingerprint sensor, or the like may be provided. The gyro sensor detects the angular velocity of the evaluation device 12 with respect to the x-axis, y-axis, and z-axis. The geomagnetic sensor detects the direction from the direction of geomagnetism. Combining the detection results of these sensors makes it possible to detect complex specific operations.

  The short-range wireless communication unit 113 performs RFID communication with the wireless communication chip 15. In the case of the passive type, communication is performed according to the following procedure. The short-range wireless communication unit 113 transmits radio waves to a predetermined range. This radio wave includes a control signal (command) for controlling the wireless communication chip 15. The wireless communication chip 15 receives the radio wave, and the antenna resonates with the radio wave to generate an electromotive force. The generated power starts the circuit and performs a process according to the control signal (a process for reading and transmitting the ID). . The wireless communication chip 15 modulates a carrier wave having a predetermined frequency with an ID and transmits it as a radio wave. The short-range wireless communication unit 113 demodulates the radio wave and extracts the ID.

  The short-range wireless communication unit 113 may be Bluetooth (registered trademark), UWB (Ultra Wide Band), or the like, and may have a function of RFID communication separately from these.

  The light receiving device 115 receives infrared rays or visible light from the irradiation device 16.

  FIG. 5 shows an example of a hardware configuration diagram of the server 13. The server 13 may have a general information processing apparatus configuration.

  The server 13 includes a CPU 301, ROM 302, RAM 303, HDD 304, graphic board 305 to which a display 320 is connected, a keyboard / mouse 306, a media drive 307, and a communication device 308. The CPU 301 controls the entire server 13 by executing the program 310 stored in the HDD 304 using the RAM 303 as a working memory. A keyboard / mouse 306 is an input device that receives an operation of a system administrator. The media drive reads and writes data on optical media such as CDs, DVDs, and Blu-ray discs. The communication device 308 is, for example, an Ethernet (registered trademark) card for connecting to a network.

  The HDD stores an OS (Windows Linux (registered trademark), etc.), middleware, and a program 310 that provides the totaling function 21 and the providing function 22. The program 310 is a file in an installable or executable format, and is distributed by being recorded on a computer-readable recording medium. The program 310 is distributed as a file that can be installed or executed from a server 13 (not shown).

  Although the hardware configuration of the browsing client 14 is the same as that of the server 13, it does not need to be the same.

[About functions]
FIG. 6 shows an example of a functional block diagram of an evaluation system including the evaluation device 12. The evaluation device 12 includes a communication unit 31, an Internet communication unit 32, a control unit 33, a storage unit 34, an operation sensing unit 35, and a light receiving unit 36. The evaluation device 12 is controlled by the control unit 33. The control unit 33 controls the communication unit 31 and the Internet communication unit 32 according to a predetermined procedure, and transmits the ID received from the wireless communication chip 15 to the server 13. The light receiving unit 36 receives radio waves or visible light emitted from the irradiation device 16. Note that the Internet communication unit 32 can receive the evaluation number.

<Evaluation device>
The communication unit 31 acquires the ID from the wireless communication chip 15 by controlling the short-range wireless communication unit 113. The Internet communication unit 32 controls the carrier communication unit 109 and the wireless LAN communication unit 108 to communicate with the server 13 based on an application layer protocol such as FTP or HTTP, and transmits the ID to the server 13.

Since there are a plurality of evaluation targets 11 in the communicable range of the communication unit 31, a plurality of wireless communication chips 15 may return IDs in a short time. In this case, the ID transmitted from the Internet communication unit 32 to the server 13 is controlled as follows.
・ Send all ・ Send only one last ID ・ Send only one ID selected by the evaluator ・ Send only one ID with the highest signal strength Send all This is a case where the evaluation target 11 may be evaluated collectively, and is effective for evaluating a series of commodities such as daily necessities and interiors having a uniform design. The last ID is the last ID received when a predetermined time or more has passed after receiving the newest ID until the next ID is received (that is, when reception of the ID is interrupted). is there. It is assumed that the evaluator is moving and stops when he / she is interested in the evaluation target 11, but the last ID is likely to be the ID of the evaluation target 11 he / she is interested in when he / she stopped. For this reason, the ID of the evaluation object 11 evaluated by the evaluator can be transmitted to the server 13 by transmitting the last ID.

The ID selected by the evaluator is an ID selected by the evaluator from several IDs.
FIG. 7A is a diagram illustrating an example of an ID that is communicated by the communication unit 31 and displayed on the display unit 105. For example, there are three evaluation targets 11 (cups in the figure) in the communication range, and the display unit 105 displays three IDs. In this case, the evaluator specifies the ID of the evaluation target 11 being evaluated by causing the evaluation device 12 to communicate with the evaluation target 11 again. When the short-range wireless communication unit 113 has directivity, the evaluation target 11 facing the evaluation device 12 returns an ID, and thus the evaluator can specify the ID of the evaluation target 11. When the wireless communication chip 11 transmits information such as a product name to the evaluation device 12, the evaluation device 12 displays the product name and the like together with the ID on the display unit 105, so that the evaluator can easily select the ID.

  The ID having the highest radio wave intensity is the evaluation target 11 that is closest to the evaluation device 12. FIG. 7B is a diagram showing an example of an ID selected based on the radio field intensity. Since the communication unit 31 can specify the ID of the wireless communication chip 15 having the strongest radio wave intensity, the evaluation device 12 surrounds the ID with a rectangular frame or reverse-displays the ID, for example. If the evaluator is interested in the evaluation target 11, it is considered that the evaluator is approaching the evaluation target 11, and therefore the ID of the evaluation target 11 being evaluated by the evaluator can be transmitted.

  Note that the Internet communication unit 32 may transmit the ID of the wireless communication chip 15 having the highest radio wave intensity to the server 13 without causing the evaluator to select the ID.

  Here, it may be preferable for the Internet communication unit 32 to add information other than the ID. For example, the server 13 may not be able to specify the evaluation target 11 only by the ID (when the ID is not registered or when the ID 11 is the same but a different evaluation target 11 is registered). Therefore, the Internet communication unit 32 transmits related information that may be related to the evaluation target 11 together with the ID.

  The related information is, for example, information received from the wireless communication chip, a unique number of the evaluation device 12, position information, time information, a traveling direction of the evaluator, an image of the evaluation target 11, and an evaluator input the evaluation target 11. Comments etc. Information received from the wireless communication chip is arbitrary information for facilitating management as described above. The unique number is, for example, an IMSI or a mobile phone number. The position information is detected by a GNSS (Global Navigation Satellite Systems) included in the evaluation device 12. It can also be calculated from the radio wave intensity from a plurality of base stations and the position of the base station. The traveling direction is information indicating east, west, north, and south, and is specified by time-series position information or a detection value of a geomagnetic sensor, for example. The image of the evaluation target 11 is taken by the camera 110. The comment is, for example, the name of the evaluation target 11 or specific evaluation contents, and is input to the evaluation device 12 by the evaluator.

  When the evaluation system 500 is developed within a specific range such as an exhibition or a department store, it is also effective to include personal information permitted by the evaluator to be transmitted in the related information. Personal information is mainly contact information, and includes company name, name, address, telephone number, e-mail address, and the like. There are many cases where the evaluator is interested in the evaluation target 11 and wants detailed materials of the evaluation target 11, and there are not a few providers of products and services that want to contact such evaluator. For example, there are many such needs in exhibitions.

  The storage unit 34 stores the ID received by the communication unit 31, and preferably the position information and time information when the ID is received. When the evaluator takes an image of the evaluation target with the camera 110, the image of the evaluation target 11 is stored.

  For example, the motion sensing unit 35 senses that the acceleration detected by the acceleration sensor 112 has occurred due to a specific motion and notifies the control unit 33 of it. The specific action detected by the acceleration sensor 112 is referred to as a gesture action. The specific motion sensed by the motion sensing unit 35 is, for example, a motion in which the evaluation device 12 is vertically shaken. In this case, the motion sensing unit 35 senses an acceleration that continuously changes from a downward acceleration to an upward acceleration. To do. In addition, the specific operation can be defined as an operation in which the evaluator shakes the evaluation device 12 several times up and down, an operation that shakes the evaluation device several times in the right and left directions, an operation that protrudes forward, etc. Detects changes in acceleration. The motion sensing unit 35 stores a change in typical acceleration of each specific motion in advance, and detects the specific motion of the evaluator by comparing it.

  Further, the specific operation may be not only a gesture operation but also an input by voice as a specific operation, and an operation on the hard key, soft key, or touch panel of the evaluation device 12 may be a specific operation.

  Also, taking a picture may be a specific action. In addition, it is also possible to set the condition for ID transmission to detect a plurality of specific actions by combining voice input or an operation to the evaluation device 12 with a gesture action.

  Further, the motion sensing unit 35 can distinguish and detect a specific operation with a good evaluation and a specific operation with a bad evaluation. In this case, a change in acceleration typical of a specific action of good evaluation and a specific action of bad evaluation is stored in advance, and the specific action of the evaluator is detected by comparing with each of them.

  The light receiving unit 36 performs A / D conversion on infrared light or visible light irradiated by the irradiation device 16 and received by the light receiving device 115, and converts a digital signal into installation information.

FIG. 8 shows an example of a schematic configuration diagram of the irradiation device 16 and the light receiving device 115. The irradiation device 16 includes a control unit 161, a light source unit 162, an amplification unit 163, a lighting unit 164, a modulation unit 165, and a storage unit 166. The control unit 161 controls the entire irradiation device 16. The storage unit 166 stores communication permission information, store ID, area code, in-store location information, product information, and other installation information. The installation information can be set by an administrator of a store or the like where the irradiation device 16 is installed.
Communication permission information: Information that permits the evaluation device 12 that wirelessly communicates with the wireless communication chip in the irradiation range to transmit the ID to the server. Alternatively, it may be determined whether the evaluation device 12 is permitted or not, with the communication permission information as either communication permission / denial information.
Store ID: identification information of a store where an evaluation target is placed. The server 13 can specify the store name and location of the store by the store ID.
Area code: Information for identifying the prefecture, city, town, etc. of the area where the store is located. The server 13 can specify the prefecture and city of the store by the area code.
In-store location information: information indicating a location where an evaluation target is placed in the store, and includes, for example, a floor, a zone number in the floor, and the like.

  The modulation unit 165 changes the installation information in the storage unit 166 to the lighting intensity. For example, when the light source unit can change the lighting intensity in four stages (L1 to L4), the control unit 161 sets the installation information “00” to L1, “01” to L2, and “10” to the modulation unit 165. Is assigned to L3 and "11" is assigned to L4.

  The modulation unit 165 reads out the installation information by 2 bits from the storage unit 166, converts it into lighting intensity, and notifies the amplification unit 163 of it. The lighting unit 164 turns on the light source unit 162 with the basic L1 lighting intensity, and further turns on the light source unit 162 based on the lighting intensity from the amplification unit 163. As a result, the light source unit 162 is lit at a lighting intensity corresponding to the installation information. The light source unit 162 is a light emitting element such as an LED.

  FIG. 9 is an example of a diagram schematically illustrating lighting intensity that changes with time. Installation information can be transmitted by controlling the lighting intensity. Note that changing the lighting intensity to 4 levels is an example, and may be 2 levels or 8 levels, for example. For example, if there are 8 stages, 3-bit data can be transmitted by one modulation, so a large amount of data can be transmitted per unit time. Further, the lighting time of the light source unit 162 based on one modulation may be constant or variable.

  The light receiving device 115 includes a light receiving element 1151, an amplifying unit 1152, a filter unit 1152, and a demodulating unit 1154. The light receiving element 1151 is a photoelectric conversion element that outputs an electrical signal corresponding to the intensity of the received light, and converts light emitted from the light source unit 162 into, for example, a voltage. The amplifying unit 1152 amplifies the voltage, and the filter unit 1153 removes noise and shapes it. The voltage that has passed through the filter unit 1153 has a value corresponding to one of the four levels of lighting intensity shown in FIG.

  The demodulator 1154 compares the voltage and the threshold corresponding to L1, the threshold corresponding to the voltage and L2, the threshold corresponding to the voltage and L3, and the threshold corresponding to the voltage and L4, and sets the voltage to “00”, “01”, “10”. “,” Is converted into a digital signal of “11”. The digital signal is stored in the buffer and read by the light receiving unit 36. The light receiving unit 36 detects the head of data because, for example, a predetermined number of 0s and 1s continues, and converts the digital signal into installation information. As described above, the light receiving unit 36 can acquire the installation information from the irradiation device 16.

<Server>
Total Function The total function 21 of the server 13 includes an ID receiving unit 23, an evaluation number adding unit 25, an ID determining unit 24, a target specifying unit 26, and an evaluation information management DB 20. The evaluation information management DB 20 may not be included in the server 13 as long as the server 13 can access it.

  The ID receiving unit 23 receives the ID and related information from the evaluation device 12 when there is related information. The ID determination unit 24 specifies the evaluation target 11 based on the ID. As described above, the evaluation target 11 may or may not be specified by the ID. For example, when an ID is assigned only to the evaluation target 11 registered in advance in the server 13, the ID determination unit 24 can uniquely identify the evaluation target 11 from the ID. Such a situation can be realized in the real world where the evaluation system 500 is deployed in a specific range such as an exhibition or a department store. On the other hand, when various providers give arbitrary IDs to the evaluation target 11 without involving the server 13, it becomes difficult to specify the evaluation target 11 only by the ID. That is, there are cases where IDs are not registered in the server 13 or IDs overlap.

  In the present embodiment, since the irradiation device 16 transmits the store ID and the area code, it is assumed that the ID transmitted by the evaluation device 12 is registered in the server 13. For this reason, the process proceeds on the assumption that the ID is registered in the server 13. However, it is also possible for the target specifying unit 26 to specify the evaluation target 11 as will be described later.

  If there is an ID that matches the ID already registered in the evaluation information management DB 20, the ID determination unit 24 notifies the evaluation number adding unit 25 of the ID. When there is a possibility that the IDs overlap, the IDs that overlap are narrowed down based on the related information, and the evaluation number adding unit 25 is notified of the IDs.

  If there is no ID that matches the ID already registered in the evaluation information management DB 20, the ID determination unit 24 newly registers the ID in the evaluation information management DB 20 and notifies the evaluation number addition unit 25 of the ID. The evaluation number of the newly registered ID is zero.

  Note that the ID determination unit 24 may refer to the unique number included in the related information and discard the ID when the ID has already been received from the same evaluation device 12. By carrying out like this, it can suppress that the same evaluator evaluates the object 11 of the same evaluation many times.

  FIG. 10A is an example of a diagram schematically illustrating an evaluation result table stored in the evaluation information management DB 20. In the example of the figure, “number of evaluations”, “store ID”, “region code”, and “related information” are associated with “ID”. The evaluation number adding unit 25 increases the evaluation number by one in principle. The store ID and the area code are included in the installation information transmitted by the irradiation device 16. As shown in FIG. 11, the related information includes the above-described unique number, position information, image of the evaluation target 11, comments, information received from the wireless communication chip, and the like.

  When the number of evaluations is totaled using the “store ID” and “region code”, the numbers can be totaled for each store or for each region. In this case, if the store or region is different, a plurality of the same IDs are registered in the evaluation result table. That is, even if the ID is the same, if the “store ID” or “region code” is different, it is treated as a different ID.

  The number of evaluations in FIG. 10A is the number of evaluations when ID transmissions are tabulated as good evaluations. When counting bad evaluations, two evaluation numbers such as “evaluation number (good)” and “evaluation number (bad)” are totaled.

  Moreover, it is preferable that the server 13 can identify what the evaluation target 11 is evaluated. For this reason, the server 13 has a target identification table.

  FIG. 10B shows an example of a target identification table stored in the evaluation information management DB 20. In FIG. 10B, “product ID” and “target information” are registered in association with “ID”. When the evaluation system 500 is deployed in a specific range such as an exhibition or department store, since the relationship between the ID and the product or service of the evaluation target 11 is specified, not only the ID of the evaluation target 11 but also the product ID, name, provider, price, etc. are known. The product ID is identification information for the product provider to specify the product. Since the product ID is managed by the provider, it may be unique within the same provider.

  “Name” describes, for example, the name of a product or service (for example, the brand name of camera A, camera B, camera C, restaurant, etc.) and the “provider” is, for example, the manufacturer of the evaluation target 11・ The seller is described. “Price” describes the price of the product, but is not required. In addition, the common names of products and services may be registered in the target specification table. Therefore, the browsing client 14 can browse the evaluation number by specifying the ID or the name of the evaluation target 11 or the provider.

  In addition, when an ID is given to the evaluation target 11 without the server 13 being involved, it is not possible to specify what evaluation target 11 the ID is alone. Therefore, it is preferable that the server 13 continuously constructs target information from related information.

  When the ID determination unit 24 determines that there is no ID that matches the ID registered in the evaluation information management DB 20, the target specifying unit 26 of the server 13 uses the ID and related information of the evaluation information management DB 20 to evaluate 11 is specified. For example, the target specifying unit 26 parses comments of related information to extract nouns, and specifies a name and a provider by a search using a dictionary or a search engine.

  When the motion sensing unit 35 senses a specific motion, the program 114 can display an input field such as a name, a provider, and a price on the display unit 105. When the evaluator explicitly inputs and transmits a name, a provider, a price, and the like, the target specifying unit 26 can reliably register the target information by using them.

  In addition, the wireless communication chip may store information such as a name, a provider, and a price. When the ID is transmitted to the evaluation device 12 together with the ID, the target specifying unit 26 uses the wireless communication chip information. The evaluation target 11 can be specified.

  In addition, the target identifying unit 26 identifies a store at the position indicated by the position information of the related information from the map data, and identifies the name and the provider. Store names (providers) are not often registered in map data, and it is possible to search for names of products and services handled from store names. Therefore, a name and a provider can be specified by putting position information and an address in a known search engine.

  The target specifying unit 26 can also specify the evaluation target 11 from the image. By searching the database and the Internet using the image matching method described in the second embodiment, an image that matches the image of the evaluation target 11 is specified, and the product name and seller are extracted from the description of the image. Specify the name, provider, and price. The target specifying unit 26 registers the information of the evaluation target 11 specified in this way in the target specifying table.

  When the ID is notified from the ID determination unit 24, the evaluation number adding unit 25 increases the evaluation number associated with the ID in the evaluation result table by one. By doing so, a high evaluation can be given to the evaluation target 11 having a large number of transmitted IDs.

Providing Function The providing function 22 of the server 13 includes a browsing request receiving unit 27, an evaluation data creating unit 28, and an evaluation data transmitting unit 29. The browsing request receiving unit 27 receives a browsing request for the evaluation number from the browsing client 14. When the browsing client 14 accesses the server 13 with a browser, for example, the browsing request receiving unit 27 transmits the HTML data of the top page to the browsing client 14.

  FIG. 12A is a diagram illustrating an example of the top page displayed on the browsing client 14. The top page includes an upper display area 501 and a search area 502. In the upper display area 501, the IDs of the top 10 evaluations and the evaluation numbers are displayed. Further, a product name or the like may be displayed. In the search area 502, search by ID and search by name are possible. In the search by ID, “Enter ID” is described, and in the search by name, “Enter name” is described. In addition to these, the product ID, the provider and the like may be input. For example, when the product ID is known, the operator of the browsing client 14 can reliably receive the evaluation number of the target 11 to be evaluated with the product ID. Thus, the operator of the browsing client 14 can search the evaluation number of the evaluation object 11 by a desired method.

  When the browsing request receiving unit 27 receives an ID or name from the browsing client 14, the evaluation data creating unit 28 creates evaluation data. When the ID is received, the evaluation data creation unit 28 searches the evaluation result table for the ID, and reads the evaluation number of the record (row) with the matching ID. In addition, when there is target information, it is preferable to read the target information together. The evaluation data creation unit 28 creates, for example, HTML evaluation data that includes at least an ID and the number of evaluations and can further include target information. The evaluation data transmission unit 29 transmits the evaluation data to the browsing client 14. When the product ID is received, the same processing is performed after converting the product ID into an ID.

  For example, when a name is received, the evaluation data creation unit 28 searches for all IDs matching the name from the evaluation result table (that is, if there are a plurality of IDs), and reads the evaluation number associated with each ID. The evaluation data creation unit 28 creates, for example, HTML evaluation data that includes at least an ID and the number of evaluations and can further include target information.

  Thereby, the browsing client 14 can display evaluation data as shown in FIG. In FIG. 12B, a search result area 503 is newly displayed on the top page. In the search result area 503, an ID, the number of evaluations, a name, and a provider are displayed. In this way, the browsing client 14 can display the number of evaluations of a certain real world evaluation target 11. In addition to the illustration, in principle, the browsing client 14 can display information managed by the server 13. For example, a comment, an image of the evaluation target 11, a location (position information) where the evaluation target 11 is located, and the like can be displayed.

  Further, the evaluation data creation unit 28 can process the number of evaluations and the like. The evaluation data creation unit 28 refers to the time information, for example, totals only the number of evaluations for the most recent hour, totals the number of evaluations for each region by referring to the position information, or refers to the unique number The number of evaluations by evaluator can be aggregated.

  The operator of such an evaluation system 500 provides an ID, the number of evaluations, related information, a product ID, and target information regardless of whether it is free of charge. For example, when the evaluation system 500 is applied to an exhibition or a department store, the ID and the evaluation number are provided to the exhibitor or the store in the department store. In this case, it is effective to provide related information, particularly personal information. Exhibitors in stores and stores in department stores can limit places where the evaluator can evaluate products and the like. Further, exhibitors in the exhibition and stores in the department store can grasp the evaluation object 11 having a high evaluation based on the ID, and can contact an evaluator who is interested in the evaluation object 11.

  Further, when the evaluation system 500 is applied to an SNS (Social Networking Service) or a website, the SNS and the website can provide the evaluation target 11 having a high evaluation in the real world to the viewer of the website. As a result, the number of visitors to the SNS and website increases, and an increase in advertising revenue can be expected.

[Operation procedure]
FIG. 13 shows three communication procedures. These are merely examples, and any communication procedure may be employed, and other communication procedures may be employed.

  FIG. 13A is an example of a flowchart illustrating a procedure for evaluating the evaluation target 11 by the evaluation device 12 according to the present embodiment. The procedure in FIG. 13A is repeatedly executed while the evaluation device 12 is executing the program 114.

  The communication unit 31 establishes communication with the wireless communication chip 15 (S10). Establishing communication means that the wireless communication chip 15 and the communication unit 31 can communicate with each other, or that exchange of identification information with each other enables data transmission / reception. The communication procedure may follow a standard such as RFID. Communication establishment may be detected by receiving an ID. The communication unit 31 periodically searches for the wireless communication chip 15 and receives the ID when the wireless communication chip 15 exists in the communication range. Once the ID is received, the communication establishment state may not be maintained, and some information may be repeatedly transmitted and received to confirm that the other party exists.

  When the communication is established, it is also effective for the evaluation device 12 to notify the evaluator that the ID has been received by generating music or vibration or displaying a message or icon on the display unit 105. Since the evaluator receives the ID, the evaluator can grasp that the evaluation object 11 can be evaluated.

  When communication with the wireless communication chip 15 is established (Yes in S10), the control unit 33 determines whether or not the operation detection unit 35 has detected a specific operation (S20). This process will be described later.

  When the motion sensing unit 35 senses a specific motion (Yes in S20), the control unit 33 determines whether communication permission information has been received from the irradiation device 16 (S30). The communication permission information may simply be that radio waves or visible light is received from the irradiation device 16. Since the functions of the irradiation device 16 and the light receiving unit 36 can be simplified, the cost can be reduced. In addition, when communication permission information is received, installation information can also be received.

  When the communication permission information is received (Yes in S30), the control unit stores the ID of the wireless communication chip 15 in the storage unit 34 (S40). As described above, it is effective to store related information together.

  When communicating with a plurality of wireless communication chips 15, as described above, the evaluator or the evaluation device 12 may select one ID or may store all IDs.

  The control unit 33 causes the Internet communication unit 32 to transmit the ID stored in the storage unit 34 to the server 13 (S50).

  When communication is difficult due to radio wave conditions, the Internet communication unit 32 transmits the ID stored in the storage unit 34 at a place where the radio wave conditions are good. In this way, the ID is transmitted to the server 13.

  Next, the procedure of FIG. 13B will be described. In FIG. 13B, contrary to FIG. 13A, the motion sensing unit 35 senses a specific motion prior to establishment of communication.

  In FIG. 13B, when the motion sensing unit 35 senses a specific motion (Yes in S20), the control unit 33 instructs the communication unit 31 to communicate with the wireless communication chip 15.

  When the communication unit 31 establishes communication with the wireless communication chip 15 (Yes in S10), the control unit 33 determines whether communication permission information has been received from the irradiation device 16 (S30). The communication permission information may simply be that radio waves or visible light is received from the irradiation device 16. Moreover, when communication permission information is received, installation information can also be received.

  When the communication permission information is received (Yes in S30), the control unit stores the ID of the wireless communication chip 15 in the storage unit 34 (S40). The evaluation device 12 is preferably music or the like and notifies the evaluator that the ID has been received.

  The control unit 33 causes the Internet communication unit 32 to transmit the ID stored in the storage unit 34 to the server 13 (S50).

  In the procedure as shown in FIG. 13B, it is not necessary for the communication unit 31 to always search for the wireless communication chip 15, so that power consumption can be suppressed. In addition, since the specific operation and the reception of the ID are a series of processes, the evaluator can easily determine whether or not the ID of the evaluation target 11 for the purpose of evaluation has been received.

  Further, as shown in the procedure of FIG. 13C, a plurality of specific operations may be detected before the ID is transmitted.

  In FIG. 13C, when the motion sensing unit 35 senses the first specific motion (Yes in S20), the control unit 33 instructs the communication unit 31 to communicate with the wireless communication chip 15. The first specific action is, for example, a gesture action.

  When the communication unit 31 establishes communication with the wireless communication chip 15 (Yes in S10), the control unit determines whether communication permission information has been received (S30). When the communication permission information is received, the operation sensing unit 35 further determines whether or not the second specific operation is sensed (S30-2). The second specific operation is, for example, a touch panel operation. When the second specific operation is detected, the control unit stores the ID of the wireless communication chip 15 in the storage unit 34 (S40).

  The control unit 33 causes the Internet communication unit to transmit the ID stored in the storage unit 34 to the server 13 (S50).

  In the procedure shown in FIG. 13C, the ID can be received by the first specific operation and the ID can be transmitted by the second specific operation. Therefore, the evaluator confirms the ID of the evaluation target 11 for the purpose of evaluation. Then, the ID can be transmitted to the server 13. Further, when a plurality of IDs are received in the first specific operation, one ID can be selected.

  It supplements about a processing procedure. In this embodiment, the evaluation device 12 receives the ID and the communication permission information within a certain range on the condition that the evaluator evaluates the evaluation target. For this reason, steps S10 and S30 are in the order of processing in the drawing, but one of them does not have to be determined first. For example, the control unit 33 records the time when the communication is established (the time when the ID is received) and the time when the communication permission information is received, and the two times are within a predetermined time (for example, within a few seconds). It can be estimated that the ID and the communication permission information are received at the place where the evaluation device 12 is located. Further, the position where the communication is established and the position where the communication permission information is received may be recorded, and it may be estimated that the ID and the communication permission information are received within a certain range.

  Therefore, storing the ID in the storage unit 34 may be performed regardless of the presence or absence of a specific action or the presence or absence of reception of communication permission information. That is, when the ID is received, it is immediately stored in the storage unit 34, and when it is estimated that the ID and the communication permission information are received within the location where the evaluation device 12 is located or the location, the storage unit 34. May be made valid (subject to transmission to the server 13).

  When the ID is received and stored in the storage unit 34, the control unit 33 detects the specific operation because the ID is received in the processing procedure of FIG. 13A even if the specific operation is not detected. An ID that is a predetermined time before the time (for example, about 10 seconds) is set as a transmission target. When a plurality of IDs are stored, sorting is performed as described with reference to FIG.

  In the processing procedure of FIG. 13B, the control unit 33 sets an ID received within a predetermined time (for example, about 10 seconds) after sensing a specific operation as a transmission target. When a plurality of IDs are received, sorting is performed as described with reference to FIG.

  In the processing procedure of FIG. 13C, an ID received within a predetermined time (for example, about 10 seconds) from the time when the first specific operation is detected is set as a transmission target.

<Detection of specific operation in S20>
When the specific action is a gesture action, detection of the specific action by the action sensing unit 35 will be described. FIG. 14 is an example of a flowchart illustrating a procedure in which the motion sensing unit 35 senses a gesture motion.

  The acceleration sensor 112 records the acceleration in time series (S201).

  The motion sensing unit 35 takes out a time series of acceleration from several seconds to several hundred milliseconds in the past (S202).

  The motion sensing unit 35 time-matches a typical series of accelerations stored in advance and a detected series of accelerations (S203). For comparison, for example, DP (Dynamic Programming) matching is used. In DP matching, a difference between a typical series of accelerations and a detected time series acceleration is calculated as a distance.

  The motion sensing unit 35 determines whether the distance is within the threshold (S204). If the distance is within the threshold (Yes in S204), the motion sensing unit 35 senses a specific motion (S205) and is not within the threshold (No in S204). The specific operation is not detected (S206).

  Note that determination by DP matching is an example, and a specific operation can be detected by a known pattern recognition technique.

<Server operation>
FIG. 15 is an example of a flowchart illustrating a procedure in which the server 13 receives an ID.
The ID receiving unit 23 of the server 13 receives the ID (S110). Preferably, at this time, related information and installation information are also received.

  The ID determination unit 24 determines whether or not the received ID is registered in the evaluation information management DB 20 (S120). If the server 13 is not involved in the ID assignment, it is determined whether or not the same ID is registered including the related information.

  When the ID is registered (Yes in S120), the evaluation number adding unit 25 increases the evaluation number associated with the ID by one (S130). Furthermore, when the time information is received, the number of evaluations may be totaled for each time segment, and when the position information is received, the number may be totaled for each position. By carrying out like this, the evaluation object 11 with a high evaluation number can be grasped | ascertained for every time division or every area.

  Further, when the evaluation device 12 transmits a unique number, the number of ID transmissions may be counted for each unique number. Thereby, incentives, such as giving a point to the evaluator who evaluates positively, can be given.

  When the ID is not registered (No in S120), the ID determination unit 24 newly registers the ID in the evaluation result table and sets the evaluation number to zero (S140).

  Thereafter, the evaluation number adding unit 25 increases the evaluation number associated with the ID by one (S130).

  FIG. 16 is an example of a flowchart illustrating a procedure in which the browsing client 14 requests evaluation data from the server 13. It is assumed that the browsing client 14 is already displaying the top page at the start of the procedure of FIG.

  The browsing client 14 receives the operation of the evaluator, and transmits a browsing request for the evaluation number using, for example, an ID as an argument (S210).

  The browsing request receiving unit 27 of the server 13 receives the browsing request (S310).

  The evaluation data creation unit 28 searches the evaluation information management DB 20 for an ID, reads the evaluation number that matches the ID registered in the evaluation result table, and creates evaluation data including the ID and the evaluation number, for example, in HTML (S320). ). At this time, it is preferable that related information of the evaluation target 11 is also transmitted.

  Further, the evaluation data creation unit 28 can also transmit the total number of evaluations based on the aggregation method (for each time zone, each region, and each evaluator) added to the browsing request. For example, when the viewer and the evaluator are the same person, since the browsing client 14 can transmit the unique number or the stored ID, the viewer can check the evaluation number of the evaluation target 11 evaluated by the viewer.

  The evaluation data transmission unit 29 transmits the evaluation data to the browsing client 14 (S330).

  The browsing client 14 receives the evaluation data (S420), analyzes the HTML data, and displays it on the display (S430).

  As described above, the evaluation system 500 according to the present embodiment actively evaluates any real product or service in the real world simply by the evaluation device 12 acquiring the ID and the evaluator operating the evaluation device 12. be able to. Moreover, the place where an evaluator evaluates can be limited, or installation information that can be received only at the place can be transmitted to the server.

[Another example of restrictions on evaluation locations]
In FIG. 6, the light receiving unit 36 of the evaluation device 12 has received the installation information from the irradiation device 16, but the evaluation device 12 can receive communication permission information from other than the irradiation device 16.

  FIG. 17 is a diagram illustrating another configuration example of the functional block diagram of the evaluation system. In FIG. 17, the irradiation device 16 is replaced with a wireless communication device 17, and the evaluation device 12 includes a wireless communication unit 37 instead of the light receiving unit 36. The wireless communication device 17 and the wireless communication unit 37 are devices that communicate based on, for example, a wireless LAN communication standard, but may also be devices that communicate via Bluetooth (registered trademark), Zigbee (registered trademark), or Z-Wave. Good. In the case of a wireless LAN, the wireless communication device 17 may be a wireless LAN access point or an information processing device that communicates in an ad hoc mode.

  The wireless communication device 17 generally transmits radio waves in a wider range than infrared rays and visible light, but the transmission range is limited. Only the evaluation device 12 that has entered the range can receive the installation information, and the evaluation device 12 transmits the evaluation target ID to the server 13 in a range that overlaps the ID reception range. Thus, the wireless communication device 17 operates in the same manner as the irradiation device 16. In the evaluation system of FIG. 17, the procedure by which the evaluation device 12 receives the ID is the same as that in FIG.

  FIG. 18 is a diagram illustrating another configuration example of the functional block diagram of the evaluation system. In FIG. 18, the evaluation device 12 has neither the light receiving unit 36 nor the wireless communication unit 37. On the other hand, the wireless communication chip is arranged in the wireless chip control device 150. In addition to the wireless communication chip 15, the wireless chip control device 150 includes a light receiving device 115 and a control unit 2 (reference numeral is a control unit 168). The light receiving device 115 receives infrared rays or visible light from the irradiation device 16.

The wireless chip control device 150 is controlled by the control unit 2, and the control unit 2 permits the wireless communication chip 15 to transmit an ID depending on whether or not the light receiving device 115 has received communication permission information from the irradiation device 16. That is, the control unit 2 controls the wireless communication chip 15 as follows.
(i) When the light receiving device 115 receives the communication permission information from the irradiation device 16, the wireless communication chip 15 permits the ID to be transmitted to the communication unit 31 of the evaluation device 12.
(ii) When transmitting the ID, the wireless communication chip 15 transmits communication permission information to the communication unit of the evaluation device 12 in addition to the ID.

  The irradiation device 16 is arranged to irradiate an evaluation target (wireless communication chip) that may transmit an ID to the server 13. The irradiation range of the irradiation device 16 is limited, and the range in which the wireless communication chip transmits the ID is also limited. Accordingly, the irradiation device 16 defines the existence range of the evaluation target (wireless communication chip), and the evaluation target (wireless communication chip) defines the existence range of the evaluation device 12. As described above, even in the configuration as shown in FIG. 18, the evaluation system can indirectly limit the evaluation targets that can be evaluated by the evaluator.

  If the evaluation device 12 senses a specific operation, the evaluation device 12 can transmit the ID to the server 13 only by receiving the ID and the communication permission information from the wireless communication chip. Therefore, there is an advantage that the evaluation device 12 does not need to include the light receiving unit 36 and the light receiving device 115.

  In the evaluation system of FIG. 18, the procedure for the evaluation device 12 to receive the ID is different from that of FIG. 13 in the following points. That is, in step S30, the control unit does not determine whether communication permission information has been received from the irradiation device 16, but determines whether communication permission information has been received from the wireless communication chip. Since the ID and the communication permission information are transmitted almost simultaneously, if the ID can be received, the communication permission information can also be received, and the conditions of S10 and S30 are satisfied.

  As described above, the arrangement of the irradiation device 16 and the reception path of the communication permission information can be flexibly realized.

In this embodiment, an evaluation system with different ID acquisition paths will be described.
19 and 20 are examples of diagrams illustrating a schematic procedure of the evaluation system 500 of the present embodiment.
(1) The evaluator carries the evaluation device 12. The evaluation device 12 is, for example, a portable communication terminal. When an evaluator encounters an evaluation object 11 of interest while moving in the real world, the evaluator generally walks and stops slowly.
(2) When the evaluator wants to evaluate the evaluation target 11 with an interest, the evaluator performs a specific operation either before or after the shooting, and takes the evaluation target 11. In the case of an object, the object may be photographed directly. In the case of a service, a signboard or a store is photographed in a place related to the service.
(3) As in the first embodiment, a radio wave or visible light with high directivity is irradiated from the irradiation device 16 to a position where the evaluation target can be evaluated. The evaluation device 12 does not transmit image data to the search server 18 unless it receives installation information from the irradiation device 16.
(4) When the installation information is received, the evaluation device 12 transmits the image data to the search server 18. The search server 18 is a server having an image data DB (or feature database) in which image data of the evaluation target 11 is associated with an ID.
(5) The search server 18 searches the image data DB 42 based on the image data transmitted by the evaluation device 12 and identifies the ID of the evaluation target 11.
(6) When the search server 18 can identify the ID of the image data, the search server 18 transmits the ID of the image data to the evaluation device 12.
(7) The evaluation device 12 transmits this ID to the server 13. The subsequent processing is the same as in the first embodiment, and the server 13 counts up the number of evaluations of IDs in the evaluation result table.

  Therefore, according to the present embodiment, the evaluation device 12 can acquire the ID by taking a picture without communicating with the wireless communication chip 15 and receiving the ID. And the number of evaluations can be tabulated similarly to Example 1.

[Configuration example]
FIG. 21 shows an example of a schematic configuration diagram of the evaluation system 500 of the present embodiment. In FIG. 16, only the main part of the part described in FIG. 3 will be described. The evaluation system 500 of the present embodiment includes an evaluation object 11, an evaluation device 12, a server 13, an irradiation device 16, and a search server 18.

  In this embodiment, the wireless communication chip 15 is not arranged on the evaluation target 11. Although it may be arranged, the evaluation device 12 receives the ID from the search server 18. The evaluation target 11 is the same as that in the first embodiment.

<Evaluation device>
The evaluation device 12 may be any device that has the camera 110 and can communicate with the server 13 and the search server 18. For example, in the case of a smartphone, tablet, straight PC, mobile phone, PDA (Personal Digital Assistant), notebook PC, etc., the evaluator carries the evaluation frequently without using a specific evaluation device 12 because the evaluator carries it frequently. The object 11 can be evaluated.

  When the evaluator photographs the evaluation object 11, the whole or a characteristic part thereof should be photographed. For example, the photograph is taken so that the entire object or logo is included. In the case of a service, the evaluator photographs a store signboard, the entire store, and the like. In the case of a sightseeing spot, a sight, a place, or a space, the nearest station or bus stop, a signboard for explaining a sightseeing spot, etc. may be photographed, or a so-called good sight or scenery is photographed. These assumed image data are registered in the search server 18.

<Irradiation device>
The irradiation device 16 is arranged so as to irradiate a place where the evaluator can evaluate the evaluation target. The evaluation device 12 receives the communication permission information from the irradiation device 16 as in the first embodiment, but can transmit the image data to the search server 18 when the communication permission information is received. Unlike the first embodiment, the evaluation device 12 does not need to receive an ID. However, the range in which the evaluation target can be photographed overlaps with the range in which radio waves can be received. Data can be transmitted to the search server 18. Alternatively, the transmission of the ID to the server 13 may be permitted only in a range where the range where the evaluation target can be photographed and the range where the radio wave can be received overlap.

<Search server>
The search server 18 may be an information processing device. The hardware configuration diagram of the search server 18 is the same as that of the server 13.

  The communication method in which the search server 18 communicates with the evaluation device 12 is the same as the case where the server 13 and the evaluation device 12 described in the first embodiment communicate. In the figure, the server 13 and the search server 18 are shown separately, but the server 13 and the search server 18 may be mounted in one information processing apparatus. The search server 18 searches the image data DB 42 for image data that matches the image data captured by the evaluation device 12.

[About functions]
FIG. 22 shows an example of a functional block diagram of the evaluation device and the like of this embodiment. 22A shows a functional block diagram when the search server 18 performs pattern matching, and FIG. 22B shows a functional block diagram when the search server 18 performs a visual search.
In FIG. 22, the description of the same components as in FIG. 6 is omitted.

  Although omitted in the present embodiment, the evaluation places can be limited in this embodiment as described with reference to FIGS.

  In this embodiment, the evaluation device 12 is configured to communicate with the search server 18. In addition, since the evaluation target 11 does not need to have the wireless communication chip 15 (may be), the evaluation device 12 does not need to have the communication unit 31. On the other hand, the evaluation device 12 includes a photographing unit 38 for photographing the evaluation target 11 with the camera 110.

  There are several variations in the procedure from image data capture to ID reception. For example, the operation sensing unit 35 can be triggered by detecting a specific operation. The photographing unit 38 photographs the evaluation target 11 with the camera 110 and acquires image data. Similar to the first embodiment, it is preferable to store the time information and position information obtained in the storage unit 34.

  The light receiving unit receives communication permission information from the irradiation device in the same manner as in the first embodiment. In many cases, the light receiving unit receives the communication permission information before the imaging unit captures the evaluation target. Therefore, the control unit determines whether or not the image data should be transmitted to the search server 18 depending on whether or not the communication permission information is received when the image data is captured. In addition, when the light receiving unit receives the communication permission information after the photographing unit captures the evaluation target and generates the image data, the communication permission information is generated within a predetermined time (for example, about 10 seconds) after the generation of the image data. Is received. Accordingly, it can be estimated that the evaluation target is captured in a range where the range in which the evaluation target can be captured and the range in which radio waves can be received overlap.

  The Internet communication unit 32 controls the carrier communication unit 109 and the wireless LAN communication unit 108 to communicate with the search server 18 and transmit image data to the search server 18. An evaluator may photograph one evaluation object 11 a plurality of times. In addition, even if the evaluator performs the shooting operation once, the imaging unit 38 can easily search the image data DB 42 by shooting several pieces of image data. Thus, unlike the ID, it may be effective for the Internet communication unit 32 to transmit a plurality of pieces of image data of the same evaluation target 11.

  In this embodiment, shooting can be regarded as a specific operation. In this case, the evaluator can acquire an ID simply by operating the program 114 and shooting the evaluation target 11. Further, when the evaluator wants to review and evaluate the captured image data later, it is also effective to detect a specific operation after the imaging.

  The control unit 33 stores the ID received from the search server 18 in the storage unit 34. The control unit 33 transmits the ID stored in the storage unit 34 to the server 13. The subsequent processing is the same as in the first embodiment.

Therefore, the procedure of the evaluation device 12 is as follows.
1) Detection of specific operation → Shooting (reception of communication permission information before and after this) → Transmission to search server 18 → Reception of ID → Transmission of ID 2) Shooting (detection of specific operation. Communication permission information is received before and after this. → Send to search server 18 → Receive ID → Send ID 3) Shooting (receive communication permission information before and after this) → Detect specific operation → Send to search server 18 → Receive ID → Send ID 1) The specific operation is, for example, a gesture operation, and the program 114 is activated by the evaluator swinging down the evaluation device 12 or the program 114 that has already been activated activates the photographing unit 38. When the evaluator photographs the evaluation target 11 with the camera 110, the photographing unit 38 stores the image data in the storage unit 34, and the control unit 33 transmits the ID to the search server 18.

  In the case of 2), when the evaluator photographs the evaluation object 11 with the camera 110 while the program 114 and the photographing unit 38 are already activated, the image data is transmitted to the search server 18.

  In the case of 3), when the evaluator takes an image of the object 11 to be evaluated with the camera 110 and wants to evaluate it while viewing the image data taken later, the evaluator activates the program 114 and activates the image. Data is transmitted to the search server 18. The specific operation in the case of 3) is, for example, an operation on a soft key or a touch panel formed by the program 114. However, it is also possible to transmit by gesture operation. For example, if one image data is transmitted by one gesture operation (down), the evaluator can transmit a plurality of image data by performing the gesture operation several times.

<Search server search>
A search by the search server 18 will be described. The search server 18 searches for image data by two methods.
A. Pattern matching Visual search (when searching text image data)
A. Pattern Matching As shown in FIG. 22A, the search server 18 includes a matching unit 41 and an image data DB 42. The image data DB 42 stores IDs and standard image data in association with each other. The standard image data is image data of various evaluation targets 11 or data obtained by converting it into feature data. There is no need for one standard image data for one evaluation target 11, and a plurality of standard image data may be associated with one evaluation target 11. For example, a plurality of image data obtained by photographing a specific coffee cup from different angles can be used as the standard image data. The standard image data may be taken in either color or grace case.

  FIG. 23 is an example of a diagram schematically illustrating the image data DB 42. In the image data DB 42, one or more standard image data is associated with one ID. The ID may be the same as the ID of the first embodiment, but may not be an IC stored in the wireless communication chip 15. Since the ID is identification information provided by the search server 18, it is guaranteed that the ID is unique within a range assumed by the evaluation system 500 (for example, the whole world, a certain country or region). All IDs registered in the image data DB 42 of the search server 18 are registered in the evaluation information management DB 20 of the server 13.

  The matching unit 41 identifies standard image data that is highly correlated with the image data received from the evaluation device 12, and transmits the ID of the standard image data to the evaluation device 12.

  The matching unit 41 performs preprocessing on the image data and then compares it with the standard image data. Preprocessing includes processing for enlarging and reducing the size of the image data so as to match the standard image data, processing for matching the color space, processing for matching the gradation of luminance, edge processing, and the like. The matching unit 41 uses known pattern matching such as SAD (Sum of Absolute Difference), SSD (Sum of Squared Difference), or NCC (Normalized Cross Correlation) for each pixel or each pixel block. The value of SAD and SSD decreases as the correlation increases, and the value of NCC approaches 1 as the correlation increases.

  The matching unit 41 identifies standard image data having the highest correlation, and reads the ID of the standard image data when the correlation is equal to or greater than a threshold value. Further, when there are a plurality of standard image data having a correlation greater than or equal to the threshold, all IDs may be read.

  When there is no standard image data having a correlation greater than or equal to the threshold value, the matching unit 41 newly assigns an ID to the image data received from the evaluation device 12 and registers it as standard image data in the image data DB 42. Thereby, the standard image data can be automatically increased.

  If there is no standard image data having a correlation greater than or equal to the threshold, the matching unit 41 can also search for image data on the Internet. List some highly correlated image data on the Internet and collect the target information. Names, providers, prices, etc. are often described in image data on the Internet, and target information can be collected. This process may be performed by the server 13.

  The search server 18 that has specified the standard image data transmits the ID to the evaluation device 12. The evaluation device 12 preferably adds related information to the ID and transmits it to the server 13. Thereby, the server 13 can count up the number of evaluations similarly to Example 1, and can register relevant information.

  Instead of communication as “evaluation device 12 → (image data) → search server 18 → (ID) → evaluation device 12 → (ID) → server 13”, “evaluation device 12 → (image data) → search Communication may be performed in the order of “server 18 → (ID) → server 13”. In this case, the evaluation device 12 can complete the evaluation only by transmitting the image data to the search server 18. This is the same as when the server 13 and the search server 18 are mounted on the same information processing apparatus.

・ B. Visual Search As shown in FIG. 22B, the search server 18 includes a feature extraction unit 43, a classification unit 44, and a feature database 45.

  FIG. 24 is an example of a diagram for schematically explaining the outline of the visual search. Visual search is a technique for extracting feature amounts of document images and comparing the feature amounts of two document images. The registered document image in the figure is a document image in which the feature amount is registered in advance, and the search image is an image taken by the evaluation device 12. The feature amount is obtained by quantifying the characteristic arrangement of the text, and an index is assigned to the registered document image. This index corresponds to the ID.

  For example, when a part of a newspaper or magazine article is photographed with the camera of the evaluation device 12 and transmitted to the search server 18, the feature amount is extracted in the same manner from the photographed document image, and the registered document image of the feature database 45 is stored. Compared with feature quantity. The search server 18 can specify not only the registered document image but also the position in the page.

  The feature amount will be described. FIG. 25 shows an example of a word bounding box determination algorithm. Word boundary box determination is to determine the boundary of one word in English. In a language that is not “split language” that does not have a clear break (blank) between words such as Japanese, “,” “.”, Etc. This is to determine the blank generated by.

  The document image is skew corrected. The text lines are aligned horizontally by deskewing. The feature extraction unit 43 calculates a horizontal projection profile (plan view characteristic) as shown in FIG. That is, a histogram of pixels is calculated in the horizontal direction, and the range in the vertical direction where the value exceeds the threshold value is determined as one line (one row).

  When each line is extracted in this way, the search server 18 specifies a word area for each line. The feature extraction unit 43 calculates a vertical projection profile (plan view characteristic) as shown in FIG. That is, a histogram of pixels is calculated in the vertical direction, and a horizontal range whose value exceeds the threshold is determined as a word (one word).

  FIG. 26 is an example of a diagram schematically illustrating grouping based on word boundaries. A circumscribed rectangle of each word detected in FIG. 25 is a word boundary. Once word boundaries are extracted, multiple groups can be formed from them. A group is, for example, a word whose word boundaries overlap each other, and the total number of words is at least three. For example, the first feature point (second word box in the second row with a length of 6; indicated by a black circle) is the first word box in the first row with the front word boundary Overlap, the back word boundary overlaps the second word box in the first row (they are 5 and 7 in length). Also, the front word boundary overlaps with the second word box in the third row (its length is 5).

  The second feature point (the fourth word box in the third row, which has a length of 5 and is indicated by a white circle) is the front word boundary of the third word box in the second row. Overlap, the back word boundary overlaps with the fourth word box in the third row (they are 4 and 5 in length). Also, the front word boundary overlaps with the second word box in the fourth row, and the rear word boundary overlaps with the third word box in the fourth row (the lengths are 8 and 7). ).

Accordingly, as shown in FIG. 26, each feature point is expressed as the length of the lower word box following the length of the upper word box. In this manner, the upper left vertex (or another vertex) of the word boundary can be used as the feature point.
First feature: 6 57 5
Second characteristic point: 5 45 87
It should be noted that the length of the word box may be based on any metric (unit).

  Next, the feature amount can be extracted so that the space is expressed by 0 and the word region is expressed by 1.

  FIG. 27 is an example of a diagram for explaining a feature quantity having 0 and 1 as feature quantities. The block representation on the right corresponds to the word / space area of the left document image (patch). That is, the word area is indicated by black pixels and the space is indicated by zero (0).

  In this case, the distance between 0 and 0 can be used as the feature amount. The extracted feature amount may be compared with various distance indexes (for example, including norm and Hamming distance). Alternatively, a hash table may be used to identify a document patch having the same feature amount as the query image (query image).

Next, an angle from each feature point to another feature point can be calculated.
FIG. 28 is a diagram illustrating an example of calculating an angle formed by a word boundary. In FIG. 28, the internal angles θ1 to θ3 when three word boundaries are connected are calculated. Any three or more word boxes may be extracted, or an angle when the word boundaries of one group described in FIG. 26 are connected may be calculated. The method of determining the word of interest is arbitrary.

  The calculated angle is compared with the angle from each feature point to another feature point in the query image. If some angle of feature points to be matched is similar, the similarity score may be increased. Alternatively, if a group of angles is used, and the series of angles between the groups in the two images are numerically similar, the similarity score may be increased. Once the score between the query image and each extracted document patch is calculated, the document patch that yields the highest score is selected and compared to an adaptive threshold to determine if the degree of match meets certain predetermined criteria. Confirm whether or not. If it meets the criteria, it is notified that a matching document patch has been found.

Further, the word length can be used as a feature amount.
FIG. 29 is an example of a diagram illustrating the feature amount based on the word length. As shown in the figure, the feature extraction unit 43 divides each word into estimated characters (plural) based on the height and width of the word. The word is divided into estimated characters. This feature amount is described together with (i) the length of the focused word, (ii) the text array in the line above the word, and (iii) the text array in the line below the word. The text arrangement information is represented by 1 or 0 as to whether or not each character of the focused word is a space.

  When the number of characters in the focused word is 6, 6-bit binary numbers are obtained in (ii) and (iii), respectively. In the case of the illustrated word, there are words above the first estimated character, and spaces above the second and third estimated characters. The upper side of the fourth to sixth estimated characters is a word. In addition, there are words below the first to fifth estimated characters, and spaces below the sixth estimated character. Therefore, the feature amount of the focused word is (6,100111,111110). When rewritten in integer form, the word is encoded as (6,39,62).

  An example of collation of documents in registered document image units by the classification unit 44 will be described. The classification unit 44 extracts the lengths of word pairs adjacent in the horizontal and vertical directions, and calculates the ranking of the patches in the feature database 45 individually. This focuses on the fact that an image of text contains two independent sources for its identity, and the word layout alongside the word, in addition to the word, identifies the document. In the following, collation is described using the length of a word pair as a feature amount, but collation can be performed using the feature amounts described with reference to FIGS.

FIG. 30 is an example of a diagram illustrating a specific example of how a vertical layout is integrated with a horizontal layout. FIG. 30A shows a document image (patch) 601 and an example of division into words. From the document image 601, horizontal and vertical “n-grams” are determined. “N-gram” is a description method that describes the amount of features in a sequence of n numbers. For example, a horizontal trigram specifies the number of characters in each word in a horizontal sequence of three (= tri) words. For example, in the case of the image data in FIG. 30A, the horizontal and vertical trigrams are as follows.
·horizontal direction
5-8-7 ("upper", "division" and "courses")
7-3-5 ("Project", "has" and "begun")
3-5-3 ("has", "begun" and "The")
3-3-6 ("461", "and" and "permit")
3-6-8 ("and", "permit" and "projects")
·Longitudinal direction
5-7-3 ("upper", "Project" and "461")
8-7-3 ("division", "Project" and "461")
8-3-3 ("division", "has" and "and")
8-3-6 ("division", "has" and "permit")
8-5-6 "division", "begun" and "permit")
8-5-8 ("division", "begun" and "projects")
7-5-6 ("courses", "begun" and "permit")
7-5-8 ("courses", "begun" and "projects")
7-3-8 ("courses", "The" and "projects")
7-3-7 ("Project", "461" and "student")
3-3-7 ("has", "and" and "student")
The classification unit 44 searches the feature database 45 for documents including the horizontal and vertical trigrams determined as described above. FIG. 30D shows the search result of the horizontal trigram, and FIG. 30E shows the search result of the vertical trigram. That is, the horizontal trigram 7-3-5 appears in the book registration document images of the indexes 15, 22, 134. Also, for example, the vertical trigram 7-5-6 appears in the registered document images with indexes 15 and 17.

  FIG. 30F shows a list in which the list of registered document images in which horizontal trigrams appear is ranked in descending order, and FIG. 30G shows a list in which the list of registered document images in which vertical trigrams appear is ranked in descending order. . For example, in FIG. 30F, a registered document image with an index of 15 is referred to by five horizontal trigrams, whereas a registered document image with an index of 9 is referenced only by one horizontal trigram. Further, for example, in the case of FIG. 30G, the registered document image with the index of 15 is referred to by 11 vertical trigrams, but the registered document image with the index of 18 is referred to by only one vertical trigram. .

  FIG. 31 is an example of a diagram illustrating a method of combining the horizontal and vertical trigram information obtained in FIG. The classifier 44 uses information about the known physical location of the trigram in the registered document image to combine the list of votes from the horizontal and vertical feature extraction. For all registered document images that are common among the top M choices output by each of the horizontal and vertical classifiers, the location of all the horizontal trigrams that were supposed to exist in the registered document image are assumed to exist in the registered document image. Compared to all vertical trigram locations. Registered document images that overlap in any vertical trigram receive a vote count equal to the number of horizontal trigrams, where “overlap” occurs when the bounding boxes of the two trigrams overlap. That is, overlapping means that some words of the horizontal trigram and the vertical trigram overlap.

  For example, from the list shown in FIGS. 31A and 31B (the same as the list shown in FIGS. 30F and 30G), the classification unit 44 can display a list of registered document images (see FIG. 31 (c)).

  FIG. 31 (d) shows only the list included in the horizontal trigram of FIG. 31 (d) extracted from the list of FIG. 31 (c), and FIG. 31 (e) shows the list of FIG. 31 (c). Of these, only those included in the vertical trigram of FIG. 30 (e) are extracted.

  The classification unit 44 uses the lists shown in FIGS. 31C, 31D, and 31E and the feature database 45 to check the overlap of documents. For example, the registered document image at index 6 is referenced by the horizontal trigram 3-5-3 and by the vertical trigram 8-3-6, and these two trigrams overlap with respect to the word “has” in the document image 601. Therefore, the registered document image of index 6 obtains one vote for each overlap.

  FIG. 31F shows an example of the number of votes of registered document images with indexes 15, 6, and 4. In the case of the document image 601, since the registered document image of the index 15 has acquired the maximum number of votes, it is confirmed as a document including the document image 601. (x1, y1) is confirmed as the location of the input image in the registered document image of index 15.

  30 and 31, a trigram is used, but any n-gram may be used for one or both of horizontal and vertical feature extraction / classification. For example, vertical and horizontal n-grams (n = 4, 5) may be used for feature extraction.

  Further, classification may be made based on adjacency relationships that are not strictly vertical or horizontal. For example, the adjacent relationship of NW (North West), SW (South West), NE (North East), and SE (South East) may be used for extraction / classification.

  As described above, when the evaluator evaluates the text, the text can be identified with high accuracy by photographing the text and using the visual search technology. For example, if an ID is assigned to each article of a magazine or each magazine, the evaluation can be performed when the evaluator thinks that the article should be on the spot in the magazine. Since the server 13 counts up magazine articles and magazine evaluation numbers, it is possible to rank articles and magazines with high evaluation numbers.

[Operation procedure]
FIG. 32 is an example of a flowchart illustrating a procedure in which the evaluation device 12 transmits image data to the search server 18. A program 114 is running on the evaluation device 12. The procedure of FIG. 32 is mainly the procedure of 1) above.

  First, the motion sensing unit 35 senses a specific motion (S410). The program 114 may be activated by this specific operation.

  When the evaluator operates the camera to photograph the evaluation target 11 (Yes in S420), the control unit 33 determines whether communication permission information has been received from the irradiation device 16 (S425).

  When the communication permission information is received (Yes in S425), the Internet communication unit 32 transmits the image data of the evaluation target 11 to the search server 18 (S430).

  The search server 18 receives the image data (S510). The matching unit 41 of the search server 18 specifies standard image data having a high correlation with the image data (S520). The search server 18 transmits the ID of standard image data having high correlation to the evaluation device 12 (S530).

  When the Internet communication unit 32 of the evaluation device 12 receives the ID (S440), the control unit 33 stores the ID in the storage unit 34 (S450).

  The internet communication unit 32 transmits the ID stored in the storage unit 34 to the server 13 (S460).

  The ID receiving unit 23 of the server 13 receives the ID (S110).

  In the present embodiment, since the received ID should be registered in the evaluation result table, the evaluation number adding unit 25 increases the evaluation number associated with the ID by one (S130).

  In the case of the procedure 2), the processes of S210 and S220 are integrated. In the case of the procedure 3), S410 and S420 are reversed.

  Further, the determination in step S425 may be performed after step S440. Accordingly, the evaluation device can transmit the image data to the server without receiving the communication permission information from the irradiation apparatus.

  As described above, the evaluation system of the present embodiment can evaluate the evaluation target 11 by taking an image even if the evaluation target does not have an ID. In particular, since a text such as a magazine can be searched with high accuracy including its position, books and the like can be evaluated with high accuracy. In addition, Examples 1 and 2 can be used in combination.

DESCRIPTION OF SYMBOLS 11 Evaluation object 12 Evaluation device 13 Server 14 Browse client 15 Wireless communication chip 16 Irradiation device 17 Wireless communication device 18 Search server 31 Communication unit 32 Internet communication unit 33 Control unit 34 Storage unit 35 Motion detection unit 36 Light reception unit 37 Wireless communication unit 38 Shooting unit 41 Matching unit 42 Image data DB
43 Feature Extractor 44 Classification Unit 45 Feature Database 500 Evaluation System

JP 2011-96259 A Japanese Patent No. 4753616 JP 2010-050919 A

Claims (10)

A specific operation detecting means for detecting a predetermined specific operation of the computer;
Identification information acquisition means for acquiring identification information of an evaluation target according to a detection result by the specific operation detection means;
Identification information storage means for storing the identification information of the evaluation target acquired by the identification information acquisition means in a storage unit;
An external device that aggregates the evaluation information of the evaluation target for the identification information stored in the storage unit when a predetermined signal is received from the outside in a place where the identification information acquisition means can acquire the identification information A transmission means for transmitting to, a program to function as,
When the identification information is received, the external device having evaluation information update means for updating the evaluation information to be evaluated that is associated with the identification information;
An evaluation system characterized by comprising: The program causes a computer to function as radio wave receiving means for receiving radio waves of a predetermined frequency,
The radio wave receiving means detects data obtained by demodulating the radio wave as the predetermined signal,
The evaluation system according to claim 1. The identification information acquisition means includes
Since the object of evaluation has received the radio wave by radio wave receiving means for receiving a radio wave of a predetermined frequency arranged in the object of evaluation, the predetermined signal transmitted together with the identification information is acquired.
The evaluation system according to claim 1. When the predetermined signal is transmission permission information that permits transmission of the identification information to the external device, the transmission means transmits the identification information stored in the storage unit to the external device.
The evaluation system according to claim 2 or 3, wherein When functioning a computer as the identification information acquisition means,
The program controls wireless communication means to wirelessly communicate with the evaluation target, and receives the identification information from the evaluation target.
The evaluation system according to claim 2 or 3, wherein In the overlapping range in which the wireless communication unit can communicate with the evaluation target and the range in which the radio wave reception unit can receive the radio wave, the wireless communication unit wirelessly communicates with the evaluation target, The radio wave receiving means receives radio waves of a predetermined frequency;
The evaluation system according to claim 5. When functioning a computer as the identification information acquisition means,
The program controls the photographing means to photograph the evaluation target,
By controlling wireless communication means, the image data to be evaluated, or the image data is transmitted to a second external device that stores the feature amount of the image data and the identification information in association with each other,
Receiving the identification information of the object of evaluation taken from the second external device;
The evaluation system according to claim 1. The program causes a computer to function as radio wave receiving means for receiving radio waves of a predetermined frequency,
The radio wave receiving means detects data obtained by demodulating the radio wave as the predetermined signal,
In the overlapping range where the range in which the imaging unit can capture the evaluation target and the range in which the radio wave reception unit can receive the radio wave overlap, the imaging unit captures the evaluation target and receives the radio wave Means detects the predetermined signal;
The evaluation system according to claim 7.   The evaluation system according to claim 2, 3 or 8, wherein the radio wave receiving means receives the radio wave of a frequency in a range of infrared rays or visible light or a satellite positioning signal. Computer
Specific operation detecting means for detecting a predetermined specific operation;
Identification information acquisition means for acquiring identification information of an evaluation target according to a detection result by the specific operation detection means;
Identification information storage means for storing the identification information of the evaluation target acquired by the identification information acquisition means in a storage unit;
An external device that aggregates the evaluation information of the evaluation target for the identification information stored in the storage unit when a predetermined signal is received from the outside in a place where the identification information acquisition means can acquire the identification information A program that functions as a transmission unit that updates the evaluation information of the evaluation target corresponding to the identification information stored in the external device.