JP6331571B2 - Information notification apparatus, information notification method, information notification system, and computer program - Google Patents

Information notification apparatus, information notification method, information notification system, and computer program Download PDF

Info

Publication number
JP6331571B2
JP6331571B2 JP2014067652A JP2014067652A JP6331571B2 JP 6331571 B2 JP6331571 B2 JP 6331571B2 JP 2014067652 A JP2014067652 A JP 2014067652A JP 2014067652 A JP2014067652 A JP 2014067652A JP 6331571 B2 JP6331571 B2 JP 6331571B2
Authority
JP
Japan
Prior art keywords
information
pattern
device
transmission
notification
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2014067652A
Other languages
Japanese (ja)
Other versions
JP2015192264A (en
Inventor
昇平 松山
昇平 松山
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to JP2014067652A priority Critical patent/JP6331571B2/en
Publication of JP2015192264A publication Critical patent/JP2015192264A/en
Application granted granted Critical
Publication of JP6331571B2 publication Critical patent/JP6331571B2/en
Application status is Active legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Description

  The present invention relates to a technical field for decoding light emission signals transmitted from a plurality of transmission devices.

  2. Description of the Related Art In recent years, for example, the luminous efficiency of LEDs has been dramatically improved due to technological progress of LEDs (Light_Emitting_Diode: hereinafter referred to as “LEDs”). In addition, as technology advances, LEDs are used in various fields. More specifically, for example, as a technique that is utilized, visible light communication that utilizes the characteristic of an LED that can blink at high speed is known.

  Here, as related technologies existing prior to the application of the present application, there are, for example, Patent Documents 1 to 5. More specifically, as an example, Patent Document 1 discloses a technique related to an optical information processing system, a terminal device, an optical information processing method, a program, and a storage medium.

  The optical information processing system disclosed in Patent Document 1 includes a transmission device that emits content data converted into an optical signal, and a digital camera that receives the optical signal emitted from the transmission device. This digital camera converts the received optical signal into an electrical signal and restores the content data based on the converted electrical signal. Then, the digital camera processes to associate the image data representing the video with the restored content data.

  Thereby, the optical information processing system can reproduce the content data obtained by visible light communication together with the video.

  Patent Documents 2 and 5 disclose techniques for processing various types of information such as transmission data and authentication information using optical signals, for example.

JP 2008-258987 A International Publication WO2003 / 036829 JP 2010-128629 A JP 2007-318491 A Japanese Patent Laid-Open No. 2007-110276

  As described above, in visible light communication, for example, there is a technique for notifying information using an optical signal emitted from an LED (hereinafter, “optical signal emitted from an LED” is also referred to as “LED emission signal” in the present application). Are known. The technique for notifying information using this LED light emission signal is, for example, when transmitting LED light emission signals having the same blinking pattern representing different meanings from two transmission devices, the transmission device that is the transmission source of the light emission signal Cannot be determined.

  Therefore, in such a technique, it is necessary to prepare a receiving device that receives the transmitted LED light emission signal for each transmitting device. Alternatively, the technology needs to include identification information that can identify the transmission device in the LED light emission signal (that is, give it) and transmit the identification information. Therefore, in an existing transmission device that does not have a function of transmitting identification information of its own device in an LED light emission signal, it is necessary to introduce a reception device for each transmission device. Therefore, it is expensive to introduce the device. Is required. Further, for example, the developer of the transmission device needs to design the transmission device so that identification information of the device itself can be included in the LED light emission signal and transmitted. In other words, this technique may not only increase the design cost but also increase the manufacturing cost due to the addition of functions.

  Furthermore, in such a technique, for each transmitting device, the receiving device corresponding to the transmitting device needs to know in advance the identification information and the meaning represented by the light emission signal (communication protocol) including the blinking pattern transmitted by the transmitting device. There is. In other words, in this technique, it is necessary to register in advance in the receiving device the meaning represented by the light emission signal composed of the blinking pattern transmitted from the transmitting device.

  In addition, the techniques disclosed in Patent Document 1 to Patent Document 5 described above decode various information transmitted from the transmission apparatus by using a communication protocol determined in advance between the transmission apparatus and the reception apparatus. It is described to do. Therefore, in the disclosed technique, when the communication protocol is different for each transmission device, it is not possible to decode the light emission signal composed of the blinking pattern transmitted from the transmission device.

  The techniques disclosed in Patent Documents 1 to 5 notify, for example, a user with low-rate information obtained by decoding a light emission signal having a blinking pattern. Therefore, in the disclosed technique, only simple code information that can be transmitted by a light emission signal having a blinking pattern, for example, is notified. That is, the disclosed technique notifies information that is unclear to the user.

  The main object of the present invention is to easily identify a transmission device that has transmitted a light emission signal and to receive information based on the light emission signal even when the light emission signal is received from one or more transmission devices having different communication protocols. The main purpose is to provide an information notification device or the like that can be notified.

  In order to achieve the above object, an information notification apparatus according to the present invention has the following configuration.

That is, the information notification device according to the present invention is
A feature amount is extracted based on image information including information constituting an image representing a transmission device to be specified, and light emission including a blinking pattern is selected from one or more transmission devices based on the feature amount. Identifying a transmitting device that transmits a signal, and obtaining first pattern information representing a blinking pattern transmitted from the identified transmitting device from the image information;
Obtaining second pattern information associated with the identified transmission device from blinking pattern information including second pattern information representing one or more blinking patterns transmitted from the one or more transmission devices;
It is determined whether or not the first pattern information is included in the obtained second pattern information, and when it is determined that the first pattern information is included, the second pattern information is based on the second pattern information. Image recognition means for decoding transmission information;
Control means for notifying the decrypted transmission information;
It is characterized by providing.

  Alternatively, the object can be achieved by an information notification system including the information notification device described above.

  In order to achieve the object, an information notification method according to the present invention is characterized by having the following configuration.

That is, the information notification method according to the present invention includes:
Depending on the information processing device,
A feature amount is extracted based on image information including information constituting an image representing a transmission device to be specified, and light emission including a blinking pattern is selected from one or more transmission devices based on the feature amount. Identifying a transmitting device that transmits a signal, and obtaining first pattern information representing a blinking pattern transmitted from the identified transmitting device from the image information;
Obtaining second pattern information associated with the identified transmission device from blinking pattern information including second pattern information representing one or more blinking patterns transmitted from the one or more transmission devices;
It is determined whether or not the first pattern information is included in the obtained second pattern information, and when it is determined that the first pattern information is included, the second pattern information is based on the second pattern information. Decrypt the transmitted information,
The decrypted transmission information is notified.

  This object is also achieved by a computer program for realizing the information notification apparatus and information notification method having the above-described configurations by a computer, and a readable storage medium in which the computer program is stored. .

  According to the present invention, even when a light emission signal is received from one or more transmission devices having different communication protocols, the transmission device that has transmitted the light emission signal is easily identified and information based on the light emission signal is notified. An information notification device or the like that can be provided can be provided.

It is a block diagram which shows the structure of the information notification apparatus in the 1st Embodiment of this invention. It is a flowchart which shows the operation | movement which the information notification apparatus in the 1st Embodiment of this invention specifies the transmission apparatus based on image information, and notifies the information sent from the transmission apparatus. It is a flowchart which shows the operation | movement which the information notification apparatus in the 1st Embodiment of this invention specifies the transmission apparatus based on image information, and notifies the information sent from the transmission apparatus. It is a block diagram which shows the structure of the information notification apparatus in the 2nd Embodiment of this invention. It is a block diagram which shows the structure of the information notification system containing the information notification apparatus in the 3rd Embodiment of this invention. It is a flowchart which shows the operation | movement which notifies a user friendly information based on the information which the information notification apparatus in the 3rd Embodiment of this invention specifies based on the image information, and transmits a transmission apparatus. It is a flowchart which shows the operation | movement which notifies a user friendly information based on the information which the information notification apparatus in the 3rd Embodiment of this invention specifies based on the image information, and transmits a transmission apparatus. It is a block diagram explaining illustratively the hardware constitutions of the information processor which can realize each embodiment concerning the present invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

<First Embodiment>
FIG. 1 is a block diagram showing a configuration of an information notification device 1 according to the first embodiment of the present invention.

  In FIG. 1, the information notification device 1 includes a control unit 2 and an image recognition unit 3.

  More specifically, first, the control unit 2 analyzes the image information 101 including the image (information constituting the image) representing the target device that is the target to be specified, and sends the image information 101 to the image information 101 from the target device. It is determined whether or not a light emission signal having a blinking pattern is included. As a result of the determination, the control unit 2 controls the storage unit 4 to store the image information 101 when determining that the image information 101 includes a light emission signal composed of a blinking pattern transmitted from the target device. .

  Further, the control unit 2 notifies the user of transmission information decoded by the image recognition unit 3 described later, for example.

  Here, the light emission signal having the blinking pattern is, for example, encoding transmission information by a transmission device (not illustrated) (for example, the transmission device 21 illustrated in FIG. 4), and converting the encoded transmission information to the light signal. It is a signal sent using a blinking pattern.

  In the following description, for convenience of description, as an example, “light emission signal including a blinking pattern” is also simply referred to as “light emission signal pattern” (hereinafter, the same applies to each embodiment).

  The image information 101 is a moving image composed of a plurality of time-series image frames including an image representing a target device imaged by a photographing device such as a camera.

  Here, the target device is a transmission device to be specified that transmits a light emission signal including a blinking pattern included in the image information 101.

  In the present embodiment, for convenience of explanation, the image information 101 has been described by taking a moving image composed of a plurality of time-series image frames as an example. However, the embodiment according to the present invention is not limited to such a configuration.

  The image information 101 may employ an image composed of a plurality of time-series image frames. Further, for example, the image information 101 may employ a feature amount extracted from an image representing a target device that is a target to be specified.

  Next, the image recognition unit 3 obtains information representing the light emission signal pattern transmitted from the target apparatus over a predetermined time by image processing based on the image information 101 stored in the storage unit 4.

  Here, the information representing the light emission signal pattern obtained by the image recognition unit 3 is information representing the light emission signal pattern transmitted from the target device obtained by the image recognition unit 3 over a predetermined time based on the image information 101. is there. Therefore, the information representing the light emission signal pattern includes information representing all or part of the light emission signal pattern transmitted from the target device.

  In the following description, for convenience of description, as an example, “information indicating a light emission signal pattern included in the image information 101” is referred to as “first pattern information” (hereinafter, the same applies to each embodiment).

  Further, the image recognition unit 3 analyzes the image information 101 stored in the storage unit 4 to identify the target device that has transmitted the light emission signal pattern from one or more transmission devices.

  More specifically, the image recognition unit 3 extracts the feature amount of the target device that is the target to be specified based on the image information 101. The image recognition unit 3 refers to the feature amount information 102 stored in the storage unit 4 based on the extracted feature amount. Then, the image recognition unit 3 obtains a device identifier (Identifier: hereinafter referred to as “ID”) that is information that can identify the target device associated with the feature amount extracted from the feature amount information 102.

  Here, the feature amount information 102 will be described more specifically.

  The feature amount information 102 includes a device ID of one or more transmission devices and information representing the feature amount of the transmission device for each transmission device. That is, the feature amount information 102 is information in which a management ID and information representing the feature amount of the transmission device are associated with each transmission device.

  Based on the obtained device ID, the image recognition unit 3 obtains information (second pattern information) representing the blinking pattern transmitted from the target device that is the target to be specified.

  More specifically, the image recognition unit 3 refers to the blinking pattern information 103 based on the obtained device ID. The image recognition unit 3 obtains information (second pattern information) representing the blinking pattern associated with the device ID from the blinking pattern information 103.

  Here, the information indicating the blinking pattern (second pattern information) is information indicating the light emission signal pattern transmitted from the target device.

  In the following description, for convenience of description, as an example, “information indicating a blinking pattern transmitted from a target device that is a target to be specified” is referred to as “second pattern information” (hereinafter, also in each embodiment). The same).

  Next, the image recognition unit 3 determines whether or not the first pattern information is included in the obtained second pattern information. When determining that the second pattern information includes the first pattern information as a result of the determination, the image recognition unit 3 decodes the transmission information based on the obtained second pattern information. The image recognition unit 3 gives the decoded transmission information to the control unit 2.

  Here, the blinking pattern information 103 will be described more specifically.

  The blinking pattern information 103 includes device IDs of one or more transmission devices and information (second pattern information) representing one or more blinking patterns transmitted from the transmission device. That is, the blinking pattern information 103 includes information in which the device ID is associated with the second pattern information.

  The storage unit 4 stores image information 101, feature amount information 102, and blinking pattern information 103.

  Here, the storage unit 4 is a nonvolatile storage device that can read and write data by a computer. More specifically, as an example, the storage unit 4 may employ a nonvolatile storage device such as a hard disk drive (Hard_disk_drive: hereinafter referred to as “HDD”) mounted in an electronic device such as a server device.

  As an example, the storage unit 4 may employ a storage device (not shown) connected to a communication network (not shown). However, the present invention described using this embodiment as an example is not limited to the above-described configuration (the same applies to the following embodiments).

  In the following description, the operation of the information notification apparatus 1 in the present embodiment will be described more specifically.

  2A and 2B, the information notification apparatus 1 according to the first embodiment of the present invention specifies a transmission apparatus (for example, the transmission apparatus 21 shown in FIG. 4) based on the image information 101, and from the transmission apparatus. It is a flowchart which shows the operation | movement which notifies the transmitted information. The operation procedure of the information notification apparatus 1 will be described along the flowchart.

  In the following description, for convenience of description, as an example, a light emission signal having a blinking pattern is transmitted from a transmission device that is a target device to be identified.

  For convenience of explanation, the above-described configuration will be described as an example. However, the present invention described by taking this embodiment as an example is not limited to the above-described configuration.

Step S1:
Based on the image information 101, the control unit 2 determines whether or not the light emission signal pattern transmitted from the target device is included in the image information 101. That is, based on the image information 101, the control unit 2 determines the presence or absence of information representing the light emission signal pattern sent from the target device included in the image information 101.

  More specifically, as an example, the control unit 2 divides an image frame constituting the image information 101 into a plurality of partial images (grids) in a grid pattern (or treats them as a plurality of divided partial images). Then, the control unit 2 includes the light emission signal pattern transmitted from the target device in the image information 101 when the optical information has a temporal change equal to or greater than a certain threshold in the divided specific grid. It is determined that there is.

  Note that the technology itself for determining the presence / absence of the light emission signal pattern based on the image information 101 by the control unit 2 can now employ a general technology, and thus a detailed description in the present embodiment will be omitted (hereinafter, referred to as the following). The same applies to each embodiment).

"YES" in step S1:
When determining that the image information 101 includes the light emission signal pattern transmitted from the target device, the control unit 2 determines that the image information 101 includes the light emission signal pattern. The process proceeds to step S2.

"NO" in step S1:
When determining that the light emission signal pattern transmitted from the target device is included in the image information 101 as a result of determining whether the light emission signal pattern is not included in the image information 101, the control unit 2 Proceed with the next image frame. That is, the control unit 2 returns the process to step S1.

Step S2:
The control unit 2 controls the storage unit 4 to store the image information 101.

  As a result, the storage unit 4 stores the image information 101.

Step S3:
The image recognition unit 3 obtains information (first pattern information) representing a light emission signal pattern sent from the target apparatus over a predetermined time by image processing based on the image information 101 stored in the storage unit 4. That is, the image recognition unit 3 obtains the first pattern information included in the image information 101 over a predetermined time based on the image information 101.

  Note that the technology itself for obtaining information representing the light emission signal pattern by the image processing based on the image information 101 by the image recognition unit 3 can currently employ a general technology. Omitted (the same applies to the following embodiments).

Step S4:
The image recognition unit 3 extracts the feature amount of the target device based on the image information 101.

  Note that, since the technology itself in which the image recognition unit 3 extracts the feature amount of the target device based on the image information 101 can be a general technology at present, detailed description in this embodiment is omitted. (The same applies to the following embodiments).

Step S5:
The image recognition unit 3 refers to the feature amount information 102 stored in the storage unit 4 based on the extracted feature amount. The image recognition unit 3 obtains a device ID that can identify the target device associated with the feature amount extracted from the feature amount information 102.

Step S6:
The image recognition unit 3 refers to the blinking pattern information 103 based on the obtained device ID. The image recognition unit 3 obtains information (second pattern information) indicating the light emission signal pattern associated with the device ID from the blinking pattern information 103.

Step S7:
The image recognition unit 3 determines whether or not the first pattern information is included in the second pattern information.

  Thereby, for example, the image recognition unit 3 is information indicating all of the light emission signal pattern even if the first pattern information obtained in step S3 is information indicating a part of the light emission signal pattern transmitted from the transmission device. (Second pattern information) can be obtained.

"YES" in step S7:
When the image recognition unit 3 determines whether or not the second pattern information includes the first pattern information, the image recognition unit 3 performs processing when determining that the second pattern information includes the first pattern information. Proceed to step S8.

“NO” in step S7:
When the image recognition unit 3 determines that the first pattern information is not included in the second pattern information as a result of determining whether the second pattern information includes the first pattern information, Advances to step S9.

Step S8:
The image recognizing unit 3 decodes the transmission information based on information (second pattern information) representing the obtained light emission signal pattern. The image recognition unit 3 gives the decoded transmission information to the control unit 2.

Step S9:
The image recognition unit 3 refers to the blinking pattern information 103 based on the obtained device ID. The image recognition unit 3 obtains second pattern information associated with the device ID from the blinking pattern information 103. That is, the image recognition unit 3 obtains other second pattern information different from the second pattern information used for the determination in step S7 from the blinking pattern information 103. The image recognition unit 3 returns the process to step S7.

  The image recognition unit 3 repeatedly executes the processes described in steps S7 and S8 until it is determined that the first pattern information is included in the second pattern information. When the image recognition unit 3 determines that all the second pattern information among the second pattern information associated with the device ID included in the blinking pattern information 103 does not include the first pattern information. Then, the process ends.

Step S10:
The control unit 2 notifies the transmission information obtained from the image recognition unit 3.

  In the above-described embodiment, for the sake of convenience of explanation, as an example, the image recognition unit 3 has been described with an example of a configuration in which processing is performed in the order of step S3, step S4, step S5, and step S6. However, the embodiment according to the present invention is not limited to such a configuration. The image recognition unit 3 may adopt a configuration in which the process shown in step S3 is executed after the process shown in steps S4 to S6 is executed.

  In the above-described embodiment, for the sake of convenience of explanation, the storage unit 4 has been described as an example of a configuration in which the image information 101, the feature amount information 102, and the blinking pattern information 103 are stored. However, the embodiment according to the present invention is not limited to such a configuration. The storage unit 4 may adopt a configuration in which the image information 101 and some information of the feature amount information 102 and the blinking pattern information 103 are stored.

  In this case, a configuration may be adopted in which other information on the feature amount information 102 and the blinking pattern information 103 is stored in, for example, another nonvolatile storage device different from the storage unit 4 or a network storage device.

  As a result, when the desired amount information is not included in the feature amount information 102 and the blinking pattern information 103 stored in the storage unit 4, the image recognition unit 3, for example, another nonvolatile storage different from the storage unit 4. Desired information can be obtained from the feature amount information 102 and the blinking pattern information 103 stored in the apparatus.

  Moreover, in this embodiment mentioned above, the information notification apparatus 1 demonstrated as an example the structure which performs the process mentioned above with respect to one object apparatus as an example for convenience of explanation. However, the embodiment according to the present invention is not limited to such a configuration. The information notification device 1 may adopt a configuration that executes the above-described processing on one or more target devices. In that case, the information notification device 1 may adopt a configuration that executes the above-described processing for each target device.

  As described above, according to the information notification device 1 according to the present embodiment, even when a light emission signal is received from one or more transmission devices having different communication protocols, the transmission device that has transmitted the light emission signal is easily identified. In addition, information based on the light emission signal can be notified. The reason is as described below.

  That is, the image recognition unit 3 of the information notification device 1 extracts the feature amount of the target device based on the image information 101 obtained by imaging the target device that transmits the light emission signal. This is because the image recognition unit 3 can identify the target device based on the extracted feature amount. This is because the information notification device 1 can realize optical communication even with an existing transmission device that does not have a function of transmitting the identification information of the transmission device in the light emission signal. Further, when executing the above-described processing, the image recognizing unit 3 refers to the feature amount information 102 and the blinking pattern information 103 stored in another storage unit 4 different from its own device, and executes the above-described processing. Therefore, for example, the administrator does not need to negotiate a communication protocol for the information notification apparatus 1 in advance.

  In addition, the image recognition unit 3 obtains first pattern information based on the image information 101. And the image recognition part 3 calculates | requires the 2nd pattern information sent from the transmission apparatus from the blinking pattern information 103 based on apparatus ID of the specified target apparatus. Then, the image recognition unit 3 decodes the transmission information based on the obtained second pattern information. Furthermore, the control unit 2 can notify the transmission information obtained from the image recognition unit 3.

  As a result, the image recognition unit 3 uses the second pattern information even if the obtained first pattern information is information representing a part of the light emission signal pattern (second pattern information) transmitted from the target device. The transmission information can be decoded based on this. In addition, the control unit 2 can notify the decoded transmission information.

<Second Embodiment>
Next, a second embodiment based on the information notification apparatus 1 according to the first embodiment of the present invention described above will be described. In the following description, the characteristic part according to the present embodiment will be mainly described. At this time, the same reference numerals are assigned to the same configurations as those in the above-described embodiments, and duplicate descriptions are omitted.

  An information notification apparatus 10 according to a second embodiment of the present invention will be described with reference to FIG.

  FIG. 3 is a block diagram showing the configuration of the information notification device 10 according to the second embodiment of the present invention.

  In FIG. 3, the information notification device 10 includes a control unit 11 and an image recognition unit 3. The storage unit 4 further stores notification information 104.

  In the present embodiment, the information notification device 10 does not notify the transmission information obtained from the image recognition unit 3 by the control unit 11, but notifies information based on the light emission signal so that it can be easily identified by the user. The information notification device 10 described in the first embodiment is different from the information notification device 10 in that the functions are further provided.

  The control unit 11 converts the communication information transmitted from the target device as a light emission signal into notification information that can be easily identified by the user, and notifies the converted notification information. That is, the control unit 11 provides user-friendly information for the user.

  More specifically, the control unit 11 refers to the notification information 104 based on the device ID and information (second pattern information) indicating the blinking pattern. The control unit 11 obtains notification information associated with the device ID and the second pattern information from the notification information 104.

  In the following description, for convenience of explanation, as an example, “notification information obtained by the control unit 11” is referred to as “first notification information” (hereinafter, the same applies to each embodiment).

  Here, the notification information 104 will be described more specifically.

  The notification information 104 includes device IDs of one or more transmission devices, information representing one or more blink patterns for each device ID, and first notification information corresponding to information representing the transmission device and the blink pattern. including. That is, the notification information 104 is information in which information representing a blinking pattern is associated with the first notification information using the device ID as a key.

  More specifically, the first notification information of the notification information 104 is, for example, a message “a message that represents the transmission information that can be identified by the user when the decoded transmission information includes an“ error code ”. A configuration including information such as “A failure in part A has been detected” may be employed. Alternatively, for example, the first notification information may be configured to include an entity of reference information such as a user manual related to “error code”.

  As another specific example, the first notification information includes, for example, when the decoded transmission information includes “URL” (Uniform_Resource_Locator) or “URI” (Uniform_Resource_Identifier), A configuration including information “URL” and “URI” expressed so as to be identifiable may be adopted.

  As another specific example, the first notification information includes, for example, “B” that represents the transmission information that can be identified by the user when the decoded transmission information includes “store name”. A configuration including information related to the store such as “Sale at a store” and information indicating a “coupon” may be adopted.

  As another specific example, the first notification information may include, for example, a configuration including information indicating a contact information of a customer center and information indicating a work procedure for a failure indicated by an error code.

As described above, it is desirable that the first notification information includes the information intended by the decrypted transmission information that is more easily expressed for the user.
However, the present invention described using this embodiment as an example is not limited to the configuration described above (hereinafter, the same applies to each embodiment).

  Next, the control unit 11 notifies user-friendly information based on the obtained first notification information. That is, based on the obtained first notification information, the control unit 11 notifies the information intended by the transmission information (related) in a manner that allows the user to easily identify the information.

  More specifically, for example, when the decoded transmission information includes “error code”, the control unit 11 includes a message indicating “error code” based on the obtained first notification information. You may employ | adopt the structure which notifies information by the aspect which a user can identify. Or the control part 11 may employ | adopt the structure which notifies by showing reference information, such as a user manual regarding "error code", for example.

  Further, as another specific example, when the decoded transmission information includes “URL” or “URI”, for example, the control unit 11 determines “URL” or “URL” based on the obtained first notification information. A configuration may be employed in which information including “URI” is notified in a manner that the user can identify. Or the control part 11 may employ | adopt the structure which notifies by showing the information showing the aspect which changed the screen to the web site which "URL" or "URI" shows, for example.

  As another specific example, for example, when the decoded transmission information includes “store name”, the control unit 11 uses information related to the store based on the obtained first notification information. You may employ | adopt the structure which notifies by the aspect which a person can identify. Alternatively, for example, the control unit 11 may adopt a configuration in which notification is made by presenting a “coupon”.

  As described above, according to the information notification device 10 according to the present embodiment, the effect described in the first embodiment can be enjoyed, and further, information based on the light emission signal can be easily identified by the user. You can be notified.

  The reason is that information that can be easily identified for the user is notified in a manner that the user can identify based on information obtained from the notification information 104 based on the management ID and the second pattern information. This is because the control unit 11 is provided.

  As a result, the user can visually identify the blinking interval and the color difference in the LED that are generally known, and realize information transmission by referring to the manual in which the meaning of the light emission signal is described. In contrast, the information notification apparatus 10 can transmit more information so that the user can easily recognize the information.

<Third Embodiment>
Next, a third embodiment based on the information notification apparatus 10 according to the second embodiment of the present invention described above will be described. In the following description, the characteristic part according to the present embodiment will be mainly described. At this time, the same reference numerals are assigned to the same configurations as those in the above-described embodiments, and duplicate descriptions are omitted.

  An information notification system 20 including an information notification device 10 according to a third embodiment of the present invention will be described with reference to FIGS. 3, 4, 5A, and 5B.

  FIG. 4 is a block diagram showing the configuration of the information notification system 20 including the information notification device 10 according to the third embodiment of the present invention.

  In FIG. 4, the information notification system 20 includes a transmission device 21, a reception device 22 including the information notification device 10, and a storage device 23. The receiving device 22 and the storage device 23 are communicably connected via the communication network 110.

  The information notification device 10 (not shown in FIG. 4) includes the control unit 11 and the image recognition unit 3 described in FIG.

  In the following description, for convenience of explanation, as an example, the receiving device 22 including the information notification device 10 according to the present invention is a generally known mobile terminal such as a smartphone or a feature phone. The receiving device 22 includes a camera device (image capturing unit) (not shown) that can capture still images and moving images, a notification unit 24 that can display (that is, can notify) various types of information, and a user operation, for example. And a possible operation unit 25.

  The transmission device 21 encodes the transmission information and transmits the encoded transmission information as a light emission signal having a blinking pattern. The transmission device 21 includes an indicator 26 that can transmit a light emission signal and is configured by, for example, an LED. That is, the transmission device 21 transmits a light emission signal by blinking the indicator 26.

  For example, when the user operates the operation unit 25, the reception device 22 activates the camera device and starts imaging the transmission device 21 including the indicator 26. In addition, the reception device 22 gives image information obtained by capturing the transmission device 21 including the indicator 26 to the control unit 11 as image information 101.

  The storage device 23 stores image information 101, feature amount information 102, blinking pattern information 103, and notification information 104.

  The storage device 23 is a storage device connected to the communication network 110, for example. However, the present invention described using this embodiment as an example is not limited to the above-described configuration (the same applies to the following embodiments).

  The communication network 110 is a general communication line such as, for example, various communication lines owned by a mobile phone operator, the Internet provided by an Internet service provider, or the like. However, the present invention described using this embodiment as an example is not limited to the configuration described above (hereinafter, the same applies to each embodiment).

  In the following description, the operation of the information notification apparatus 10 in the present embodiment will be described more specifically.

  5A and 5B show that the information notification device 10 according to the third embodiment of the present invention specifies the transmission device 21 based on the image information 101 and is user-friendly based on the information sent from the transmission device 21. It is a flowchart which shows the operation | movement which notifies information. The operation procedure of the information notification apparatus 10 will be described along the flowchart. In this case, the same reference numerals are assigned to the same components as those in the flowcharts shown in FIGS. 2A and 2B described above, and redundant description is omitted.

Step S21:
The control unit 11 refers to the notification information 104 based on the management ID and information indicating the blinking pattern (second pattern information). The control unit 11 obtains notification information (first notification information) associated with the management ID and the second pattern information from the notification information 104.

Step S22:
Based on the first notification information, the control unit 11 notifies the information intended by the transmission information so that the user can easily identify the information.

  More specifically, the control unit 11 notifies the information intended by the transmission information by, for example, displaying the information on the notification unit 24 of the reception device 22. However, the mode of notification (notification) is not limited to display. For example, a configuration for notifying by voice may be adopted as the notification mode. Moreover, you may employ | adopt the structure notified by vibrators, such as a vibration, as the aspect of notification.

  Thus, according to the information notification device 10 according to the present embodiment, the effects described in the embodiments can be enjoyed. Moreover, the information notification apparatus 10 is suitable for application to an information notification system.

  The reason is that the information notification device 10 can be realized by applying it to a mobile terminal having a camera function and a communication function, for example. That is, the information notification device 10 can be realized without providing a dedicated terminal.

(Hardware configuration example)
Each unit illustrated in the drawings in the above-described embodiment may be realized by a dedicated device (hardware module). Further, the control units (the control unit 2 and the control unit 11) illustrated in the drawings can be regarded as a function (processing) unit (software module) of the software program. However, the division of each part shown in these drawings is a configuration for convenience of explanation, and various configurations can be assumed in mounting. An example of the hardware environment in this case will be described with reference to FIG.

  FIG. 6 is a diagram illustrating an exemplary configuration of an information processing apparatus 300 (computer) that can execute the information notification apparatus according to the exemplary embodiment of the present invention. That is, FIG. 6 can realize the information notification device 1 shown in FIG. 1, the information notification device 10 shown in FIG. 3, or the information notification device 10 shown in FIG. This is a configuration of a computer (information processing apparatus) such as a simple server, and represents a hardware environment capable of realizing each function in the above-described embodiment.

  An information processing apparatus 300 illustrated in FIG. 6 includes a CPU (Central_Processing_Unit) 301, a ROM (Read_Only_Memory) 302, a RAM (Random_Access_Memory) 303, and a communication interface (Interface: hereinafter referred to as “I / F”) 305. A general computer is provided with a camera device 304 connected to the communication I / F, and these components are connected via a bus 306 (communication line).

  The present invention described using the above-described embodiment as an example is a block diagram (FIGS. 1, 3, and 4) or a flowchart (FIG. 1) referred to in the description of the information processing apparatus 300 shown in FIG. This is achieved by supplying a computer program capable of realizing the functions of 2A, 2B, 5A, and 5B) to the CPU 301 of the hardware and executing the computer program. The computer program supplied to the apparatus may be stored in a non-volatile storage device such as a readable / writable temporary storage memory (RAM 303).

  In the above case, the computer program can be supplied to the hardware by using a general procedure, such as a method of downloading from the outside via a communication line such as the Internet. it can. In such a case, the present invention can be regarded as being configured by a code constituting the computer program or a storage medium storing the code.

DESCRIPTION OF SYMBOLS 1 Information notification apparatus 2 Control part 3 Image recognition part 4 Storage part 10 Information notification apparatus 11 Control part 20 Information notification system 21 Transmission apparatus 22 Reception apparatus 23 Storage apparatus 24 Notification part 25 Operation part 26 Indicator 101 Image information 102 Feature-value information 103 Blink pattern information 110 Communication network 300 Information processing device 301 CPU
302 ROM
303 RAM
304 Camera Device 305 Communication Interface 306 Bus

Claims (9)

  1. A feature amount is extracted based on image information including information constituting an image representing a transmission device to be specified, and light emission including a blinking pattern is selected from one or more transmission devices based on the feature amount. Identifying a transmitting device that transmits a signal, and obtaining first pattern information representing a blinking pattern transmitted from the identified transmitting device from the image information;
    Obtaining second pattern information associated with the identified transmission device from blinking pattern information including second pattern information representing one or more blinking patterns transmitted from the one or more transmission devices;
    It is determined whether or not the first pattern information is included in the obtained second pattern information, and when it is determined that the first pattern information is included, the second pattern information is based on the second pattern information. Image recognition means for decoding transmission information;
    And a control means for notifying the decrypted transmission information.
  2. The control means includes
    Based on the second pattern information, the one or more identifiable device ID transmission device, and the second pattern information, the first notification information including information which the transmission information is intended 2. The information notification apparatus according to claim 1, wherein the first notification information is obtained from the associated notification information, and the obtained first notification information is notified in a manner that the user can identify. .
  3. The image sure 識手 stage,
    Based on the extracted feature quantity, the feature quantity information including the one or more transmission devices and the feature quantity of the transmission apparatus is referred to and associated with the extracted feature quantity from the feature quantity information. The information notification apparatus according to claim 1, wherein the apparatus ID is obtained.
  4. The control means includes
    It is determined whether or not the image information includes a light emission signal composed of a blinking pattern transmitted from the specified transmission device, and the image information is stored when it is determined that the light emission signal is included. The information notification apparatus according to claim 1, wherein the information notification apparatus is controlled so as to be stored in a unit.
  5. The control means includes
    When the first notification information includes information related to an error code, the information indicating either the message indicating the error code or the reference information regarding the error code is notified in a manner that can be identified by the user. The information notification device according to claim 2.
  6. The control means includes
    When the first notification information includes information related to a URL, either the information indicating the URL or the information indicating the mode of transition to the Web site indicated by the URL is notified in a mode that can be identified by the user. The information notification device according to claim 2.
  7. A transmission device that transmits transmission information by a light emission signal having a blinking pattern, a reception device including the information notification device according to claim 1, and a storage device that is communicably connected to the reception device via a network communication network. An information notification system comprising:
    The transmitter is
    An indicator capable of transmitting the light emission signal;
    The receiving device is:
    An imaging unit that images the transmission device including the indicator and gives the captured image information to the control unit;
    The storage device
    Information notification system characterized by storing at least the image information and the prior SL blink pattern information.
  8. Depending on the information processing device,
    A feature amount is extracted based on image information including information constituting an image representing a transmission device to be specified, and light emission including a blinking pattern is selected from one or more transmission devices based on the feature amount. Identifying a transmitting device that transmits a signal, and obtaining first pattern information representing a blinking pattern transmitted from the identified transmitting device from the image information;
    Obtaining second pattern information associated with the identified transmission device from blinking pattern information including second pattern information representing one or more blinking patterns transmitted from the one or more transmission devices;
    It is determined whether or not the first pattern information is included in the obtained second pattern information, and when it is determined that the first pattern information is included, the second pattern information is based on the second pattern information. Decrypt the transmitted information,
    An information notification method comprising notifying the decrypted transmission information.
  9. A feature amount is extracted based on image information including information constituting an image representing a transmission device to be specified, and light emission including a blinking pattern is selected from one or more transmission devices based on the feature amount. Identifying a transmitting device that transmits a signal, and obtaining first pattern information representing a blinking pattern transmitted from the identified transmitting device from the image information;
    Obtaining second pattern information associated with the identified transmission device from blinking pattern information including second pattern information representing one or more blinking patterns transmitted from the one or more transmission devices;
    It is determined whether or not the first pattern information is included in the obtained second pattern information, and when it is determined that the first pattern information is included, the second pattern information is based on the second pattern information. A function for decoding transmission information;
    A function of notifying the decrypted transmission information;
    A computer program characterized in that a computer is realized.
JP2014067652A 2014-03-28 2014-03-28 Information notification apparatus, information notification method, information notification system, and computer program Active JP6331571B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2014067652A JP6331571B2 (en) 2014-03-28 2014-03-28 Information notification apparatus, information notification method, information notification system, and computer program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2014067652A JP6331571B2 (en) 2014-03-28 2014-03-28 Information notification apparatus, information notification method, information notification system, and computer program

Publications (2)

Publication Number Publication Date
JP2015192264A JP2015192264A (en) 2015-11-02
JP6331571B2 true JP6331571B2 (en) 2018-05-30

Family

ID=54426461

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014067652A Active JP6331571B2 (en) 2014-03-28 2014-03-28 Information notification apparatus, information notification method, information notification system, and computer program

Country Status (1)

Country Link
JP (1) JP6331571B2 (en)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3678404B2 (en) * 2000-05-12 2005-08-03 株式会社東芝 Image information processing apparatus
JP2003345279A (en) * 2002-05-27 2003-12-03 Sony Corp Signboard, and device and method for managing signboard
JP2010147527A (en) * 2008-12-16 2010-07-01 Kyocera Corp Communication terminal, and program for identifying information transmission source
EP2474205A1 (en) * 2009-09-04 2012-07-11 American DJ Supply, Inc. Wireless controller for lighting system
JP5776255B2 (en) * 2011-03-25 2015-09-09 ソニー株式会社 Terminal device, object identification method, program, and object identification system
CN107196703B (en) * 2012-05-24 2019-09-03 松下电器(美国)知识产权公司 Information communicating method

Also Published As

Publication number Publication date
JP2015192264A (en) 2015-11-02

Similar Documents

Publication Publication Date Title
US20140043480A1 (en) Video monitoring system and method
US20060086796A1 (en) Image signal output device, coded image signal generation method, image signal output program, camera operation system, camera operation program, matrix code decoding device, and matrix code decoding program
US20130272717A1 (en) Transmission system, transmitter and receiver
US8820630B2 (en) Hand held bar code readers or mobile computers with cloud computing services
TWI253867B (en) Image encoding apparatus, image encoding method, image encoding program, image decoding apparatus, image decoding method, and image decoding program
Perli et al. PixNet: Interference-free wireless links using LCD-camera pairs
US8833640B2 (en) Utilizing matrix codes during installation of components of a distribution system
US20170180047A1 (en) Information processing program, reception program, and information processing apparatus
MX2011009969A (en) System and method for compressing video based on latency measurements and other feedback.
US9384332B2 (en) Watermarking method and apparatus for tracking hacked content and method and apparatus for blocking hacking of content using the same
KR101851398B1 (en) Apparus and method for authorizing combining code using quick response code
CN103430565A (en) Synching one or more matrix codes to content related to multimedia presentation
CN101512580A (en) Automatic equipment registration system with bar code discrimination and maintenance information generation
IL215308D0 (en) System and method for selecting a video encoding format based on feedback data
US20140003817A1 (en) Transmit and receive mimo protocols for light array communications
US20130026220A1 (en) Apparatus and method of displaying hardware status using augmented reality
KR20100047670A (en) Apparatus and method for transmitting data using visual code and apparatus and method for receiving data using visual code
KR20130052609A (en) Device communication
US9449294B2 (en) Method and apparatus for managing user devices and contents by using quick response codes
WO2017181777A1 (en) Panoramic live video streaming method, device, system, and video source control apparatus
KR20130066069A (en) Method and system for providing application based on cloud computing
CN104364754A (en) Information processing device, information processing method, and program
MX2010012948A (en) Method and apparatus for generating stereoscopic image data stream by using camera parameter, and method and apparatus for restoring stereoscopic image by using camera parameter.
JP2008011512A (en) Data processing apparatus, data storage device and data processing methods therefor
JP2007034998A (en) Two-dimensional code generation system having optional specified image as pattern

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20170215

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20180214

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180220

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180323

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20180403

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20180416

R150 Certificate of patent or registration of utility model

Ref document number: 6331571

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150