JP6626792B2 - Terminal and processing execution method - Google Patents

Description

  The present invention relates to a terminal for executing a process corresponding to feature information of an image and a process execution method.

  Conventionally, it has been known that a wireless tag for short-range wireless communication is embedded in a medium such as a booklet, and processing such as displaying various information is performed in response to the terminal starting communication with the wireless tag. I have. For example, in Patent Document 1, in response to receiving information including a start signal of an image reading application from a wireless tag by short-range wireless communication, the image reading application is started to read image information and extracted from the image information. It is disclosed to execute a specific process associated with the characteristic information such as the color.

Japanese Patent No. 5846669

  The distance over which information can be read from the wireless tag by the short-range wireless communication is, for example, less than 10 cm. Therefore, there is a problem that it is difficult to specify the characteristic information from the image information. For this reason, in the related art, after receiving information from the wireless tag and starting the image reading application, it is necessary to make the terminal detect the characteristic information by performing an operation of separating the terminal from a booklet or the like in which the wireless tag is embedded. And the operation was complicated.

  Therefore, the present invention has been made in view of these points, and an object of the present invention is to provide a terminal and a processing execution method capable of executing processing corresponding to feature information with a small number of operations.

  A terminal according to a first aspect of the present invention includes an imaging unit configured to capture a plurality of images, a detection unit configured to detect characteristic information from the images captured by the imaging unit, and the detection unit configured to detect the characteristic information from each of the plurality of images. An execution unit that executes a predetermined process associated with the characteristic information detected before the characteristic information makes a predetermined change, based on the detected change in the characteristic information.

The detection unit detects pixel values of a plurality of pixels constituting the image, and the execution unit detects a plurality of the pixel values detected before the plurality of pixel values change corresponding to the predetermined change. The predetermined processing corresponding to the value may be executed.
The detection unit further detects the color of the image based on the pixel value, the execution unit, when the color of the image becomes a predetermined color, the detection unit has detected before the predetermined color The predetermined process associated with the color of the image may be executed.

The detection unit further detects the color of the image and the brightness of the image based on the pixel value, the execution unit, when the brightness of the image reaches a predetermined brightness, before the brightness reaches the predetermined brightness. The predetermined process associated with the color of the image detected by the detection unit may be executed.
The detection unit may detect a color of the image based on pixel values within a predetermined range among the detected pixel values.
The detection unit may correct the pixel value based on a relationship between pixel values of a plurality of pixels forming the image, and detect a color of the image based on the corrected pixel value.
The detection unit performs correction of the detected pixel value based on a pixel value corresponding to the predetermined color among the pixel values detected from the image, and performs correction of the image based on the corrected pixel value. Color may be detected.

When the color of the image becomes a predetermined color, the execution unit includes a predetermined type of color among pixels constituting each of the plurality of images captured from the time when the predetermined color is obtained to a time before a predetermined time. May be calculated, and a type of color in which the number of pixels exceeds a predetermined number may be specified as the color of the image before the predetermined color.
The execution unit, if the detection unit has not detected the color related to the predetermined process for a predetermined time or more after detecting the color related to the predetermined process, It may be considered that the color related to the processing is not detected.

The terminal further includes a communication unit that performs communication with a wireless tag that performs communication according to a predetermined wireless communication method, and the execution unit performs the predetermined processing when the communication unit starts communication with the wireless tag. May be executed.
The communication unit may receive information from the wireless tag, and the execution unit may execute the predetermined process based on the information received from the wireless tag.

The terminal further includes a storage unit configured to store information receivable from the wireless tag, the color of the image, and the content of the predetermined process in association with each other, and the execution unit stores the information received from the wireless tag. And the predetermined process associated with the color of the image detected by the detection unit.
The terminal further includes a second communication unit that communicates with an external device using a method different from the predetermined wireless communication method, wherein the second communication unit receives information from the wireless tag by the communication unit. In response to the detection unit detecting the color of the image, the information and the information indicating the content of the predetermined process related to the color of the image is acquired, and the execution unit determines that the second communication unit The predetermined process may be executed based on the acquired information.
The detection unit may detect a pattern included in the image, and the execution unit may execute the predetermined processing when the pattern detected by the detection unit changes to a predetermined size.

The execution unit executes the predetermined process associated with the average value of the feature indicated by the feature information detected for an image captured at a predetermined time before the feature information changes by a predetermined amount. You may.
The execution unit, among the features indicated by the feature information detected for an image captured at a predetermined time before the feature information makes a predetermined change, the feature associated with the most detected feature A predetermined process may be executed.

  A terminal according to a second aspect of the present invention includes a color detection unit that detects a color of an object, a storage unit that stores information indicating the color detected by the color detection unit, and a storage unit that is stored in the storage unit. An execution unit that executes a predetermined process associated with the color detected before the color changes by a predetermined amount.

  The processing execution method according to a third aspect of the present invention includes a step of capturing a plurality of images, a step of detecting feature information from the captured images, and the feature information detected from each of the plurality of images. And performing a predetermined process associated with the characteristic information detected before the characteristic information makes a predetermined change based on the change of the characteristic information.

  According to the present invention, it is possible to execute a process corresponding to feature information with a small number of operations.

It is a figure showing the outline of the terminal concerning a 1st embodiment. FIG. 2 is a diagram illustrating a configuration of a terminal according to the first embodiment. FIG. 4 is a diagram illustrating an example of first color range information. FIG. 9 is a diagram illustrating an example of second color range information. It is a figure showing an example of processing specification information. 5 is a flowchart illustrating a flow of a process in the terminal according to the first embodiment. It is a figure showing the outline of the terminal concerning a 3rd embodiment.

<First embodiment>
[Overview of Terminal 1]
FIG. 1 is a diagram illustrating an outline of a terminal 1 according to the first embodiment. The terminal 1 is a portable electronic device such as a smartphone or a tablet. The terminal 1 detects the feature information included in the area 21 by reading an area 21 provided on a medium such as the booklet 2 and including the feature information, and performs a predetermined process associated with the feature information. Execute Here, the area 21 is given a predetermined color, and the terminal 1 detects the predetermined color as the feature information.

  In the first embodiment, when reading the area 21 provided in the booklet 2, the terminal 1 reads a reading application program (hereinafter simply referred to as a reading application) for executing a predetermined process in accordance with a user operation. ) ((1) in FIG. 1). When the user brings the terminal 1 close to the area 21, the terminal 1 detects the color of the area 21 ((2) in FIG. 1). Thereafter, when the user further brings the terminal 1 closer to the area 21, the area 21 is darkened by the shadow of the terminal 1, and the color detected by the terminal 1 changes ((3) in FIG. 1). When the detected color changes, the terminal 1 executes a predetermined process related to the detected color before the change. Here, the terminal 1 displays information corresponding to the color detected before the change on its own display unit ((4) in FIG. 1).

As described above, the user of the terminal 1 activates the application for causing the terminal 1 to execute a predetermined process, and then performs an operation of bringing the terminal 1 closer to the area 21 provided in the booklet 2. Performs a predetermined process. Therefore, after executing the image reading application by bringing the terminal 1 close to the wireless tag provided in the booklet, there is no need to perform an operation of moving the terminal 1 away from the booklet to read the area and detect the characteristic information. Can cause the terminal 1 to execute a predetermined process corresponding to the feature information with a small number of operations.
Next, the configuration of the terminal 1 will be described.

[Configuration Example of Terminal 1]
FIG. 2 is a diagram illustrating a configuration of the terminal 1 according to the first embodiment.
The terminal 1 includes an input unit 11, a display unit 12, an imaging unit 13, a first communication unit 14, a second communication unit 15, a storage unit 16, and a control unit 17.

The input unit 11 is, for example, a button or a touch panel, and receives an operation input from a user of the terminal 1.
The display unit 12 is, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display, and displays various information under the control of the control unit 17.
The imaging unit 13 is, for example, a camera, and captures an image around the terminal 1 under the control of the control unit 17. The imaging unit 13 captures a plurality of images, for example, by capturing images at predetermined frames, and outputs the captured images to the control unit 17.

The first communication unit 14 performs wireless communication with a wireless tag that stores information by a short-range wireless communication method such as NFC in which a communicable distance is a predetermined distance (for example, 10 cm).
The second communication unit 15 performs wireless communication by a method different from that of the first communication unit 14. For example, the second communication unit 15 performs wireless communication with an external device (not shown) via a communication network such as a mobile phone line or the Internet.

  The storage unit 16 is, for example, a ROM and a RAM. The storage unit 16 stores various programs for causing the terminal 1 to function. The storage unit 16 stores a reading application that causes the control unit 17 of the terminal 1 to function as the imaging control unit 171, the detection unit 172, and the execution unit 173. The storage unit 16 may read and store a program stored in a storage medium such as an external memory, or may store a program downloaded from an external device via a communication network.

  The control unit 17 is, for example, a CPU. The control unit 17 controls functions related to the terminal 1 by executing various programs stored in the storage unit 16. The control unit 17 functions as an imaging control unit 171, a detection unit 172, and an execution unit 173 by executing a reading application stored in the storage unit 16 in response to an instruction from a user of the terminal 1.

The imaging control unit 171 activates the imaging unit 13 in response to the execution of the reading application, and causes the imaging unit 13 to capture a plurality of images.
The detection unit 172 detects characteristic information from the image captured by the imaging unit 13. Specifically, the detection unit 172 detects RGB values as pixel values of a plurality of pixels constituting an image captured by the imaging unit 13. The detection unit 172 specifies an RGB value within a predetermined range among the detected RGB values, and detects a color of an image as feature information based on the RGB value.

  For example, the reading application includes first color range information in which a predetermined type of color related to a predetermined process is associated with an RGB value range corresponding to the color. FIG. 3 is a diagram illustrating an example of the first color range information. As shown in FIG. 3, the predetermined types of colors are, for example, red, blue, green, and the like, and each of the RGB values is specified in a range. Here, it is assumed that the predetermined type of color does not include white and black.

  Further, the reading application includes second color range information in which a color that is not related to a predetermined process (a predetermined color) is associated with a range of an RGB value corresponding to the color. FIG. 4 is a diagram illustrating an example of the second color range information. As shown in FIG. 4, colors not related to the predetermined type are, for example, black and white, and each of the RGB values is specified in a range. In the present embodiment, black is a color that changes from a predetermined type of color when the terminal 1 approaches the area 21 provided in the booklet 2. White is a color that changes from a predetermined type of color when the terminal 1 is brought close to the display, for example, when the area 21 is displayed on a display having a light emitting body or the like.

  For example, when the R value of the pixel value is 200 to 255, the G value is 0 to 60, and the B value is 0 to 60, the color of the pixel corresponding to the pixel value is red. When the R value, the G value, and the B value of the pixel value are all 0 to 100, the color of the pixel corresponding to the pixel value is black. The detection unit 172 specifies a color based on a pixel value for each of a plurality of pixels included in a captured image, and totals the number of pixels for each color. Then, the detection unit 172 determines the color having the largest number of pixels as the color of the image.

  Although the reading application includes the first color range information and the second color range information, the reading application is not limited to this. For example, the reading application may include a program code for acquiring at least one of the color range information from an external device (not shown). Then, in response to the control unit 17 executing the reading application, the detection unit 172 may acquire the color range information from the external device via the second communication unit 15 and store the information in the storage unit 16. .

  Further, the detection unit 172 may correct the pixel value based on the relationship between the pixel values of a plurality of pixels included in the image, and detect the color of the image based on the corrected pixel value. For example, the detection unit 172 converts the detected RGB values of the plurality of pixels into HSV values, and specifies the brightness of the image based on the average value of the V values indicating the brightness among the HSV values. When the brightness of the image is equal to or more than the first value, the detection unit 172 corrects the brightness of the image by reducing the V value of each of the plurality of pixels, and the brightness of the image is smaller than the first value. If it is less than the second value, the brightness of the image is corrected by increasing the V value of each of the plurality of pixels. The detection unit 172 corrects the pixel value based on the brightness, but is not limited thereto, and may correct the pixel value based on the relationship between the hues or the saturations of a plurality of pixels. In the present embodiment, the detection unit 172 converts the RGB values of the detected pixels into HSV values, and specifies the brightness of the image based on the average of the V values indicating the brightness among the HSV values. However, it is not limited to this. For example, an illuminance sensor may be further provided as the detection unit 172, and the brightness of the image may be detected based on the illuminance detected by the illuminance sensor.

  The detecting unit 172 corrects the detected pixel value based on a pixel value corresponding to a predetermined color among the pixel values detected from the image, and detects a color of the image based on the corrected pixel value. May be. Here, the predetermined color is, for example, white or black. For example, the detection unit 172 specifies the illumination environment based on the color of a pixel corresponding to white (for example, H value among HSV values) among a plurality of pixels forming the image. Here, the lighting environment is the type of lighting in the environment where the image is captured. The detecting unit 172 corrects the pixel values of the plurality of pixels so that the image approaches a state captured by natural light, and detects the color of the image based on the corrected pixel values. The detecting unit 172 corrects the pixel value based on the type of illumination in the environment where the image is captured, but is not limited thereto. The detection unit 172 may detect the brightness of the illumination in the environment where the image is captured, and may correct the pixel value based on the brightness.

  The execution unit 173 is configured to execute, based on a change in the color (feature information) detected by the detection unit 172 from each of the plurality of images captured by the imaging unit 13, a predetermined color associated with the color detected before the predetermined change. The processing of is performed. Here, the predetermined change is that the color of the detected image has changed from a predetermined type of color associated with the predetermined process to a color (white or black) not associated with the predetermined process. . When at least one of the pixel values constituting each of the plurality of images captured by the imaging unit 13 changes according to a predetermined change, the execution unit 173 converts the plurality of pixel values detected before the change into a plurality of pixel values. A predetermined process associated with the color of the corresponding image is executed. For example, the execution unit 173 executes a predetermined process associated with the color detected immediately before the predetermined change.

  As shown in FIG. 5, the reading application includes processing specifying information in which a predetermined type of color is associated with a predetermined processing content. For example, the color of the image is detected as “red” based on a plurality of pixel values constituting the image detected by the detection unit 172, and the color of the image detected by the detection unit 172 is black or When the color changes to white, the execution unit 173 performs a predetermined process associated with the color of the image detected by the detection unit 172 before the color of the image changes to black or white, that is, “red”. In the example illustrated in FIG. 5, the execution unit 173 causes the display unit 12 to display the image A as a predetermined process corresponding to “red”.

  Note that the reading application includes the process specifying information, but is not limited thereto. For example, the reading application may include a program code for acquiring the process specifying information from an external device. Then, the execution unit 173 acquires the process specifying information from the external device via the second communication unit 15 in accordance with the execution of the reading application by the control unit 17, and causes the storage unit 16 to store the information. Is also good.

  The execution unit 173 has executed the predetermined process associated with the color detected immediately before the predetermined change, but is not limited to this. When the color of the image becomes a predetermined color, the execution unit 173 determines a predetermined color among pixels constituting each of the plurality of images captured a predetermined time (for example, three seconds before) from the time when the color becomes the predetermined color. The number of pixels corresponding to the types of colors may be totaled. Then, the execution unit 173 may specify a type of color in which the number of pixels exceeds the predetermined number as a color of the image before the color becomes the predetermined color. Here, when there are a plurality of types of colors in which the number of pixels exceeds the predetermined number, the execution unit 173 changes the color corresponding to the largest pixel among the totaled pixels to the image before the predetermined color. It may be specified as a color.

  In addition, the execution unit 173 is associated with the average value of the colors (features indicated by the feature information) detected for an image captured during a predetermined time before the color detected by the detection unit 172 changes by a predetermined amount. A predetermined process may be executed. For example, the execution unit 173 may average pixel values corresponding to the colors detected by the detection unit 172 from each of the plurality of images, and specify the color indicated by the average value. Then, the execution unit 173 may execute a predetermined process associated with the color specified from the average value.

  The execution unit 173 is associated with the most frequently detected color among the colors detected for the image captured during the predetermined time before the color detected by the detection unit 172 changes by a predetermined amount. A predetermined process may be executed. By doing so, the terminal 1 can accurately specify the color before the color detected by the detection unit 172 changes by a predetermined amount.

  Further, for example, when the detection unit 172 includes an illuminance sensor and the brightness detected by the detection unit 172 reaches a predetermined brightness, the execution unit 173 detects the brightness before the predetermined brightness. A predetermined process associated with the color of the image may be executed. In this way, for example, it is possible to accurately detect that the terminal 1 has approached the display that emits light or to approach the booklet 2 with high accuracy, and execute a predetermined process.

  If the predetermined type of color has not been detected for a predetermined time or more since the last detection of the predetermined type of color, it is highly likely that the user of the terminal 1 has interrupted the color reading operation. Therefore, when the detecting unit 172 does not detect the predetermined type of color related to the predetermined processing last time and does not detect the predetermined type of color for a predetermined time (for example, 5 seconds), It is assumed that the unit 172 has not detected a predetermined type of color in the past. By doing so, the terminal 1 can invalidate the color detected before the interruption when the possibility that the user has interrupted the color reading operation is high.

[Processing flow in terminal 1]
Subsequently, a flow of processing in the terminal 1 will be described with reference to a flowchart. FIG. 6 is a flowchart illustrating a flow of a process in the terminal 1 according to the first embodiment.
First, the control unit 17 determines whether the reading application has been executed (S1). When determining that the reading application has been executed, the control unit 17 shifts the processing to S2, and when judged that the reading application has not been executed, re-executes S1.

Subsequently, the imaging control unit 171 causes the imaging unit 13 to start imaging (S2). The imaging unit 13 outputs the image to the control unit 17 in response to capturing the image.
Subsequently, the detection unit 172 performs a color detection process for detecting the color of the image output from the imaging unit 13 (S3).

  Subsequently, the execution unit 173 determines whether the detection unit 172 has detected a predetermined type of color related to the predetermined process in S3 (S4). If it is determined that the predetermined type of color has been detected, the process proceeds to S3, and if it is determined that the predetermined type of color has not been detected, the process proceeds to S5.

  Subsequently, the execution unit 173 determines whether there is a predetermined change in the color detected by the detection unit 172 (S5). Specifically, the execution unit 173 determines whether the color of the captured image has changed to a predetermined color (white or black) within a predetermined time after the detection unit 172 detects the predetermined type of color in S2. By determining whether or not there is a predetermined change, it is determined whether or not there is a predetermined change. When determining that there is a predetermined change, execution unit 173 shifts the processing to S6, and when determined that there is no predetermined change, shifts the processing to S7.

In S6, the execution unit 173 executes a predetermined process associated with the predetermined type of color detected before the predetermined change, and thereafter ends the process according to this flowchart.
When determining that there is no predetermined change, the execution unit 173 determines whether or not a predetermined type of color has been detected for a predetermined time in S7. When determining that the predetermined type of color has not been detected for the predetermined time, the execution unit 173 shifts the process to S8, and assumes that the detection unit 172 has not detected the predetermined type of color in the past. The detection unit 172 resets the color detected in the past. When determining that a predetermined type of color has been detected within the predetermined time, the execution unit 173 shifts the processing to S3.

[Effect in First Embodiment]
As described above, the terminal 1 according to the first embodiment detects the color of an image as feature information from an image captured by the imaging unit 13 and detects the detected color based on a change in the color detected from each of the plurality of images. Performs a predetermined process associated with the color detected before the predetermined change. In this way, the user of the terminal 1 activates an application for executing a predetermined process on the terminal 1, and then performs an operation of bringing the terminal 1 closer to the area 21 provided in the booklet 2. Since the terminal 1 can execute the predetermined processing, the terminal 1 can execute the processing corresponding to the color (feature information) with a small number of operations.

<Second embodiment>
[Detect patterns as feature information]
Subsequently, a second embodiment will be described. The second embodiment differs from the first embodiment in that the terminal 1 detects a pattern as feature information. Hereinafter, portions different from the first embodiment will be described. A description of the same parts as those in the first embodiment will be appropriately omitted. In the second embodiment, the feature information is a pattern. However, the present invention is not limited to this, and may be characters, symbols, or the like.

  In the second embodiment, the detection unit 172 detects a predetermined pattern associated with a predetermined process by analyzing an image captured by the imaging unit 13. For example, the predetermined pattern is arranged instead of the area 21 in each page of the booklet 2. In addition, the reading application includes pattern information in which a form of a predetermined pattern related to a predetermined process is associated with a range of a size corresponding to the pattern. The detection unit 172 detects a predetermined pattern associated with a predetermined process and a size of the pattern from the image captured by the imaging unit 13 by referring to the pattern information.

  The execution unit 173 executes a predetermined process when the pattern detected from the image by the detection unit 172 changes to a predetermined size. For example, when the size of the pattern detected from the image by the detection unit 172 changes from the first size to the second size larger than the first size, the execution unit 173 refers to the pattern information and And performs a predetermined process associated with.

[Effects in Second Embodiment]
As described above, the terminal 1 according to the second embodiment detects a predetermined pattern associated with a predetermined process by analyzing a captured image, and determines that the pattern changes to a predetermined size. The processing of is performed. By doing so, in response to the terminal 1 approaching the booklet 2 and the size of the detected pattern increasing, the predetermined processing can be executed in the same manner as the terminal 1 according to the first embodiment. Can be.

<Third embodiment>
[Perform predetermined processing when the detected color changes and approaches the wireless tag]
Subsequently, a third embodiment will be described. The third embodiment is different from the first embodiment in that the color detected from the image undergoes a predetermined change and the terminal 1 executes a predetermined process in response to the terminal 1 approaching the wireless tag.

  FIG. 7 is a diagram illustrating an outline of the terminal 1 according to the third embodiment. As shown in FIG. 7, a wireless tag 22 is embedded in the booklet 2 of the third embodiment in correspondence with each page. In FIG. 7, the wireless tag 22 is arranged adjacent to the area 21, but is not limited thereto, and may be arranged so as to overlap the area 21.

  Similar to the terminal 1 according to the first embodiment, the terminal 1 according to the third embodiment executes a reading application for executing a predetermined process according to a user operation ((1) in FIG. 7). . When the user brings the terminal 1 close to the area 21, the detection unit 172 detects the color of the area 21 ((2) in FIG. 7).

  Thereafter, when the user further brings the terminal 1 closer to the area 21, the area 21 is darkened by the shadow of the terminal 1, and the color detected by the detection unit 172 changes. The execution unit 173 of the terminal 1 detects that the detected color has changed and that a predetermined change has occurred ((3-1) in FIG. 7). In addition, the first communication unit 14 of the terminal 1 performs wireless communication with the wireless tag 22 embedded near the area 21 in response to the terminal 1 approaching the area 21 ((3-2 in FIG. 7). )).

  The execution unit 173 of the terminal 1 detects that a predetermined change has occurred, and when starting communication with the wireless tag 22, executes a predetermined process ((4) in FIG. 7). In the third embodiment, the first communication unit 14 performs wireless communication with the wireless tag 22 in response to the terminal 1 approaching the wireless tag 22, and receives information stored in the wireless tag 22. The execution unit 173 executes a predetermined process based on the information received from the wireless tag and the color detected by the detection unit 172 before the predetermined change.

  For example, the reading application includes information that can be received from the wireless tag 22, information for processing that associates the color of the image with the content of the predetermined processing, and the execution unit 173 transmits the information for processing identification. By referring to the information, the content of the predetermined process associated with the information received from the wireless tag 22 and the color of the image detected by the detection unit 172 before the predetermined change is specified. Then, the execution unit 173 executes a predetermined process based on the content of the specified predetermined process.

  The execution unit 173 receives, from the wireless tag 22, process specifying information in which the color of the image is associated with the content of the predetermined process, and executes the predetermined process based on the process specifying information. You may. In this way, by making the information stored in the wireless tags 22 different, when the terminal 1 reads each wireless tag 22, the terminal 1 can execute different processing.

  In addition, the execution unit 173 may acquire information for specifying predetermined content from the wireless tag 22. Then, the external device may store the process specifying information, the color of the image, and the information indicating the content of the predetermined process in association with each other. In this case, the execution unit 173 receives the information and the image from the external device via the second communication unit 15 in response to receiving the information from the wireless tag 22 and detecting the color of the image by the detection unit 172. The information indicating the content of the predetermined process related to the color of the image is acquired. Then, the execution unit 173 executes a predetermined process based on the information acquired via the second communication unit 15. By doing so, it is possible to change the content of the predetermined process to be executed on the terminal 1 in the external device, and to cause the terminal 1 to execute a different process.

[Effect in Third Embodiment]
As described above, the terminal 1 according to the third embodiment executes a predetermined process associated with the information received from the wireless tag 22 and the color of the image detected by the detection unit 172. By doing so, for example, even when the detection unit 172 detects the same type of color, the terminal unit 172 detects the terminal based on the information included in the wireless tag 22 embedded for each page of the booklet 2. 1 can perform different processing.

  As described above, the present invention has been described using the embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. It is apparent to those skilled in the art that various changes or improvements can be added to the above embodiment.

  In the above-described embodiment, the imaging unit 13 captures a plurality of images, and the detection unit 172 detects the feature information from the image captured by the imaging unit 13, but is not limited thereto. For example, using a light receiving element such as a phototransistor, a red, blue, and a color detection unit such as a color sensor that detects the color of an object by detecting light of wavelengths corresponding to green, The color information indicating the color detected by the color detection unit may be stored in the storage unit 16 in association with the detected time. Then, the execution unit 173 may execute a predetermined process associated with the color detected before the color stored in the storage unit 16 changes by a predetermined amount.

  Further, the specific embodiment of the dispersion / integration of the apparatus is not limited to the above-described one, and all or a part of the apparatus may be arbitrarily added according to various additions or the like, or according to a functional load. It can be configured to be distributed or integrated functionally or physically.

DESCRIPTION OF SYMBOLS 1 ... terminal, 11 ... input part, 12 ... display part, 13 ... imaging part, 14 ... 1st communication part, 15 ... 2nd communication part, 16 ... storage Unit, 17 control unit, 171 imaging control unit, 172 detection unit, 173 execution unit, 2 booklet, 21 area, 22 wireless tag

Claims (17)

An imaging unit that captures a plurality of images;
A detection unit that detects feature information from the image captured by the imaging unit,
Executing a predetermined process associated with the feature information detected before the feature information changes by a predetermined amount, based on a change in the feature information detected by the detection unit from each of the plurality of images; Department and
Equipped with a,
The detection unit detects pixel values of a plurality of pixels constituting the image, and performs correction of the pixel values based on a relationship between the detected pixel values of the plurality of pixels constituting the image. Detecting the color of the image based on the pixel value,
The execution unit, when the color of the image becomes a predetermined color, performs the predetermined processing associated with the color of the image detected by the detection unit before the color becomes the predetermined color,
Terminal.   An imaging unit that captures a plurality of images;
  A detection unit that detects feature information from the image captured by the imaging unit,
  Executing a predetermined process associated with the feature information detected before the feature information changes by a predetermined amount, based on a change in the feature information detected by the detection unit from each of the plurality of images; Department and
  With
  The detection unit detects pixel values of a plurality of pixels constituting the image, and among the detected pixel values, corrects the detected pixel values based on a pixel value corresponding to the predetermined color. Detecting the color of the image based on the corrected pixel values,
  The execution unit, when the color of the image becomes a predetermined color, performs the predetermined processing associated with the color of the image detected by the detection unit before the color becomes the predetermined color,
  Terminal.   An imaging unit that captures a plurality of images;
  A detection unit that detects feature information from the image captured by the imaging unit,
  Executing a predetermined process associated with the feature information detected before the feature information changes by a predetermined amount, based on a change in the feature information detected by the detection unit from each of the plurality of images; Department and
  With
  The detection unit detects pixel values of a plurality of pixels constituting the image, and detects a color of the image based on the detected pixel values,
  When the color of the image becomes a predetermined color, the execution unit includes a predetermined type of color among pixels constituting each of the plurality of images captured from the time when the predetermined color is obtained to a time before a predetermined time. Calculate the number of pixels corresponding to, the color of the type in which the number of pixels exceeds a predetermined number, is specified as the color of the image before the predetermined color, the specified color before the predetermined color Performing the predetermined process associated with the color of the image,
  Terminal.   An imaging unit that captures a plurality of images;
  A detection unit that detects feature information from the image captured by the imaging unit,
  Executing a predetermined process associated with the feature information detected before the feature information changes by a predetermined amount, based on a change in the feature information detected by the detection unit from each of the plurality of images; Department and
  With
  The detection unit detects pixel values of a plurality of pixels constituting the image, and detects a color of the image based on the detected pixel values,
  When the color of the image becomes a predetermined color, the execution unit executes the predetermined process associated with the color of the image detected by the detection unit before the color of the image becomes the predetermined color. If a color related to the predetermined process is not detected for a predetermined time or more after detecting a color related to the predetermined process, the detection unit detects a color related to the predetermined process in the past. Not considered,
  Terminal. Wherein the detection unit further detects the brightness of the previous SL image based on the pixel value,
When the brightness of the image reaches a predetermined brightness, the execution unit executes the predetermined process associated with the color of the image detected by the detection unit before the brightness reaches the predetermined brightness.
The terminal according to claim 1 . The detection unit, among the detected pixel values, detects the color of the image based on pixel values within a predetermined range,
The terminal according to claim 1 . Further comprising a communication unit that performs communication with a wireless tag that performs communication according to a predetermined wireless communication method,
The execution unit executes the predetermined process when the communication unit starts communication with the wireless tag,
The terminal according to any one of claims 1 6. The communication unit receives information from the wireless tag,
The execution unit executes the predetermined processing based on information received from the wireless tag,
The terminal according to claim 7 . A storage unit that stores information that can be received from the wireless tag, the color of the image, and the content of the predetermined process,
The execution unit executes the predetermined processing associated with the information received from the wireless tag and the color of the image detected by the detection unit,
The terminal according to claim 8 . The wireless communication system further includes a second communication unit that performs communication with an external device using a method different from the predetermined wireless communication method,
The second communication unit, in response to the communication unit receiving information from the wireless tag and the detection unit detecting a color of the image, the predetermined processing related to the information and the color of the image Get information indicating the contents of
The execution unit executes the predetermined processing based on the information acquired by the second communication unit.
The terminal according to claim 8 . The detection unit detects a pattern included in the image,
The execution unit executes the predetermined processing when the pattern detected by the detection unit changes to a predetermined size.
The terminal according to any one of claims 1 10. The execution unit executes the predetermined process associated with an average value of a feature indicated by the feature information detected for an image captured at a predetermined time before the feature information changes by a predetermined amount. ,
The terminal according to any one of claims 1 to 11. The execution unit, among the features indicated by the feature information detected for an image captured at a predetermined time before the feature information makes a predetermined change, the feature associated with the most detected feature Execute a predetermined process,
The terminal according to any one of claims 1 12. Computer runs,
Capturing a plurality of images;
Detecting feature information from the captured image;
Based on a change in the feature information detected from each of the plurality of images, performing a predetermined process associated with the feature information detected before the feature information makes a predetermined change,
Equipped with a,
In the detecting step, pixel values of a plurality of pixels constituting the image are detected, and the pixel values are corrected based on a relationship between the detected pixel values of the plurality of pixels constituting the image. Detecting the color of the image based on the pixel values of
In the performing step, when the color of the image becomes a predetermined color, the predetermined process associated with the color of the image detected in the detecting step before the color becomes the predetermined color,
Processing execution method.   Computer runs,
  Capturing a plurality of images;
  Detecting feature information from the captured image;
  Based on a change in the feature information detected from each of the plurality of images, performing a predetermined process associated with the feature information detected before the feature information makes a predetermined change,
  With
  In the detecting step, a pixel value of a plurality of pixels constituting the image is detected, and among the detected pixel values, correction of the detected pixel value is performed based on a pixel value corresponding to the predetermined color. Perform, detect the color of the image based on the corrected pixel value,
  In the performing step, when the color of the image becomes a predetermined color, the predetermined process associated with the color of the image detected in the detecting step before the color becomes the predetermined color,
  Processing execution method.   Computer runs,
  Capturing a plurality of images;
  Detecting feature information from the captured image;
  Based on a change in the feature information detected from each of the plurality of images, performing a predetermined process associated with the feature information detected before the feature information makes a predetermined change,
  With
  In the detecting step, a pixel value of a plurality of pixels constituting the image is detected, and a color of the image is detected based on the detected pixel value.
  In the step of executing, when the color of the image becomes a predetermined color, a predetermined type of pixel among the pixels constituting each of the plurality of images captured from a time when the predetermined color is obtained to a time before a predetermined time is reached. The number of pixels corresponding to the color is calculated, and the type of color in which the number of pixels exceeds a predetermined number is specified as the color of the image before the predetermined color, and before the specified color is specified. Performing the predetermined process associated with the color of the image of
  Processing execution method.   Computer runs,
  Capturing a plurality of images;
  Detecting feature information from the captured image;
  Based on a change in the feature information detected from each of the plurality of images, performing a predetermined process associated with the feature information detected before the feature information makes a predetermined change,
  With
  In the detecting step, a pixel value of a plurality of pixels constituting the image is detected, and a color of the image is detected based on the detected pixel value.
  In the executing step, when the color of the image becomes a predetermined color, executes the predetermined processing associated with the color of the image detected in the detecting step before the color becomes the predetermined color, If the color related to the predetermined process has not been detected for a predetermined time or more after detecting the color related to the predetermined process in the detecting step, the detecting step may not include the color related to the predetermined process in the past. Color is not detected.
  Processing execution method.

Images