JP4260718B2 - Portable device with photographing function and computer program - Google Patents

Description

  The present invention relates to a portable device having an alarm function and a photographing function, and a computer program that operates on the portable device.

  In general, a portable device such as a cellular phone is normally provided with an alarm function for generating an alarm such as an alarm sound at a set time for alarming. When the user sets a time at which an alarm is to be generated and turns on the alarm function, an alarm sound is continuously generated for a predetermined time when the time arrives. Usually, in order to stop the alarm sound before the predetermined time elapses, any button of the portable device is pressed.

Patent Document 1 compares a fingerprint of a registered person in advance with a fingerprint read when necessary using a fingerprint sensor so that only the alarm setter can perform alarm time setting and pre-setting cancellation. An alarm clock is disclosed that enables the setting and cancellation when the two match.
JP 2002-250785 A

  By the way, for example, when an alarm is set as an alarm, if the alarm can be easily canceled by pressing a button, the user may unconsciously cancel the alarm before sufficiently awakening and then fall asleep again. In such a case, the corner alarm setting becomes meaningless.

  The technique described in Patent Document 1 is intended to prevent users other than the registered person from setting or canceling the alarm, and the alarm is stopped until the effect of the alarm is assured. It's not something you don't want to do.

  The present invention has been made in such a background, and an object thereof is to effectively use the photographing function of the portable device with the photographing function so that the alarm does not stop until the effect of the alarm is assured. It is an object of the present invention to provide a portable device with a photographing function and a computer program that operates on the portable device.

  A portable device with a photographing function according to the present invention includes timer means for setting a time for generating an alarm in advance, alarm generating means for generating an alarm in response to an instruction from the timer means, digital imaging means, and digital imaging means An evaluation value generating means for generating an evaluation value based on the image data obtained in step (b), and comparing the evaluation value generated by the evaluation value generating means with a predetermined threshold after the occurrence of an alarm, and the evaluation value is greater than or equal to the threshold Comparing means for stopping the alarm of the alarm generating means when the alarm occurs is provided.

  In this configuration, an alarm is generated from the alarm generation means at the time set in the timer means. When this alarm occurs, the user of the portable device photographs a predetermined subject with the digital imaging means. An evaluation value is generated by the evaluation value generation means based on the image data obtained by this photographing. The evaluation value is compared with a predetermined threshold value by the comparison means, and the alarm is stopped when the evaluation value becomes equal to or greater than the threshold value. That is, the alarm is stopped when the condition of the photographed subject or the like satisfies a predetermined photographing condition. As a result, in order to stop the alarm, the user needs to perform a shooting operation for satisfying the predetermined shooting condition, and in the process, a sufficient alarm effect (for example, a sufficient alarm at the time of alarm for alarming) Awakening) is demonstrated.

  You may provide the message output means which notifies a user of the conditions of imaging | photography by the said digital imaging means for stopping an alarm. The user needs to confirm the message to stop the alarm when the alarm occurs. For example, when message output is performed by display, the user needs to open the eyes and check the message. This is particularly effective when the user does not know the shooting conditions or when the shooting conditions to be used are switched every time an alarm occurs as will be described later.

  You may provide the key lock means which invalidates operation of the key for stopping the alarm which generate | occur | produced. This prevents the alarm from being easily stopped regardless of shooting.

  The key lock means may cancel the invalidation of the operation of the key after a predetermined time has elapsed after the occurrence of the alarm. As a result, it is possible to manually stop the alarm when it cannot be stopped by photographing.

  A plurality of shooting conditions may be prepared for use by the user. This makes it possible to set shooting conditions suitable for individual users.

  Alternatively, a shooting condition to be used every time an alarm is generated may be switched from a plurality of conditions. This prevents the user from getting used to the same shooting conditions each time.

  It can also be understood as a computer program according to the present invention. That is, this computer program is a computer program executed in a portable device with a photographing function, the step of starting a photographing function when an alarm occurs, the step of generating an evaluation value based on the obtained image data, A step of comparing the generated evaluation value with a predetermined threshold value and a step of stopping the alarm function and stopping the photographing function when the evaluation value exceeds the threshold value are executed.

  According to the present invention, it is possible to prevent the alarm from stopping until the effect of the alarm is assured by requesting the user to perform a shooting operation under a predetermined shooting condition as the alarm stop condition. . For example, in the case of an alarm for the purpose of alarming, it is expected that the user will be sufficiently awakened during the shooting process for stopping the alarm. At present, portable devices with a photographing function are widely used, and the present invention can be easily realized by effectively utilizing the photographing function.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described in detail with reference to the drawings.

  First, FIG. 1 shows a hardware configuration example of a mobile device 100 with a photographing function (a mobile phone here) to which the present invention is applied. The portable device 100 with a photographing function includes a control unit 102, a communication circuit 103, a display unit 104, an operation unit 105, a memory 106, an image processing unit 107, and a clock unit 108, and these units are connected to each other through a control line 150. Has been. The control line 150 is a transmission line that transfers control data such as a control signal from the control unit 102. In addition, the speaker 111, the microphone 112, and the imaging control unit 113 are connected to each other via the data line 160. A communication circuit 103 and a display unit 104 are also connected to the data line 160. The data line 160 is a transmission line for transferring data such as audio data.

  The control unit 102 includes a CPU and the like, and controls each unit of the apparatus by program control. The communication circuit 103 is connected to an antenna 101, is connected to a base station (not shown) via the antenna 101, and performs radio communication using radio waves for calling and data communication. The display unit 104 includes a display device such as a liquid crystal display or an organic EL display, and provides visual information such as text and images to the user. The operation unit 105 includes a numeric keypad, various call keys such as a call key, a power key, and a clear key, a jog dial, and the like, and accepts user operations on the apparatus. The memory 106 is a storage unit that provides a storage area for a control program executed by the control unit 102, a storage area for various data including image data, evaluation values, threshold values, and the like, which will be described later, and a work area. At least a part of the memory 106 includes a nonvolatile memory that retains stored contents even when the power is turned off. At least a part of the nonvolatile memory includes a rewritable nonvolatile memory that holds user data and the like (including photographed image data and mail data) in a nonvolatile manner. The image processing unit 107 is a functional unit that processes an image captured by the camera 114, and also generates an evaluation value in the present invention. The clock unit 108 is a functional unit that generates date and time information based on a reference clock (not shown) in the apparatus, and also provides a timer function for an alarm in the present embodiment.

  The speaker 111 is a functional unit that outputs voice during a call to a user, and emits a ringtone, a ringtone, and a voice message. Usually, the voice output during a call and the output of the ringtone and the like are different voice outputs. A device is provided. The microphone 112 is a functional unit that converts a voice uttered by a user for a voice call or the like into an electric signal. The imaging control unit 113 controls the camera 114 having an imaging element such as a CCD under the control of the control unit 102. The camera 114 converts the input optical image into a digital image signal and outputs the digital image signal to the imaging control unit 113 under the control of the imaging control unit 113.

  FIG. 2 is a functional block diagram of the portable device 100 of FIG. 1 in the present embodiment.

  In the present embodiment, the imaging unit (digital imaging unit) 11 corresponds to the camera 114 and the imaging control unit 113 in FIG. 1 and generates captured image data. The evaluation value generation unit 12 corresponds to the image processing unit 107 in FIG. 1 and generates an evaluation value according to the shooting conditions. Imaging conditions and evaluation values will be described later. The threshold storage unit 14 corresponds to the memory 106 in FIG. 1 and stores a threshold stored in advance corresponding to the imaging condition of the evaluation value. The comparison unit 13 corresponds to the control unit 102 in FIG. 1, compares the evaluation value generated by the evaluation value generation unit 12 with the threshold value of the threshold value storage unit 14, and an alarm described later when the evaluation value becomes equal to or greater than the threshold value. A stop signal is output to the generator 16. The timer unit 15 corresponds to the clock unit 108 in FIG. 1, measures the time for the alarm set time (or date and time), and outputs a start signal when the set time arrives. The alarm generation unit 16 corresponds to, for example, the control unit 102 and the speaker 111 of FIG. 1 and generates an alarm (in this example, an alarm sound) in accordance with an activation signal from the timer unit 15 for a set time. The activation signal of the timer unit 15 may be used as an interrupt signal to the CPU, and the alarm generation unit 16 may be activated from the CPU. The alarm stop shooting condition message output unit 17 corresponds to the control unit 102 and the display unit 104, and displays a message for informing the user of shooting conditions for stopping the alarm. It is also possible to output the message as an alarm sound instead of or in addition to the display. When the alarm stop shooting conditions are fixed, it is not always necessary to output a message.

Here, imaging conditions and evaluation values in the present embodiment will be described. Examples of the shooting conditions required for the user to stop the alarm include the following.
(1) Shooting a subject including a specific shape The specific shape is, for example, a square shape such as a television screen, a round shape of a clock or the like. The degree of similarity with the target shape can be obtained by image processing of the captured image data, and this can be used as an evaluation value. Such image processing can be realized using existing technology.
(2) Shooting a subject mainly having a specific color A subject mainly having a specific color is such that most of the shooting region has a predetermined specific color (for example, red, blue, etc.). A subject (for example, clothes or curtains). For example, the ratio of the area where a specific color exists to the entire shooting area can be used as the evaluation value. When using this shooting condition, the user needs to confirm in advance that such a subject is close.
(3) Shooting a subject with a predetermined brightness or more The predetermined brightness indicates a state in which the brightness (illuminance) of the subject is increased to a predetermined level or more by turning on a lighting device such as an indoor lamp. . The evaluation value can be generated based on the average brightness of the photographed image of the photographed subject. That is, the determination can be made based on the average luminance value of the photographed image when the strobe light is not emitted. When the camera is set to the automatic flash emission mode, the brightness of the subject can be determined using the determination result of whether or not to perform the flash emission.
(4) Shooting a reference subject registered in advance A face with the eyes opened by the user is registered and the photographed image is registered. This is based on the condition of shooting. As the evaluation value, the similarity between the registered image and the captured image is obtained by image processing. Such image processing can be realized using existing technology.

  An appropriate threshold value is set according to the photographing condition and stored in the threshold value storage unit 14. Any one of the shooting conditions to be adopted may be used, or the user may be allowed to select from a plurality of shooting conditions. Alternatively, as will be described later, the mobile device may randomly select from a plurality of shooting conditions each time.

  FIG. 3 is a flowchart illustrating an example of a processing procedure of alarm processing in the present embodiment. All or a main part of this processing is installed as a control program of the control unit 102 in advance in the portable device at the time of shipment of the device, or is additionally installed as an application program according to a user instruction afterwards.

  This alarm processing is started when the time set by the user in the timer unit 15 (FIG. 2) comes. First, the alarm generator 16 activates an alarm such as an alarm sound (S11). Next, key lock is performed to invalidate the operation of the key operated by the user to stop the alarm (S12). Thereby, even if the user operates the key, the alarm does not stop. Therefore, the alarm stop shooting condition is output as a message (S13). In the case of message output by display, for example, a message as illustrated in FIG. 4 is displayed. In the example of FIG. 4 (a), “Please shoot a face with open eyes”, in the example of FIG. 4 (b), “Please shoot a lit illumination”, FIG. 4 (c). In the example, the message “Please shoot a blue object” is displayed.

  Thereafter, the camera is activated (S14), and camera shooting is enabled. When a predetermined time (timeout time) has elapsed after the camera is started (S15, Yes), the process proceeds to step S22 described later, the alarm is immediately stopped (S22), and the camera is also stopped (S23). This “timeout” is for automatically stopping the generation of an alarm when the user is absent. Specifically, the timeout time is a relatively long time (eg, 10 minutes) at which the user is considered sufficiently awake, and may be a predetermined fixed value, May be variably settable.

  If it is not timed out in step S15, an input image is captured from the camera (S16). That is, the digital image data of the subject is taken into the memory. This process is performed in response to the user pressing the shutter button. Or you may make it extract 1 frame of the image taken in continuously. The captured input image is processed by the evaluation value generation unit 12, and an image evaluation value is generated (S17). The comparison unit 13 compares the evaluation value with a threshold value, and when it is determined that the evaluation value is equal to or greater than the threshold value (S18, Yes), the process proceeds to step S19. Otherwise, the process returns to step S13, and the process of message output, camera shooting, evaluation value generation, and comparison is repeated until a time-out occurs or the evaluation value becomes equal to or greater than the threshold value. Although both displays are alternately performed in order to share the same display unit 104 for the monitor display of camera photography and the message output in step S13, so-called superimpose processing is performed to superimpose the message output on the monitor display. If the message is output by voice, the monitor display of the camera can be continuously performed. When the message is output by voice, the voice message itself can be used instead of the alarm sound.

  After the evaluation value becomes equal to or greater than the threshold value, the key lock is released (S19), and the alarm is stopped (S20). Further, the camera is also stopped (S21).

  In order to stop the alarm between the occurrence of the alarm and the elapse of the timeout time by the processing of FIG. 3, the user needs to perform camera shooting under the alarm stop shooting conditions specified by the message output. That is, in order to perform the operation successfully, the user must open the eyes and perform the shooting operation with a certain concentration. Therefore, it is expected that sufficient awakening is performed when the alarm is stopped by the operation.

  FIG. 5 is a flowchart showing a modification of the process of FIG. In FIG. 5, the same steps as those in the process of FIG. In the process of FIG. 4, the alarm cannot be stopped unless a predetermined camera photographing is performed until a relatively long timeout time elapses. In the example of FIG. 5, when the time-out period has elapsed (S15, Yes), the key lock is released (S22), and when there is a key input for stopping the alarm (S23, Yes), the alarm is immediately stopped (S20). ), The camera is also stopped (S21). This allows the user to manually stop the alarm after the timeout period has elapsed.

  Although not particularly illustrated, a second timeout time longer than the timeout time (first timeout time) in step S15 in FIG. 5 is set in parallel, and the alarm does not stop after the first timeout time elapses. It is also possible to automatically stop the alarm when the second timeout period elapses.

  Next, FIG. 6 shows a functional block diagram of another embodiment of the present invention. The hardware configuration of the portable device 100 is as shown in FIG. 1 as in the first embodiment. Constituent elements similar to those shown in FIG. 2 are given the same reference numerals, and redundant descriptions are omitted. In the first embodiment, when the same alarm stop shooting conditions are always used, the user performs the same shooting every time to stop the alarm, and there is a possibility that the user will get used and the effect of awakening will be diminished.

  Therefore, in the configuration of FIG. 6, an alarm stop shooting condition random determination unit 18 is provided. The alarm stop shooting condition random determination unit 18 causes the portable device 100 to randomly select one shooting condition from a plurality of alarm stop shooting conditions prepared in advance. The threshold value storage unit 14a stores a threshold value corresponding to each of the plurality of alarm stop shooting conditions, and selects a threshold value according to the shooting condition instructed from the alarm stop shooting condition random determination unit 18 and sends the threshold value to the comparison unit 13. Output. The alarm stop photographing condition message output unit 17 outputs a message instructing photographing under the selected photographing condition.

  FIG. 7 shows a flowchart of the alarm processing in the embodiment of FIG. This process is similar to the process of FIG. 5, and the same processing steps as in FIG.

  In the process of FIG. 7, steps S31 to S33 are inserted between step S12 and step S13 of FIG. That is, in step S31, it is checked whether or not it is a random mode. Whether the mode is random or not is determined by the initial setting by the user. If not in the random mode, a predetermined alarm stop shooting condition (or selected by the user) is selected (S33). In the case of the random mode, the alarm still shooting condition is determined at random (S32). Based on the alarm stop shooting conditions selected or determined in this way, the process proceeds to the subsequent steps S13 and subsequent steps. Since this process is as described above, a description thereof will be omitted. The process after step S13 may be the process of FIG. 3 instead of the process of FIG.

  According to the embodiment of FIG. 6, the alarm stop shooting condition required for stopping the alarm changes randomly every time an alarm occurs, so that the user can change the contents of the alarm stop shooting condition message each time the alarm stops. There is a need to confirm and perform shooting accordingly. As a result, it is considered that the effect of sufficiently awakening the user lasts for a long time.

  The preferred embodiments of the present invention have been described above, but various modifications and changes other than those mentioned above can be made. For example, in the embodiment of FIG. 3, it is assumed that a single alarm stop shooting condition is used. However, a plurality of shooting conditions may be prepared in the apparatus so that the user can select any shooting condition. In the embodiment shown in FIG. 6, a plurality of prepared alarm stop shooting conditions are switched at random. However, a corresponding effect can be expected even in a configuration in which switching is performed in a predetermined order.

It is a block diagram which shows the hardware structural example of the portable apparatus (here mobile phone) with an imaging | photography function to which this invention is applied. It is a functional block diagram of the portable apparatus of FIG. 1 in an embodiment of the present invention. It is a flowchart which shows an example of the process sequence of the process at the time of an alarm in embodiment of this invention. It is a figure which shows the example of a display of the message of the stop imaging | photography condition in embodiment of this invention. It is a flowchart showing the modification of the process of FIG. It is a functional block diagram of other embodiments of the present invention. It is a flowchart of the process at the time of the alarm of embodiment of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Imaging part, 12 ... Evaluation value generation part, 13 ... Comparison part, 14 ... Threshold storage part, 14a ... Threshold storage part, 15 ... Timer part, 16 ... Alarm generation part, 17 ... Alarm stop imaging condition message output part, DESCRIPTION OF SYMBOLS 18 ... Alarm stop imaging condition random determination part, 100 ... Portable apparatus, 101 ... Antenna, 102 ... Control part, 103 ... Communication circuit, 104 ... Display part, 105 ... Operation part, 106 ... Memory, 107 ... Image processing part, 108 ... Clock part, 111 ... Speaker, 112 ... Microphone, 113 ... Imaging control part, 114 ... Camera, 150 ... Control line, 160 ... Data line

Claims (12)

Timer means for setting a time for generating an alarm in advance;
Alarm generating means for generating an alarm in response to an instruction from the timer means;
Digital imaging means;
Evaluation value generating means for generating an evaluation value based on image data obtained by the digital imaging means;
Comparing means for comparing the evaluation value generated by the evaluation value generating means after occurrence of an alarm with a predetermined threshold, and stopping the alarm of the alarm generating means when the evaluation value is equal to or greater than the threshold;
Message output means for letting the user know the conditions of photographing by the digital imaging means for stopping the alarm;
A portable device with a photographing function characterized by comprising:   2. The portable device with a photographing function according to claim 1, further comprising key lock means for invalidating an operation of a key for stopping the generated alarm. 3. The portable device with a photographing function according to claim 2 , wherein the key lock unit cancels the invalidation of the operation of the key after a predetermined time elapses after an alarm is generated. Wherein is shooting conditions provides multiple, portable device with a photographing function according to claim 1, characterized in that it is subjected to the user selection. Wherein is shooting conditions provides multiple, every time an alarm occurs, according to claim 1, wherein the imaging conditions to be used is switched photographing function portable device.   Timer means for setting a time for generating an alarm in advance;
  Alarm generating means for generating an alarm in response to an instruction from the timer means;
  Digital imaging means;
  Evaluation value generating means for generating an evaluation value based on image data obtained by the digital imaging means;
  Comparing means for comparing the evaluation value generated by the evaluation value generating means after occurrence of an alarm with a predetermined threshold, and stopping the alarm of the alarm generating means when the evaluation value is equal to or greater than the threshold;
  A key lock means for disabling the key operation for stopping the generated alarm,
  The portable device with a photographing function, wherein the key lock means cancels the invalidation of the operation of the key after a predetermined time elapses after an alarm is generated. A computer program executed in a portable device with a photographing function,
A step of activating the shooting function when an alarm occurs,
Generating an evaluation value based on the obtained image data;
Comparing the generated evaluation value with a predetermined threshold;
Stopping the alarm and stopping the shooting function when the evaluation value is equal to or greater than a threshold;
Outputting a message to inform the user of shooting conditions for stopping the alarm; and
A computer program that causes a computer to execute .   8. The computer program according to claim 7, further comprising a step of invalidating a key operation for stopping the generated alarm. 9. The computer program according to claim 8 , further comprising the step of canceling the invalidation of the operation of the key after a predetermined time has elapsed after the occurrence of the alarm. The computer program according to claim 7, further comprising a step of preparing a plurality of shooting conditions and providing them for user selection. 8. The computer program according to claim 7, further comprising a step of preparing a plurality of shooting conditions and switching a shooting condition to be used every time an alarm is generated.   A computer program executed in a portable device with a photographing function,
  A step of activating the shooting function when an alarm occurs,
  Generating an evaluation value based on the obtained image data;
  Comparing the generated evaluation value with a predetermined threshold;
  Stopping the alarm and stopping the shooting function when the evaluation value is equal to or greater than a threshold;
  A step of disabling the key operation for stopping the generated alarm,
  Canceling the invalidation of the operation of the key after a predetermined time has elapsed after the occurrence of the alarm; and
  A computer program that causes a computer to execute.

Images