JP5729759B2 - Portable electronic device, its control method and program - Google Patents

Description

  The present invention relates to a portable electronic device, a control method thereof, and a program. In particular, the present invention relates to a portable electronic device including a camera.

  In recent years, portable electronic devices such as mobile phones, smartphones, PDAs (Personal Digital Assistants), digital cameras, music players, and game machines have become widespread. Many of these portable electronic devices have a camera and can shoot still images and moving images. In a portable electronic device equipped with a camera, a mirror can be substituted by displaying a user's face and the like in real time using a preview function for displaying an image captured by the camera as it is on a display.

  Here, Patent Document 1 discloses a photographing apparatus that can easily perform mode switching between a photographing mode and a reproduction mode with one hand. In the photographing apparatus disclosed in Patent Document 1, when the digital camera is in a horizontal posture, it is set to a photographing mode capable of photographing a still image or a moving image, and is obtained by photographing when the digital camera is in a vertical posture. A playback mode for displaying image data on an LCD (Liquid Crystal Display) is set.

Japanese Patent Application Laid-Open No. 2005-236883

  Each disclosure of the above prior art document is incorporated herein by reference. The following analysis has been made from the viewpoint of the present invention.

  As described above, a portable electronic device equipped with a camera can substitute for a mirror by using a preview function. On the other hand, since the camera and the display are housed in the same housing of the portable electronic device, an object such as the back of the head where the display cannot be seen cannot be visually recognized. Even in such a case, it is possible to view the back of the head or the like by capturing a still image or a moving image using a camera and reproducing the stored image.

  However, there is a possibility that it is inconvenient to take, store, and play back a still image or a moving image through a plurality of operation procedures in order to confirm the back of the head as a substitute for a mirror. In addition, the intention to use a mirror is to confirm an object that cannot be directly visually recognized. When a portable electronic device is used as a substitute for a mirror, a certain degree of real time is required for display. Therefore, when it is necessary to check the back of the head, etc., if it is necessary to take, save, and reproduce the image every time, the real-time property required for the mirror is greatly impaired. That is, the functionality as a mirror is reduced.

  As described above, there is a problem to be solved when substituting a mirror using a camera mounted on a portable electronic device. Therefore, a portable electronic device that can visually recognize an object at an angle that cannot be visually recognized by the user without requiring a special operation from the user, and a control method and program thereof are desired.

According to the first aspect of the present invention, a display unit, a lens capable of taking an image, an acceleration sensor, and image data acquired from the lens are displayed on the display unit according to an output of the acceleration sensor. either or mobile electrons and a control unit for performing one of switching to display a past image data acquired from the lens on the display unit, and a storage unit capable of storing image data acquired from the lens In the device, the control unit sets the position of the portable electronic device and the direction in which the portable electronic device faces to the first state based on the output of the acceleration sensor after the lens and the display unit are activated. Based on the output of the sensor, the amount of movement from the position of the portable electronic device in the first state and the amount of rotation from the direction of the portable electronic device in the first state are respectively predicted. The position of the portable electronic device and the direction in which the portable electronic device faces when it changes to a predetermined threshold value or more are defined as a second state, and in the second state, the image data acquired from the lens is stored in the memory stored in part, when a transition from said second state to said first state, mobile electronic device for displaying the image data stored in the storage unit on the display unit is provided.

According to a second aspect of the present invention, there is provided a portable electronic device including a display unit, a lens capable of capturing an image, an acceleration sensor, and a storage unit capable of storing image data acquired from the lens. a control method, after activation of the lens and the display unit, based on an output of the acceleration sensor, and the previous SL you a position and a direction facing the said portable electronic device of the mobile electronic device in the first state step , based on an output of the acceleration sensor, each of the rotation amount from the direction facing the said portable electronic device movement amount and in the first state from the position before Symbol portable electronic device in the first state, in advance defines a step to position and direction toward the said portable electronic device of the portable electronic device shall be the second state when the changes above a threshold value was, the stored image data acquired from the lens when the second state Part Provided is a method for controlling a portable electronic device, comprising: a step of storing; and a step of displaying image data stored in the storage unit on the display unit when transitioning from the second state to the first state Is done.

According to a third aspect of the present invention, there is provided a portable electronic device including a display unit, a lens capable of capturing an image, an acceleration sensor, and a storage unit capable of storing image data acquired from the lens. a program to be executed by the control computer, after activation of the lens and the display unit, based on an output of the acceleration sensor, the pre-Symbol position and direction toward the said portable electronic device of the mobile electronic device a first state and processing shall be the, based on an output of the acceleration sensor, the rotation amount from the direction facing the said portable electronic device in the first state amount of movement from the position before Symbol portable electronic device in the first state each, and treated you with the portable electronic position and direction toward the said portable electronic apparatus of the device a second state when changed over a predetermined threshold value, the lens during the second state of A process of storing the acquired image data in the storage unit, and a process of displaying the image data stored in the storage unit on the display unit when transitioning from the second state to the first state; Is provided.

  According to each aspect of the present invention, a portable electronic device that can visually recognize an object at an angle that cannot be visually recognized by the user without requiring a special operation from the user, a control method thereof, and a program thereof are provided.

It is a figure for demonstrating the outline | summary of embodiment of this invention. It is a figure which shows an example of the external appearance of the portable electronic device which concerns on the 1st Embodiment of this invention. It is a figure which shows an example of an internal structure of the portable electronic device shown in FIG. 3 is a flowchart illustrating an example of an operation of the mobile electronic device illustrated in FIG. 2. It is a figure which shows an example at the time of a user using the portable electronic device shown in FIG. 2 as a mirror.

  First, the outline of the embodiment will be described with reference to FIG. Note that the reference numerals of the drawings attached to this summary are attached to the respective elements for convenience as an example for facilitating understanding, and are not intended to limit the present invention to the illustrated embodiment.

  As described above, when a portable electronic device equipped with a camera is used as a mirror, there is a problem in operability when displaying an object at an angle that cannot be visually recognized by the user. Therefore, a portable electronic device that can visually recognize an object at an angle that cannot be visually recognized by the user without requiring a special operation from the user is desired.

  Therefore, the portable electronic device shown in FIG. 1 is provided as an example. The portable electronic device shown in FIG. 1 displays a display unit, a lens capable of taking an image, an acceleration sensor, and image data acquired from the lens on the display unit according to the output of the acceleration sensor, or A control unit that switches whether to display past image data acquired from the lens on the display unit.

  If the attitude of the portable electronic device is determined from the output of the acceleration sensor and the attitude of the portable electronic device changes to a predetermined threshold value or more, it is determined that the display unit cannot be visually recognized by the user. In that case, instead of outputting the image data obtained from the lens in real time, the past image data obtained from the lens is outputted after the posture of the portable electronic device is changed to a state where the display unit can be viewed from the user. . As a result, when a portable electronic device equipped with a camera is used as a mirror, an object that cannot be directly visually recognized by a user, such as the back of the head, can be confirmed almost in real time. At this time, since the user is not required to perform a special operation, the operability of the portable electronic device is not deteriorated.

[First Embodiment]
Next, the first embodiment of the present invention will be described in more detail with reference to the drawings. FIG. 2 is a diagram illustrating an example of the appearance of the mobile electronic device 1 according to the present embodiment.

  A portable electronic device 1 shown in FIG. 2 includes an LCD 10 and a lens 20. Information necessary for the user's operation is displayed on the LCD 10. The lens 20 is used to capture a still image and an action. When operating the portable electronic device 1, a touch panel or a hardware key that is provided over the LCD 10 is used.

  FIG. 3 is a diagram illustrating an example of the internal configuration of the mobile electronic device 1. The portable electronic device 1 shown in FIG. 3 includes an LCD 10, a lens 20, an LCD driver 30, an image sensor 40, a DSP (Digital Signal Processor) 50, a memory 60, an acceleration sensor 70, and a CPU (Central Processing Unit). ) 80 and a selector 90.

  The LCD 10 and the lens 20 are as described above, and a description thereof will be omitted. The LCD driver 30 generates a signal for driving the LCD 10 from the image data. The image sensor 40 converts an image obtained through the lens 20 into an electrical signal. The DSP 50 performs image processing such as filtering processing on the data output from the image sensor 40. The memory 60 temporarily stores data output from the DSP 50. Further, the attitude of the portable electronic device 1 is detected by the acceleration sensor 70. The acceleration sensor 70 can detect rotation and movement of the portable electronic device 1 in the X-axis and Y-axis directions. Note that the X axis and the Y axis are defined as shown in FIG.

  The CPU 80 controls each unit of the mobile electronic device 1. The selector 90 switches between sending image data output from the DSP 50 and image data stored in the memory 60 to the LCD driver 30. When the captured data is displayed in real time (preview display), the DSP 50 performs image processing and then transmits the data to the LCD driver 30. On the other hand, when the captured data is displayed on the LCD 10 with a certain delay, the data is buffered in the memory 60 and then transmitted to the LCD driver 30. Switching in the selector 90 is determined by the CPU 80.

  Further, it is assumed that the LCD 10 and the lens 20 are disposed on the same surface, and the viewing angles thereof are in the same direction. When the user captures a front image of himself / herself with the lens 20, the captured image can be visually recognized on the LCD 10. Further, the CPU 80 can recognize the posture of the portable electronic device 1 and its change based on the output of the acceleration sensor 70.

  Next, the operation of the mobile electronic device 1 will be described with reference to FIG. FIG. 4 is a flowchart illustrating an example of the operation of the mobile electronic device 1.

  In step S01, a camera function is activated based on a user operation. Along with the activation of the camera function, the image sensor 40 and the DSP 50 start shooting operations.

  In step S02, the acceleration sensor 70 is activated.

  In step S <b> 03, the CPU 80 determines the attitude of the portable electronic device 1 from the output of the acceleration sensor 70. The posture of the portable electronic device 1 determined in this step is set as an initial state.

  In step S04, the setting of the selector 90 is switched from the CPU 80, and the image data output from the DSP 50 is displayed on the LCD 10.

  In step S05, it is confirmed whether or not an operation intended to end display of the captured image from the user has been performed. If an operation intended to end the display is performed, the process ends. If the operation intended to end the display is not performed, the process proceeds to step S06.

  In step S06, the CPU 80 constantly monitors the change in the attitude of the portable electronic device 1 from the output of the acceleration sensor 70, and determines whether the attitude of the portable electronic device 1 has changed beyond a predetermined threshold. If the posture has changed beyond the threshold, the process proceeds to step S07. If the change in posture is less than the threshold value, the process proceeds to step S05 and the process is continued. While transitioning to step S05 and continuing the processing, the display of the image data output by the DSP 50 is continued.

  In step S07, buffering of image data output from the DSP 50 in the memory 60 is started.

  In step S08, the CPU 80 determines from the output of the acceleration sensor 70 whether or not the attitude of the portable electronic device 1 has returned to the initial state. If the posture of the portable electronic device 1 has returned to the initial state, the process proceeds to step S09. If the attitude of the portable electronic device 1 has not returned to the initial state, the determination in step S08 is continued.

  In step S09, the setting of the selector 90 is switched from the CPU 80, and the image data buffered in the memory 60 is sent to the LCD driver 30. Through the operation in this step, the image data buffered in the memory 60 is displayed on the LCD 10.

  In step S10, all the image data buffered in the memory 60 is transmitted to the LCD driver 30, and it is determined whether or not the image data is displayed on the LCD 10. If all the image data is displayed, the process proceeds to step S04, whereby the LCD 10 displays the image data output from the DSP 50 (resumes the preview display). If all the image data is not displayed, the determination in step S10 is continued.

  FIG. 5 is a diagram illustrating an example when the user uses the portable electronic device 1 as a mirror. When the user activates the camera function, the front image of the user is displayed on the LCD 10 using the lens 20. In this case, the camera preview function is used. The state where the front image is displayed corresponds to the above-described initial state. The acceleration sensor 70 mounted on the portable electronic device 1 is used for the detection of the initial state.

  From this initial state, the user moves and rotates the portable electronic device 1 and changes the state in which the lens 20 is directed to the user's back of the head or the like. When the CPU 80 detects a change state from the output of the acceleration sensor 70, it starts buffering image data in the memory 60. Thus, the buffering start timing to the memory 60 is determined based on the change in the attitude of the portable electronic device 1 detected by the acceleration sensor 70. Further, when the CPU 80 detects that the attitude of the portable electronic device 1 has changed from the changed state to the initial state, the image data buffered in the memory 60 is displayed on the LCD 10. In this way, an image of an object (such as a user's back head) captured during the change state can be confirmed on the LCD 10. After displaying all the buffered image data in the memory 60, the camera preview function is used again.

  In the description of the present embodiment, the initial state is detected using the acceleration sensor 70. However, the human face is detected using a face detection function that can determine whether the human face is included in the captured image. The included state (the posture of the portable electronic device 1) can be set to the initial state.

  When determining the transition to the change state, it is determined that the mobile electronic device 1 has transitioned to the change state when the attitude of the mobile electronic device 1 changes to a predetermined threshold value or more and the output of the acceleration sensor 70 does not change for a certain period of time. Is also possible. By setting the posture in which the user stops the movement of the mobile electronic device 1 to the change state, it is possible to capture the object intended by the user.

  In addition, the user can determine the timing for buffering image data in the memory 60 and the switching timing of the selector 90 using a hardware key or the like. Further, when returning from the changed state to the initial state again, a timer may be activated to display the buffered image in the memory 60 only for a predetermined time.

  As described above, the posture change of the mobile electronic device 1 is detected using the acceleration sensor 70, and while it is considered that the user cannot visually recognize the LCD 10, the image data is buffered in the memory 60, and the user visually recognizes the LCD 10 again. The buffered image data is displayed after transition to the ready state. That is, when the attitude of the portable electronic device 1 changes and the user cannot directly view the LCD 10, the image data obtained from the lens 20 is time-shifted and provided to the user. As a result, it is possible to easily and instantaneously display an image at an angle that cannot be directly viewed by the user such as the back of the head. Therefore, the user can confirm an object having an angle that cannot be visually recognized in almost real time without performing a special operation.

  A part or all of the above embodiments can be described as in the following supplementary notes, but is not limited thereto.

  (Additional remark 1) The image data acquired from the said lens is displayed on the said display part according to the output of the display part, the lens which can image | photograph an image, an acceleration sensor, and the said acceleration sensor, or the said lens A control unit that switches whether to display past image data acquired from the display unit on the display unit.

  (Additional remark 2) Furthermore, it is provided with the memory | storage part which can memorize | store the image data acquired from the said lens, The said portable electronic device calculated from the output of the said acceleration sensor after starting the said lens and the said display part Is defined as a first state, and a state in which the posture of the portable electronic device calculated from the output of the acceleration sensor has changed to a predetermined threshold value or more is defined as a second state. In the second state, The portable electronic device which memorize | stores the acquired image data in the said memory | storage part, and displays the image data memorize | stored in the said memory | storage part on the said display part when it changes to the said 1st state from the said 2nd state.

  (Additional remark 3) The said control part is a portable electronic device which displays the image data acquired from the said lens on the said display part, after displaying the image data memorize | stored in the said memory | storage part on the said display part.

  (Additional remark 4) The said control part is a portable electronic device which makes the said attitude | position calculated from the output of the said acceleration sensor into the said 1st state, when the person's face is contained in the image acquired from the said lens.

  (Additional remark 5) The said control part memorize | stores the image data acquired from the said lens in the said memory | storage part based on operation which a user performs, Furthermore, based on the operation which a user performs, the image memorize | stored in the said memory | storage part is stored. A portable electronic device to be displayed on the display unit.

  (Additional remark 6) The said control part is a portable electronic device which displays the image memorize | stored in the said memory | storage part on the said display part for a predetermined period, after changing from the said 2nd state to the said 1st state.

  (Additional remark 7) The said control part is the said case where the attitude | position of the said portable electronic device computed from the output data of the said acceleration sensor changes more than a predetermined threshold value, and the output of the said acceleration sensor does not change for a fixed time. A portable electronic device in the state of 2.

  (Additional remark 8) Furthermore, portable electronic equipment provided with DSP which performs image processing with respect to the image data acquired from the said lens.

  (Supplementary note 9) A method for controlling a portable electronic device, comprising: a display unit; a lens capable of taking an image; an acceleration sensor; and a storage unit capable of storing image data acquired from the lens. After the activation of the lens and the display unit, a step of calculating the attitude of the portable electronic device from the output of the acceleration sensor as a first state, and the posture of the portable electronic device calculated from the output of the acceleration sensor are predetermined. A step of calculating a posture when the state changes to a threshold value or more as a second state, a step of storing image data acquired from the lens in the second state in the storage unit, and the second state from the second state. And a step of displaying the image data stored in the storage unit on the display unit when the state is changed to the state 1.

  (Additional remark 10) Furthermore, after displaying the image data memorize | stored in the said memory | storage part on the said display part, the control method of the portable electronic device including the process of displaying the image data acquired from the said lens on the said display part.

  (Additional remark 11) The control method of the portable electronic device which calculates the attitude | position calculated from the output of the said acceleration sensor as said 1st state, when the person's face is contained in the image acquired from the said lens.

  (Additional remark 12) Furthermore, based on the operation performed by the user, the step of storing the image data acquired from the lens in the storage unit, and the image stored in the storage unit based on the operation performed by the user, the display unit A method for controlling a portable electronic device including a step of displaying on a portable electronic device.

  (Supplementary Note 13) A method for controlling a portable electronic device, wherein an image stored in the storage unit is displayed on the display unit for a predetermined period after transition from the second state to the first state.

  (Supplementary Note 14) The case where the attitude of the portable electronic device calculated from the output of the acceleration sensor changes to a predetermined threshold value or more and the output of the acceleration sensor does not change for a certain time is calculated as the second state. Control method of portable electronic device.

  (Additional remark 15) The program which makes the computer which controls a portable electronic device provided with a display part, the lens which can image | photograph an image, an acceleration sensor, and the memory | storage part which can memorize | store the image data acquired from the said lens run The process of calculating the attitude of the portable electronic device as a first state from the output of the acceleration sensor after activation of the lens and the display unit, and the portable electronic device calculated from the output of the acceleration sensor Processing for calculating a posture when the posture changes to a predetermined threshold value or more as a second state, processing for storing image data acquired from the lens in the second state in the storage unit, and the second And a process of displaying the image data stored in the storage unit on the display unit when the state transits from the state to the first state.

  (Additional remark 16) Furthermore, after displaying the image data memorize | stored in the said memory | storage part on the said display part, the program which performs the process which displays the image data acquired from the said lens on the said display part.

  (Additional remark 17) The program which calculates the attitude | position calculated from the output of the said acceleration sensor as said 1st state, when the human face is contained in the image acquired from the said lens.

  (Additional remark 18) Furthermore, the process which memorize | stores the image data acquired from the said lens in the said memory | storage part based on the operation which a user performs, The image memorize | stored in the said memory | storage part based on the operation which a user performs is said display part A program that executes processing to be displayed on the screen.

  (Additional remark 19) The program which displays the image memorize | stored in the said memory | storage part on the said display part for a predetermined period, after changing from the said 2nd state to the said 1st state.

  (Supplementary Note 20) The case where the attitude of the portable electronic device calculated from the output of the acceleration sensor changes to a predetermined threshold value or more and the output of the acceleration sensor does not change for a certain time is calculated as the second state. program.

  Each disclosure of the cited patent documents and the like cited above is incorporated herein by reference. Within the scope of the entire disclosure (including claims) of the present invention, the embodiment can be changed and adjusted based on the basic technical concept. Various combinations and selections of various disclosed elements are possible within the scope of the claims of the present invention. That is, the present invention of course includes various variations and modifications that could be made by those skilled in the art according to the entire disclosure including the claims and the technical idea. For example, the image data captured in the memory may be either a still image or a moving image.

1 Mobile electronic device 10 LCD
20 Lens 30 LCD driver 40 Image sensor 50 DSP
60 Memory 70 Acceleration sensor 80 CPU
90 selector

Claims (8)

A display unit;
A lens capable of taking images,
An acceleration sensor;
A control unit that switches between displaying image data acquired from the lens on the display unit or displaying past image data acquired from the lens on the display unit according to the output of the acceleration sensor. When,
A storage unit capable of storing image data acquired from the lens;
A portable electronic device comprising:
The controller is
After activation of the lens and the display unit, based on the output of the acceleration sensor, the position of the portable electronic device and the direction in which the portable electronic device faces are in a first state,
Based on the output of the acceleration sensor, the amount of movement from the position of the portable electronic device in the first state and the amount of rotation from the direction of the portable electronic device in the first state are respectively predetermined threshold values. The position of the portable electronic device and the direction of the portable electronic device when changed as described above are determined as the second state, respectively.
In the second state, the image data acquired from the lens is stored in the storage unit, and the image data stored in the storage unit is displayed when the transition from the second state to the first state is performed. A portable electronic device characterized by being displayed on a screen . The portable electronic device according to claim 1 , wherein the control unit displays the image data acquired from the lens on the display unit after the image data stored in the storage unit is displayed on the display unit. The control unit determines the position of the portable electronic device and the direction of the portable electronic device calculated from the output of the acceleration sensor when the human face is included in the image acquired from the lens in the first state. The portable electronic device according to claim 1 or 2 . Wherein, after shifting from the second state to the first state, a predetermined period, any one of claims 1 to 3 for displaying an image stored in the storage unit on the display unit The portable electronic device as described in. Wherein, each of the moving amount and the rotation amount is changed more than a predetermined threshold value, and, according to claim 1 to 4 output of the acceleration sensor and the second state when not changed for a certain time The portable electronic device as described in any one of. Further, the portable electronic device according to any one of claims 1 to 5 comprising a DSP (Digital Signal Processor) for performing the image processing on the image data acquired from the lens. A display unit;
A lens capable of taking images,
An acceleration sensor;
A storage unit capable of storing image data acquired from the lens;
A method for controlling a portable electronic device comprising:
After activation of the lens and the display unit, based on an output of the acceleration sensor, comprising the steps you a direction toward the position and the portable electronic device prior Symbol portable electronic device in the first state,
Based on the output of the acceleration sensor, each of the rotation amount from the direction facing the said portable electronic device in the first state amount of movement from the position before Symbol portable electronic device in the first state, predetermined a step the position and direction toward the said portable electronic device of the portable electronic device shall be the second state when the changes above the threshold have,
Storing the image data acquired from the lens in the second state in the storage unit;
Displaying the image data stored in the storage unit on the display unit when transitioning from the second state to the first state;
A method for controlling a portable electronic device, comprising: A display unit;
A lens capable of taking images,
An acceleration sensor;
A storage unit capable of storing image data acquired from the lens;
A program for causing a computer to control a portable electronic device comprising:
After activation of the lens and the display unit, and on the basis of the output of the acceleration sensor, before Symbol position and the direction facing the portable electronic device shall be the first state processing of the mobile electronic device,
Based on the output of the acceleration sensor, each of the rotation amount from the direction facing the said portable electronic device in the first state amount of movement from the position before Symbol portable electronic device in the first state, predetermined said you a position and a direction facing the said portable electronic device of the mobile electronic device and the second state process when changes above the threshold have,
A process of storing image data acquired from the lens in the second state in the storage unit;
A process of displaying the image data stored in the storage unit on the display unit when transitioning from the second state to the first state;
A program that executes.

Images