JP6346701B1 - Electronic device, overlay method, and overlay program - Google Patents

Abstract

An electronic apparatus that effectively utilizes information detected by a sensor. An electronic apparatus includes an imaging unit, a sensor, a storage unit, a display unit, and a control unit. The sensor 7 includes a position information acquisition sensor 7B. The control unit 6 calculates the movement route information of the own device based on the position information acquired by the position information acquisition sensor 7B at a plurality of times. The control unit 6 stores a preview image obtained by overlaying the movement path information on the captured image captured by the imaging unit 5 in the storage unit 8 as an overlay moving image 8G. The control unit 6 displays, on the overlay moving image 8G displayed on the display unit, movement path information of a scale corresponding to the speed of the own device at the start of the storage process of the overlay moving image 8G. [Selection] Figure 3

Description

  The present disclosure relates to an electronic device, an overlay method, and an overlay program.

  2. Description of the Related Art Conventionally, electronic devices that display date information related to an image together with the image are known. For example, Patent Document 1 discloses displaying an image on a display unit and displaying date information on the display unit.

  Conventionally, electronic devices including various sensors are known. For example, Patent Document 2 discloses an electronic device that calculates the state of its own device based on information detected by an acceleration sensor and an atmospheric pressure sensor.

JP 2011-193208 A JP 2015-121481 A

  It is desired to effectively use information detected by various sensors included in an electronic device.

  An object of the present disclosure made in view of such a point is to provide an electronic device, an overlay method, and an overlay program that effectively use information detected by a sensor.

The electronic device of the present disclosure includes an imaging unit, a sensor, a storage unit, a display unit, and a control unit. The sensor includes a position information acquisition sensor. The said control part calculates the moving path information of an own machine based on the positional information which the said positional information acquisition sensor acquired in several time. The control unit stores a preview image obtained by overlaying the movement path information on the captured image captured by the imaging unit in the storage unit as an overlay moving image. The control unit displays on the overlay moving image displayed on the display unit the moving path information of a scale corresponding to the speed of the own device at the start of the storage process of the overlay moving image. The control unit does not change the scale of the movement route information according to the speed of the own device at the midpoint of the storage process of the overlay moving image.
The overlay method of the present disclosure includes an imaging unit, a sensor, a storage unit, a display unit, and a control unit, and the sensor is an overlay method executed by an electronic device including a position information acquisition sensor. The overlay method includes a step in which the control unit calculates movement path information of the own device based on position information acquired by the position information acquisition sensor at a plurality of times. The overlay method includes a step in which the control unit stores a preview image obtained by overlaying the movement path information on a captured image captured by the imaging unit in the storage unit as an overlay moving image. In the overlay method, the control unit displays the movement path information at a scale corresponding to the speed of the own device at the start of the storage process of the overlay moving image on the overlay moving image displayed on the previous display unit. Including the step of displaying. The overlay method includes a step in which the control unit does not change the scale of the movement route information according to the speed of the own device at the midpoint of the storage process of the overlay moving image.
Moreover, the overlay program of the present disclosure includes an imaging unit, a sensor, a storage unit, a display unit, and a control unit, and the sensor is executed by an electronic device including a position information acquisition sensor. The overlay program causes the electronic device to execute a step of calculating movement path information of the own device based on the position information acquired by the position information acquisition sensor at a plurality of times. The overlay program causes the storage unit to store a preview image obtained by overlaying the movement path information on the captured image captured by the imaging unit as an overlay moving image. The overlay program displays the moving path information at a scale corresponding to the speed of the own device at the start of the overlay moving image storage process on the overlay moving image displayed on the display unit. Let it run. The overlay program executes a step of not changing the scale of the movement route information according to the speed of the own device at the midpoint of the storage process of the overlay moving image.

Electronic device of the present disclosure includes an imaging unit, a sensor, a storage unit, a display unit, and a control unit. The sensor includes a position information acquisition sensor. The said control part calculates the moving path information of an own machine based on the positional information which the said positional information acquisition sensor acquired in several time. The control unit displays, on the display unit, an overlay moving image obtained by overlaying dynamic sensor information acquired by the sensor on the captured image captured by the imaging unit and stored in the storage unit. Wherein the control unit, the moving route information of the scale corresponding to the speed of the ship at the start of the process of storing the captured image is displayed on the display unit displayed on the overlay moving images. The control unit does not change the scale of the movement route information according to the speed of the own device at the midpoint of the display process of the overlay moving image.

  According to the electronic device, the overlay method, and the overlay program according to an embodiment of the present disclosure, information detected by the sensor can be effectively used.

1 is an external view of an electronic device according to an embodiment of the present disclosure. It is an external view of the bicycle which attached the electronic device shown in FIG. It is a functional block diagram which shows schematic structure of the electronic device shown in FIG. It is a figure which shows the example of the setting screen displayed on the display part shown in FIG. It is a figure which shows the example of the setting table shown in FIG. It is a figure which shows the other example of the setting screen shown on the display part shown in FIG. It is a figure which shows the example of the preview image displayed on the display part shown in FIG. FIG. 4 is a diagram illustrating an example of a preview image displayed on the display unit illustrated in FIG. 3 during processing for storing an overlay moving image. It is a schematic diagram for demonstrating the method to show movement path information on the display part shown in FIG. FIG. 4 is a flowchart for explaining an example of an operation in an overlay process of a control unit shown in FIG.

  Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

  First, a comparison between this embodiment and the invention described in the prior art document will be described. The invention described in Patent Document 1 displays date information together with an image on a display unit. Further, the invention described in Patent Document 2 calculates the state of its own device based on information detected by an acceleration sensor and an atmospheric pressure sensor.

  In contrast, the electronic apparatus according to the present embodiment forms a captured image obtained by overlaying dynamic sensor information acquired by the sensor on the captured image, and displays the captured image on the display as a preview image. The electronic device according to the present embodiment stores the preview image displayed on the display in the storage unit 8 as an overlay image. Although it was common to display date information together with an image as described in Patent Document 1, there was no idea of displaying information detected by a sensor as described in Patent Document 2 together with an image. On the other hand, when the captured image is captured, the electronic device according to the present embodiment overlays the acquired sensor information on the captured image. Furthermore, the electronic device according to the present embodiment stores an image on which sensor information is overlaid. Therefore, according to the electronic apparatus according to the present embodiment, the user can visually store the captured image in real time after visually recognizing the captured image in which the sensor information is overlaid in a desired shape (position, size, etc.). Can be made.

  With reference to FIG. 1, the external appearance of the electronic device 1 which concerns on this embodiment is demonstrated. FIG. 1 is an external view of an electronic apparatus 1 according to this embodiment.

  As shown in FIG. 1, the electronic device 1 according to this embodiment includes a housing 2, a touch screen display 3, operation buttons 4, and an imaging unit 5. The electronic device 1 can be, for example, a smartphone, but is not limited to this. The electronic device 1 may be, for example, a feature phone type mobile phone or a tablet. Moreover, the electronic device 1 may be an imaging device equipped with a communication function and a sensor, for example.

  As shown in FIG. 1A, the touch screen display 3 and the operation buttons 4 are arranged on one surface (hereinafter referred to as “front surface”) of the housing 2. Further, as shown in FIG. 1B, the imaging unit 5 is disposed on a surface opposite to the front surface of the housing 2 (hereinafter referred to as “rear surface”). The imaging unit 5 may also be arranged on the front side of the housing 2 as shown in FIG.

  The electronic device 1 may be used in a state where it is attached to the handle of the bicycle 100, for example, as shown in FIG. In this case, the electronic device 1 is attached so that the imaging unit 5 images an arbitrary direction desired by the user, for example, the traveling direction of the bicycle 100. The electronic device 1 is attached so that the user can visually recognize the touch screen display 3. Thereby, the user can view the captured image captured by the imaging unit 5 in real time while riding the bicycle 100.

  The touch screen display 3 includes a display unit 3A and an input unit 3B. The display unit 3A includes a display device such as a liquid crystal display, an organic EL panel (Organic Electro-Luminescence Panel), or an inorganic EL panel (Inorganic Electro-Luminescence Panel). The display unit 3A displays characters, images, symbols, graphics, or the like. Information necessary for display on the display unit 3A is transmitted from the control unit 6 described later. Further, the display unit 3A may include a backlight or the like as appropriate.

  The input unit 3B detects contact of a finger of a user who operates the touch screen display 3 or a stylus pen. The input unit 3B can detect a position where a finger, a stylus pen, or the like contacts the input unit 3B. The detection method of the input unit 3B can be any method such as a capacitance method, a resistance film method, a surface acoustic wave method (or an ultrasonic method), an infrared method, an electromagnetic induction method, and a load detection method. The signal detected by the input unit 3B is output to the control unit 6.

  The operation button 4 detects the operation when operated by the user. The operation button 4 outputs a detection signal to the control unit 6 when an operation is detected. The operation on the operation button 4 is, for example, click, double click, push, long push, and multi push, but is not limited thereto.

  The imaging unit 5 is a camera that captures a captured image. The imaging unit 5 includes at least an optical system and an imaging element. The imaging element captures a captured image by converting an image of a subject formed on the light receiving surface into an image signal via an optical system. For example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor is used as the imaging element. In addition, the captured image captured by the imaging unit 5 is output to the control unit 6.

  Next, a functional configuration of the electronic apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 3 is a functional block diagram illustrating a schematic configuration of the electronic apparatus 1. The electronic device 1 includes a control unit 6, a sensor 7, and a storage unit 8, as shown in FIG. 3, in addition to the functional units shown in FIG. Each of these functional units is arranged inside the housing 2 shown in FIG.

  The control unit 6 is, for example, a CPU (Central Processing Unit). The control unit 6 may be an integrated circuit such as an SoC (System-on-a-Chip) in which other components such as the communication sensor 7A are integrated. The control unit 6 may be configured by combining a plurality of integrated circuits. The control unit 6 controls each functional unit of the electronic device 1 and realizes various functions by comprehensively controlling the operation of the electronic device 1. The operation of the control unit 6 in this embodiment will be described later in detail.

  The sensor 7 detects information on a detection target related to the electronic device 1 on which the sensor 7 is mounted as dynamic sensor information 8C. The sensor 7 can detect the change of the detection target as dynamic sensor information 8C by continuously detecting the detection target. Further, the sensor 7 outputs the detected dynamic sensor information 8C to the control unit 6.

  The dynamic sensor information 8C is information that changes with time according to a change in the state of the own device. That is, the dynamic sensor information 8C does not include, for example, information that does not change or is not expected to change within a predetermined time such as a date. The dynamic sensor information 8C is, for example, speed information, distance information, altitude information, gravity acceleration information, atmospheric pressure information, position information, movement path information, wind speed information, and direction information. Further, the sensor information 8C is not limited to the above-mentioned information. For example, weather information, point information, mountain weather information, sea weather / wave related information, snow related information, sunrise / sunset information, tide, stamp, step count information. Etc. may be further included.

  The sensor 7 includes a communication sensor 7A, a position information acquisition sensor 7B, an orientation sensor 7C, an acceleration sensor 7D, and an atmospheric pressure sensor 7E. In addition, the sensor 7 may include a position information acquisition sensor 7B, an azimuth sensor 7C, an acceleration sensor 7D, and an atmospheric pressure sensor 7E that are sensors that detect the state of the own device without including the communication sensor 7A. .

  The communication sensor 7A transmits and receives information via the communication network. A communication method used for transmission / reception of information by the communication sensor 7A is a wireless communication standard. For example, as a wireless communication standard, there are standards such as 2G (2nd Generation), 3G (3rd Generation), and 4G (4th Generation). Examples of wireless communication standards include LTE (Long Term Evolution), W-CDMA, CDMA2000, PDC, GSM (registered trademark), PHS (Personal Handy-phone System), and the like. For example, as a wireless communication standard, WiFi (The Standard for Wireless Fidelity), WiMAX (Worldwide Interoperability for Microwave Access), IEEE 802.11, Bluetooth (registered trademark), IrDA (Infrared Data Association), NFC (Near Field Radio Communication), etc. There is. The communication sensor 7A may support one or more of the communication standards described above.

  7 A of communication sensors acquire the wind speed information which shows the wind speed in the position of the electronic device 1 from an external server etc., and output this wind speed information to the control part 6 as sensor information 8C. Further, the communication sensor 7A acquires weather information, point information, mountain weather information, sea weather / wave related information, snow related information, sunrise / sunset information, tide, stamp, step count information, etc. as sensor information 8C, You may output to the control part 6.

  The position information acquisition sensor 7B receives a GPS signal indicating the position of the GPS satellite, a signal transmission time, and the like from the GPS satellite, and acquires position information indicating the position of the electronic device 1 based on the GPS signal. The position information acquisition sensor 7B continuously acquires position information, and acquires movement path information based on the position history indicated by the position information. The position information acquisition sensor 7B calculates a change in position per unit time as the speed of the electronic device 1, and acquires speed information indicating the calculated speed. The position information acquisition sensor 7B acquires distance information indicating the movement distance of the electronic device 1 calculated based on the change in position. Further, the position information acquisition sensor 7B outputs the acquired position information, movement route information, speed information, and distance information to the control unit 6 as sensor information 8C.

  The direction sensor 7C is, for example, a magnetic sensor, a gyro sensor, or the like. The azimuth sensor 7C acquires azimuth information indicating the azimuth based on a change in geomagnetism. In addition, the direction sensor 7 </ b> C outputs the acquired direction information to the control unit 6.

  The acceleration sensor 7D acquires gravitational acceleration information indicating the gravitational acceleration of the electronic device 1. Further, the acceleration sensor 7D outputs the gravitational acceleration information to the control unit 6 as sensor information 8C.

  The atmospheric pressure sensor 7 </ b> E acquires atmospheric pressure information indicating the atmospheric pressure of the surrounding environment of the electronic device 1. Moreover, the atmospheric pressure sensor 7E acquires altitude information indicating the altitude of the surrounding environment of the electronic device 1 based on the atmospheric pressure. The atmospheric pressure sensor 7E outputs atmospheric pressure information and altitude information to the control unit 6 as sensor information 8C.

  The storage unit 8 stores programs and information. The storage unit 8 is also used as a work area for temporarily storing the processing result of the control unit 6. The storage unit 8 may include an arbitrary storage device such as a semiconductor storage device and a magnetic storage device. The storage unit 8 may include a plurality of types of storage devices. The storage unit 8 may include a combination of a portable storage medium such as a memory card and a storage medium reading device.

  Specifically, the storage unit 8 stores, for example, a control program 8A, an overlay application 8B, sensor information 8C, setting information 8D, a setting table 8E, an overlay still image 8F, and an overlay moving image 8G. To do. The control program 8A and the overlay application 8B may be installed in the storage unit 8 via wireless communication by the communication sensor 7A or via a storage medium. In this specification, “application” is an abbreviation for application program.

  The control program 8A is a program for causing the electronic device 1 to execute various functions. Specifically, the control unit 6 executes various functions by controlling each functional unit, for example, according to the control program 8A.

  The overlay application 8B is an application for the control unit 6 to perform overlay processing. The overlay processing includes processing for forming a preview image in which the sensor information 8C output from the sensor 7 is overlaid on the captured image captured by the imaging unit 5. The overlay processing includes processing for storing a preview image in the storage unit 8 as an overlay still image 8F or an overlay moving image 8G based on the setting information 8D and the setting table 8E.

  Here, the overlay process executed by the control unit 6 in accordance with the overlay application 8B will be described in detail.

  Prior to the start of the overlay process of the present embodiment, the control unit 6 sets a menu for overlaying dynamic sensor information 8C on the captured image captured by the imaging unit 5 based on a user operation.

  Specifically, first, the control unit 6 displays a menu on the display unit 3A. The menu can be used for the electronic device 1, for example. In this case, as shown in FIG. 4, each setting as a menu and radio buttons corresponding to the usage are displayed on the setting screen. The use indicates the user's activities associated with the execution of the overlay process. For example, “surfing marine sports”, “climbing”, “skiing / snowboarding”, “bicycle”, “fishing”, “trekking” included. In this case, when detecting a touch on one of the radio buttons, the control unit 6 stores setting information 8D indicating that the use corresponding to the touched radio button is selected in the storage unit 8.

  Thereby, the control unit 6 forms a preview image overlaid on the captured image using the setting table 8E in the subsequent overlay processing. The setting table 8E is a table that stores sensor information 8C corresponding to the application as shown in FIG. 5, for example. When the application is selected on the selection screen as described above, the control unit 6 captures the sensor information 8C corresponding to the application selected in the setting table 8E among the sensor information 8C detected by the sensor 7. Overlay to. In addition to the sensor information 8C, the control unit 6 may overlay the captured date and time information, elapsed time information from the start of processing for storing an overlay moving image 8G, which will be described later, and the like.

  A check box may be displayed on the setting screen instead of the radio button. At this time, the user can select one or more uses, and the control unit 6 overlays information corresponding to each of the selected one or more uses on the captured image.

  As another example, the menu may be sensor information 8C to be overlaid on the captured image. In this case, as shown in FIG. 6, in order to allow the user to select, each sensor information 8C as a menu and check boxes respectively corresponding to the sensor information 8C are displayed on the setting screen. When the control unit 6 detects a touch on any one or more check boxes, the control unit 6 stores in the storage unit 8 setting information 8D indicating that sensor information 8C corresponding to each of the touched check boxes has been selected. Accordingly, the control unit 6 overlays the selected sensor information 8C on the captured image in the subsequent overlay processing.

  When a predetermined operation for instructing the start of overlay processing is performed after the type of sensor information 8C is set, the control unit 6 controls the imaging unit 5 to capture a captured image. Further, the control unit 6 acquires sensor information 8 </ b> C based on information output from the sensor 7. The predetermined operation may be pressing of a predetermined operation button 4 or touching a predetermined object displayed on the touch screen display 3.

  When the start of the overlay process is instructed, the control unit 6 acquires various sensor information 8 </ b> C output from the sensor 7.

  Specifically, the control unit 6 acquires the wind speed information output from the communication sensor 7A. In addition, the control unit 6 acquires the position information, movement route information, speed information, and distance information output from the position information acquisition sensor 7B. Further, the control unit 6 acquires the azimuth information output from the azimuth sensor 7C. Moreover, the control part 6 acquires the gravity acceleration information output from the acceleration sensor 7D. Further, the control unit 6 acquires atmospheric pressure information and altitude information output from the atmospheric pressure sensor 7E.

  The control unit 6 forms a preview image in which the sensor information 8C is overlaid on the captured image based on the setting information 8D.

  The region on the captured image on which the control unit 6 overlays the sensor information 8C is preferably a region that is expected to have a low user interest level in the captured image. In general, a user who wants to store a preview image on which sensor information 8C is overlaid as a moving image has a higher degree of interest in a region representing the earlier side than a region representing the front side in the traveling direction. That is, in the captured image captured by the imaging unit 5 installed in the traveling direction, the user's degree of interest is considered to be lower at the lower side. In addition, the user is highly interested in the range of the central portion representing the area that the user is expected to pass through, and is relatively insensitive to the range near the left and right ends. Therefore, as shown in FIG. 7A, the control unit 6 displays the sensor information 8C in the lower part of the captured image or in the vicinity of the left and right ends. Accordingly, it is possible to prevent the sensor information 8C from being displayed in a region of high interest in the preview image and making it difficult for the user to visually recognize the captured image.

  The control unit 6 displays the formed preview image on the display unit 3A. In the example illustrated in FIG. 7, the control unit 6 displays a preview image in which images indicating speed information D1, distance information D2, altitude information D3, gravity acceleration information D4, and current date / time information D5 are overlaid on the captured image. ing. The preview image is continuously displayed on the display unit 3A every time the sensor information 8C is overlaid on the captured image. That is, a preview image of a plurality of continuous frames is displayed on the display unit 3A. At this time, the control unit 6 may display the preview image on a so-called wide screen having a screen aspect ratio of 16: 9. In this case, in particular, when the user is active outdoors, the user can visually recognize an image with high presence.

  The control unit 6 displays a preview image and displays the still image storage object O1 on the display unit 3A. The still image storage object O1 is an object for allowing a user to input a command for causing the control unit 6 to store a preview image as an overlay still image 8F. When detecting a touch on the still image storage object O1, the control unit 6 stores the preview image displayed on the display unit 3A in the storage unit 8 as an overlay still image 8F.

  Further, the control unit 6 displays the moving image storage object O2 on the display unit 3A. The moving image storage object O2 is an object for allowing the user to input a command for the control unit 6 to start storing the overlay moving image 8G. When detecting the touch on the moving image storage object O2, the control unit 6 starts processing for storing the overlay moving image 8G in the storage unit 8.

  When the processing for storing the overlay moving image 8G is started, the control unit 6 may overlay the elapsed time information D6 on the captured image as shown in FIG. 8 until the storage of the overlay moving image 8G is completed. .

  In addition, the control unit 6 may overlay the maximum speed information D7 on the captured image after starting the process for storing the overlay moving image 8G. The speed indicated by the maximum speed information D7 is the highest speed among the speeds indicated by the speed information acquired after the storage of the overlay moving image 8G is started and stored in the storage unit 8.

  The control unit 6 may overlay the maximum gravitational acceleration information D8 on the captured image after starting the process for storing the overlay moving image 8G. The maximum gravitational acceleration indicated by the maximum gravitational acceleration information D8 is the maximum gravitational acceleration among the gravitational accelerations indicated by the gravitational acceleration information D4 acquired after the storage of the overlay moving image 8G is started and stored in the storage unit 8. .

  Further, the control unit 6 may overlay the moving path information D9 after starting the process for storing the overlay moving image 8G on the captured image. Here, a detailed method of displaying the movement route information D9 by the control unit 6 will be described with reference to FIG.

  The control unit 6 overlays the movement route information D9 on the movement route display range R based on the position information acquired every predetermined time by the position information acquisition sensor 7B.

  When overlaying the travel route information D9, the control unit 6 associates the start point of the travel route in the real space with a predetermined position (start point SP) in the image space. As shown in FIG. 9B, the start point SP can be the center of the movement path display range R, but is not limited thereto. In addition, the control unit 6 associates the traveling direction in the real space immediately after the movement is started from the starting point with the vertical direction in the image space. The control unit 6 may associate a predetermined direction in the real space, for example, the north direction with the vertical upper side of the image space.

  The control unit 6 overlays the captured image with movement path information D9 obtained by reducing the position history in the real space at a predetermined scale, which is indicated by the position information acquired every predetermined time. At this time, the control unit 6 overlays the movement path information D9 in the direction in the image space corresponding to the changing direction in the real space. The predetermined scale may be determined based on the initial speed at the time when storage of the overlay moving image 8G is started. The predetermined scale is appropriately designed so that the moving path display range R includes a range in the image space corresponding to a range in the real space where the user is expected to move during the process of overlaying the moving path information. At this time, the predetermined scale is preferably designed so that the movement route information is displayed as large as possible.

  When at least a part of the travel route information in the image space is displayed outside a predetermined range of the travel route display range R (for example, within the bold rectangle shown in FIG. 9B), the control unit 6 The scale of the movement path information D9 is changed from the predetermined scale. Specifically, as shown in FIG. 9C, the control unit 6 performs a path in the image space with respect to a path in the real space so that all of the travel path information D9 is included in the travel path display range R. Is reduced and displayed. That is, the control unit 6 increases the scale of the path in the image space with respect to the path in the real space. In the example shown in FIG. 9C, the scale of the movement route information is set to twice the scale shown in FIG. That is, the control unit 6 sets the area of the movement route information D9 to ¼ that shown in FIG. 9B. Further, when the movement route information D9 reaches the end of the predetermined range, the control unit 6 expands the movement route display range R to an area adjacent to the end. In the example shown in FIG. 9B, the end of the predetermined range that the travel route information D9 has reached is located at the lower right of the start point SP. In this case, as illustrated in FIG. 9C, the control unit 6 extends the movement route display range R to the lower left, upper right, and lower right regions. In the example shown in FIG. 9C, the control unit 6 changes the position of the start point SP along with the change of the scale, but the scale of the movement route information D9 is changed without changing the position of the start point SP. It may be changed.

  Returning to FIG. 7, when the control unit 6 detects a touch on the moving image storage object O2 and starts processing for storing the overlay moving image 8G, as shown in FIG. 8, the end object O3 is displayed together with the preview image. Is displayed on the display unit 3A. The end object O3 is an object for allowing the user to input a command to end the storage of the overlay moving image 8G. When detecting a touch on the moving image storage object O2, the control unit 6 starts a process of storing the preview image displayed continuously on the display unit 3A in the storage unit 8 as an overlay moving image 8G. When the control unit 6 detects a touch on the end object O3, the control unit 6 ends the storage of the overlay moving image 8G in the storage unit 8.

  The control unit 6 also includes a mode object O4 indicating the imaging mode of the imaging unit 5 and an image object O5 indicating a part of the overlay still image 8F or the overlay moving image 8G that has already been captured and stored in the storage unit 8. You may display on display part 3A collectively. Note that these objects O1 to O5 are not overlaid on either the overlay still image 8F or the overlay moving image 8G.

  Next, an example of the operation of the electronic device 1 according to the present embodiment will be described with reference to the flowchart shown in FIG. The electronic device 1 starts overlay processing when a predetermined operation is performed on the electronic device 1.

  First, the control unit 6 acquires a captured image captured by the imaging unit 5 (step S1).

  Moreover, the control part 6 acquires the information which the sensor 7 detected as sensor information 8C (step S2).

  An image is acquired in step S1. When the sensor information 8C is acquired in step S2, the control unit 6 forms a preview image in which the sensor information 8C corresponding to the menu indicated by the setting information 8D is overlaid on the captured image (step S3).

  When the preview image is formed in step S3, the control unit 6 displays the preview image on the display unit 3A (step S4).

  When the preview image is displayed in step S4, the control unit 6 determines whether or not a touch on the still image storage object O1 has been detected (step S5).

  When a touch on the still image storage object O1 is detected in step S5, the control unit 6 stores the preview image displayed when the touch is detected in the storage unit 8 as an overlay still image 8F (step S6). ).

  When the overlay still image 8F is stored in step S6, it is determined whether or not an end operation of the overlay process is detected (step S7).

  When the end operation is detected in step S7, the control unit 6 ends the overlay process.

  If the end operation is not detected in step S7, the control unit 6 returns to step S1 and repeats the subsequent processing.

  If a touch on the still image storage object O1 is not detected in step S5, the control unit 6 determines whether a touch on the moving image storage object O2 is detected (step S8).

  When a touch on the moving image storage object O2 is detected in step S8, the control unit 6 acquires the captured image captured by the imaging unit 5 again (step S9).

  Moreover, the control part 6 acquires the information which the sensor 7 detected as sensor information 8C (step S10).

  An image is acquired in step S9. When the sensor information 8C is acquired in step S10, the control unit 6 forms a preview image in which the sensor information 8C corresponding to the menu indicated by the setting information 8D stored in the storage unit 8 is overlaid on the captured image (step S10). S11).

  When the preview image is formed in step S11, the control unit 6 displays the preview image on the display unit 3A (step S12).

  When the preview image is formed in step S11, the control unit 6 stores the preview image in the storage unit 8 (step S13).

  When the preview image is stored in step S13, the control unit 6 determines whether or not a touch on the end object O3 has been detected (step S14).

  If a touch on the end object O3 is not detected in step S14, the control unit 6 returns to step S9 and repeats the subsequent processes.

  When a touch on the end object O3 is detected in step S14, the control unit 6 forms an overlay moving image 8G from the preview image of one frame or more stored by repeating the processing from step S9 to step S14 (step S14). S15).

  When the overlay moving image 8G is formed in step S15, the control unit 6 stores the formed overlay moving image 8G in the storage unit 8 (step S16).

  When the overlay moving image 8G is stored in step S16, the control unit 6 returns to step S7 and repeats the subsequent processing.

  As described above, according to the present embodiment, the electronic device 1 causes the display unit 3 </ b> A to display the preview image in which the dynamic sensor information 8 </ b> C acquired from the sensor 7 is overlaid on the captured image captured by the imaging unit 5. For this reason, the user can confirm the captured image captured by the imaging unit 5 together with the sensor information 8C. In addition, the user can immediately confirm how the sensor information 8C is overlaid on the captured image by acquiring the sensor information 8C. In addition, the electronic device 1 stores the preview image displayed on the display unit 3A in the storage unit 8 as an overlay still image 8F. For this reason, the user can store a desired preview image after confirming in real time that the sensor information 8C acquired together with the captured image is overlaid. Further, the user can visually recognize the same image as the preview image displayed at the timing when the image capturing unit 5 captured the image after capturing the image.

  Further, according to the present embodiment, the electronic device 1 causes the display unit 3 </ b> A to display a preview image obtained by overlaying dynamic sensor information 8 </ b> C acquired by the sensor 7 on the captured image captured by the imaging unit 5. For this reason, the captured image captured by the imaging unit 5 can be confirmed together with the sensor information 8C. In addition, it is possible to immediately confirm how the sensor information 8C is overlaid on the captured image by acquiring the sensor information 8C. In addition, the electronic device 1 stores the preview image displayed on the display unit 3A in the storage unit 8 as the overlay moving image 8G. For this reason, the user confirms in real time the state in which the sensor information 8C acquired together with the imaging of the captured image is overlaid, and then stores a plurality of consecutive frames of preview images for a desired period as the overlay moving image 8G. be able to. Furthermore, the user can enjoy a sense of reality during and after shooting by viewing the preview image as a moving image and storing it as an overlay moving image 8G.

  Further, according to the present embodiment, the sensor 7 can detect a change in the surrounding environment. The sensor information 8C is dynamic information that changes with time according to changes in the surrounding environment. It is important for users who are affected by the surrounding environment to quantitatively understand the changes in the surrounding environment. By overlaying sensor information 8C indicating a change in the surrounding environment on the captured image, the user quantitatively grasps the change while visually recognizing the image indicating the surrounding environment, and makes a decision to take an action that is effective for the user. There are cases where it is possible.

  In addition, according to the present embodiment, the electronic device 1 overlays dynamic sensor information 8C on the captured image every time the captured image is captured. The sensor information 8C can be easily overlaid on the captured image using the memory.

  According to the present embodiment, when a menu for overlaying dynamic sensor information 8C on the captured image is selected by the input unit 3B before shooting, at least one dynamic sensor information corresponding to the menu is selected. 8C is overlaid on the captured image. For this reason, the electronic device 1 can overlay only the sensor information 8C desired by the user in the sensor information 8C on the captured image. Therefore, the user does not need to visually recognize the sensor information 8C that the user does not desire, and can recognize only the desired sensor information 8C without hesitation. Further, since sensor information 8C is stored in advance corresponding to the application, the user can save the trouble of selecting the sensor information 8C one by one and overlay the sensor information 8C expected to be desired according to the application on the captured image. The setting to perform can be performed easily.

  Further, according to the present embodiment, the electronic device 1 displays the movement route information of the own device on the display unit 3A based on the position information of the own device acquired by the position information acquisition sensor 7B every predetermined time. It is important for a user whose main purpose is his / her movement to grasp movement path information indicating a history of how the user has moved. By overlaying the movement path information on the captured image, the user can check the movement path information while visually recognizing an image showing the surrounding environment. Further, since the travel route information is information indicating the history of the travel route, it is difficult to predict at a departure time how far the vehicle will move from the departure point. For this reason, when the travel route information is displayed at a predetermined scale in the travel route display range R of the display unit 3A, the travel route display range R may not include all of the travel route information. When the travel route information reaches the end of the predetermined range, the travel route information is reduced so that all the travel route information is included in the travel route display range R. As a result, the user can appropriately recognize the travel route information.

  While the above embodiments have been described as representative examples, it will be apparent to those skilled in the art that many changes and substitutions can be made within the spirit and scope of the disclosure. Accordingly, the present disclosure should not be construed as being limited by the above-described embodiments, and various modifications and changes can be made without departing from the scope of the claims. For example, a plurality of constituent blocks described in the embodiments can be combined into one, or one constituent block can be divided.

  In the above embodiment, the control unit 6 displays the still image storage object O1 and the moving image storage object O2 together when displaying the preview image on the display unit 3A. However, the present invention is not limited to this. For example, the control unit 6 may display either the still image storage object O1 or the moving image storage object O2 based on the usage set by the user's selection. For example, when the set use is “surfing / marine sports”, “mountain climbing”, “skiing / snowboarding”, or “bicycle”, the control unit 6 displays only the moving image storage object O2 together with the preview image. Can do. In addition, when the set application is, for example, “fishing” or “trekking”, the control unit 6 can display only the still image storage object O1 together with the preview image.

  In general, users who select “surfing / marine sports”, “mountain climbing”, “skiing / snowboarding”, and “bicycle” have a lot of movement, and the scenery observed during the movement, sensor information 8C accompanying the change in the scenery There is a great interest in the changes. For this reason, a user who selects these uses often tries to store a moving image instead of a still image. Therefore, by displaying only the moving image storage object O2 in advance in this case, the user can smoothly perform an operation for storing the preview image without hesitation. That is, user convenience is enhanced.

  On the other hand, a user who has selected “fishing” or “trekking” has a great interest in results such as fishing results and sensor information 8C when the results are obtained. . For this reason, users who have selected these uses often try to store still images instead of moving images. Accordingly, by displaying only the still image storage object O1 in advance in this case, the user can smoothly perform an operation for storing the preview image without hesitation. That is, user convenience is enhanced.

DESCRIPTION OF SYMBOLS 1 Electronic device 2 Housing 3 Touch screen display 3A Display part 3B Input part 4 Operation button 5 Imaging part 6 Control part 7 Sensor 7A Communication sensor 7B Position information acquisition sensor 7C Direction sensor 7D Acceleration sensor 7E Pressure sensor 8 Storage part 8A Control program 8B Overlay application 8C Sensor information 8D Setting information 8E Setting table 8F Overlay still image 8G Overlay moving image 100 Bicycle D1 Speed information D2 Distance information D3 Altitude information D4 Gravity acceleration information D5 Time information D6 Elapsed time information D7 Maximum speed information D8 Maximum gravitational acceleration information D9 Travel route information

Claims (5)

An imaging unit, a sensor, a storage unit, a display unit, and a control unit;
The sensor includes a position information acquisition sensor,
The controller is
Based on the position information acquired by the position information acquisition sensor at a plurality of times, the travel route information of the own machine is calculated,
A preview image obtained by overlaying the movement path information on the captured image captured by the imaging unit is stored in the storage unit as an overlay moving image;
Wherein the route information of the scale corresponding to the speed of the own apparatus at the start of the process of storing the overlay video image, and displays on the overlay video image displayed on the display unit,
At the midpoint of the storage process of the overlay moving image, the scale of the moving route information is not changed according to the speed of the own device.
Electronics. The sensor is a sensor that can detect a change in a detection target related to its own device,
Dynamic sensor information acquired by the sensor changes with time due to a change in a detection target related to the own device.
The electronic device according to claim 1 . An image capturing unit, a sensor, a storage unit, a display unit, and a control unit, wherein the sensor is an overlay method executed by an electronic device including a position information acquisition sensor,
The control unit is
Calculating the movement route information of the own machine based on the position information acquired by the position information acquisition sensor at a plurality of times;
Storing a preview image obtained by overlaying the movement path information on the captured image captured by the imaging unit in the storage unit as an overlay moving image;
Displaying the movement path information at a scale corresponding to the speed of the own device at the start of the storage process of the overlay moving image on the overlay moving image displayed on the display unit;
In the middle of the overlay moving image storage process, the step of not changing the scale of the movement path information according to the speed of the own machine;
Including overlay method. An imaging unit, a sensor, a storage unit, a display unit, and a control unit are provided, and the sensor is an electronic device including a position information acquisition sensor.
Calculating the movement route information of the own machine based on the position information acquired by the position information acquisition sensor at a plurality of times;
Storing a preview image obtained by overlaying the movement path information on the captured image captured by the imaging unit in the storage unit as an overlay moving image;
Displaying the movement path information at a scale corresponding to the speed of the own device at the start of the storage process of the overlay moving image on the overlay moving image displayed on the display unit;
In the middle of the overlay moving image storage process, the step of not changing the scale of the movement path information according to the speed of the own machine;
Overlay program that executes An imaging unit, a sensor, a storage unit, a display unit, and a control unit;
The sensor includes a position information acquisition sensor,
The controller is
Based on the position information acquired by the position information acquisition sensor at a plurality of times, the travel route information of the own machine is calculated,
An overlay moving image in which dynamic sensor information acquired by the sensor is overlaid on the captured image captured by the imaging unit and stored in the storage unit is displayed on the display unit,
Displaying the movement path information at a scale corresponding to the speed of the own device at the time of starting the storage process of the captured image on the overlay moving image displayed on the display unit,
In the middle of the display process of the overlay moving image, the scale of the movement route information is not changed according to the speed of the own device.
Electronics.

Images