JP2020140232A - Photographing direction recording apparatus, photographing direction recording method and program - Google Patents

Abstract

To more easily record a photographing position and a photographing direction in which an image is photographed.SOLUTION: A photographing direction recording apparatus including a camera and a direction sensor includes an input reception unit that receives a touch to a display screen, a display information generation unit that displays a first screen displaying a predetermined drawing or an image and an icon for receiving an execution instruction of a predetermined function, and a second screen receiving a touch operation on the drawing or the image when receiving a touch to the icon, and a photographing direction identification unit that starts the camera upon receiving the touch operation and identifies a photographing direction of the image photographed using output information from the direction sensor. The display information generation unit displays an icon having a predetermined mode indicating the photographing direction at a position where the touch operation on the drawing or the image is received, and displays the second screen in which the photographed image is disposed at the predetermined position.SELECTED DRAWING: Figure 2

Description

The present invention relates to a shooting direction recording device, a shooting direction recording method, and a program.

Patent Document 1 describes a digital camera with a shooting position and orientation, or a mobile phone system with an image.

Japanese Unexamined Patent Publication No. 2004-48427

In the technique described in Patent Document 1, a digital camera is provided with a GPS function and a function of detecting a direction, and a directional map image in which an arrow is drawn in the direction of the shooting position and the direction acquired from the shooting position is created. However, when shooting in a place where GPS signals cannot be received, there is a problem that the shooting position cannot be specified.

The present invention has been made in view of the above problems, and an object of the present invention is to provide a shooting direction recording device capable of more easily recording a shooting position and a shooting direction in which an image is taken.

The present application includes a plurality of means for solving at least a part of the above problems, and examples thereof are as follows. The shooting direction recording device according to one aspect of the present invention that solves the above problems is a shooting direction recording device having a built-in camera and a direction sensor, and has an input receiving unit that receives a touch on a display screen, a predetermined drawing, or A first screen displaying an image and an icon for receiving an execution instruction of a predetermined function is displayed, and when a touch to the icon is accepted, a second screen for accepting a touch operation on the drawing or the image is displayed. The display is provided with a display information generation unit and a shooting orientation specifying unit that activates the camera when the touch operation is received and specifies the shooting orientation of the captured image using the output information from the orientation sensor. The information generation unit displays an icon of a predetermined form indicating the shooting direction at a position on the drawing or image where the touch operation is received, and displays the second screen in which the shot image is arranged at a predetermined position. To do.

Further, when the function of acquiring the output information from the azimuth sensor is set to OFF, the display information generation unit displays a user interface capable of selecting the shooting azimuth when the touch operation is received. The shooting direction specifying unit may specify the direction selected by the user as the shooting direction.

Further, the display information generation unit displays a no-direction button that does not specify a shooting direction together with the user interface, and when a touch to the no-direction button is received, the shooting direction is at a position where the long-pressed touch is received. A predetermined form of icon that does not indicate may be displayed.

Further, the user interface may be represented by arrows indicating four directions of north, south, east and west and four directions of northeast, northwest, southeast and southwest.

Further, the display information generation unit may display a user interface for setting a reference orientation on the drawing or image.

Further, the display information generation unit may display an icon indicating the shooting direction with respect to the reference direction as an arrow direction at the shooting position where the touch operation is accepted.

Further, the display information generation unit further includes a storage unit that stores the captured image, and when the touch to the predetermined icon on the first screen is received, the display information generation unit accepts the touch operation on the drawing or the image. When the screen of 3 is displayed and the touch operation is accepted, the captured image stored in the storage unit is displayed in a selectable manner, and a user interface in which the shooting direction of the selected image can be selected is displayed. The shooting orientation specifying unit specifies the orientation selected by the user as the shooting orientation of the selected image, and the display information generating unit determines the shooting orientation at a position on the drawing or image that receives the touch operation. In addition to displaying the icon of the predetermined form indicating, the third screen in which the captured image is arranged at a predetermined position may be displayed.

Further, when the touch to the predetermined icon on the first screen is accepted, a drawing unit that draws according to the locus of the touch position on the drawing or image or the captured image may be further provided.

Further, when the display information generation unit receives a touch on the predetermined icon on the first screen, the display information generation unit displays a fourth screen that accepts a touch operation on the drawing or an image, and presses and holds the touch. When an image is taken by the camera activated based on the above, the fourth screen displaying the taken image may be displayed at a position on the drawing or the image where the touch operation is accepted.

Further, an overall control unit that assigns an identification number to the icon indicating the shooting direction and generates management information associated with the icon, the shooting position on the drawing or the image, the shooting direction, and the shot image is further provided. , The display information generation unit displays a dialog for inputting the identification number and accepting a search instruction for the icon, and the overall control unit displays the drawing or the drawing of the icon based on the identification number of the icon for which the input is received. The shooting position, the shooting direction, and the shot image on the image may be specified, and the display information generation unit may display the specified icon and the shot image on the drawing or the image.

Further, when the touch to the predetermined icon on the first screen is received, the display information generation unit displays the icon indicating the shooting direction on the drawing or the image and selects the icon. Format information may be generated in which an image taken at the shooting position and shooting direction of the icon and the drawing or image including the selected icon are arranged at predetermined positions.

Further, the communication unit further includes a communication unit for transmitting information to an external device, and the communication unit provides construction information including the drawing or image including the icon indicating a shooting position and a shooting direction, and the shot image. It may be transmitted to an external device.

Further, another embodiment of the present invention is a shooting direction recording system having a shooting direction recording device and a server device having a built-in camera and a direction sensor, and the shooting direction recording device receives an input for receiving a touch on a display screen. A first screen displaying a unit, a predetermined drawing or image, and an icon for receiving an execution instruction of a predetermined function is displayed, and when a touch to the icon is accepted, a touch operation on the drawing or image is accepted. A display information generation unit that displays a second screen, and a shooting orientation specifying unit that activates the camera when the touch operation is received and specifies the shooting orientation of the captured image using the output information from the orientation sensor. A drawing or image including the icon indicating a shooting position and a shooting direction, and a communication unit for transmitting construction information including the shot image to the server device. An information storage unit that stores the construction information acquired from the shooting direction recording device, and an information transmission / reception unit that transmits the requested construction information to the shooting direction recording device when a display request from the shooting direction recording device is received. , Equipped with.

Another embodiment of the present invention is a shooting direction recording method performed by a shooting direction recording device having a built-in camera and a direction sensor, wherein the shooting direction recording device includes an input reception step for receiving a touch on a display screen. A first screen displaying a predetermined drawing or image and an icon for receiving an execution instruction of a predetermined function is displayed, and when a touch to the icon is accepted, a second screen that accepts a touch operation on the drawing or image is received. A display information generation step for displaying a screen and a shooting direction specifying step for activating the camera when the touch operation is accepted and specifying the shooting direction of the captured image using the output information from the direction sensor. In the display information generation step, an icon of a predetermined form indicating the shooting direction is displayed at a position on the drawing or image where the touch operation is received, and the shot image is arranged at a predetermined position. Display the screen of.

Another embodiment of the present invention is a program that causes a computer having a built-in camera and orientation sensor to function as a shooting orientation recording device, wherein the shooting orientation recording device has an input receiving unit that receives a touch on a display screen. A first screen displaying a predetermined drawing or image and an icon for receiving an execution instruction of a predetermined function is displayed, and when a touch to the icon is accepted, a second screen that accepts a touch operation on the drawing or image is received. A display information generation unit that displays a screen, and a shooting orientation specifying unit that activates the camera when the touch operation is received and specifies the shooting orientation of an image shot using the output information from the orientation sensor. The display information generation unit displays an icon of a predetermined form indicating the shooting direction at a position on the drawing or image that receives the touch operation, and arranges the shot image at a predetermined position. Display the second screen.

According to the shooting direction recording device according to the present invention, it is possible to more easily record the shooting position and shooting direction in which the image is taken.

Issues, configurations, and effects other than those described above will be clarified by the description of the following embodiments.

It is a figure which showed an example of the photographing direction recording system which concerns on one Embodiment of this invention. It is a block diagram which showed an example of the functional structure of the photographing direction recording apparatus which concerns on one Embodiment of this invention. It is a figure which showed an example of the main screen which concerns on one Embodiment of this invention. It is a figure which showed an example of the hardware composition of the photographing direction recording apparatus which concerns on one Embodiment of this invention. It is a figure which showed an example of the user interface for setting the north direction which concerns on one Embodiment of this invention. It is a flow chart which showed an example of the photographing direction recording processing which concerns on one Embodiment of this invention. It is a figure which showed an example of the pre-photographing screen which concerns on one Embodiment of this invention. It is a figure which showed an example of the user interface for manually setting a shooting direction which concerns on one Embodiment of this invention. FIG. 9A is a diagram showing an example of a pre-shooting screen (second screen) on which a pin icon according to an embodiment of the present invention is displayed. FIG. 9B is a diagram showing an example of a second screen in which a plurality of pin icons are displayed. FIG. 10A is a diagram showing an example of a fourth screen before the direct pasting process according to the embodiment of the present invention. FIG. 10B is a diagram showing an example of the fourth screen after the direct pasting process. It is a figure which showed an example of the format information including the photographed image and the drawing which concerns on one Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a diagram showing an example of the photographing direction recording system 1000 according to the present embodiment. As shown in the figure, the shooting direction recording system 1000 includes a shooting direction recording device 100 and a server device 200. The shooting orientation recording device 100 may be used, for example, by bringing it to a construction site (for example, a construction site or a water pipe construction site) where a shooting object is located, or when it is used in an office or another construction site. is there. The shooting direction recording device 100 transmits the construction information associated with the shooting position and the shooting direction of the image taken at the construction site on the drawing such as the design drawing to the server device 200. The server device 200 manages the construction information acquired from the shooting direction recording device 100. Further, the server device 200 transmits the construction information to the photographing direction recording device 100 that has received the display request.

These shooting orientation recording devices 100 and the server device 200 are connected to each other via a predetermined network N so as to be able to communicate with each other. The network N is, for example, a public network such as the Internet, a LAN (Local Area Network), or a WAN (Wide Area Network).

FIG. 2 is a block diagram showing an example of the functional configuration of the photographing direction recording device 100. As shown in the figure, the photographing direction recording device 100 includes a calculation unit 110, a storage unit 120, and a communication unit 130.

The calculation unit 110 is a central functional unit that performs various processes of the photographing direction recording device 100. Specifically, the calculation unit 110 includes an input reception unit 111, a display information generation unit 112, an overall control unit 113, a shooting direction specifying unit 114, and a drawing unit 115.

The input receiving unit 111 is a functional unit that receives instructions and input information from the user via an input device such as a touch panel.

The display information generation unit 112 is a functional unit that generates screen information for display on a display device such as a display. For example, the display information generation unit 112 may be referred to as a main screen (hereinafter, referred to as a first screen) in which a drawing or an image captured in the shooting direction recording device 100 and an icon for receiving an execution instruction of various functions from a user are arranged. ) And other screen information (for example, a menu screen and the second to fifth screen information described later) are generated and displayed on the display. Further, the display information generation unit 112 displays a pin icon indicating the shooting position and the shooting direction on the drawing together with the shot image by the shooting direction recording process described later.

FIG. 3 is a diagram showing an example of the main screen 300 displayed by the display information generation unit 112. As shown in the figure, the main screen 300 has a drawing display area 310 read by the shooting direction recording device 100, and an area 320 displaying an icon for receiving an execution instruction of various functions from the user.

The icon includes, for example, a pin arrangement icon 321 that receives an execution instruction of a shooting direction recording process for arranging a pin icon indicating a shooting position and a shooting direction of a shot image on a drawing. Further, the icon includes, for example, a drawing tool icon 322 that receives an execution instruction of a drawing function for drawing a line, a figure, or the like overlaid on a drawing or a captured image. Further, the icon includes, for example, an output icon 323 that receives an instruction to output a drawing or a captured image. Further, the icons include, for example, an icon 324 for receiving an image shooting instruction, an icon 325 for receiving a moving image shooting instruction, and an icon 326 for receiving an instruction to associate a pin with a shot image later and place it on a drawing. There is an icon 327 that accepts an instruction to associate a pin with a recorded moving image and place it on the drawing later. Further, the icon includes a setting icon 328 that accepts the setting of the north direction of the captured drawing. Further, the icon includes a direct-paste icon 329 that directly displays a photographed image at a photographed position on a drawing.

Note that these icons are not limited to the main screen (first screen), but are also displayed in common on the second to fourth screens described later.

The overall control unit 113 is a functional unit that controls various processes executed by the photographing direction recording device 100. Specifically, the overall control unit 113 controls the operation of other functional units in response to an instruction received from the user via the input reception unit 111.

The shooting direction specifying unit 114 is a functional unit that specifies the shooting direction of the image. Specifically, the photographing azimuth specifying unit 114 identifies the north azimuth on the drawing based on the information acquired via the user interface. Further, the shooting direction specifying unit 114 specifies the shooting direction at the time of shooting based on the information acquired from the direction compass equipped in the shooting direction recording device 100. Further, when the automatic acquisition function of the shooting direction is OFF, the shooting direction specifying unit 114 specifies the shooting direction based on the information manually set by the user via the input receiving unit 111.

The drawing unit 115 is a functional unit that provides a drawing function. Specifically, the drawing unit 115 draws by superimposing a line or a figure on the drawing or the captured image based on the locus of the finger in contact with the touch panel.

The storage unit 120 is a functional unit that stores various information. For example, the storage unit 120 has a shooting orientation recording application, drawing information to be displayed on the display, color information associated with each pin category of the pin icon arranged on the drawing in advance, and a user interface that manually receives the shooting orientation from the user. Pin management information and various setting information that associate the output format of the drawing and the captured image, the identification number of the pin icon, the pin classification, the position on the drawing for displaying the pin icon, and the identification information of the drawing. Various information such as is stored.

The communication unit 130 is a functional unit that transmits / receives information to / from an external device (for example, a server device 200 or another shooting direction recording device 100). Specifically, the communication unit 130 transmits the construction information including the pin icon indicating the shooting position and the shooting direction and the drawing associated with the shot image to the server device 200. Further, the communication unit 130 transmits a drawing or a photographed image to another device (for example, another device such as a shooting direction recording device 100, a PC, or a smartphone).

The functional block of the photographing direction recording device 100 has been described above.

The server device 200 has an information storage unit that stores upload information such as construction information acquired from the shooting orientation recording device 100, and information that extracts construction information that has received an acquisition request from the shooting orientation recording device 100 from the information storage unit. It is assumed that it has a management unit and an information transmission / reception unit that transmits the extracted construction information to the photographing direction recording device 100.

FIG. 4 is a diagram showing an example of the hardware configuration of the photographing direction recording device 100. The shooting direction recording device 100 is realized by a mobile information processing terminal such as a tablet terminal or a smartphone.

As shown in the figure, the photographing orientation recording device 100 includes an input device 401, a display device 402, an external storage device 403, an arithmetic unit 404, a main storage device 405, a communication device 406, an orientation sensor 407, and a camera. It has a 408 and a bus 409 that electrically interconnects them.

The input device 401 is a pointing device such as a touch panel or a home button. The touch panel is integrally configured with the display device 402, which is a display, and outputs a signal including information such as coordinates and touch time on the display that has received a touch from the user. The touch panel detects, for example, a touch time of less than 1 second as a normal touch and a touch time of 1 second or more as a long press touch. The display device 402 is, for example, a liquid crystal display or an organic display. The input device 401 detects a predetermined touch operation (for example, a predetermined touch operation such as a double tap that touches the touch panel twice within 1 second) as a touch operation different from the normal touch, instead of the long press touch. You may do so.

The external storage device 403 is a non-volatile storage device such as a flash memory capable of storing digital information.

The arithmetic unit 404 is, for example, a CPU (Central Processing Unit). The main storage device 405 is a memory device such as a RAM (Random Access Memory) or a ROM (Read Only Memory).

The communication device 406 is a wireless communication device that performs wireless communication via an antenna. The communication device 406 performs information communication with a predetermined external device (for example, the server device 200 and another shooting direction recording device 100) connected to the network N.

The azimuth sensor 407 is a sensor capable of detecting the azimuth, such as a gyro compass or a magnetic compass, which is equipped on a normal tablet terminal. The camera 408 is, for example, a CMOS camera equipped with a CMOS image sensor or a CCD camera equipped with a CCD image sensor.

The arithmetic unit 110 of the photographing direction recording device 100 is realized by a program that causes the arithmetic unit 404 to perform processing. This program is an application program (application) for the shooting direction recording device 100 to execute the shooting direction recording process and the like, and is stored in the external storage device 403 by downloading from the external device. Further, such a program is loaded on the main storage device 405 and executed by the arithmetic unit 404 for its execution. The storage unit 120 is realized by the main storage device 405, the external storage device 403, or a combination thereof. Further, the communication unit 130 is realized by the communication device 406.

Further, each of the above-mentioned configurations, functions, processing units, processing means and the like of the photographing direction recording device 100 may be realized by hardware by designing a part or all of them by, for example, an integrated circuit. Further, the above configuration and functions may be realized by software by the processor interpreting and executing a program that realizes each function. Information such as programs, tables, and files that realize each function can be stored in a storage device such as a memory or a recording medium such as an IC card or an SD card.

Further, the hardware configuration of the photographing direction recording device 100 is not limited to these, and may be configured by using other hardware. For example, it may be a device that accepts input / output via the Internet. Although not shown, the shooting direction recording device 100 has known elements such as an OS (Operating System), middleware, and an application, and has an existing processing function for displaying a GUI screen on an input / output device such as a display. To be equipped.

The hardware configuration of the photographing direction recording device 100 has been described above.

The hardware configuration of the server device 200 is not particularly limited, but any high-performance information processing device capable of executing various processes may be used. Specifically, the server device 200 includes an arithmetic unit, a main storage device, an external storage device, a communication device, and a bus that electrically connects them. The external storage device is a non-volatile storage device such as a so-called hard disk (Hard Disk Drive), SSD (Solid State Drive), or flash memory capable of storing digital information. Since the arithmetic unit, the main storage device, and the communication device are the same as those of the photographing direction recording device 100, the description thereof will be omitted.

The information management unit of the server device 200 is realized by a program that causes the arithmetic unit to perform processing. This program is stored in the main storage device or the external storage device, loaded on the main storage device when the program is executed, and executed by the arithmetic unit. Further, the information storage unit is realized by a main storage device, an external storage device, or a combination thereof. Further, the information transmission / reception unit is realized by a communication device.

The hardware configuration of the server device 200 has been described above.

[Explanation of operation]
Next, various functions provided by the photographing direction recording device 100 and their processing will be described.

(North direction setting function of drawing)
The shooting direction recording device 100 provides the user with a function of setting the north direction of the drawing. Specifically, the overall control unit 113 displays an icon for receiving a drawing or image capture instruction on a predetermined screen and receives a user's instruction via the display information generation unit 112. When the touch to the icon is received, the overall control unit 113 acquires the drawing (or image) stored in the storage unit 120 in advance, and the acquired drawing and a predetermined drawing via the display information generation unit 112. The main screen (first screen) displaying the icon is displayed. In the following description of each function, it is premised that a predetermined drawing is captured.

Further, the overall control unit 113 receives a touch on the setting icon 328 displayed on the main screen via the input reception unit 111. Upon receiving a touch on the icon, the shooting orientation specifying unit 114 displays a user interface for setting the north orientation on the drawing via the display information generation unit 112.

FIG. 5 is a diagram showing an example of a user interface for setting the north direction. When the user rotates the interface 500 to determine the north direction of the drawing, the user touches the confirmation button 501 to complete the setting. When the shooting direction specifying unit 114 receives a touch on the confirmation button 501 via the input receiving unit 111, the shooting direction specifying unit 114 identifies the direction pointed to by the north direction of the user interface as the north direction of the drawing, and associates this with the drawing to store the storage unit. Store in 120.

In this way, the user can manually set the north orientation on the drawing. As a result, the north direction on the drawing, which is the reference of the shooting direction, can be set regardless of whether or not the place where the user is located cannot acquire the direction from the direction sensor.

(Shooting direction recording function)
The shooting direction recording device 100 provides the user with a shooting direction recording function. The shooting direction recording device 100 executes the shooting direction recording process when executing such a function.

FIG. 6 is a flow chart showing an example of shooting direction recording processing. As shown in the figure, such processing is started when the input receiving unit 111 receives a touch on the pin arrangement icon 321 displayed on the main screen. It is assumed that the drawing for recording the shooting direction is selected in advance by the user and the main screen is displayed on the display.

When the process is started, the overall control unit 113 sets an icon for setting the pin classification (hereinafter referred to as a pin classification setting icon) and ON / OFF of the automatic acquisition function of the shooting direction via the display information generation unit 112. A pre-shooting screen (hereinafter, may be referred to as a second screen) in which an icon (hereinafter, referred to as an automatic orientation setting icon) is displayed on the main screen is displayed (step S001).

FIG. 7 is a diagram showing an example of a screen before shooting. On the pre-shooting screen 550, in addition to the drawing and the predetermined icon displayed on the main screen, the pin division setting icon 551 and the automatic orientation setting icon 552 are displayed.

The pin classification is a construction type identification classification such as water supply, water distribution, gas, water distribution, and repair, and different colors are associated with each construction type in advance and stored in the storage unit 120. The automatic acquisition function of the shooting direction is a function of acquiring the shooting direction from the direction sensor 407 provided in the shooting direction recording device 100. For example, when it is desired to manually set the shooting direction, the user sets such a function to OFF. As a result, the user can manually set the azimuth at the construction site where the azimuth sensor 407 does not operate normally.

When the overall control unit 113 receives a touch on the pin classification setting icon 551 via the input receiving unit 111, the overall control unit 113 displays a pop-up screen for selecting the pin classification via the display information generation unit 112 (not shown). Further, when any one of the pin divisions is selected via the input reception unit 111, the overall control unit 113 temporarily stores this as setting information of the pin division in the storage unit 120.

Further, when the overall control unit 113 receives a touch on the automatic azimuth setting icon 552 via the input reception unit 111, a pop-up that accepts ON or OFF selection of the automatic azimuth acquisition function via the display information generation unit 112. Display the screen (not shown). Further, when either ON or OFF is selected via the input receiving unit 111, the overall control unit 113 temporarily stores this in the storage unit 120 as setting information of the automatic acquisition function of the shooting direction.

Next, the input receiving unit 111 determines whether or not a long press touch to a predetermined position (for example, a position corresponding to the shooting position) of the drawing displayed on the display has been accepted (step S002). Then, when it is determined that the long press touch is not accepted (No in step S002), the input receiving unit 111 performs the process of step S002 again. On the other hand, when it is determined that the long press touch has been accepted (Yes in step S002), the input reception unit 111 shifts the process to step S003.

In step S003, the shooting direction specifying unit 114 determines whether or not the automatic acquisition function of the shooting direction is ON. Specifically, the overall control unit 113 uses the setting information stored in the storage unit 120 to determine whether or not the function is ON. Then, when it is determined that the automatic acquisition function of the shooting direction is set to ON (Yes in step S003), the shooting direction specifying unit 114 activates the camera and shifts the process to step S005.

On the other hand, when it is determined that the automatic acquisition function of the shooting direction is not set to ON (No in step S003), the shooting direction specifying unit 114 manually sets the shooting direction via the display information generation unit 112. The user interface is displayed on the display, and the setting of the shooting direction is received from the user (step S004). The shooting orientation specifying unit 114 acquires a preset north direction of the drawing from the recording unit and displays it at a predetermined position on the display together with the user interface.

FIG. 8 is a diagram showing an example of a user interface for manually setting the shooting orientation. As shown, the user interface 600 is represented by arrows pointing in four directions, north, south, east, and west, and four directions, northeast, northwest, southeast, and southwest. The display also displays an orientationless button 601 that does not set an orientation. When the user selects one orientation of the user interface 600 or selects the no orientation button 601 while referring to, for example, the north orientation of the drawing, the manual setting of the shooting orientation is completed. When the input receiving unit 111 receives a touch on any one direction of the user interface 600 or the no direction button 601, the shooting direction specifying unit 114 temporarily uses the received direction (or no direction) as the manual direction setting information. It is stored in the storage unit 120. Further, the shooting direction specifying unit 114 activates the camera 408 and shifts the process to step S005.

In step S005, the overall control unit 113 determines whether or not shooting has been performed. Specifically, the overall control unit 113 determines whether or not the touch to the shutter button has been received via the input reception unit 111. Then, when it is determined that the touch to the shutter button is not accepted (No in step S005), the overall control unit 113 performs the process of step S005 again. On the other hand, when it is determined that the touch to the shutter button has been accepted (Yes in step S005), the overall control unit 113 sets the shooting direction to the position on the drawing where the long press touch is accepted via the display information generation unit 112. Display the screen information including the pin icon and the like (step S006).

Specifically, when the overall control unit 113 receives a touch on the shutter button, it identifies the shooting direction by using the manual direction setting information stored in the direction sensor 407 or the storage unit 120. Further, the overall control unit 113 specifies the pin division from the setting information stored in the storage unit 120. Further, the overall control unit 113 generates an identification number assigned to the pin icon. In addition, the overall control unit 113 corresponds to the captured image, the identification number of the pin icon, the pin classification, the position (coordinates) and the shooting orientation on the drawing that received the long press touch, and the identification information of the drawing. It is attached and stored in the storage unit 120 as pin management information.

Further, the overall control unit 113 displays, via the display information generation unit 112, a pin icon of a predetermined form indicating a shooting direction, which is a specified pin division, at a position on the drawing where a long press touch is received. Specifically, the display information generation unit 112 displays a pin icon indicating the shooting direction with respect to the north direction (reference direction) on the drawing as the arrow direction at the shooting position where the long press touch is received. Further, the overall control unit 113 displays such a pin icon via the display information generation unit 112, and displays the captured image in a predetermined area on the drawing. When no orientation is set, the overall control unit 113 outputs a pin icon generation instruction that does not indicate the orientation to the display information generation unit 112.

FIG. 9A is a diagram showing an example of screen information (pre-shooting screen) 650 in which a pin icon indicating a shooting direction is displayed at a shooting position. As shown in the figure, a pin icon 651 indicating the shooting direction at the shooting position and a display area 652 displaying the shot image associated with the pin icon 651 are displayed on the screen before shooting 650. The pin icon 651 indicates a shooting direction (east direction in FIG. 9A) with an arrow with respect to the north direction (lower left direction of the screen in the drawing of FIG. 9A) on the drawing. Further, the pin icon 651 is represented by a color corresponding to the pin classification, and the identification number of the pin icon is indicated.

When a plurality of pin icons are displayed on the drawing, when the overall control unit 113 receives a touch to any of the pin icons via the input receiving unit 111, it is associated with the touched pin icon. An instruction is output to the display information generation unit 112 to display the captured image. The display information generation unit 112 refers to the pin management information of the storage unit 120, and identifies the identification number of the pin icon and the captured image to which the touched position (for example, coordinate value) on the drawing is associated. Further, the overall control unit 113 generates and displays a pre-shooting screen in which the captured image acquired from the storage unit 120 is arranged in the display area 652 on the drawing.

When step S006 is performed, the overall control unit 113 determines whether or not an execution instruction for another process has been accepted (step S007). Specifically, the overall control unit 113 is an icon displayed on the pre-shooting screen via the input reception unit 111, and is a predetermined icon that receives instructions for other processing (for example, a drawing tool icon 322). Determine if the touch to is accepted. Then, when it is determined that the touch to the icon has been accepted (Yes in step S007), this flow ends. On the other hand, when it is determined that the touch to the predetermined icon is not accepted (No in step S007), the overall control unit 113 shifts the process to step S002.

In step S002, as described above, the display displays a pre-shooting screen that accepts a long press touch on the shooting position. That is, when the shooting of the image by the camera 408 is completed, the pre-shooting screen including the pin icon indicating the shooting direction and the shot image is displayed on the display after the shooting, and a new shooting is immediately possible. As a result, the user can smoothly shoot a plurality of images while recording the shooting direction by simply repeating the long press touch of the display and the touch of the shutter button of the camera.

FIG. 9B is a diagram showing an example of the pre-shooting screen 660 in which a plurality of pin icons are displayed. Pin icons 661 and 662 are displayed in addition to the pin icon 651 because the processes of steps S002 to S007 are repeated on the drawing. The pin icon 662 indicates a pin icon when the shooting orientation is not set (setting without orientation).

In addition, the pin icon indicating the shooting direction can be displayed by setting the pin classification according to the construction type and color-coding each pin classification. Therefore, it is possible to visually recognize which type of construction-related image is associated with the pin icon displayed on the drawing.

Further, in the shooting direction recording device 100, the shooting direction can be set manually. Therefore, even at the construction site where the azimuth sensor 407 does not work normally, the user can manually set the shooting azimuth while referring to the north azimuth set in the drawing in advance.

The user can upload the construction information associated with the pin icon and the photographed image to the server from a predetermined screen (for example, a menu screen) displayed on the photographing direction recording device 100. Specifically, the overall control unit 113 receives a touch on the upload button displayed on the menu screen via the input reception unit 111. When the upload button is touched by the user, the overall control unit 113 transmits the construction information including the pin icon and the captured image associated with the pin icon to the server device 200 as the latest information via the communication unit 130. ..

In this way, since the construction information is managed by the server device 200, it can be visually confirmed by downloading the construction information even if the user is at a place other than the construction site, for example.

(A function to associate a pin with a captured image later and place it on the drawing)
The shooting direction recording device 100 provides the user with a function of associating a pin icon with a shot image later and arranging the pin icon on the drawing.

When the overall control unit 113 receives a touch on an icon (for example, icon 326) that receives an execution instruction of such a function while receiving a touch on the pin arrangement icon 321 on the main screen, the overall control unit 113 causes the display information generation unit 112. A third screen is displayed on the display via. Since the third screen has the same display configuration as the pre-shooting screen 550, the description thereof will be omitted.

Here, the overall control unit 113 receives a long press touch at a position where the pin icon is arranged on the drawing via the input reception unit 111. Then, when the long press touch is received, the overall control unit 113 acquires the captured images from the storage unit 120, and displays these images on the display in a thumbnail format so as to be selectable via the display information generation unit 112. Further, when one of the images is selected by the user, the overall control unit 113 identifies the selected image via the input reception unit 111.

Next, the overall control unit 113 displays the user interface 600 for manually setting the shooting direction of the selected image on the display via the display information generation unit 112. The user interface 600 is the same as that shown in FIG. 8, and the setting method by the user is the same as described above, and thus the description thereof will be omitted.

When the overall control unit 113 receives a touch on any one direction of the user interface 600 or the no-direction button 601 via the input reception unit 111, the overall control unit 113 temporarily stores the manual orientation setting information in the storage unit 120.

Further, the overall control unit 113 displays and selects a pin icon of a predetermined form indicating a shooting direction in a predetermined pin division at a position on the drawing that receives a long press touch via the display information generation unit 112. A third screen in which the created image is displayed in a predetermined display area on the drawing is displayed on the display. Since the third screen on which the pin icon and the captured image are displayed is the same as in FIGS. 9A and 9B, the description thereof will be omitted.

Since the state in which the third screen is displayed is maintained on the display, if the user wants to continue the same process, he / she can press and hold the drawing displayed on the display to take a picture. The pin icon associated with the image can be displayed on the drawing.

According to such a function, it is possible to record the shooting position and the shooting direction of the captured image on the drawing later. Therefore, for example, even when a photographed image at a construction site is acquired from another device, the photographing position and the photographing direction of the photographed image can be recorded later on the drawing.

(Drawing function)
The shooting direction recording device 100 provides the user with a drawing function for drawing and a shot image.

The drawing unit 115 is a drawing tool icon (for example, a straight line, a curve) displayed on the main screen (first image), the pre-shooting screen (second screen), or the third screen via the input receiving unit 111. , Predetermined figure and text, etc.) When the touch to 322 is received, drawing is performed according to the type of drawing tool selected on the drawing or the captured image.

Specifically, the drawing unit 115 specifies a position on the drawing or captured image touched via the input receiving unit 111. Further, when the selected drawing tool is a straight line or a curved line, the drawing unit 115 draws the straight line or the curved line according to the locus of the touch position on the specified drawing or the captured image. Further, when the selected drawing tool is a figure or text, the drawing unit 115 displays a predetermined figure or text input area at a touch position on the drawing or captured image.

With such a drawing function, the user can draw a line, a figure, or text on a drawing or a captured image. This makes it possible to record, for example, a place to watch and a memo.

(Direct image pasting function)
The shooting direction recording device 100 provides the user with a function of directly pasting an image.

The overall control unit 113 touches the direct-paste icon 329 displayed on the main screen (first image), the pre-shooting screen (second screen), or the third screen via the input reception unit 111. Is received, the screen information of the fourth screen for directly pasting the captured image is generated and displayed via the display information generation unit 112. FIG. 10A is a diagram showing an example of a fourth screen before the direct pasting process of the captured image. As shown, the drawing in the display area 310 of the drawing and the predetermined icons 321 to 329 are displayed on the fourth screen 700.

When the icon 751 for receiving a shooting instruction is touched while the fourth screen 700 is displayed, the overall control unit 113 presses and holds the position on the drawing on which the shot image is directly pasted. stand by. When the long press touch on the drawing is received, the overall control unit 113 activates the camera 408 and waits for the shutter button to be touched. Further, when the touch to the shutter button is received, the overall control unit 113 stores the captured image in the storage unit 120 and displays the captured image in a predetermined size at the position on the drawing where the long press touch is made. The fourth screen is displayed. The overall control unit 113 stores the captured image and the position on the drawing touched by long press in association with each other in the storage unit 120.

FIG. 10B is a diagram showing an example of the fourth screen 750 after the direct pasting process. As shown in the figure, the captured image 753 is directly displayed in a predetermined size at the position on the drawing where the long press touch is received.

Further, when the icon 752 for receiving the direct pasting instruction of the captured image is touched while the fourth screen 750 is displayed, the captured image is directly pasted at the position on the drawing where the long press touch is accepted. Will be done. The process after receiving the long press touch is the same as the process executed by the function of associating the pin with the captured image and arranging the pin on the drawing, and thus the description thereof will be omitted.

With such an image direct pasting function, the user can directly confirm the captured image while looking at the drawing.

(Pin icon search function)
The shooting direction recording device 100 provides the user with a search function for pin icons arranged on the drawing.

The overall control unit 113 displays the pin search icon that accepts the search for the pin icon on the fifth screen that accepts the selection of the drawing to be captured via the display information generation unit 112. Further, when the pin search icon is touched, the overall control unit 113 displays the search pin input dialog via the display information generation unit 112. In this dialog, a field for inputting the identification number of the pin to be searched, a numeric keypad, and a search button are displayed. The user touches the numeric keypad, inputs the identification number of the pin icon to be searched, and touches the search button.

When the overall control unit 113 acquires the identification number of the pin icon input via the input reception unit 111, the position and pin classification of the pin icon to be searched are used by using the pin management information stored in the storage unit 120. And the drawing identification information and the captured image associated with such a pin icon. Further, the overall control unit 113 generates screen information of the main screen (first screen) displaying the pin icon to be searched and the captured image at the specified position on the drawing via the display information generation unit 112. And display.

With such a pin icon search function, the user can easily search and display the pin icon and the captured image to be confirmed from among a large number of pin icons.

(Output function)
The shooting direction recording device 100 provides the user with various forms of output functions.

When the overall control unit 113 receives a touch on the output icon 323 displayed on the first screen to the fourth screen via the input reception unit 111, the display information is displayed so that the output format selection screen is popped up. An instruction is output to the generation unit 112.

On the output format selection screen, three types of output formats, that is, the entire drawing, only the photograph, and the drawing + the photograph are displayed so as to be selectable. The user touches any desired output form.

When the general control unit 113 receives a touch on the entire drawing via the input reception unit 111, the drawing displayed on the main screen is converted into a predetermined format (for example, PDF) via the display information generation unit 112. Display the converted preview screen. When the overall control unit 113 receives a touch on the execution icon displayed on the preview screen via the input reception unit 111, the overall control unit 113 transmits drawing information to a predetermined output destination via the communication unit 130.

Further, when the overall control unit 113 receives a touch on only the photograph via the input reception unit 111, the overall control unit 113 displays the drawing on which the pin icon is arranged by the previous operation via the display information generation unit 112. Further, the overall control unit 113 accepts the selection of the pin icon via the input reception unit 111. A plurality of pin icons can be selected. The user selects a pin icon associated with an image to be output by touching the pin icon or tracing on the drawing so as to surround an area including a plurality of pin icons.

When the overall control unit 113 identifies the selected pin icon via the input reception unit 111, the overall control unit 113 identifies the captured image associated with the selected pin icon using the pin management information, and displays information generation unit. The identified captured image is displayed in thumbnail format via 112. The user selects an image to be output from the captured images displayed by thumbnail formation.

The overall control unit 113 displays a preview screen in which the selected image is converted into a predetermined format (PDF) via the display information generation unit 112. Further, when the overall control unit 113 receives a touch on the execution icon displayed on the preview screen via the input reception unit 111, the overall control unit 113 transmits the captured image to a predetermined output destination via the communication unit 130.

Further, when the overall control unit 113 receives a touch on the drawing + the photograph via the input reception unit 111, the overall control unit 113 displays the drawing on which the pin icon is arranged by the previous operation via the display information generation unit 112. .. Further, the overall control unit 113 accepts the selection of the pin icon via the input reception unit 111. Since the selection of the pin icon is the same as the case where the touch to only the photo is accepted, the description thereof will be omitted.

When the overall control unit 113 identifies the selected pin icon via the input reception unit 111, the overall control unit 113 identifies the captured image associated with the selected pin icon using the pin management information, and displays information generation unit. The identified captured image is displayed in thumbnail format via 112. The user selects an image to be output from the captured images displayed by thumbnail formation.

The overall control unit 113 sets a format in which the selected image and the area on the drawing including the pin icon associated with the captured image are arranged at a predetermined position via the display information generation unit 112. Convert to (PDF) and display as a preview screen. Further, when the overall control unit 113 receives a touch on the execution icon displayed on the preview screen via the input reception unit 111, the overall control unit 113 transmits the format information related to the predetermined output destination via the communication unit 130. ..

FIG. 11 is a diagram showing an example of format information 800 including captured images and drawings. In the illustrated example, a captured image 801 and a drawing 802 including a pin icon associated with such an image are arranged one above the other.

With such an output function, the user can simply transmit information including a desired captured image, a drawing in which a pin icon is arranged, or both of them. In particular, since it is possible to easily generate a format in which a photographed image and a drawing including a related pin icon are arranged, a report or a form can be generated with a simple operation by registering a desired format in advance. can do.

In the above-described embodiment, an example in which an image is captured and stored in association with the shooting orientation has been described, but the present invention is not limited to this, and a moving image is shot instead of the image, and the shooting position and shooting orientation are used. It is also possible to store it on the drawing in association with. Specifically, the pre-shooting screen for executing moving image shooting is displayed by selecting the pin arrangement icon on the first screen or the like and then selecting the moving image shooting icon instead of the photography icon.

It should be noted that the above-described embodiments and modifications have been described in detail in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the described configurations. Further, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. In addition, it is possible to add, delete, or replace a part of the configuration of each embodiment with another configuration.

1000 ... Shooting direction recording system, 100 ... Shooting direction recording device, 110 ... Calculation unit, 111 ... Input reception unit, 112 ... Display information generation unit, 113 ... Overall control unit, 114 ... Shooting direction identification unit, 115 ... Drawing unit, 120 ... Storage unit, 130 ... Communication unit, 200 ... Server device, 401 ... Input device, 402 ... Display device , 403 ... external storage device, 404 ... arithmetic device, 405 ... main storage device, 406 ... communication device, 407 ... orientation sensor, 408 ... camera, 409 ... bus

Claims (15)

A shooting orientation recording device with a built-in camera and orientation sensor.
An input reception unit that accepts touches on the display screen,
A first screen displaying a predetermined drawing or image and an icon for receiving an execution instruction of a predetermined function is displayed, and when a touch to the icon is accepted, a second screen that accepts a touch operation on the drawing or image is received. Display information generator that displays the screen and
When the touch operation is accepted, the camera is activated, and a shooting direction specifying unit for specifying the shooting direction of the captured image using the output information from the direction sensor is provided.
The display information generation unit
It is characterized in that an icon of a predetermined form indicating the shooting direction is displayed at a position on the drawing or an image where the touch operation is received, and the second screen in which the shot image is arranged at a predetermined position is displayed. Shooting direction recording device. The shooting direction recording device according to claim 1.
The display information generation unit
When the function of acquiring the output information from the azimuth sensor is set to OFF, a user interface capable of selecting the shooting azimuth is displayed when the touch operation is received.
The shooting direction identification unit is
A shooting direction recording device characterized in that the direction selected by the user is specified as the shooting direction. The shooting direction recording device according to claim 2.
The display information generation unit
Along with the user interface, a no-azimuth button that does not specify the shooting orientation is displayed.
A shooting orientation recording device, characterized in that when a touch to the no orientation button is received, an icon of a predetermined form that does not indicate the shooting orientation is displayed at a position where the touch operation is received. The shooting direction recording device according to claim 2.
The user interface is
A photographing direction recording device characterized by being represented by arrows indicating four directions of north, south, east, west, and four directions of northeast, northwest, southeast, and southwest. The shooting direction recording device according to any one of claims 1 to 4.
The display information generation unit
A shooting orientation recording device characterized by displaying a user interface for setting a reference orientation on the drawing or image. The shooting direction recording device according to claim 5.
The display information generation unit
A shooting direction recording device, characterized in that an icon indicating the shooting direction with respect to the reference direction as an arrow direction is displayed at a shooting position where the touch operation is accepted. The shooting direction recording device according to claim 2.
It also has a storage unit that stores captured images.
The display information generation unit
When the touch to the predetermined icon on the first screen is accepted, the third screen that accepts the touch operation on the drawing or image is displayed.
When the touch operation is accepted, the captured image stored in the storage unit is displayed in a selectable manner.
Display a user interface that allows you to select the shooting orientation of the selected image,
The shooting direction identification unit is
The user-selected azimuth is specified as the shooting azimuth of the selected image,
The display information generation unit
It is characterized in that an icon of a predetermined form indicating the shooting direction is displayed at a position on the drawing or an image where the touch operation is received, and the third screen in which the shot image is arranged at a predetermined position is displayed. Shooting direction recording device. The shooting direction recording device according to any one of claims 1 to 7.
When a touch to the predetermined icon on the first screen is received, a drawing unit for drawing according to the locus of the touch position on the drawing or image or the captured image is further provided. Azimuth recorder. The shooting direction recording device according to claim 1.
The display information generation unit
When the touch to the predetermined icon on the first screen is accepted, the fourth screen that accepts the touch operation on the drawing or image is displayed.
When an image is taken by a camera activated based on the touch operation, the fourth screen displaying the taken image is displayed at a position on the drawing or the image where the touch operation is received. Shooting direction recording device. The shooting direction recording device according to claim 1.
An identification number is assigned to the icon indicating the shooting direction, and an overall control unit for generating the icon, the shooting position on the drawing or the image, the shooting direction, and the management information associated with the shot image is further provided.
The display information generation unit
Enter the identification number to display a dialog that accepts the search instruction for the icon.
The overall control unit
Based on the identification number of the icon that received the input, the shooting position, shooting direction, and shot image of the icon on the drawing or image are specified.
The display information generation unit
A shooting orientation recording device for displaying the specified icon and the shot image on the drawing or image. The shooting direction recording device according to claim 1.
The display information generation unit
When the touch to the predetermined icon on the first screen is accepted, the icon indicating the shooting direction is selectively displayed on the drawing or the image.
Shooting orientation recording, which generates format information in which an image shot at the shooting position and shooting direction of the selected icon and the drawing or image including the selected icon are arranged at predetermined positions. apparatus. The shooting direction recording device according to claim 1.
It also has a communication unit that sends information to external devices.
The communication unit
A shooting orientation recording device, characterized in that construction information including the drawing or image including the icon indicating a shooting position and shooting direction and the shot image is transmitted to the external device. A shooting direction recording system having a shooting direction recording device and a server device having a built-in camera and a direction sensor.
The shooting direction recording device is
An input reception unit that accepts touches on the display screen,
A first screen displaying a predetermined drawing or image and an icon for receiving an execution instruction of a predetermined function is displayed, and when a touch to the icon is accepted, a second screen that accepts a touch operation on the drawing or image is received. Display information generator that displays the screen and
When the touch operation is accepted, the camera is activated, and the shooting direction specifying unit that specifies the shooting direction of the image taken by using the output information from the direction sensor, and the shooting direction specifying unit.
The drawing or image including the icon indicating a shooting position and a shooting direction, and a communication unit for transmitting construction information including the shot image to the server device.
The server device
An information storage unit that stores the construction information acquired from the shooting direction recording device, and
A shooting direction recording system including an information transmission / reception unit that transmits the construction information to be requested to the shooting direction recording device when receiving a display request from the shooting direction recording device. This is a shooting direction recording method performed by a shooting direction recording device with a built-in camera and direction sensor.
The shooting direction recording device is
An input reception step that accepts touches on the display screen,
A first screen displaying a predetermined drawing or image and an icon for receiving an execution instruction of a predetermined function is displayed, and when a touch to the icon is accepted, a second screen that accepts a touch operation on the drawing or image is received. Display information generation step to display the screen and
When the touch operation is accepted, the camera is activated, and a shooting direction specifying step of specifying the shooting direction of the captured image using the output information from the direction sensor is performed.
In the display information generation step,
The feature is that an icon of a predetermined form indicating the shooting direction is displayed at a position on the drawing or image where the touch operation is received, and the second screen in which the shot image is arranged at a predetermined position is displayed. Shooting direction recording method. A program that allows a computer with a built-in camera and orientation sensor to function as a shooting orientation recorder.
The shooting direction recording device
An input reception unit that accepts touches on the display screen,
A first screen displaying a predetermined drawing or image and an icon for receiving an execution instruction of a predetermined function is displayed, and when a touch to the icon is accepted, a second screen that accepts a touch operation on the drawing or image is received. Display information generator that displays the screen and
When the touch operation is accepted, the camera is activated and functions as a shooting direction specifying unit that specifies the shooting direction of the image taken by using the output information from the direction sensor.
The display information generation unit
It is characterized in that an icon of a predetermined form indicating the shooting direction is displayed at a position on the drawing or image where the touch operation is received, and the second screen in which the shot image is arranged at a predetermined position is displayed. Program to do.

Images