JP2008211837A - Image photographing apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To speedily and surely instruct and perform photographing in an image photographing apparatus which performs photographing on the basis of photography schedule information such as working steps. <P>SOLUTION: When a key corresponding to a recording function of an input section 22 is operated during a speech (S231), voice information received by a communication control section 28 is stored in a voice instruction storage section 254 (S232). When the stored voice information is instructed to be played (S233), the voice information is played (S234). When a release key is pressed while the voice information is played (S235), a photographing target is photographed by a photographing section 27 and photographic image information is recorded (S236). A text of mail indicating that the relevant photographing is based on a voice instruction is then created (S237), this mail text is added with the voice information and the photographic image information and transmitted to a personal computer 1 via the communication control section 28, and a transmission completion flag corresponding to the photographic image information is turned to "transmitted" (S238). <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image photographing apparatus such as a portable terminal with a camera that receives a series of photographing plan information from a management apparatus that creates and records photographing plan information of a series of work processes, and performs photographing according to the photographing plan information, and a program.

  Generally, in public works and the like, a work process at a construction site is recorded by a photographing device such as a digital camera. This construction record photograph is used as a record of the construction status and as a material of the completed parts that cannot be seen after completion of the construction, and is positioned as one of the important items in construction management. Prior to the start of the construction, the construction record photograph is taken in accordance with the photography plan after creating a construction record photograph plan and obtaining the approval of the orderer.

As a digital camera system for taking a work record photograph such as a construction photograph, for example, Patent Document 1 discloses image data photographed by a digital camera by transmitting photographing information input by a computer to the digital camera. An apparatus (system) is proposed that returns the shooting information to the computer and completes and manages the image database on the computer side.
JP 2001-24982 A

  However, data communication between the digital camera and the computer requires a cable such as a USB, and there is a trouble of connecting the digital camera to the computer. Moreover, it is necessary to perform a predetermined operation to take in the data, which is troublesome. there were.

  An object of the present invention is to enable quick and reliable shooting instruction and shooting in an image shooting apparatus that performs shooting based on shooting plan information such as a work process.

  The image capturing apparatus of the present invention includes means for storing received sound information, means for reproducing the stored sound information, image capturing means for capturing an image, and image capturing by the image capturing means during reproduction of the sound information. Means for determining whether or not the photographed image is taken during reproduction of the voice information, means for creating information indicating that the photographed image is based on a voice instruction, and the created It is characterized by comprising information indicating that it is based on a voice instruction and a transmission means for transmitting a photographed image photographed during reproduction of the voice information.

  According to the present invention, voice information indicating a shooting instruction or the like is received, and shooting is performed during playback, and information indicating that the shot image is based on the voice instruction is created, Since this information and the photographed photographed image are transmitted, an instruction such as photographing plan information is received by voice, and a necessary image can be photographed quickly, and the photographed image is based on which photographing instruction. Can be sure.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
First, the configuration will be described.
FIG. 1 is a diagram showing an overall configuration of an imaging apparatus (hereinafter referred to as an imaging system) 100 in the present embodiment.
The photographing system 100 is a system that manages photographing of each work process constituting a series of work processes. As shown in FIG. 1, the personal computer 1 and the mobile phone 2 are mutually connected via the radio base station A and the network NT. It is configured to be connected so that data can be transmitted and received.

  Although a series of work processes for managing shooting by the shooting system 100 may be any, in the present embodiment, a case where shooting of each work process of construction is managed will be described as an example.

  The personal computer 1 serving as a management apparatus creates and records a series of shooting plan information for shooting each work process constituting a series of work, and attaches this shooting plan information to an e-mail (hereinafter referred to as an e-mail). The mobile phone 2 and receiving from the mobile phone 2 each shooting plan information and the shooting image information corresponding to each shooting plan information, classifying the shooting image information of each work process constituting a series of construction, It is something to manage.

  A mobile phone 2 as a camera-equipped mobile terminal is a mobile terminal having a function of performing voice communication with an external device, a mail transmission / reception function, and a shooting function, and a series of shooting plan information regarding construction is attached from the personal computer 1. The mail is received, and the photographed image information photographed based on the received photographing plan information is associated with the photographing plan information, attached to the mail, and transmitted to the personal computer 1. In FIG. 1, the mobile phone 2 is shown as one unit, but the present invention is not limited to this.

  The network NT is a communication network constructed using a dedicated line or an existing general public line, and various line forms such as a LAN (Local Area Network) and a WAN (Wide Area Network) can be applied. is there. The network NT includes, for example, various communication line networks such as a telephone line network, an ISDN line network, a dedicated line, a mobile communication network, a communication satellite line, and a CATV line network, and an Internet service provider that connects them.

  The radio base station A is connected to the network NT, and transmits and receives data between the mobile phone 2 in the area managed by the radio base station A and the personal computer 1 connected to the network NT. In FIG. 1, the radio base station A is illustrated as one unit, but the present invention is not limited to this.

Next, the internal configuration of the personal computer 1 will be described with reference to FIG.
FIG. 2 is a block diagram showing a functional configuration of the personal computer 1. As shown in FIG. 2, the personal computer 1 includes a CPU (Central Processing Unit) 11, an input unit 12, a display unit 13, a RAM (Random Access Memory) 14, a recording unit 15, a communication control unit 16, and the like. Each part is connected by a bus 17.

  The CPU 11 reads out a system program stored in the recording unit 15, develops it in a work memory formed in the RAM 14, and controls each unit according to the system program. In addition, the CPU 11 stores shooting plan data creation and mail transmission processing program, mail reception processing program, voice processing program, automatic classification recording processing program, various processing programs such as mail software, and various application programs stored in the recording unit 15. The data is read out and expanded in the work memory, and shooting plan data creation and mail transmission processing (see FIG. 5), mail reception processing (see FIG. 13), voice processing (see FIG. 14), automatic classification recording processing (see FIG. 15) described later. Various processes including the above are executed, and the processing results are stored in the work memory in the RAM 14 and displayed on the display unit 13. Then, the processing result stored in the work memory is stored in a designated storage location in the recording unit 15.

  The input unit 12 includes a keyboard having character / alphanumeric input keys, cursor keys, various function keys, and the like, and a mouse that is a pointing device. An operation signal from the mouse is output to the CPU 11 as an input signal.

  The display unit 13 is configured by an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube), or the like, and displays various screens on the display screen according to instructions of a display signal input from the CPU 11.

  The RAM 14 forms a work area that temporarily stores a system program executed by the CPU 11 as a buffer, various processing programs, application programs, data being processed in each processing, processing results, and the like. For example, as shown in FIG. 2, the RAM 14 is received from the mobile phone 2 and an unclassified image area 141 that temporarily stores unclassified captured image information attached to an email received from the mobile phone 2. And an uncategorized voice area 142 for temporarily storing uncategorized voice information attached to the mail.

  The recording unit 15 includes a system program corresponding to the personal computer 1, a shooting plan data creation and mail transmission processing program, a mail reception processing program, a voice processing program, an automatic classification recording processing program, various processing programs such as mail software, and various application programs. Various data are recorded in advance, and the recording unit 15 includes a magnetic, optical recording medium, or a recording medium readable by the CPU 11 such as a semiconductor memory. This recording medium includes a portable medium such as a CD-ROM (Compact Disc Read Only Memory) and a memory card, and a fixed medium such as a hard disk. The program, data, and the like stored in the recording medium may be configured to be received from the communication control unit 16 via a network such as WAN or LAN from a server or a client. May be a server or client recording medium built on a network.

  The recording unit 15 records a shooting plan data file 151 created for each construction in shooting plan data creation and mail transmission processing (see FIG. 5), which will be described later. FIG. 4 shows an example of the shooting plan data file 151. The shooting plan data file 151 records a series of shooting plan information relating to a series of work processes. As shown in FIG. 4, the shooting plan data file 151 indicates the order of shooting and identification for uniquely identifying each shooting plan information. “Shooting plan number” as information, and “Category”, “Work type”, “Type”, “Subdivision”, “Title”, “Shooting time”, “Shooting location”, “Comment”, “Shooted flag” This is a database that stores data of shooting plan information of each work process in the work to be shot in association with the shooting plan number. This shooting plan data file 151 is created for each construction, and in the header, construction information such as “construction number”, “construction title”, “ordering year” for uniquely identifying the construction In addition, data such as “orderer name (ministry name, department name)” and the like, and contractor information such as “branch name” and “official name of contractor” are stored.

  In addition, the recording unit 15 records a keyword file 152 that stores character information serving as keywords and combinations of “category”, “work type”, and “type” used in the shooting plan information in association with each other. The keyword file 152 is a file created based on a result of empirically determining a combination of “classification”, “work type”, and “type” of the work process of the construction in which the photographing target represented by the character information serving as the keyword is photographed. . Furthermore, the recording unit 15 includes an image / sound storage unit 153 that records and stores the captured image information and the sound information received from the mobile phone 2.

  The communication control unit 16 is configured by a network card or the like for communicating with an external device, and communicates with a device connected to the network NT.

Next, the mobile phone 2 will be described with reference to FIG.
FIG. 3 is a block diagram showing a functional configuration of the mobile phone 2. As shown in FIG. 3, the cellular phone 2 includes a CPU 21, an input unit 22, a display unit 23, a RAM 24, a recording unit 25, a voice input / output unit 26, a photographing unit 27, a communication control unit 28, and the like. 29 is connected.

  The CPU 21 reads a system program stored in the recording unit 25, develops it in a work memory formed in the RAM 24, and controls each unit according to the system program. Further, the CPU 21 reads out a shooting plan addition processing program, a shooting processing program, a shooting processing program according to a voice instruction, various processing programs such as mail creation and transmission processing, and application programs such as mail software stored in the recording unit 25. The processing is expanded in the work memory, and a shooting plan addition process (see FIG. 7), a shooting process (see FIG. 8), a shooting process (see FIG. 10) according to a voice instruction, and an e-mail creation and transmission process (see FIG. 11) are started. The processing results are stored in the work memory in the RAM 24 and displayed on the display unit 23. Then, the processing result stored in the work memory is stored in a specified storage destination in the recording unit 25.

  The input unit 22 includes a cursor key, character / number keys, various function keys, and the like, and outputs a press signal by the key operation to the CPU 21.

  The display unit 23 is configured by an LCD panel or the like, and performs screen display based on display data input from the CPU 21.

  The RAM 24 forms a work area that temporarily stores various programs, data being processed, processing results, and the like as a buffer. For example, the RAM 24 has a current work number storage area 241 for storing a work number for identifying the work currently being photographed.

  The recording unit 25 is configured by a non-volatile memory such as a flash memory, and the system program corresponding to the mobile phone 2, various processing programs that can be executed on the system program, application programs, data processed by these programs, and the like Record.

  The recording unit 25 records the shooting plan data file received from the personal computer 1 as the shooting plan data file 251. In addition, the recording unit 25 records and stores the captured image information in a folder for each construction number and stores the captured image information in a folder for each construction number. It has a comment storage unit 253 and a voice instruction storage unit 254 that records and stores voice information of voice instructions obtained through a call.

  The voice input / output unit 26 includes a microphone, a speaker, an amplifier, an A / D conversion unit, a D / A conversion unit, and the like, converts a user's voice signal input from the microphone into digital voice information, and the voice information. Is output to the CPU 21, and voice information input from the CPU 21 during reception, voice information such as a ringtone and operation confirmation sound is converted into an analog voice signal, amplified, and output from the speaker.

  The photographing unit 27 includes an optical lens made of glass or plastic, an image pickup device such as a CCD (Charge Coupled Diode) or a CMOS (Complementary Metal Oxide Semiconductor), an A / D converter, and the like, and is input via the optical lens. An image to be captured is converted into an electrical signal by an image sensor, and further A / D converted to generate digital captured image information. When the release key (shutter key, the same applies hereinafter) of the input unit 22 is pressed, the photographing unit 27 performs photographing of the subject.

  The wireless communication unit 28 includes a wireless communication unit including an antenna 281, and transmits / receives various information to / from each device on the network NT via the wireless base station A in accordance with an instruction input from the CPU 21.

Next, the operation of the present embodiment will be described.
<Shooting plan data creation and email transmission processing>
FIG. 5 is a flowchart showing photographing plan data creation and mail transmission processing executed by the CPU 11 of the personal computer 1. Hereinafter, with reference to FIG. 5, the shooting plan data creation and mail transmission processing executed by the CPU 11 of the personal computer 1 will be described. This process is a process executed when an instruction to create a shooting plan is given from the input unit 12.

  First, the photographing plan data creation screen 131 shown in FIG. 6 is displayed on the display unit 13 (step S101). Header information (“construction title”, “construction number”, “ordering year”, etc.) is input from the header information input area 131a of the imaging plan data creation screen 131 (step S102), and imaging is performed from the imaging plan information input area 131b. Shooting plan information (for example, “category”, “work type”, “type”, “subdivision” “title”, “shooting time”, “shooting location”, “comment”, etc.) When input is made in the order of shooting (step S103), and input of all shooting plan information of the construction to be shot is completed and the "confirm" button is pressed (step S104; YES), based on the input information Thus, a shooting plan data file 151 (see FIG. 4) is created and recorded in the recording unit 15 (step S105). In the shooting plan data file 151, the input header information is stored in the header area, and the input shooting plan information is stored according to the item. Information indicating the input order is stored in the item of the shooting plan number. Next, an e-mail attached with the shooting plan data file 151 is created (step S106), and the e-mail created by the communication control unit 16 is transmitted to the mobile phone 2 (step S107), and this process ends.

  The photographing plan data file 151 is created based on a standard document defined by the Ministry of Land, Infrastructure, Transport and Tourism, for example. Data necessary for the shooting plan may be extracted from data created at the time of construction planning, such as integration data and CAD data, and the shooting plan data file 151 may be created based on the extracted data. Also, image data and graphic data such as a design drawing of a photographing object and a place, a photograph, etc., and graphic data are input and stored in the photographing plan data file 151 in association with the photographing plan information, and the photographing plan data file including image data and graphic data is stored. 151 may be transmitted to the mobile phone 2 and these images may be displayed on the display screen of the mobile phone 2.

  For work processes that require voice input of comments regarding the construction site status, such as work processes for which construction details or changes in the members to be used are predicted, “From the comment column of the imaging plan information input area 131b” By inputting “Voice Comment Required” or the like, it becomes possible to identify a work process in the cellular phone 2 that requires voice comment input.

  When the mail from the personal computer 1 is received, the mobile phone 2 records the shooting plan data file attached to the received mail in the recording unit 25 as the shooting plan data file 251. A plurality of shooting plan data files 251 may be recorded in response to an email transmitted from the personal computer 1. Further, when receiving an e-mail from the personal computer 1, the mobile phone 2 determines whether or not the e-mail with the shooting plan data file attached is received, and the e-mail with the shooting plan data file attached is received. If there is, it is notified, and a menu screen including a shooting plan menu is displayed on the display unit 23, and if the user selects the shooting plan menu, a shooting process described later may be executed.

<Shooting plan addition process>
In the mobile phone 2 in which the shooting plan data file 251 is recorded, shooting plan information can be created in accordance with the shooting plan suddenly generated at the construction site and added to the shooting plan data file 251.
FIG. 7 is a flowchart showing a shooting plan addition process executed by the CPU 21 of the mobile phone 2. Hereinafter, the imaging plan addition process will be described with reference to FIG. This process is a process executed by selecting a shooting plan addition menu from the menu screen displayed on the display unit 23 of the mobile phone 2.

  First, the construction subject is extracted from the header information of each shooting plan data file 251 recorded in the recording unit 25, and the construction subject list screen is displayed on the display unit 23 (step S201). When a construction subject is selected from the construction subject list screen using the cursor key of the input unit 22 (step S202), a shooting plan data addition screen is displayed on the display unit 23 (step S203), and the input unit 12 is displayed according to the items on the screen. When the shooting plan information is input using the character / number key (step S204), the input shooting plan information is added to the shooting plan data file 251 corresponding to the selected construction subject (step S205). The input items of the shooting plan data addition screen are the same items as those in the shooting plan information input area 131b of the shooting plan data creation screen 131 shown in FIG. However, since the display screen of the mobile phone 2 is small, it is possible to input one shooting plan information from one shooting plan data addition screen, and the next page corresponding to the “next page” display on the display screen. A shooting plan data addition screen for inputting next shooting plan information is displayed by operating a key or the like. The photographing plan number is automatically set to a value obtained by adding 1 to the final photographing plan number stored in the photographing plan data file 251 corresponding to the selected construction subject.

  Steps S204 to S205 are repeatedly executed until input of all shooting plan information to be added is completed. When input of all shooting plan information to be added is completed (step S206; YES), this process ends.

  In addition, in the shooting plan data addition screen of the mobile phone 2, by inputting “Voice comment required” or the like from the comment field, a work process that requires voice input in the mobile phone 2 at the time of shooting is identified. It becomes possible.

  In addition, the shooting plan information can be corrected in the mobile phone 2. The correction is performed by the following procedure.

  When the shooting plan correction menu is selected from the menu screen displayed on the display unit 23 of the mobile phone 2, the construction subject is extracted from the header information of each shooting plan data file 251 recorded in the recording unit 25. 23, a construction subject list screen is displayed, and when a construction subject is selected by the cursor key of the input unit 22, a title list screen displaying a list of shooting plan information titles in order of shooting numbers is displayed on the display unit 23. When the title of the shooting plan information is selected with the 22 cursor keys, a shooting plan information correction screen corresponding to the selected title is displayed. When correction of the shooting plan information is input from this correction screen, the shooting plan data file 251 corresponding to the selected construction subject is corrected.

  If it is necessary to input a comment by voice in advance at the work site, by inputting “Voice comment required” or the like in the comment field from this correction screen, the voice can be input from the mobile phone 2 at the time of shooting. It is possible to identify a work process that requires input of a comment.

<Shooting process>
FIG. 8 is a flowchart showing a photographing process executed by the CPU 21 of the mobile phone 2. Hereinafter, with reference to FIG. 8, a photographing process executed by the CPU 21 of the mobile phone 2 will be described. This process is a process executed when a shooting plan menu is selected from the menu screen displayed on the display unit 23 of the mobile phone 2. That is, when the shooting plan menu is selected, the mobile phone 2 is switched from a device having a telephone function to a device having a function of taking a construction photograph.

  First, the construction subject is extracted from the header information of each shooting plan data file 251 recorded in the recording unit 25, and the construction subject list screen 231 is displayed on the display unit 23 (step S211). FIG. 9A shows an example of the construction subject name list screen 231. When the photographing of all work processes has been completed, a mark is added to the “Done” column.

  When a construction subject is selected by the cursor key of the input unit 22 (step S212), a title list screen 232 displaying a list of shooting plan information titles in order of shooting number is displayed on the display unit 23 (step S213). FIG. 9B shows an example of the title list screen 232. A work process for which shooting has been completed is displayed with a mark in the “done” column.

  When the title of the shooting plan information is selected by the cursor key of the input unit 22 (step S214), shooting plan information corresponding to the selected title is displayed (step S215). Here, if a comment such as “Voice input required” is input in the comment field in advance, the photographer is a process in which the work process corresponding to the shooting plan information is required to input the situation at the site by voice. It becomes possible to recognize that.

  Next, pressing of the release key is waited (step S216, although not shown, the operation returns to step S213 if the release key is operated during standby), and when the release key is pressed (step S216; YES), The photographing object 27 is photographed by the photographing unit 27, and photographed image information is recorded (step S217). When the input of the voice comment is instructed (S218; YES), the voice input from the microphone of the voice input / output unit 26 is recorded (recorded) (step S219). The displayed shooting plan information is associated with the input shot image information and voice information, and the shot image information is recorded and stored in the shot image storage unit 252 and the voice information is stored in the voice comment storage unit 253. (Step S220). Specifically, the captured image information and the audio information are each recorded as one file, and the shooting plan information is stored in a predetermined area (for example, a header area, which will be described below as being stored in the header area) of each file. The construction number and shooting plan number are recorded. Thus, each file is associated with the shooting plan information. Also, “completed” information is added to the captured flag area of the imaging plan information of the imaging plan data file 251 that has been captured (step S221).

  After shooting, it is confirmed whether or not shooting of all work processes has been completed. If the shooting has not been completed (step S222; NO), the process proceeds to step S223 to display a title list of the next shooting plan number. In this case, when the final line “underground cableway / heading” shown in the title list screen 232 shown in FIG. 9B is completed, the “underground cableway / burial” of the next shooting plan number becomes the last line. Is displayed, and the screen is scrolled up so that “water supply / root cutting / laying” in the first line is deleted. If it is desired to display the title of the shooting plan number not in the title list display, the title list screen is scrolled by the scroll key. Thereafter, the process returns to step S214, and steps S214 to S222 are repeatedly executed. And when imaging | photography of all the work processes is complete | finished (step S222; YES), this process is complete | finished.

<Shooting process according to voice instructions>
In addition, for example, there is a case in which a shooting instruction is transmitted by voice communication of the mobile phone 2 during the construction from the headquarters that supervises the construction. In such a case, it is possible to store a sound and perform shooting according to the sound.

  FIG. 10 is a flowchart of the photographing process according to the voice instruction executed by the CPU 21 of the mobile phone 2. Hereinafter, the imaging process according to the voice instruction will be described with reference to FIG.

  When a key corresponding to the recording function of the input unit 22 is operated during a call (step S231), the voice information received by the communication control unit 28 is stored in the voice instruction storage unit 254 (step S232). This audio information is saved as a file, and the construction number currently stored in the construction number storage area 241 is stored in the header area. When reproduction of the stored audio information is instructed by the input unit 22 (step S233; YES), the audio information is reproduced (step S234), and the release key is pressed during reproduction of the audio information (step S235). YES), the photographing object 27 is photographed and the photographed image information is recorded (step S236). This audio information is recorded as a file, and the construction number currently stored in the construction number storage area 241 is stored in the header area. Then, a mail text indicating that the shooting is based on a voice instruction is created in a predetermined format (step S237), and voice information and photographed image information are attached to the mail text. It is transmitted to the personal computer 1, and the transmitted flag corresponding to this captured image information is transmitted (step S238).

<Mail creation and transmission processing>
After the end of photographing in a series of work steps, the cellular phone 2 creates a mail attached with photographed image information and transmits it to the personal computer 1. FIG. 11 is a flowchart of the mail creation / transmission process executed by the CPU 21. The mail creation / transmission process will be described below with reference to FIG. This process is a process that is executed when an instruction to transmit the shooting plan information based on the shooting plan is given from the input unit 22 of the mobile phone 2.

  First, the construction number of the construction currently being photographed that is stored in the current construction number storage area 241 of the RAM 24 is referred to, and the number of the photographed image information files in the folder corresponding to the construction number in the photographed image storage unit 252 N is counted (step S241). In addition, the initial value 1 is stored in the counter n (step S242).

  Next, from the shooting plan data file 251 corresponding to the construction number, it corresponds to the shooting plan number stored in the header area of the shooting image information stored nth in the folder of the construction number in the captured image storage unit 252. The shooting plan information is acquired (step S243), and it is determined whether or not the shooting image information corresponding to the acquired shooting plan information has already been transmitted. If the acquired shooting plan information is associated with the transmitted flag and the captured image information corresponding to the shooting plan information has been transmitted (step S244; YES), the process proceeds to step S250.

  On the other hand, when the acquired shooting plan information is not associated with the transmitted flag and the shooting image information corresponding to the shooting plan information is not transmitted (step S244; NO), a voice comment is added to the shooting image information. Are associated with each other (step S245), and if they are associated, the voice information of the voice comment is acquired from the voice comment storage unit 253 (step S246).

  Next, based on the shooting plan information, a mail text is created in a predetermined format (step S247). The contents of the e-mail text indicate, for example, what work process the captured image information attached by reading the e-mail, such as the classification of the construction number and shooting plan information, type of work, type, subdivision, etc. What can be discriminated is sufficient. FIG. 12 shows an example of the mail text created in step S247.

  When the email text is created, if there is shooting plan information, shot image information, and voice comment, the shooting plan information, shot image information, and voice comment voice information are attached to the created email text and stored in the transmission folder In step S248, the transmission completion flag is added to the shooting plan information (step S249), and the process proceeds to step S250.

  In step S250, the counter n is incremented (step S250). If n> N is not satisfied, that is, if n does not exceed the number of captured image information files stored in the folder (step S251; NO), processing is performed. Returns to step S243, and steps S243 to 251 are repeatedly executed. If n exceeds the number of captured image information files stored in the folder (step S251; YES), the mail data in the transmission folder is transmitted to the personal computer 1 by the communication control unit 29 (step S252). finish.

<Mail reception processing>
FIG. 13 is a flowchart of mail reception processing executed by the CPU 11 of the personal computer 1. Hereinafter, the mail reception process will be described with reference to FIG. The process is a process executed every predetermined time.

  First, it is determined whether or not a new mail has been received via the communication control unit 16 (step S111). If a new mail has not been received (step S111; NO), this process ends. If a new mail has been received (step S111; YES), the contents of the received new mail are determined, and it is determined whether or not the received new mail is a mail related to construction photography (step). S112). That is, the text of the received new mail is a mail indicating attachment of a captured image by a voice instruction created in step S237 of FIG. 10 or a mail indicating the contents of the shooting plan information created in step S247 of FIG. If there is, it is determined that the email is related to construction photography.

  If the received new mail is not a mail related to construction photography (step S112; NO), a normal mail reception process is performed (step S113), and this process ends. That is, the received mail is stored in the reception folder.

  When the received new mail is a mail relating to construction shooting (step S112; YES), and the mail is a mail indicating attachment of photographed image information by voice instruction (step S114; YES), it is shot by voice instruction. Audio processing for classifying the captured image information is executed (step S115).

  FIG. 14 is a flowchart showing the audio processing executed by the CPU 11 in step S115. Hereinafter, the audio processing will be described with reference to FIG.

  First, the voice information attached to the received new mail is converted into character information (step S301). Next, the keyword file 152 is referred to, the converted character information is used as a keyword, and the combination of “category”, “work type”, and “type” of the shooting plan information corresponding to the keyword is determined and recorded in the recording unit 15. Shooting plan information including a combination of the determined “section”, “work type”, and “type” is searched from the shooting plan data file 151 corresponding to the construction (step S302). Then, the photographed image information attached to the mail is associated with the retrieved photographing plan information (step S303), that is, the photographing plan number of the photographed plan information retrieved in the header area of the photographed image information attached to the mail. Is stored, and the process proceeds to step S119 in FIG.

  In FIG. 13, when the received new mail is a mail related to construction shooting (step S112; YES), and the mail is not a mail with a photographed image attached by voice instruction, that is, the mail is the shooting plan information. If it is an email indicating the contents (step S114; NO), the contents of the shooting plan data file 151 stored in the recording unit 15 are updated based on the shooting plan information (step S116). For example, when the content of the corresponding shooting plan information does not match the content attached to the mail, the content of the shooting plan data file 151 stored in the recording unit 15 is replaced with the content attached to the mail. If there is no corresponding shooting plan information, it is added to the shooting plan data file 151 stored in the recording unit 15.

  In addition, when voice information is attached to an email indicating the contents of the shooting plan information, that is, when there is a voice comment corresponding to the attached shot image information (step S117; YES), it is attached to the email. Audio information is stored in the uncategorized audio area 142 (step S118), and the process proceeds to step S119.

  In step S119, the captured image information attached to the received mail is stored in the unclassified image area 141 of the RAM 14. Steps S112 to S120 are repeatedly executed for all received new mails. When all new mails are finished (step S120; YES), automatic classification recording processing is executed (step S121), and this process ends.

  FIG. 15 is a flowchart showing the automatic classification recording process executed by the CPU 11 in step S121. Hereinafter, the automatic classification recording process will be described with reference to FIG.

  First, it is determined whether or not the image / sound storage unit 153 of the recording unit 15 has created a folder hierarchical structure for storing captured image information of the shooting plan data file 151 relating to the construction (step S311). If not (step S311; NO), all shooting plan information in the shooting plan data file 151 is acquired, and a folder hierarchical structure is created in accordance with the classification system of each shooting plan information (step S312).

  FIG. 16 shows an example of a folder hierarchy structure according to the classification system of each shooting plan information created in step S312. As shown in FIG. 16, in the image / sound storage unit 153, the first hierarchy is a folder of “construction subject” (for example, XX road pavement), and the second hierarchy is a folder of “classification” (for example, completed form). Management), the third layer is a folder of “work type” (for example, pavement), the fourth layer is a folder of “type” (for example, roadbed worker 1, roadbed worker 2,...), And the fifth layer is “shooting plan”. A folder hierarchy structure is created, which is a folder of “number” (for example, “001”, “002”, “003”...).

  Next, the captured image information files stored in the unclassified image area 141 of the RAM 14 are accessed one file at a time from the beginning, and are specified as the captured image information files to be processed (step S313). Next, the shooting plan number in the header area of the identified file is read (step S314), and it is checked whether or not there is a folder corresponding to the shooting plan number (step S315). If there is no corresponding folder corresponding to the photographing plan number, a folder for storing a photographed image information file having this photographing plan number is created (step S316), and the photographed image information file is stored in the corresponding folder. The stored image information stored in the unclassified image area 141 is deleted (step S317). Steps S313 to 317 are repeatedly executed for all the files of the photographed image information stored in the unclassified image area 141. When all the files are finished and there is no unclassified photographed image information (step S318; NO), The processing moves to step S319.

  In step S319, the uncategorized audio area 142 of the RAM 14 is accessed one file at a time from the beginning, and is specified as the audio information file to be processed (step S319). Next, the shooting plan number in the header area of the specified file is read (step S320), the specified audio information file is stored in the corresponding folder, and the audio information file in the unclassified area is deleted ( Step S321). Steps S319 to S321 are repeatedly executed for all files of audio information stored in the uncategorized audio area 141. When all files are finished and there is no uncategorized audio information (step S322; NO), this processing is performed. Ends.

When classifying photographic image information, based on the text information of the photographic plan information described in the email text, the "plan", "work type", "type", etc. of the photographic plan information corresponding to the photographic image information are recognized. The captured image information attached to the mail may be automatically classified based on the recognized information.
The classification of the shooting plan information and the shot image information can be corrected and edited by the personal computer 1.

  As described above, the shooting plan data file 151 is hierarchical information obtained by hierarchically classifying each work process constituting a series of works, and the CPU 11 of the personal computer 1 performs the automatic classification recording process from the mobile phone 2. When the received captured image information and audio information are classified, they are automatically classified and sorted in a hierarchical structure according to the shooting plan data file. This makes it possible to manage user-friendly images and voice comments. Even when creating a construction record album or the like for submission to the orderer based on each photographed image information, the creation becomes easy.

  As described above, according to the photographing system 100, the personal computer 1 attaches a photographing plan data file relating to a series of work processes to an e-mail and transmits it to the mobile phone 2. The received shooting plan data file is received and recorded, and shooting image information shot according to any shooting plan information of each shooting plan information constituting the recorded shooting plan data file corresponds to the shooting plan information. The recorded photographic image information and the corresponding photographic plan information are attached to an electronic mail and transmitted to the personal computer 1. In the personal computer 1, the received photographic image information is classified and recorded based on the corresponding photographic plan information.

  Therefore, transmission and reception of data including personal computer 1, mobile phone 2, and photographed image information can be performed using electronic mail that is currently used frequently, as in the case of conventional photographing with a digital camera. In addition, it is possible to easily transmit and receive data such as photographed image information without the need to connect the digital camera to a personal computer with a data communication cable and without requiring specialized knowledge.

  In addition, since the mobile phone 2 can further add shooting plan information to the shooting plan data file transmitted from the personal computer 1, it can add shooting plan information suddenly generated at the construction site. Shooting can be performed.

  The shooting plan data file 151 has a hierarchical structure in which each process of a series of work processes is hierarchically classified. The personal computer 1 uses the shooting image information based on the hierarchical structure of the series of shooting plan information. Are automatically classified, it is not necessary to manually classify the photographed image information and the photographed image information can be easily managed.

  In addition, the mobile phone 2 stores voice information of a shooting instruction instructed by a call, reproduces the voice information, performs shooting based on the voice information, and corresponds to the voice information of the shot image information. Attached to an e-mail and sent to the personal computer 1, the personal computer 1 converts the voice information received from the mobile phone 2 into characters, and classifies the received captured image information based on the conversion result. . Therefore, it is possible to perform shooting according to the shooting instruction transmitted to the construction site by voice communication, and it is possible to easily classify the captured image information shot according to the shooting instruction by voice.

  In addition, since the cellular phone 2 creates the text of the email based on the shooting plan information corresponding to the captured image information, the person who read the email with the personal computer 1 that received the email is attached to the email. It becomes possible to easily recognize what kind of shooting plan information the shot image information was shot.

  Further, when the personal computer 1 receives an e-mail created based on the shooting plan information in the camera-equipped mobile terminal, the personal computer 1 displays the taken image information attached to the e-mail based on the text information of the body of the e-mail. Since classification is performed, classification of captured image information is facilitated.

  In addition, the description content in the said embodiment is a suitable example of the imaging | photography system 100 which concerns on this invention, and is not limited to this.

  For example, in the above-described embodiment, the case where a series of work processes of construction is photographed has been described as an example. For example, the present invention is applicable when photographing maintenance inspection results of a power transmission tower or photographing according to a photographing plan, such as photographing an on-site photograph of an accident or disaster.

  In the above embodiment, the mobile phone 2 is used for shooting. For example, any device having a mail communication function and a shooting function such as a PHS, a camera-integrated personal computer, or a wearable computer may be used. .

Further, instead of attaching the shooting plan information to the e-mail as in the above embodiment, transmission / reception may be performed between the mobile phone 2 and the personal computer 1 as the body of the e-mail.
In addition, the detailed configuration and detailed operation of each apparatus constituting the imaging system 100 can be changed as appropriate without departing from the spirit of the present invention.

1 is a block diagram illustrating an overall configuration of a photographing system 100 according to the present invention. It is a block diagram which shows the functional structure of the personal computer 1 of FIG. It is a block diagram which shows the functional structure of the mobile telephone 2 of FIG. FIG. 6 is a diagram illustrating an example of data storage of a shooting plan data file 151. It is a flowchart which shows the photography plan data preparation and mail transmission process performed by CPU11 of FIG. It is a figure which shows an example of the imaging | photography plan data creation screen. It is a flowchart which shows the imaging | photography plan addition process performed by CPU21 of FIG. It is a flowchart which shows the imaging | photography process performed by CPU21 of FIG. 5 is a diagram illustrating an example of a construction subject list screen 231 and a title list screen 232; FIG. It is a flowchart which shows the imaging | photography process according to the audio | voice instruction | indication performed by CPU21 of FIG. It is a flowchart which shows the mail preparation transmission process performed by CPU21 of FIG. It is a figure which shows an example of the mail text produced by step S247 of FIG. It is a flowchart which shows the mail reception process performed by CPU11 of FIG. It is a flowchart which shows the audio | voice process performed by CPU11 of FIG. It is a flowchart which shows the automatic classification | category recording process performed by CPU11 of FIG. It is a figure which shows an example of the folder hierarchical structure matched with the classification system of photography plan information.

Explanation of symbols

100 Shooting System 1 Personal Computer 11 CPU
12 Input unit 13 Display unit 14 RAM
141 Unclassified image area 142 Unclassified voice area 15 Recording unit 151 Shooting plan data file 152 Keyword file 153 Image / sound storage unit 16 Communication control unit 2 Mobile phone 21 CPU
22 Input unit 23 Display unit 24 RAM
241 Current construction number storage area 25 Recording unit 251 Imaging plan data file 252 Captured image storage unit 253 Audio comment storage unit 254 Audio instruction storage unit 26 Audio input / output unit 27 Imaging unit 28 Communication control unit 281 Antenna

Claims (4)

Means for storing received audio information;
Means for reproducing the stored audio information;
Photographing means for photographing an image;
Means for determining whether or not photographing by the photographing means was performed during reproduction of the audio information;
Means for creating information indicating that the photographed image is based on a voice instruction when the photographing is performed during reproduction of the voice information;
An image photographing apparatus comprising: information indicating that the information is based on the created voice instruction; and transmission means for transmitting a photographed image photographed during reproduction of the voice information.   The image photographing apparatus according to claim 1, wherein the creating unit creates a mail text indicating that the photographed image is based on a voice instruction.   The transmission means further transmits the voice information to a management device, the management device converts the voice information into character information, and stores the photographed image corresponding to the converted character information. The image photographing device according to claim 1. Means for storing audio information received by the computer of the image capturing device;
Means for reproducing the stored audio information;
Photographing means for photographing images,
Means for determining whether or not photographing by the photographing means has been performed during reproduction of the audio information;
Means for creating information indicating that the photographed image is based on a voice instruction when the photographing is performed during reproduction of the voice information;
A program for functioning as transmission means for transmitting information indicating that the information is based on the created voice instruction and a photographed image photographed during reproduction of the voice information.

Images