JP2007128499A - Information processor and display control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a multimedia information terminal capable of preparing a database automatically only by storing multimedia information collected on site as it is without mapping an object on a map. <P>SOLUTION: A portable information processing device 4, an image input device 1 which photographs an object, a sound recording device 2 which records sound information, a GPS device 3 which outputs GPS information including coordinate information expressed as longitude and latitude and time information, and a cellular phone 5 are integrally housed and interconnected. The portable information processing device 4 is provided with: a function for fetching the multimedia information of image information and sound information and the GPS information; and a function for transmitting transmission data formed by making the multimedia information and the GPS information which are simultaneously collected into one set to a communication partner 10 with whom line connection is performed by the cellular phone 5. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a multimedia information terminal device effective for inputting multimedia information such as image data and audio data in order to create a database of a map information system with multimedia information.

  A conventional map information system can display an object such as a symbol on a map by superimposing the information attached to the object ID (identifier) and image information on the map. I have to. In order to display the attached information and image information in relation to the corresponding position on the map, it is necessary to associate the map data with the page number of the map data and the coordinate information on the map in advance, It is necessary to create a database with data such as ancillary information such as the trader name and image information of the construction site.

  Conventionally, as for the information of the database constructed in the database device, most of the data other than the map data has been manually input by the operator. Specifically, as shown in FIG. 7, a symbol is arranged at a location corresponding to a construction site on a map displayed using a map information system, and the ID of this symbol is registered in the symbol list. Along with the symbol registration, an auxiliary information file for storing the auxiliary information of the construction site and an image file for storing the image data of the construction site are determined and registered in the database. Then, the information indicating the location of the auxiliary information file storing the auxiliary information of the construction site and the image file storing the photographed image data of the construction site is registered in the symbol list in association with the symbol ID. In addition to image data, audio information recorded on-site along with shooting can be registered in a database in a file format in association with a symbol ID.

  When arranging corresponding image data or the like on the map of the map information system, it is necessary for the operator to select a symbol arranged on the map and give an instruction to arrange the image data or the like. Using the selected symbol ID as a key, the corresponding image file, auxiliary information file and audio information file are extracted from the database, the contents of the image file and auxiliary information file are displayed at the symbol position, and the audio information of the audio information file is displayed. Is output in a timely manner.

  However, when registering multimedia information (images, sounds) collected in the field in the database of the map information system, the complicated work of placing symbols at corresponding positions on the map and associating the information with the symbols is done manually by the operator. Because it relied on, it was not always good workability, and it took enormous effort and time to create a database in a wide area with a large amount of input information.

  The present invention has been made in view of the above circumstances, and provides a multimedia information terminal device capable of automatically constructing multimedia information collected in the field in a database without intervention of an operator's manual work. With the goal.

  In order to achieve the above object, according to one aspect of the present invention, image information for collecting image information for creating a beta base in which image information collected on-site is associated with a collection location on a map is collected. A terminal device, a portable information processing device, an image input device that captures a subject, a GPS device that outputs GPS information including coordinate information and time information expressed in longitude and latitude, and the portable information processing device. An operation switch for giving a command, an autodial function for connecting the mobile communication radio to a predetermined communication partner and a mobile communication radio are housed and connected in an integrated manner, and the portable information processing is performed. A function of capturing image information of a subject photographed by the image input device and GPS information output from the GPS device when the image information is collected into the device; and the mobile communication wireless And a function for sending transmission data that is a set of image information and GPS information collected simultaneously to a communication partner that is connected to the line via the above-described processing from the capture of the image information and GPS information to transmission to the communication partner Is started by turning on the operation switch. An image information terminal device is provided.

  As described above in detail, according to the present invention, it is possible to automatically create a database by simply saving multimedia information collected on site without mapping an object that represents position information on a map. And a map information system database can be easily created. In addition, when storing multimedia information and GPS information in a file format, the file name can be uniquely determined without duplication, and it is not necessary for the worker to specify each time. The workability of workers during storage can be improved dramatically. Furthermore, since a worker only needs to perform a single switch operation in a series of processes from collection to transmission of multimedia information, the burden on the worker can be greatly reduced.

  Embodiments of the present invention will be described below. FIG. 1 shows the configuration of the multimedia information terminal device of the present embodiment. This multimedia information terminal device includes a digital still camera 1 for inputting an on-site image, a microphone 2 for recording sound on the site, a GPS (Global Positioning System) device 3 for receiving position information from a satellite, multimedia information A portable personal computer (hereinafter referred to as “portable PC”) 4 that functions as a take-in and storage unit, a mobile phone 5 that transmits multimedia information, and the like are integrally stored in a storage case. However, the digital still camera 1 and the microphone 2 are connected to the portable PC 4 via a cord.

  The digital still camera 1 includes a strobe, and converts color image information of a subject imaged by an image pickup device including a CCD into a general video signal and outputs the video signal. The photographing operation of the digital still camera 1 can be controlled from the portable PC 4. The microphone 2 converts the voice collected on site into a general voice signal and outputs it. The operator can operate the microphone 2 by a switch provided on the microphone 2. The digital still camera 1 and the microphone 2 collect multimedia information on site.

  The GPS device 3 can obtain longitude / latitude information when three GPS satellites are received, and can obtain altitude information when four or more are received. The GPS device 3 calculates a moving speed and a moving direction from the longitude / latitude information and time information, and periodically outputs them in a predetermined format together with the longitude / latitude information and date / time information of Greenwich time. The GPS device 3 is of a type that can be connected to the portable PC 4 with a PCMCIA card, and periodically outputs latitude / longitude information, Greenwich date / time information, moving speed information, and moving direction information to the portable PC 4.

  The portable PC 4 incorporates an information storage HDD 6 for temporarily storing multimedia information taken from the digital still camera 1 and the microphone 2 and GPS information taken from the GPS device 3 in a file format. Further, the portable PC 4 is connected with an operation switch 7 for an operator to input a series of processing triggers from the collection of multimedia information to transmission for registration in a database to be described later. An earphone 8 serving as a voice output unit for a synthesized sound that conveys the situation to the operator is connected.

  The mobile phone 5 can be connected to a workstation on the center side by the auto-dial function of the portable PC 4. The multimedia information and the GPS information stored in the information storage HDD 6 are read by the portable PC 4 and transmitted to the work station on the center side via the telephone line network 9.

  FIG. 2 is a conceptual diagram showing the relationship between a plurality of multimedia information terminal devices carried by workers at each site and the center. In the center 10, a workstation 11 and a database apparatus 12 are installed. A database of the map information system is constructed in the database device 12. The map information system is provided by activating the software of the map information system installed in the workstation 11.

  FIG. 3 shows the database structure of the map information system constructed in the database device 12. In addition to files that store map data, image files that store image data collected on-site, audio information files that store audio collected on-site, GPS information files and file management data for managing these files File exists.

  The processing contents of the multimedia information terminal device configured as described above will be described. This multimedia information terminal device is carried by an operator who moves around the site, moves with the operator, and multimedia information is collected at each site. When the operator gives an instruction to collect multimedia information to the portable PC 4, the portable PC 4 receives GPS information (current longitude / latitude information, Greenwich date / time information, travel speed information, and travel speed information) from the COM port to which the GPS device 3 is connected. Read movement direction information). The GPS information acquired from the GPS device 3 is converted into a file format and temporarily stored in a predetermined area until a file name is set.

  On the other hand, the operator pushes the switch of the digital still camera 1 in order to photograph the situation at this site. As a result, the color image data of the subject imaged by the digital still camera 1 is converted into a color video signal and sent to the portable PC 4. The portable PC 4 converts the color video signal for one frame input from the digital still camera 1 into digital image data, and temporarily stores it in a predetermined area until the file name is set in the image file format.

  Further, when the operator reports the situation at the site by voice, the operator turns on the microphone 2 and inputs the voice information by the operator. The voice information collected by the microphone 2 is converted into a voice signal and sent to the portable PC 4.

  The portable PC 4 converts the audio signal input from the microphone 2 into an audio file in a format suitable for a sound source used such as a synthesizer board, and temporarily stores it in a predetermined area until a file name is set.

  The file names of the three files are created by the file name automatic creation function of the portable PC 4. The file name automatic creation function of the portable PC 4 automatically generates a directory name and a file name according to the following rules using the terminal number and GPS information in order to uniquely determine these three file names.

  ... \ ABYYMMDD \ hour hour minute minute second second. XXX The character string between \ ~ \ is the directory name, hour, hour, minute, minute, second. XXX is a file name. AB is the terminal number of the multimedia information terminal device, YY is the information collection year, MM is the information collection month, DD is the information collection date, hour is the information collection time, minute is the information collection time minute, second is the information collection time Collection time in seconds. “.XXX” is one of “.GPS”, “.JPG”, and “.WAV”, and “.GPS” is set in the GPS information file from the GPS device 3, and image information from the digital still camera 1 is set. “.JPG” is set to the file of “.”, And “.WAV” is set to the file of the audio information from the microphone 2. For example, the image file created by the multimedia information terminal device of terminal number # 1 includes [... ¥ # 1YYMMDD ¥ hour hour minute minute second second. The file name “JPG” is automatically set.

  Each file name thus created is added to the corresponding GPS information file, image information file, and audio information file and stored in the information storage HDD 6. After the multimedia information collected at the site and the GPS information captured at the collection site are stored in the information storage HDD 6 in file format, a telephone line is connected to the work station 11 of the center by the cellular phone 5. After the mobile phone 5 is connected to the work station 11, the multimedia information file and the GPS information file stored in the information storage HDD 6 are transmitted.

  FIG. 4 shows the contents of data transmitted from the multimedia information terminal device to the center in one collection of multimedia information. As shown in the figure, transmission data composed of a directory name, a file name, and a file content portion is transmitted for each file via the mobile phone 5.

  When the center 10 receives the transmission data from the multimedia information terminal devices # 1 to # 4 in the field, it is stored in the database device 12 as it is as a GPS information file, an image file, and an audio information file. At this time, the directory name and file name of each file can be extracted from the received data to create file management data as shown in FIG. The file names of GPS information, image information and audio information collected almost simultaneously at the same site are stored as the same record. If multimedia information is collected at multiple sites on the same terminal device on the same day, they are placed under the same directory although records are different.

  By using the database created as described above, it is possible to associate the multimedia information with the site position on the map without arranging symbols on the map of the map information system. When a GPS information file registered in the database is opened, position information on the map according to longitude and latitude is registered, and an image file storing image data and audio information collected at the position registered in the GPS information file And the voice information file can be immediately retrieved from the file management data.

  Even if file management data is not used, an image file and an audio file having the same file name as the GPS information file (however, only “.XXX” is different from the end) may be retrieved by directly searching the database. .

  Therefore, the position on the map can be specified by the absolute coordinate information of the GPS information file, and the image and sound collected at the site can be displayed in association with the corresponding position on the map.

  In the above description, the worker has performed simple operations of the digital still camera 1 and the microphone 2 on site, but a database can be created automatically in conjunction with the shutter operation of the camera.

  A process for performing a single operation from taking in multimedia information and the like to transmitting it to the center will be described with reference to the flowchart of FIG. Instead of pressing the shutter button with the operator holding the digital still camera 1 with respect to the subject, the operation switch 7 is turned on. When the operation switch 7 is turned on, the portable PC 4 reads GPS information (current longitude / latitude information, Greenwich date / time information, moving speed information and moving direction information) from the COM port to which the GPS device 3 is connected, and the GPS information is read. Create a file. The subject is imaged by controlling the operation of the digital still camera 1 from the portable PC 4 in conjunction with the ON operation of the operation switch 7. A video signal input from the digital still camera 1 is converted into image data of digital data, encoded and compressed by the JPEG method, and an image file is created. In addition, voice information is recorded for about 10 seconds after the operation switch 7 is turned on to create a voice information file.

  When the GPS information, the image information, and the sound information are collected and the file is created, a sound indicating that “the collection of the multimedia information is completed” is output from the earphone 8 using the synthesizer board built in the portable PC 4. Output audio. The audio information output from the earphone 8 is stored in advance in the portable PC 4 in the form of an audio information file.

  The portable PC 4 automatically creates directory names and file names according to the rules described above for the collected GPS information, image information and audio information files, and stores the information by assigning the directory name and file name to each file. Store in HDD 6.

  When three files of GPS information, image information, and audio information are stored in the information storage HDD 6, a sound indicating that “collected GPS information, image information, and audio information is transmitted to the center” is output from the earphone 8 as audio. Let

  The portable PC 4 dials up the telephone number of the workstation 11 from the mobile phone 5 using the auto-dial function, and connects the mobile phone 5 to the workstation 11 via a line. The telephone number of the workstation 11 is stored in advance in the portable PC 4. After the line is connected to the workstation 11, the portable PC 4 reads out the GPS information and multimedia information stored in the information storage HDD 6 and transmits them from the mobile phone 5 to the workstation 11.

  If the work station 11 is not connected to the telephone, it is retried after a time and transmitted when the line is connected. According to such an embodiment, when multimedia information such as image information and audio information is collected at the site, GPS information including absolute coordinate information of longitude and latitude is taken in at the same time. If the information and the GPS information are associated with each other, the database can be automatically created without mapping an object representing the position information on the map. The correspondence between the multimedia information and the GPS information on the database can be automatically and easily associated with the file name or the like without any human system.

  Also, when the multimedia information is individually stored in the file format, the file name is automatically created from the Greenwich date / time information and the terminal number included in the GPS information. Therefore, it is possible to save time and labor for the operator to input at the site.

  In addition, since multimedia information can be operated in conjunction with each other with only one switch operation without operating individual input devices, it is possible to greatly reduce the burden of collecting multimedia information on workers. it can. In addition, since the processing progress is announced from the earphone in the middle of a series of operations, the worker can confirm whether or not the operation is normal.

  In the above description, a mobile phone is used as the mobile communication radio, but other devices such as PHS can also be used. The present invention is not limited to the above embodiment, and various modifications can be made without departing from the scope of the present invention.

The functional block diagram of the multimedia information terminal device which concerns on embodiment of this invention. The conceptual diagram which shows the relationship between a some multimedia information terminal device and a center. The figure which shows the file structure of a database apparatus. The figure which shows the specific example of transmission data. The figure which shows the data arrangement structure of file management data. The flowchart at the time of automating a series of processes from collection of multimedia information to transmission. The conceptual diagram which shows database creation, mapping the object which represents a positional information on a map.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Digital still camera, 2 ... Microphone, 3 ... GPS apparatus, 4 ... Portable PC, 5 ... Mobile phone, 6 ... Information storage HDD, 7 ... Operation switch, 8 ... Earphone, 9 ... Telephone line network, 10 ... Center, 11 ... workstation, 12 ... database device

Claims (3)

An image information terminal device that collects image information for creating a beta base in which image information collected on-site and a collection location on a map are associated with each other,
Portable information processing equipment,
An image input device for photographing the subject;
A GPS device that outputs GPS information including coordinate information and time information expressed in longitude and latitude;
An operation switch for giving a command to the portable information processing device;
The mobile communication radio unit is housed and connected in an integrated manner with an auto-dial function for connecting a line to a predetermined communication partner and the mobile communication radio unit,
The portable information processing device has a function of capturing image information of a subject photographed by the image input device and GPS information output from the GPS device when the image information is collected, and a line by the mobile communication radio. A function of sending transmission data that is a set of image information and GPS information collected simultaneously to a connected communication partner;
An image information terminal device, wherein processing from capturing of the image information and GPS information to transmission to a communication partner is started by turning on the operation switch.   The image information terminal device according to claim 1, wherein the portable information processing device stores the image information captured from the image input device and the GPS information captured from the GPS device in a file format, and the image information and An image information terminal device comprising a function of creating each file name of GPS information using time information of GPS information. In the image information terminal device according to claim 1 or 2,
The portable information processing device assigns a directory name based on the terminal information and date / time information of the image information terminal device to the set of image information and GPS information captured at the time information, and An image information terminal device characterized by transmitting.

Images