JP2003125254A - Image transmission apparatus, map information system, and image transmission method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image transmission technology utilizing features a mobile-processed Web camera and to provide an image display system for utilizing a transmitted image. SOLUTION: The Web camera 2 is provided with a PHS communication section 22 and exchanges information with a PHS base station 4 to receive information required to identify a position of the camera 2. A position information acquisition section 214 calculates position information of the camera 2 on the basis of the received information. The position information is related with image data outputted from an imaging section 211 and the resulting data are distributed to a PHS network and the Internet via an information distribution section 213 and a data communication section 221. A Web server receives the imaged data with which the position information is related and linked to corresponding coordinates on map data. Then the Web server opens the image data linked to the map data into public on the Internet.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for transmitting captured images and a technique for using the transmitted captured images.

[0002]

2. Description of the Related Art There is a device generally called a web camera for delivering images (or audio) using the Internet. A web camera is generally a device having a communication function having a unique IP address, and transmits an image via the Internet using a protocol such as FTP or HTTP.

[0003] Then, by accessing from the browsing PC or various terminals by designating the IP address of the Web camera, the format of the image transmitted (JPE
Based on G, motion JPEG, MPEG, etc.), these images (or audio) are reproduced.

FIG. 10 is a diagram showing a system configuration using a Web camera. Web cameras are connected to the Internet via network devices such as routers and TAs. On the other hand, image viewing terminals such as PCs are also connected to the Internet via network devices such as routers and TAs. The web camera has an image pickup device for picking up an image and a web server function for delivering the picked up image,
The peripheral image is captured and the image can be distributed to the Internet. An image browsing device such as a PC can browse images distributed by a web camera by using a web browser.

[0005]

There are products of various shapes and specifications in what are called Web cameras and Internet image transmission systems, but the characteristics of Web cameras are that they are characterized by their optical mechanism as a camera. This means that functions such as image (compression) processing and image distribution are integrated.

Furthermore, PHS (registered trademark) is used as a communication path.
Or using mobile networks such as mobile phones,
By using a battery or battery as the power source, it can be used as a mobile device that can be carried anywhere.

However, generally, the Web camera is fixedly installed and used for the purpose of transmitting (fixed point) images. Even if the webcam is made mobile, it is only an advantage that it can be easily moved and installed, and it cannot be said that the service unique to mobile has been realized.

In view of the above problems, it is an object of the present invention to provide an image transmission technique that makes the best use of the characteristics of a mobile Web camera, and a system that utilizes the images thus transmitted. And

[0009]

In order to solve the above-mentioned problems, the invention according to claim 1 is an apparatus for picking up and transmitting an image, wherein a) an image pickup apparatus for picking up an image, and b) a mobile phone. A communication interface for performing data communication via the network, c) position data acquisition means for acquiring current position data of the device itself based on a signal received from a mobile phone base station, and d) imaging by the imaging device. With respect to the image data, as position information when the image data is imaged, after associating the position data acquired by the position data acquisition means, the image data and the position data associated with the image data, And an information distribution unit that distributes the information to the outside through the communication interface while maintaining the association.

According to a second aspect of the present invention, in the image transmission apparatus according to the first aspect, the position data acquisition means is c-
1) A position information updating means for updating the current position of the own device by acquiring the current position data of the own device when a predetermined time has elapsed.

According to a third aspect of the present invention, there is provided a system comprising an image transmission device and a content generation server for displaying a photographed image on map data, the image transmission device comprising:
a-1) An image pickup device for picking up an image, a-2) A communication interface for performing data communication via a mobile phone network, and a-3) Based on a signal received from a mobile phone base station, A-4) position data acquisition means for acquiring the current position data, a-4) for the image data captured by the imaging device, as the position information when the image data was captured, the position data acquisition means acquired An information distribution unit that distributes the image data and the position data associated with the image data to the outside through the communication interface while maintaining the association after the position data is associated with the content generation server. B-1) means for receiving the image data transmitted from the image transmission device and position data associated with the image data, and b-2) the received image data for the image data. Based on the position data attached, characterized in that it comprises an image link means for linking the appropriate coordinate position on the map data.

The invention according to claim 4 is the map information system according to claim 3, wherein the image linking means includes means for displaying an icon at a corresponding position on the map data to which the image data is linked. Is characterized by.

According to a fifth aspect of the present invention, there is provided a method for picking up and transmitting an image, comprising: a) establishing communication with a base station of a mobile telephone network; and b) receiving from the base station. Based on the signal, the step of acquiring the current position data of the own device, c) the step of capturing an image, and d) the image data is captured with respect to the image data acquired in step c). As position information at that time, a step of associating the position data obtained in the step b), and e) a step of distributing the image data and the position data associated with the image data to the outside while maintaining the association, It is characterized by including.

According to a sixth aspect of the present invention, there is provided a method of displaying a photographed image on map data by using an image transmission device and a content generation server, wherein: a) the image transmission device is a base of a mobile telephone network. Establishing communication with the station, b)
A step of acquiring the current position data of the image transmission apparatus based on a signal received from the base station by the image transmission apparatus; c) a step of capturing an image by the image transmission apparatus; and d) the image transmission apparatus. However, with respect to the image data acquired in the step c), as the position information when the image data is captured, a step of associating the position data acquired in the step b), e) the image transmission device, A step of transmitting the image data and the position data associated with the image data to the content generation server while maintaining the association; f) the content generation server, the image data distributed in the step e), and G) receiving the position data associated with the image data, g) the content generation server relates the image data received in the step f) to the image data. Based on the position data attached, characterized in that it comprises the steps of linking to the appropriate coordinate position on the map data.

According to a seventh aspect of the present invention, in the image transmitting method according to the sixth aspect, the image transmitting apparatus includes the image data captured at each point while moving and the position data associated with the image data. It is characterized in that it is transmitted to the content generation server.

The "portable telephone" in the present invention also includes "PHS (registered trademark); simplified portable telephone".

[0017]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

{1. Overall Schematic Configuration} FIG. 1 shows a web camera 2 which is an image transmission device according to the present embodiment, and a web.
It is a figure which shows the whole structure of the map information system containing the camera 2.

The Web camera 2 has a camera body 21 and a PHS communication unit 22. The PHS communication unit 22 can be connected to the PHS network by performing wireless communication with the PHS base station 4, and further can be connected to the Internet 5 via the PHS network.
Therefore, the web camera 2 can capture a peripheral image by the camera body 21, and the PHS communication unit 22
Using, it is possible to perform data communication with other PCs, mobile terminals, etc. connected to the Internet 5.

The Web content generation server 3 is a Web server connected to the Internet 5. The Web content generation server 3 has a function of acquiring image data captured by the Web camera 2 and providing a map information system using the acquired image data to the Internet 5.

{2. Position measurement by communication device}
As described above, the web camera 2 is a communication line (infrastructure).
As for, the PHS network is used. However, the communication line used by the web camera 2 is not limited to the PHS network, and a mobile phone network may be used. In these PHS and mobile phone networks, there are many radio wave transmission / relay stations called base stations mainly in urban areas, and in addition to voice calls to nearby PHS terminals and mobile phone terminals, data communication It is possible to do.

FIG. 2 shows a plurality of base stations 4, 4, ... Arranged in an urban area. The PHS terminal 25 (or mobile phone terminal) enters the area of the base station 4 to enable data communication with the base station 4.

Further, the PHS network management system (not shown) obtains the radio field intensity of the PHS terminal 25 existing in the area of the base station 4 to determine which PHS terminal exists in which base station area. It is possible to obtain information about whether to do it. Therefore, based on this information, PHS
It is possible to know the current location of the terminal. Specifically, it is possible to measure that the terminal exists within a circle at an equal distance (50 m, 100 m, etc.) where the radio wave can reach from the base station.

Further, by acquiring the radio wave intensity and the radio wave phase measured by the plurality of base stations 4,
Calculate the distance to the PHS terminal 25 using triangulation etc.,
It is possible to specify the current location of the terminal.

{3. Configuration of Web Camera} FIG. 3 is a diagram showing a functional block configuration of the web camera 2 according to the present embodiment. The web camera 2 includes a camera body 21 and a PHS communication unit 2.
2 and. The camera body 21 includes an image pickup unit 211, an image processing unit 212, an information distribution unit 213, and a position information acquisition unit 214. The PHS communication unit 22 includes a data communication unit 221 and a base station information exchange unit 222. Is equipped with. Each functional unit included in the camera body 21 and the PHS communication unit 22 may be a functional unit realized by executing software using hardware resources such as a CPU and a RAM. Some or all of them may be configured by hardware.

Then, the Web camera 2 in the present embodiment
The battery uses a battery, a battery, etc. as a power source, and has a lightweight size as a whole, so that it can be used as a mobile camera that can be carried around freely.

The camera body 21 and the PHS communication unit 22 are
As shown in the figure, the PHS communication unit 22 may be configured separately, and the PHS communication unit 22 may be inserted into the camera main body unit 21 for use, or the camera main body unit 21 and the PHS communication unit 22 may be integrated. It may be configured.

The flow of processing in the camera body 21 will be described. An image obtained from the image pickup unit 211 including a camera optical system, a CCD and the like is encoded by the image processing unit 212 according to an appropriate format or the like. Image processing unit 212
The image data output from the device is packetized by the information distribution unit 213 according to the HTTP or FTP protocol,
It is transmitted from the data communication unit 221 of the communication unit 22. The image data transmitted from the data communication unit 221 is the base station 4
And is transmitted to a wide area network such as the Internet via a relay station.

The base station information exchanging unit 222 provided in the PHS communication unit 22 uses the exchange of management information with the base station 4 to identify the position of its own terminal from the management system (not shown) of the PHS network. Receive the information needed to do so. For example, as described above, in the case of being in the area of a single base station, the latitude / longitude information of the base station in which the own terminal exists and the radio wave range information of the base station are acquired from the management system. As a result, it is possible to determine that the own terminal exists within the equidistant circle of the specified base station. Also, in the case of being in the area of a plurality of base stations, the position of the own terminal can be calculated by acquiring the information on the radio wave intensity and the radio wave phase of the own terminal from each base station.

When the base station information exchanging unit 222 receives the information necessary for specifying the position of the own terminal via the base station 4, the base station information exchanging unit 222 transfers the information to the position information acquiring unit 214. Then, the position information acquisition unit 214 calculates the position information of its own terminal by performing the arithmetic processing for measuring the position as described above based on this information. The program for acquiring position information may be installed from the beginning, or the program may be acquired by downloading using a technique such as JAVA (registered trademark).

The position information thus obtained is associated with the image data output from the image processing unit 212 (the association will be described later), and is described above.
It is passed to the sending process using HTTP or FTP.

{4. Association between image data and position data} Next, the association between the image data and the position data described above will be described. 4 and 5 are diagrams showing an example of a method of associating position data with image data.

FIG. 4 shows a format in which position data is embedded in the header portion of image data. By transferring the captured image in such an image format,
At the receiving terminal, it is possible to obtain position data that corresponds to the image data on a one-to-one basis. Further, when transferring frame images that are continuously captured, if position data is recorded in the header portion for each frame image,
On the receiving side, it is possible to acquire position data corresponding to each of continuously shot images. The information distribution unit 213 generates such an image format.

FIG. 5 is a diagram showing a processing mode for continuously transmitting image data and position data. In the processing mode shown in FIG. 4, the image data and the position data are transmitted in one file format.
The image data and the position data are continuously transmitted in an independent state.

The image data and the position data transmitted by such a method are processed on the receiving terminal side according to a certain rule. For example, if the image data is received after the position data is acquired, it is determined that the position data and the image data are associated with each other. On the contrary, if the position data is received after the image data is acquired, it may be determined that the image data and the position data are associated with each other.

Further, as shown in the figure, it is not always necessary to alternately transmit the image data and the position data. The position data may be transmitted after some image data is transmitted. In this case, the receiving side may associate the subsequently received position data with the successively received image data. Alternatively, conversely, after receiving the position data, the image data that is continuously received may be associated with the previously received position data.

{5. Image Transmission Processing Flow} Next, a processing flow for transmitting an image in the Web camera 2 having the above-described configuration will be described with reference to FIG.

First, the base station information exchanging unit 222 causes the base station 4
Communication is established between the two (step S1). And
Based on the information for specifying the position, which is received from the base station 4, the position information acquisition unit 214 performs a calculation process to calculate the position information of the terminal itself (step S2).

Next, an image is picked up by the image pickup unit 211,
Image processing is performed in the image processing unit 212 (step S
3). Then, the image data and the position data output from the image processing unit 212 are input to the information distribution unit 213, and the process of associating the position data with the image data is performed (step S4). Furthermore, in the information distribution unit 213
Data is generated according to the HTTP or FTP protocol and transmitted from the data communication unit 221 to the base station 4 (step S5). In addition, the information distribution unit 213
The information may be delivered using mail delivery using SMTP, or stream delivery system protocols such as RTP / RTCP (real-time transport protocol) and RTSP.

When image transmission is performed in this way,
Next, it is judged whether or not the transmission is finished (step S
6) If the transmission is to be ended (Yes in step S6), the image transmission process is ended. If the transmission is to be continued (No in step S6), it is determined whether a predetermined time has elapsed (step S7). That is, since the web camera 2 according to the present embodiment is lightweight and portable, the photographer can move while taking an image using the web camera 2. Therefore, the shooting position of the image taken by the Web camera 2 also changes, and the position information is updated when a predetermined time (for example, several seconds or several minutes) has elapsed.

Therefore, if the predetermined time has elapsed (Yes in step S7), the process returns to step 1 to update the position information. On the other hand, if the predetermined time has not elapsed (No in step S7), the process returns to step S3 to continue the image transmission process.

As described above, the position information is first acquired, then the images are continuously photographed, the image information is transmitted after being associated with the acquired position information, and the position information is acquired when a predetermined time elapses. Update, capture images continuously again, and perform image transmission after associating with the updated position information,
The above process is repeated. This ensures that
It is possible to perform image transmission associated with position information.

Further, in the case of a shooting operation involving a lot of movement, it is possible to improve the accuracy of the position information even during the moving shooting by shortening the period for updating the position information. Further, in the case of a shooting operation that hardly moves, it is possible to improve the processing speed by lengthening the update interval of the position information.

In updating the position data, the position data may be updated only when the difference from the previous position data exceeds a certain threshold. Alternatively, the error can be rounded off by taking a method of obtaining the average value by acquiring the position data a plurality of times. Alternatively, the position accuracy can be improved by acquiring the position data a plurality of times and cutting the position data having an extremely large deviation.

As described above, the image transmitting apparatus according to the present embodiment adds the position information of the own terminal obtained by the communication between the Web camera 2 and the PHS (or mobile phone) base station to the image and transmits it. Can be used as higher value-added information. Further, since the PHS communication unit 22 functions as a communication interface that realizes two processes of acquisition of position information and data transmission (communication), compared to other methods (for example, a method using GPS for position information acquisition),
The hardware can be simplified and the price can be reduced.

{6. Map information system} Next, above
The configuration of the map information system using the image data distributed by the web camera 2 will be described.

FIG. 7 is a diagram showing the functional blocks of the Web content generation server 3. Although hardware such as CPU, memory, and hard disk are omitted in the figure, Web
The content generation server 3 is composed of a computer such as a personal computer or WS.

The Web content generation server 3 uses the communication IF
31, an image reception unit 32, a content generation unit 33, and a Web distribution unit 34. The software stored in the hard disk or memory is
A functional unit realized by being executed by using hardware resources such as U and RAM.

The communication IF 31 is a connection interface with the Internet. The image receiving unit 32 uses the communication IF 3
The image data transmitted by the web camera 2 via 1 and the associated position data are received.

The image receiving section 32 receives the received image data,
And the associated position data is stored in the hard disk as the image data 37 (with position information). Here, the image data 37 (with position information) may be generated in one image format as shown in FIG. 4, or a database of image data and position data may be provided separately from the image data. May be stored. The database of image data and position data is, for example, a database in which a data file name of image data and position information of the image data are associated with each other. Thus, the image data 37 (with position information) may be composed of a single file for one captured image or may be composed of image data and a database.

Next, the content generator 33 generates the Web content 39 from the image data 37 (with position information) and the map data 38. The map data 38 is data composed of raster data (image) or vector data, and the map data 38 defines coordinates (latitude, longitude). Therefore, it is possible to link the image data 37 having the position information corresponding to the corresponding position on the map data 38, and by generating such data as Web contents, It is possible to build a map information system.

FIG. 8A is a diagram showing an example of the Web content 39. Icons 391, 391, ... Are plotted on the map data 38 of the road map. The content generator 33 plots an icon on the map data 38 and links the image data 37 (with position information) to this icon. Therefore, FIG.
Icon 3 on Web content 39 shown in (A)
When the pointer 40 is aligned with 91 and clicked, the linked image data 37 is displayed as shown in FIG. 8 (B).

As described above, in the map information system according to the present embodiment, contents are automatically generated from the image data transmitted from the Web camera 2 and the position data associated with the image data. Web camera 2 in particular
Since the acquisition processing of the position information in step 1 and the content generation processing in the web content generation server 3 are both automated, the development cost can be reduced and the data can be updated quickly. Becomes

In this embodiment, the map information system is constructed as a Web application, but the form of the application is not particularly limited. It is also possible to build it as an application on various OS with a GUI.

The Web content 39 generated in this way is published on the Internet 5 by the Web distribution unit 34. The Web delivery unit 34 is specifically a functional unit realized by operating a WWW server application.

FIG. 9 is a diagram showing an example of the Web content 39 generated by utilizing the characteristics of the mobileized Web camera 2.

FIG. 9 (A) is a diagram showing a state in which photographing work is carried out while moving while carrying the Web camera 2 in an urban area. In this example, first, the peripheral image is photographed using the Web camera 2 at the photographing point P1. next,
At the moving shooting points P2 and P3, respectively
I am shooting with the Web camera 2.

By distributing the image data thus photographed and the position data associated with the image data to the Web content generation server 3, the Web content generation server 3 generates the Web content 39. This generated Web content 39 is shown in FIG.
Shown in (B).

As described above, the position information distributed from the Web camera 2 is regularly updated, so that FIG.
As shown in (B), an icon 3 is displayed at each moved point.
91 is plotted and the icon 391 is displayed.
Then, the image data 37 taken at that point is linked. In this way, it is possible to reflect the image at the current position in the map information system in a near real-time state by following the Web camera 2 that shoots while moving.

As described above, the mechanism for acquiring position information of the present invention uses the PHS network,
Of course, it may be a mobile phone network. However, the installation interval of the base stations in the mobile telephone network is much wider than that of the PHS base stations, and therefore it is preferable to use the PHS network network in order to improve the position accuracy.

[0061]

As described above, according to the invention described in claim 1 or 5, the current position data of the own device is acquired based on the signal received from the mobile phone base station, and the image data is acquired. Since it is transmitted after being associated with, it is possible to utilize the high-value-added image data associated with the position information.

According to the second aspect of the present invention, since the position information is updated every time a predetermined time elapses, it is possible to associate the position information even with a moving image.

In the invention described in claim 3 or 6, the current position data of the own device is acquired based on the signal received from the mobile phone base station, and the image data associated with the position information is also acquired. Since the image data is linked to and on the map data, the link between the map data and the image data can be automated.

According to the fourth aspect of the invention, the icon is displayed on the map data and the image data is linked to the icon, so that the operability is excellent.

In the invention described in claim 7, since the photographed image is reflected while the photographed image is reflected on the map data while moving, it is possible to update the data of the image display system while moving by using the image transmission device which can be carried around freely. It is possible to carry out.

[Brief description of drawings]

FIG. 1 is an overall system configuration diagram of an image transmission device and a map information system including the image transmission device.

FIG. 2 is a diagram showing base stations installed in an urban area.

FIG. 3 is a functional block configuration diagram of a web camera.

FIG. 4 is a diagram showing a format in which image data and position data are stored in one file.

FIG. 5 is a diagram showing a form in which image data and position data are continuously transmitted while being independent of each other.

FIG. 6 is a flowchart showing a process of image transmission.

FIG. 7 is a functional block configuration diagram of a Web content generation server.

[Figure 8] Web linking image data on map data
It is a figure which shows a content.

FIG. 9 is a diagram showing Web contents generated by performing moving shooting.

FIG. 10 is a diagram showing a system configuration example of a general Web camera.

[Explanation of symbols]

2 Web camera 3 Web content generation server 4 base stations 211 Imaging unit 212 image processing unit 213 Information Distribution Department 214 Location Information Acquisition Unit 221 Data communication unit 222 Base station information exchange section 32 Image receiver 33 Content generator 34 Web Distribution Department

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 7/14 H04B 7/26 106B 5K101 H04Q 7/34 106AM (72) Inventor Toshikazu Kaneko Chiyoda-ku, Tokyo Ichibancho 17-6 F term in Mega Fusion Co., Ltd. (reference) 5B085 AA08 BA07 BE01 BG03 BG07 5C022 AA13 5C064 AA06 AC04 AC06 AC18 AC22 AD02 AD06 AD14 5K024 CC11 GG10 5K067 AA34 BB04 BB08 DD20 EE02 EE10 JJ52 FF53 JJ53 FF53 JJ53FF KK16 LL12 NN06 NN18

Claims (7)

[Claims] 1. An apparatus for picking up and transmitting an image, comprising: a) an image pickup apparatus for picking up an image, b) a communication interface for data communication via a mobile phone network, and c) from a mobile phone base station. Position data acquisition means for acquiring the current position data of the own device based on the received signal, and d) as position information when the image data is picked up with respect to the image data picked up by the image pickup device. An information distribution unit that, after associating the position data acquired by the position data acquisition unit, distributes the image data and the position data related to the image data to the outside via the communication interface while maintaining the association. An image transmission device comprising: 2. The image transmission device according to claim 1, wherein the position data acquisition unit acquires the current position data of the device itself when c-1) a predetermined time has elapsed, An image transmission device comprising: position information updating means for updating the current position. 3. A system comprising an image transmission device and a content generation server for displaying a photographed image on map data, wherein the image transmission device comprises a-1) an image pickup device for picking up an image, and a- 2) A communication interface for performing data communication via the mobile phone network, a-3) Position data acquisition means for acquiring the current position data of the own device based on the signal received from the mobile phone base station, and -4) With respect to the image data imaged by the imaging device, as position information when the image data is imaged, after associating the position data acquired by the position data acquisition unit,
Image data and position data associated with the image data, and information distribution means for delivering to the outside through the communication interface while maintaining the association, the content generation server, b-1) the Means for receiving the image data transmitted from the image transmission device and the position data associated with the image data, and b-2) the received image data based on the position data associated with the image data, An image linking means for linking to a corresponding coordinate position on map data, and a map information system. 4. The map information system according to claim 3, wherein the image linking means includes means for displaying an icon at a corresponding position on the map data to which the image data is linked. system. 5. A method for imaging and transmitting an image, comprising: a) establishing communication with a base station of a mobile phone network; and b) based on a signal received from the base station. A step of acquiring the current position data of the own device, c) a step of capturing an image, and d) the image data acquired in the step c) as position information when the image data is captured, A step of associating the position data acquired in the step b), and a step of e) distributing the image data and the position data associated with the image data to the outside while maintaining the association. Image transmission method. 6. A method of displaying a photographed image on map data using an image transmission device and a content generation server, comprising: a) communicating the image transmission device with a base station of a mobile telephone network. B) acquiring the current position data of the device itself based on the signal received by the image transmission device from the base station; and c) the image transmission device capturing an image. And d) a step of associating the image data acquired in the step c) with the position data acquired in the step b) as the position information when the image data is captured, e) a step in which the image transmission device transmits image data and position data associated with the image data to the content generation server while maintaining the association; f) the content generation server performs the step e ) Receiving the image data distributed in step 1) and the position data associated with the image data, g) the content generation server sets the image data received in step f) to the position associated with the image data. And a step of linking to a corresponding coordinate position on the map data based on the data, the image transmission method. 7. The image transmission method according to claim 6, wherein the image transmission device transmits image data captured at each point while moving and position data associated with the image data to the content generation server. An image transmission method characterized by the above.