TWI558199B - Carry information machine and information acquisition system - Google Patents

Description

Carrying information machine and information acquisition system

The present invention relates to a portable information machine and an information acquisition system.

The present application claims priority based on Japanese Patent Application No. 2008-205729, filed on August 8, 2008, the content of which is hereby incorporated herein.

In the past, a portable information device such as a photographing device (for example, a digital camera) having a photographing function has a function of detecting the position information of the portable information device and correspondingly detecting the position information. The captured image data is processed (see, for example, Patent Document 1).

[Patent Document 1] Japanese Patent Laid-Open Publication No. 2004-15187

An aspect of the present invention is to provide a portable information machine, a photographing apparatus, and an information acquisition system that can enrich a user's activities.

According to an aspect of the present invention, a portable information device includes: an image sensor; a position information acquisition unit that outputs position information; an orientation sensor; and a display that displays an object output from the image sensor. The image of the object and the information related to the object obtained from at least the measurement data from the position information acquisition unit and the position sensor.

According to another aspect of the present invention, an information acquisition system is provided, comprising: a server; a database; and a portable information device, including an image sensor, a position information acquisition unit, an orientation sensor, a display, and a wireless communication unit that input position information, wherein the display displays an image of an object output from the image sensor and information related to the object, at least according to the The information related to the object obtained by the location information acquisition unit and the measurement data of the position sensor is acquired from the database through the wireless communication unit and the server.

According to another aspect of the present invention, there is provided an image pickup apparatus comprising: a photographing unit that captures a subject; a position information acquisition unit that acquires position information of a photographing position; and an orientation information acquisition unit that acquires The orientation information of the photographing direction of the photographing position is displayed.

According to another aspect of the present invention, an information acquisition system is provided which is composed of a photographing apparatus and an information retrieval system that retrieves information related to the subject from a subject photographed by the photographing apparatus. And transmitting the search result to the photographing device; the photographing device includes: a photographing unit that captures the subject; a position information acquiring unit that acquires position information of the photographing position; and an orientation information acquiring unit that acquires and displays The orientation information of the photographing direction of the photographing position; the information retrieval system has: a database storing information related to the object corresponding to the position information and the orientation information; and an information retrieval server according to the information The location information and the orientation information of the image data captured by the photographing device retrieves information related to the subject corresponding to the location information and the orientation information of the image data from the database.

According to another aspect of the present invention, a portable information device includes: a position information acquisition unit that outputs position information; a display; an orientation sensor; and a control unit that relates information related to the object, and the The image of the object is displayed on the display after the image is associated with the object, and the information related to the object is used according to at least the location information from the location information obtaining unit. The data of the object photographed based on the photographing position based on the position information is obtained.

According to the present invention, it is possible to provide a portable information machine, a photographing apparatus, and an information acquisition system that can enrich the activities of the user.

1‧‧‧ digital camera

2‧‧‧Information retrieval system

3‧‧‧Wire Base Station

4‧‧‧Information Communication Network

11‧‧‧Control Department

12‧‧‧Transceiver

13‧‧‧Photography Department

14‧‧‧GPS

15‧‧‧Memory Department

16‧‧‧Azimuth sensor

17‧‧‧Display Department

18‧‧‧Timer

21‧‧‧Server

22‧‧‧Database

Fig. 1 is a block diagram showing an example of the configuration of an information acquisition system according to an embodiment of the present invention.

Fig. 2 is a conceptual diagram showing a configuration example of a construction object table stored in the database in Fig. 1.

Fig. 3 is a flow chart showing the flow of information retrieval processing of the image captured by the digital camera of the embodiment.

Fig. 4 is a conceptual diagram showing an example of a display image displayed on the digital camera of the embodiment.

Fig. 5 is a conceptual diagram showing an example of a display image displayed on the digital camera of the embodiment.

Fig. 6 is a conceptual diagram showing an example of a display image displayed on the digital camera of the embodiment.

Fig. 7 is a flow chart showing the flow of information retrieval processing of the image taken by the digital camera of the embodiment.

Fig. 8 is a flow chart showing the flow of processing from the shop information retrieval information input to the digital camera of the embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a block diagram showing an example of the configuration of a portable information device (photographic apparatus) and an information acquisition system according to the embodiment.

In FIG. 1, the information acquisition system includes a digital camera 1 and an information retrieval system 2 as an example of a photographing device. The digital camera 1 communicates with the wireless base station 3 via wireless communication, and transmits data through the information base 4 such as the wireless base station 3 and the Internet, and the information retrieval system 2 (or the information retrieval server 21 described later). send. Further, the photographing apparatus of the present embodiment is a portable terminal having a photographing function such as the above-described digital camera 1 or a mobile phone having a camera.

The digital camera 1 has a browsing function, and includes a control unit 11, a transmission/reception unit 12, an imaging unit 13, a GPS (Global Positioning System) (location information acquisition unit) 14, a storage unit 15, and an orientation sensor 16, The display unit 17 and the timer 18 are provided. Here, the wireless communication of the present embodiment includes a communication partner such as radio waves, light, or sound waves without using a cable as a transmission path.

The photographing unit 13 includes a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a lens, and the like, and is a subject (the object to be photographed). The image data is output to the control unit 11. In the present embodiment described below, the photographing system indicates the construction of a building (a commercial building including a shop, a public building including a school and a hospital, a factory, a house including an apartment, an iron tower, a bridge, a dam, an amusement park, a bronze statue, etc.) Buildings, etc.).

The GPS 14 inputs a control signal indicating the photographing from the user (for example, a control signal output from a peripheral circuit not shown in which the photographing button B1 has been pressed), or a control signal indicating the information retrieval (for example, The control signal outputted by the peripheral circuit (not shown) that has been selected by the user by touching the image (logo) such as the display search or the like is detected, that is, the information of the latitude and longitude of the digital camera 1 is obtained, and The control unit 11 outputs.

The azimuth sensor 16 is composed of an electronic compass (geomagnetic sensor), and is input with a control signal indicating a photograph from the user (for example, a peripheral circuit not shown in which the photographing button B1 has been pressed is detected) Control signal), or a control signal indicating the information retrieval (for example, a control signal outputted by a peripheral circuit not shown) by detecting an image (logo) that has been touched by a user to display a search or the like) In the imaging unit 13, for example, the CCD and the lens arranged in series detect the orientation in the series direction and output the information to the control unit 11 as the orientation information. Further, the orientation sensor 16 can also detect the orientation of the subject (ie, the photographing direction) viewed from the user, and output it to the control unit 11 as the orientation information. Here, when the azimuth is used as the azimuth information, for example, the latitude and longitude of the position information is taken as the center point, and the north is used as the reference (0 degree), and the clockwise east (90 degrees), the south (180 degrees), the west (270 degrees), the azimuth is expressed in units of degrees, minutes, and seconds.

When the control unit 11 inputs a control signal indicating that the user presses the photographing button B1 or the like from the peripheral circuit, the image recognition information is given to the captured image data, and the image data captured by the image recognition information is recorded. The time data, the position information, and the position information acquired from the timer 18 are written in the storage unit 15 in accordance with the shooting order.

The display unit 17 displays the image data captured by the imaging unit 13 or the image data read by the control unit 11 from the storage unit 15 by the user selecting the image to be displayed.

Further, the display unit 17 displays the image data received from the information retrieval system 2 or the text data input by the user, as controlled by the control unit 11, as will be described later.

The transceiver unit 12 performs transmission and reception with the wireless base station 3 via wireless communication, and performs image transmission between the information communication system 4 and the information retrieval system 2 through the information communication network 4. Sending and receiving of materials such as materials, text data or control signals.

Next, the information retrieval system 2 has an information retrieval server 21 and a database 22 as shown in FIG. Further, the database 22 may be provided in a recording medium (for example, a memory or an HDD) in the information retrieval server 21, or may be provided in an external recording medium or a recording medium of another terminal.

As shown in FIG. 2, in the database 22, the building identification information, the name of the building, and the information of the building (address, telephone number, type, and surrounding image data centered on the building) are stored in the database 22. Information such as the information, the location information of the latitude and longitude of the building, the description of the building (if the store is the information recorded in the store), the submission information (the comments and users of the user reviews that have been visited, etc.) Submission of image data, etc.).

Further, in the database 22, map data of each of the registered objects in which the latitude and longitude are two-dimensional planes is arranged is stored. In the map data herein, each of the structures is displayed at the position of the corresponding latitude and longitude by the above-mentioned building identification information.

The information retrieval server 21 searches for the building located at the closest distance in the direction indicated by the orientation information by using the input position information and the orientation information from the position of the latitude and longitude displayed by the position information, and obtains the found The building identification information of the building.

Further, the information retrieval server 21 searches for the construction object corresponding to the construction object identification information of the construction obtained by the search for the construction object table, and searches for the information of the construction object (building name, construction object) Information, etc.) is sent to the digital camera 1. Further, the information retrieval server 21 can selectively transmit the information of the above-mentioned monument transmitted by the digital camera 1 by, for example, the necessity of the transmission and reception data capacity and the like. At this time, the information retrieval server 21 can also be operated by a predetermined operation. The information remaining in the information of the above-mentioned building is again transmitted to the digital camera 1 (for example, from the request of the digital camera 1 or the like).

<Information retrieval of images taken with digital camera 1>

Next, the operation of this embodiment will be described with reference to Figs. 1 and 3 and Figs. 4 to 6 . FIG. 3 is a flowchart showing an operation example of the information retrieval processing of the present embodiment when the information retrieval is performed in a state where the digital camera 1 is being photographed toward the object. 4 to 6 are views showing the arrangement of the screen displayed on the display unit 17 of the digital camera 1 and the photographing button B1 of the digital camera.

In the following description, for example, the state in which the user searches for a restaurant for dinner while walking in the downtown area is described.

When the user squats in the downtown area, the lens of the digital camera 1 is directed to the restaurant having the desired appearance (step S1), and when the restaurant that wants to obtain the appearance of the information is found, as shown in FIG. 4, touch (press) The browsing image I1 is set in the image display field MP of the digital camera 1, thereby selecting the browsing image I1 (step S2).

At this time, the control unit 11 displays the image data captured by the imaging unit 13 input from the imaging unit 13 in the imaging state, and displays the image of the restaurant in the image display column MP on the image display column MP as shown in FIG. data. Further, the video display column MP (video display unit) in the present embodiment is configured by a touch panel (including, for example, a pressure sensitive type, an electrostatic type, or a sound wave type).

Further, in the above step S2, after the photographing button B1 of the digital camera 1 is pressed, the image display field MP of the restaurant image displayed is displayed while being touched, and the browsing image I1 is touched to select.

By touching the image I1, a signal indicating that the browse image I1 has been selected is output to the control unit 11 from a peripheral circuit (not shown).

Next, the control unit 11 indicates that the input browsing image I1 has been selected. The signal of the event detects that the image I1 has been selected for viewing, and provides image recognition information to the image data of the restaurant in the shooting of the photographing unit 13, and writes the image data and the shooting time to the memory unit corresponding to the image recognition information. 15, to store the image data (step S3).

Further, when the browsing image I1 is touched, the control unit 11 writes the position information acquired by the GPS 14 and the orientation information acquired by the orientation sensor 16 as the connection information, and writes the information to the storage unit in accordance with the image identification information. 15, and stored (step S4).

Then, after the video data and the related information are written in the storage unit 15, the control unit 11 recognizes the camera identification information (the user identification information given to the user or the identification information given to the digital camera 1) of the digital camera 1 , The search request signal including the position information and the orientation information is transmitted to the information retrieval system 2 via the transceiver unit 12 (step S5). Further, in the above-described steps S3 to S5, the control unit 11 may transmit the search request signal to the information retrieval system 2 via the transmission/reception unit 12 without writing the video data and the related information to the storage unit 15.

Next, in the information retrieval system 2, when the server 21 receives the search request signal from the digital camera 1, the search object is extracted from the map data of the database 22 based on the location information and the orientation information contained in the search request signal. . Then, the server 21 transmits the information in the construction object table to the digital camera 1 as the retrieval result information from the construction object table of FIG. 2 by using the construction identification information (step S7). . At this time, for example, the server 21 reads the address of the digital camera 1 attached to the network when the search request signal is transmitted from the digital camera 1 through the transceiver 12, and transmits the search result information to the address. In addition, in the above step S7, the server 21 is in the database. The user registration form stored in the 22 may also be used only when detecting that the camera identification information included in the search request signal is registered in the user login form, based on the location information and location information contained in the search request signal. The map data of 22 extracts the construction object of the search object. At this time, when detecting that the camera identification information included in the search request signal is not registered in the user registration table, for example, the server 21 may transmit the information requiring the user to log in to the digital camera 1 based on the camera identification information.

Next, in the digital camera 1, when the control unit 11 receives the search result information from the information retrieval system 2 via the transmission/reception unit 12, the display information is displayed on the information display column SP through the display unit 17 as shown in FIG. Information) (step S8). For example, when the building is a restaurant, it will display information on the type of restaurant (Chinese, Japanese, French, Italian, etc.), the phone number and address of the restaurant. Further, the information display column SP shown in FIG. 5 is only an example of the present embodiment, and may be displayed in one of the image superimposed information display fields SP of the restaurant. Further, the information display field SP is a part of the image display field MP, and is displayed by touching, for example, the above-described browsing image I1 or a CM image I2 to be described later.

Further, when the user touches the CM image I2, the peripheral circuit outputs a signal indicating that the CM image I2 has been selected to the control unit 11. Thereby, the control unit 11 detects the selected CM image I2 by inputting the signal of the selected CM image I2, and detects the restaurant advertisement information (menu, number of seats, in-store image) included in the search result information. The recommended cooking of the chef today, etc.) is displayed on the information display column SP through the display unit 17. Further, when the advertisement information includes image data such as an in-store image, the control unit 11 displays the image data on the information display column SP.

Further, when the user touches the posting viewing image I3, the peripheral circuit outputs a signal indicating that the posting viewing image I3 has been selected to the control unit 11. Thereby, the control unit 11 detects the selected posting view image I3 by inputting the signal of the selected posting viewing image I3, and writes the posting information written by other users included in the search result information (comment) It is displayed on the information display column SP through the display unit 17.

Further, when there are a plurality of pieces of posting information, the control unit 11 displays a plurality of pieces of posting information in the information display column SP in the order of the date of submission.

When the posting information also includes image data, and includes a photo of each of the dishes photographed by the other user or image data of the inside of the store, the control unit 11 displays the image data on the information display column SP through the display unit 17.

Next, in FIG. 5, when the control unit 11 detects, for example, a signal indicating that the information is touched from the left end of the information display column SP to the right direction, the control unit 11 ends the display of the information display field SP, and is suitable for the image as shown in FIG. The display field MP displays the image of the restaurant through the display unit 17. Further, the control unit 11 may, for example, display the display of the information display column SP or the display of the posting information when the signal of the posting viewing image I3 is selected in the display of the posting information in the information viewing column SP.

Further, the control unit 11 may display the advertisement information together with the building information when the advertisement information (or the posting information) is displayed after displaying the building information in the information display column SP, or may delete the building information after the information is displayed from the information display column SP. Display advertising information.

Further, when detecting the signal indicating that the in-store image displayed on the information display column SP has been touched, the control unit 11 displays the enlarged image or the reduced image of the in-store image on the information display column SP (or the image display). Column MP).

Further, when the user touches the mail image I4, the peripheral circuit outputs a signal indicating that the mail image I4 has been selected to the control unit 11.

Thereby, the control unit 11 detects the selected mail image I4 by inputting the signal that the mail image I4 has been selected, and displays the input field IP as shown in FIG. 6 on the display unit 17 on the image display. One part of the bar MP. The input field IP here is composed of a text field T for the user to input information and a touch screen type keyboard unit K. This input field IP is used by the user to input a posting information, a shop name, or an annual time.

The user uses the touch screen type keyboard unit K to write the contribution information such as the food that he has eaten, the atmosphere in the store, or the service quality of the clerk in the text field T of the input field IP. Then, when the user touches the mail image I4 again, the control unit 11 detects the selected mail image I4, and displays the text information recorded in the character field T and the image data displayed on the image display field MP and the camera. The identification information and the building identification information together serve as the posting information, and the search request signal including the posting information is transmitted to the information retrieval system 2 via the transmitting and receiving unit 12.

Next, when the server 21 receives the search request signal from the digital camera 1, the new submission information corresponding to the input of the construction identification information is written in the posting field of the construction table of the database 22. Further, the server 21 may write the posting information written in the posting writing field G3 to the posting field of the construction table of the database 22, or may be in the user registration table of the database 22, and only the search is detected. When the camera identification information included in the signal is requested, and the camera identification information is detected, the posting information is written in the posting column of the construction table of the database 22.

Next, the control unit 11 determines whether or not the detection of the end image E has been selected (step S9). Here, when the user touches the end image E, the peripheral circuit outputs a signal indicating that the end image E has been selected to the control unit 11.

Next, the control unit 11 detects that the end image E has been selected by inputting the signal of the selected end image E, and ends the process of information retrieval.

On the other hand, when the control unit 11 does not input the signal of the selected end image E and does not detect the selected end image E, the processing returns to step S1 to continue the photographing processing and the information retrieval processing of the digital camera 1. .

Further, when the browsing image I1 is selected, the control unit 11 may cause the search request signal transmitted to the information search system 2 to include the captured image data.

Then, the server 21 can also compare the surrounding image data of the building information retrieved from the construction object table and the transmitted image data, and the image data from the building object table through the image identification information of the building object extracted from the map data. The feature amount is extracted, and compared with the feature quantity of the stored peripheral image data, whether or not the value is set to be equal to or greater than the value of the similarity is determined, thereby determining whether it corresponds to the photographed object.

At this time, when it is determined that the construction of the peripheral image data and the construction of the image data are not the same as the comparison result, the server 21 may also extract the structure of the next closest distance from the map data by using the position information and the orientation information. And then compare the feature quantities again, and evaluate the similarity between the surrounding image data of the newly extracted building and the image data in the shooting.

Further, the browsing image I1 of the present embodiment may be provided in the photographing device 1 as a browsing button (not shown) similarly to the above-described photographing button B1. At this time, the function of the above-mentioned navigation button is the same as that of the above-described browsing image I1. Further, the photographing button B1 of the present embodiment can also function as a navigation button by operating a switching unit (not shown). At this time, it is not necessary to browse the image I1 or the browse button.

<Information retrieval of images after photography by digital camera 1>

Next, the present embodiment will be described using FIG. 1 and FIG. 7 and FIG. 4 to FIG. The action. 7 is a flow chart showing an operation example of the information retrieval processing of the present embodiment in the case where the image data stored in the storage unit 15 is read by the digital camera 1 and the image data is retrieved. Figure.

In the following description, for example, a case in which a user searches for a restaurant that uses dinner in the downtown area of Shinjuku, and finds a restaurant in which a restaurant is photographed after photographing a plurality of restaurants.

While the user is in the downtown area, the digital camera 1 is directed to the restaurant having the desired appearance (step S1), and then when the restaurant for the appearance of the information retrieval is found, the photography button B1 provided on the digital camera 1 is pressed ( Shutter) (step S12). Here, the control unit 11 displays the image data of the restaurant being photographed on the image display field MP of the display unit 17 as shown in FIG.

Next, when the user presses the photographing button B1, the peripheral circuit outputs a signal indicating that the photographing button has been pressed to the control unit 11.

Next, the control unit 11 detects that the photographing button has been pressed by inputting a signal indicating that the photographing button has been pressed, and provides image recognition information to the image data of the restaurant in which the photographing unit 13 is photographing, and the image. The identification information correspondingly writes the image data and the photographing time to the storage unit 15 and stores them (step S13).

Next, when the photographing button B1 is pressed, the control unit 11 writes the position information acquired by the GPS 14 and the orientation information acquired by the orientation sensor 16 to the memory unit 15 in association with the video recognition information and memorizes them (steps) S14).

Secondly, when the user collects the information of the restaurant to be photographed, the user touches the read image R of the captured image. Thereby, the peripheral circuit outputs a signal indicating that the read image R has been selected to the control unit 11.

Here, the control unit 11 determines whether or not the image is stored in the storage unit 15 by inputting a signal indicating that the read image R has been selected (step S15).

At this time, when the signal indicating that the read image R has been selected is output, the control unit 11 detects that the read image R has been selected and starts the search of the information. Therefore, the process proceeds to step S16. Further, the read image R can also be made as a read button (not shown). At this time, the read button may be provided to the digital camera 1 as the photographing button B1.

On the other hand, when the signal indicating that the read image R has been selected is not input or when the image is not stored in the storage unit 15, the control unit 11 performs new image processing, and the process returns to step S11.

Next, when the user touches the read image R and the signal indicating that the read image R has been selected is input from the peripheral circuit, the control unit 11 sequentially reads the image from the memory unit 15 in the order of time series shooting. The data (step S16) is displayed on the image display field MP by the display unit 17 as the photo image in accordance with the preset number of sheets (or each of the image data).

Moreover, when the photo image is difficult to enter a page (or according to each display), if the user touches the image displayed in the image display column MP in a manner of sliding in a predetermined direction, the photo image of the previous or next page That is, it is displayed in the image display column MP. At this time, the control unit 11 detects that the image displayed on the image display field MP has been touched in a predetermined direction, that is, the photo image of the previous or next page is displayed on the display unit 17 through the display unit 17. Display bar MP.

Next, the user selects the image of the restaurant of interest from the photo image by touching, and then touches the browse image I1, and the peripheral circuit selects the selected image recognition signal and the signal indicating that the browse image I1 has been selected. Control department 11 output.

The control unit 11 reads the position information corresponding to the image identification information from the storage unit 15 by inputting the image identification information of the selected image data after inputting the signal indicating that the browsing image I1 has been pressed. The orientation information and the search request signal including the camera identification information, the location information, and the orientation information are transmitted to the information retrieval system 2 via the transceiver unit 12 (step S5).

The processing of steps S6 to S8 below is the same as the processing of steps S6 to S6 of FIG. 3, and thus the description thereof is omitted.

Next, the control unit 11 determines whether or not the detection of the end image E has been selected (step S18). At this time, when the user touches the end image E and the signal output indicating that the end image E has been selected is output from the peripheral circuit, the control unit 11 ends the browsing process. On the other hand, when the control unit 11 does not input the signal of the selected end image E, the process returns to step S16 to continue the selection process of the image from the photo image.

<Information retrieval from shop information that has been input to digital camera 1>

Next, the operation of this embodiment will be described with reference to Figs. 1 and 8 and Figs. 4 to 6 . 8 is a view showing that when the user inputs the name of the shop to the digital camera 1, the information is retrieved from the construction table of FIG. 2 of the corresponding store name stored in the database 22, and the information of the restaurant of the entered shop name is searched. A flowchart of an operation example of the information retrieval processing of the present embodiment.

In the following description, for example, it is intended to confirm the state of the information of the restaurant heard from a friend when the dinner is to be used in Harajuku.

When the user selects the search image I5 by touch, the peripheral circuit outputs a signal indicating that the search image I5 has been selected to the control unit 11.

Thereby, the control unit 11 inputs an indication that the search image I5 has been selected. The signal detects that the search image I5 has been selected, and displays the input field IP as shown in FIG. 6 on the display unit 17 in one of the image display fields MP.

Next, the user writes the name of the restaurant of the restaurant to be searched using the touch screen type keyboard unit K in the character field T of the input field IP (step S21), and the user touches the search image I5 again (step S22).

Thereby, the peripheral circuit outputs the character data indicating that the search image I5 has been selected and the character data of the shop name input to the character column T to the control unit 11.

Next, the control unit 11 detects the selected search image I5 by inputting the signal indicating that the search image I5 has been selected, reads the information of the shop name input to the character field T, and recognizes the camera with itself. The information is transmitted as a search request signal to the information retrieval system 2 via the transceiver 12 (step S23).

Next, when the server 21 inputs the search request information, the information of the building (store) corresponding to the store name is read from the construction object table in the database 22 (store information, information in the table of FIG. 2) ) (step S24).

After reading the store information, the server 21 transmits the acquired shop information to the digital camera 1 (step S25).

After receiving the store information through the transceiver unit 12, the control unit 11 displays the image data around the shop included in the building information in the image display field MP of FIG. 5 via the display unit 17, and displays the building information in the information display column SP. (Step S26). For example, information on the types of restaurants (Chinese, Japanese, French, Italian, etc.) and telephone numbers are displayed.

Further, when the user selects the CM image I2 by touch, the control unit 11 detects that the CM image I2 has been selected, and displays the restaurant advertisement information (menu, number of seats, in-store image) included in the search result information. Chef's recommendation today The information is displayed on the information display column SP through the display unit 17.

Further, when the user selects the posting viewing image I3 by touch, the peripheral circuit outputs a signal indicating that the posting viewing image I3 has been selected to the control unit 11. The control unit 11 detects that the posted viewing image I3 has been selected by inputting the signal of the selected posting viewing image I3, and displays the posting information written by another user included in the search result information on the display unit 17. In the information display bar SP.

Further, when there is a plurality of posting information, the control unit 11 sequentially displays the plurality of posting information on the information display column SP through the display unit 17. Further, when the posting information also includes the image data, the control unit 11 displays the image data on the information display column SP through the display unit 17.

Next, the control unit 11 determines whether or not the detection of the end image E has been selected (step S27). The detection of the selection of the end image E is the same as the processing of step S9 in the information search of the image captured by the digital camera 1, and therefore the description thereof is omitted.

At this time, when the control unit 11 inputs a signal indicating that the user has selected the end image E by touching the end image E from the peripheral circuit, the control unit 11 ends the browsing process. On the other hand, when the signal indicating that the end image E has been selected is not input, the processing returns to the step S21, and the retrieval of the shop information is continued.

<Charging for the store registered in the database 22>

The construction item list of the database 22 may also store the information of the discount coupons according to the stores when the construction objects are shops (including restaurants or companies).

Next, the server 21 adds the discount coupon information to the search result information and transmits it to the digital camera 1.

When the user uses the above discount coupon information to dine or shop, the server 21, based on whether the discount coupon information is used to detect whether the user has a meal or shopping. For example, when the discount coupon information is displayed on the barcode (including the two-dimensional barcode) of the information display column SP of the digital camera 1, the barcode is read by the reader of the store, and the camera is sent from the digital camera 1. The identification information and the cost of shopping (or dining) are transmitted by the information network information retrieval system 2 which displays the use of the discount coupon.

Thereby, when the server 21 receives the usage information, the history information corresponding to the camera identification information attached to the usage information is read from the database 22, and the information is used during the information utilization phase. Stores or use the information provided by the store to use the store or view the submission information and use the information of the store, etc., that is, the extent to which the information on the use of the information in the database 22 is used Shops used by the shop are charged differently. Further, the server 21 writes a history of the information search in accordance with each camera market information and the history of the discount coupon information in the history table stored in the database 22.

The bar code includes information showing the building identification of the store. The database 22 is provided with a fee schedule for storing the accumulated value of the charge history and charge corresponding to each store corresponding to the monument identification information.

Next, the server 12 corresponds to the building identification information, and writes the charge corresponding to the used amount and the utilization stage of the above information as a history into the above-mentioned fee list, and adds a new charge to the accumulated value to update the accumulated value.

<Additional processing of points to users>

The server 21 is a number of points corresponding to the amount of use when the user uses the discount coupon information in the store to use the discount coupon information (for example, the usage amount is multiplied by the point coefficient). User login of library 22 The number of points to be found in the table is accumulated corresponding to the camera identification information.

Further, the server 21 accumulates the number of points of the value set in advance by the user who has transmitted the posting information in association with the camera identification information in the user registration table.

The above points can also be used in place of money, in conjunction with discount coupon information in the payment price.

<Display order of submission information>

Here, the server 21 may also transmit the nickname and the title as the posting information and the posting identification information to the digital camera 1 at the initial stage.

Next, the control unit 11 initially displays only a plurality of nicknames and titles in the information display column SP. Then, the user touches the nickname and the title of the submission information of interest from the plural display. Thereby, the peripheral circuit transmits the posting identification information indicating the nickname and the title and the selected posting information to the control unit 11.

Thereby, the control unit 11 transmits the posting identification information and the posting information transmission request to the information retrieval system 2.

Thereby, the server 21 transmits the text data and the video material (the entire posting information) corresponding to the transmitted posting identification information to the digital camera 1.

Here, the server 21 assigns the posting identification information for identification to each posting information, and writes it to the user registration table in association with the camera identification information and stores it.

In addition, in the present embodiment, after receiving the text data and video data from the information retrieval system 2, the control unit 11 may display the text data in the information display column SP and display the image data in the image display field. MP.

Moreover, the server 21 is in the user login table and is checked from the user login table. The submission identification information corresponding to the submitted posting information is referenced, and the reference number of the camera identification information corresponding to the submission identification information is added.

Then, the server 21 displays the nickname and the title of the user who has a large number of reference times in the information display column according to the order of the number of times the posting information is selected, in the display stage of the first nickname and the title of the user. The order of the SP is the upper display table, which is sent to the digital camera 1.

Thereby, the control unit 11 sequentially displays the nickname and the title in the information display column SP in accordance with the above display table.

<Display processing of image data in the past>

Further, in the present embodiment, the database 22 may have a past video table for storing image data of buildings and scenery for each latitude and longitude in each year in accordance with each latitude and longitude.

When the user selects the past image image I6 by the touch, the peripheral circuit outputs a signal indicating that the past image image I6 has been selected to the control unit 11.

Thereby, the control unit 11 detects that the past video image I6 has been selected by inputting a signal indicating that the past video image I6 has been selected, and displays the input field IP as shown in FIG. 6 on the display unit 17. The image display bar is part of the MP.

Next, the user touches the past video image I6 (or browses the image I1) after writing the year (for example, the epoch) in the character field T using the touch screen type keyboard portion K.

Thereby, the peripheral circuit transmits a signal indicating that the past video image I6 has been selected and the text data of the above-mentioned year to the control unit 11.

When the control unit 11 detects that the signal of the past video image I6 has been selected, the text data is read (the year in which the display is written in the character field T).

After reading the data of the year, the control unit 11 transmits the past image search request to the information retrieval system 2 together with the year of reading, location information, orientation information, and camera identification information.

Next, in the information retrieval system 2, the server 21 selects a past video table corresponding to the latitude and longitude based on the position information of the building (received from the digital camera 1 displayed in the image display column MP). Next, the server 21 reads the image data corresponding to the orientation information and the year in the selected past image table, and transmits the read image data to the digital camera 1. The digital camera 1 displays the video data corresponding to the above-mentioned year received from the server 21 on the video display field MP through the display unit 17. Further, the server 21 transmits the read image data and the information to the digital camera 1 when information or the like is added to the read image.

In this way, the user can obtain information on what kind of construction in the past years, or only the scenery and no other images.

Here, when the server 21 cannot retrieve the past image table of the corresponding latitude and longitude, the server 21 searches for the past video table of the latitude and longitude in the direction of the orientation information and is the nearest latitude and longitude, and extracts the image data from the table.

In addition, as long as there is no photo, the image data of the CG (Computer Graphics) created by the epoch may be replaced by the image data of the photographic image, and stored in the past in the memory unit 15 corresponding to the year. Image table.

In one embodiment, the portable information device, the imaging device, and the information obtained by acquiring the information on the position of the subject and capturing the relationship between the subject and the position information are obtained by using the information. The information acquisition system of the subject information.

In one embodiment, the user can obtain orientation information (eg, azimuth). The orientation information is used to know whether the user has taken a subject in either direction from the photographing position.

In one embodiment, it is possible to easily obtain information on the subject being photographed by the user, for example, what kind of building the building is.

In one embodiment, since the user not only captures the positional information of the photographing position of the subject, but also obtains the orientation information (that is, the display is photographed in any direction from the position indicated by the position information acquired by the position information acquiring unit). In the orientation information, it is possible to specify the azimuth angle of the subject to be photographed, that is, the direction in which the specific user directs the photographing device.

In one embodiment, since the position information and the orientation information of the photographed subject can be obtained, the user can easily obtain the photograph taken by the photographing device from the photographed position information and the orientation information search database. Information on the construction.

1‧‧‧ digital camera

2‧‧‧Information retrieval system

3‧‧‧Wire Base Station

4‧‧‧Information Communication Network

11‧‧‧Control Department

12‧‧‧Transceiver

13‧‧‧Photography Department

14‧‧‧GPS

15‧‧‧Memory Department

16‧‧‧Azimuth sensor

17‧‧‧Display Department

18‧‧‧Timer

21‧‧‧Server

22‧‧‧Database

Claims (32)

A portable information device, comprising: an image sensor; a display for displaying an image of an object generated by the image sensor and at least a position identification information according to a position information of the current position and an image of the image of the object a related information obtained related to the object; an image displayed on the display, the user displays the image of the object at the current position for the user to submit the manuscript information to the current position; and the control unit When the image of the object is displayed on the display by the image, the posting information submitted through the image is displayed on the display together with the image of the object and the related information. A portable information device, comprising: an image sensor; a display for displaying an image of an object generated by the image sensor and at least a position identification information according to a position information of the current position and an image of the image of the object Corresponding information related to the object obtained; the image is displayed by the user for inputting the manuscript information to the object while the image of the object is displayed on the display; and the control unit has the first mode and a second mode; in the first mode, the user passes the image to the current position In the column displaying the posting information, the column of the posting information is displayed superimposed on the image of the object, and in the second mode, the user submits the posting in the column displaying the posting information through the image. News. A portable information device, comprising: an image sensor; a display for displaying an image of an object generated by the image sensor and at least a position identification information according to a position information of the current position and an image of the image of the object a related information obtained related to the object; an image for the user to submit the manuscript information to the current position while the image of the object is displayed on the display; and a control unit for the object Displaying the related information and the posting information submitted by the image on the display during the display; the posting information includes an image of the object or its related object captured by the image sensor And evaluation of the image. The portable information device of any one of claims 1 to 3, wherein the display is a touch panel type display for the user to input the posting information. The portable information machine of any one of claims 1 to 3, wherein the touch panel type keyboard can be displayed on the display. The portable information device of any one of claims 1 to 3, wherein the display displays a text field for inputting characters and a touch panel type keyboard in order to support input of the posting information. The portable information machine of any one of claims 1 to 3, wherein the related information includes coupon information related to the object. The portable information device of any one of claims 1 to 3, wherein the object is a store; the posting information includes an image related to the store or the product. The portable information machine of any one of claims 1 to 3, wherein the object is a restaurant; the posting information includes images related to a building or a menu or a menu of the restaurant. The portable information machine of any one of claims 1 to 3, wherein the related information is selectively obtained through an external server. The portable information machine of any one of claims 1 to 3, wherein the image has an identification image that is directed to the user. The portable information machine of any one of claims 1 to 3, wherein the display simultaneously displays an image of the object and the related information. A portable information device, comprising: an image sensor; a display for displaying an image of an object generated by the image sensor and at least a position identification information according to a position information of the current position and an image of the image of the object a related information obtained related to the object; an image for the user to input the posting information to the object, and at least one of the text input text field and the touch screen type keyboard when the submission information is input On the display; The control unit has a first mode and a second mode; and in the first mode, the related information including the posting information is displayed on the display while the image of the object is displayed on the display; and the second mode is displayed At least one of the character field and the touch screen type keyboard is displayed on the display; the image has an image displayed by superimposing the image of the object in the first mode and is used for the first The mode is switched to the image of the second mode. A portable information device, comprising: an image sensor; a display for displaying an image of an object generated by the image sensor and at least a position identification information according to a position information of the current position and an image of the image of the object a related information obtained related to the object; an image for the user to input the posting information to the object, and at least one of the text input text field and the touch screen type keyboard when the submission information is input The display unit and the control unit have a first mode and a second mode. In the first mode, the character field and the touch screen type keyboard are not displayed on the display, and the image of the object is displayed on the display. During the display, the related information including the posting information is displayed on the display; in the second mode, the related information is displayed on the display while at least one of the text field and the touch screen type keyboard is displayed on the display Not displayed. Such as the information-bearing machine of claim 13 or 14 In the first mode, during the display of the image of the object, an image related to the predetermined operation and the related information are displayed on the display. The information carrying machine of claim 13 or 14, wherein the related information includes coupon information related to the object. The information carrying machine of claim 13 or 14, wherein the image has an identification image for guiding the user. The information carrying machine of claim 13 or 14, wherein the display simultaneously displays an image of the object and the related information. A portable information machine comprising: a display; an image sensor; a position information acquisition unit for obtaining position information showing a current position; and a memory unit for storing a past image with a positional relationship with respect to a past image of the past image and storing And a control unit that displays at least one of the past images stored in the memory portion based on the position information of the current position and the position information of the past image during display of the image generated by the image sensor Displayed on the display. A portable information machine comprising: a display; an image sensor; a position information acquisition unit that obtains position information showing a current position; and a memory unit that displays past images and position information about past images of the past image with respect to the past image The date information of the past images is stored after the connection is made; and The control unit displays at least one of the past images stored in the memory unit based on the position information indicating the current position and the date information input by the user while displaying the image generated by the image sensor For the display. The portable information device of claim 19 or 20, wherein the past image is an image taken by the image sensor. For example, the portable information device of claim 19 or 20, wherein the past image is an image taken by the user. The portable information device of claim 19 or 20, wherein the display displays an image of the object generated by the image sensor and the position information according to the current position and the object At least one of the image recognition results of the image is related information related to the object. For example, the portable information device of claim 19 or 20, wherein the display is a touch panel type display capable of inputting information about the posting of the past image. A portable information device having: an image sensor; a position information acquisition unit for obtaining position information; and a memory unit for storing an image of an object photographed by the image sensor and the location information and storing the relationship; the display; The control unit has a first mode in which the user reads an image of the object, and a user reads the image from the memory unit, and superimposes the image read from the memory unit. Information acquisition The related information related to the object is displayed in the second mode of the display, and the input unit inputs the posting information related to the image read from the storage unit. A portable information device includes: an image sensor; a position information acquisition unit that acquires position information of a photographing position of the object; and a memory unit that assigns the position information to the plurality of images captured by the image sensor After the connection relationship, the display unit has a first mode in which at least one of the plurality of images is selected by the user after the plurality of images are captured, and a method of overlapping the image read from the memory unit The related information related to the object obtained based on the location information is displayed in the second mode of the display; and the input unit inputs the posting information related to the image read from the storage unit to the location information. A portable information machine having: an image sensor; a memory unit for storing an image of an object photographed by the image sensor; a display; a control unit having a user reading from the memory unit after the image is captured The first mode of the indication of the image, and the overlap with the first mode a mode in which the image is read, a second mode in which the related information related to the object is obtained based on the read image recognition result of the image; and an input unit that reads the image from the memory unit The relevant submission information is input to the object. The portable information machine of any one of claims 25 to 27, wherein the related information includes coupon information related to the object. The portable information device of any one of claims 25 to 27, wherein the input portion is an image for the user to touch the operation. The portable information device of any one of claims 25 to 27, wherein the input unit has a touch screen type keyboard for the user to input the posting information. The portable information machine of any one of claims 25 to 27, wherein the display simultaneously displays the image and the related information. An information acquisition system comprising: a server; a database; and a portable information machine of any one of claims 1 to 31.