JP2005050315A - Portable terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information retrieval system enabling a user to immediately obtain information for a scenery in front of him/her or the music or animal call coming from a circumference which he/she wants to know without requiring a complicated operation. <P>SOLUTION: A retrieval server device 10 comprises a database 20 recording an object of a designated data format that is a designated object and information for each object. The data format of a retrieval object includes image data and voice data. The database 20 records information for scenery image data and information for each scenery, records information for animal call voice data and information for each animal. A user terminal 30 comprises an imaging part 31 for generating scenery image data and a voice recording part 33 for generating voice data. The device receives data of the retrieval object of the data format from the user terminal 30, detects an object corresponding to the retrieval object from the objects stored in the data base 20, and transmits information for this object to the user terminal 30 as a retrieval result. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to providing an information search service to a user via a communication line, and more particularly to a portable terminal used for an information search service for searching multimedia data such as image data and audio data.

  Conventional information retrieval systems that provide information retrieval services to users via communication lines include web page searches on the Internet, various statistics and patents via communication lines such as the Internet, personal computer communication, and telephone lines. There are those that perform database searches and the like.

  The search instruction is performed by inputting a search word or a search expression from a keyboard or the like, or selecting a search target from the displayed options.

  However, the conventional information retrieval system has the following problems.

  First, in the conventional information retrieval system, it is necessary to specify the content to be searched in detail using a search expression or a search word. For example, the operation for instructing the search is troublesome and troublesome, and the user knows. I couldn't immediately get information about what I wanted to do.

  Secondly, in a conventional information retrieval service via a communication line, multimedia data such as image data and audio data cannot be designated in place of a retrieval word designated for retrieval.

  Recently, digital cameras and other devices that allow users to easily create such image data have become widespread, and furthermore, high-speed and large-capacity that can instantly transmit these image data and the like over a communication line. Therefore, there is a need for an information search service via a communication line that performs a search based on these image data and the like.

  The object of the present invention is to solve the above-mentioned drawbacks of the prior art, and requires complicated operations for information on the scenery in front of you, the music you hear, the sounds of animals, etc. that you want to know. It is to provide a portable terminal used for an information search service that can be obtained immediately without being taken.

  In order to achieve the above object, a portable terminal of the present invention is a portable terminal that includes a storage medium and performs communication via a communication line, and transmits a search object recorded on the storage medium via the communication line, A search result for the search object is received via the communication line.

  The portable terminal of the present invention according to claim 2 is characterized in that the search object is still image data.

  The portable terminal of the present invention according to claim 3 is characterized in that the search object is moving image data.

  The portable terminal of the present invention according to claim 4 is characterized in that the search object is sound data.

  A portable terminal according to a fifth aspect of the present invention includes a display, and the search result is displayed on the display.

  The portable terminal of the present invention according to claim 6 is a portable terminal that performs communication via a communication line, transmits voice data collected by a microphone as a search object via the communication line, and a search result for the search object Is received via the communication line.

  The mobile terminal of the present invention according to claim 7 is a mobile terminal that performs communication via a communication line, transmits image data captured by a camera as a search object via the communication line, and displays a search result for the search object. It receives via the said communication line, It is characterized by the above-mentioned.

  The portable terminal of the present invention according to claim 8 transmits the search object to a search server device that provides an information search service via the communication line, and receives a search result for the search object from the search server device. It is characterized by.

  The portable terminal of the present invention according to claim 9 is a portable terminal that includes position detecting means, a camera, and a storage medium, and performs communication via a communication line, and when the camera captures image data, The current position information is detected by a detection means, the image data and the current position information are stored, the current position information and the image data are transmitted as a search object via the communication line, and a search result for the search object is displayed as the search object. It is characterized by receiving via a communication line.

  The portable terminal of the present invention according to claim 10 is characterized in that the search result is guidance or information related to the search object.

  According to an eleventh aspect of the present invention, there is provided a portable terminal comprising a display, wherein the search result is displayed on the display.

  The portable terminal of the present invention according to claim 12 acquires a search object from an external device, transmits the search object via a communication line, and receives a search result for the search object via the communication line. To do.

  A portable terminal according to a thirteenth aspect of the present invention is characterized in that the search object is acquired from the external device via infrared communication.

  A portable terminal according to a fourteenth aspect of the present invention is characterized in that the search object is acquired from the external device via a code.

  A portable terminal according to a fifteenth aspect of the present invention includes a storage medium, and stores the search object acquired from the external device in the storage medium and then transmits the search object.

  According to the mobile terminal used for the information search service of the present invention, the following effects are achieved.

  First, the user can easily receive information related to what is visible or audible to the user without taking time or effort. For example, by sending a picture of a mountain to an information search service company using a terminal, detailed information such as the name of the mountain that the user wishes to know can be immediately received by the information terminal. Further, as detailed information of the searched mountain, not only the name of the mountain but also climbing route information is obtained, so that it is convenient to climb without hesitation.

  Second, since the server device can be notified of the current position by a method such as connecting a car navigation system to the user terminal of the information search system of the present invention, the shooting position of the image to be searched can be determined. It becomes much easier to specify and high search accuracy can be realized.

  Thirdly, as a search service using voice information, a user can input “nasal song” to a terminal of an information search service company using a mobile phone and receive detailed information such as “song title”. In addition, it is possible to receive information such as the name of the bird by using a picture of the “bird” and its “scream”, and it is possible to meet the needs of bird watching enthusiasts.

  Fourth, since the usage fee for the search service can be paid through a settlement organization such as a credit card company, the user can easily pay the usage fee, and the search service can be provided. All of them including the collection of usage fees can be automated by the server device.

  Fifth, search can be performed using various multimedia data such as voice and images, and the contents that can be displayed when the search is applicable (mountain name, mountain climbing route, etc.) are freely prepared by the service provider. Therefore, it is possible to realize an encyclopedia via a communication line such as the Internet.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 2 is a diagram illustrating a configuration of the information search system 100 according to the first embodiment of this invention.

  Referring to FIG. 2, an information search system 100 according to the present embodiment includes a database 20 storing data to be searched and an image / sound designated by the user in an information providing service company that provides the information search service to the user. A server device 10 that searches the database 20 based on moving image data and the like and notifies a search result is provided, and the server device 10 is connected to the user terminal 30 of each user via a communication line 40.

  As the communication line 40, for example, a line such as the Internet or personal computer communication, a telephone line, a wireless telephone line, a LAN, and other dedicated communication lines can be used.

  As the user terminal 30, for example, a mobile communication terminal such as a mobile phone or a PHS, or an information terminal such as a personal computer, a notebook personal computer, or a PDA (personal digital assistant) can be used.

  The user terminal 30 is connected to the server device 10 via the communication line 40, and instructs the server device 10 to search by transmitting a search object indicated by image / audio data or the like. The search result is received via the line 40.

  The search here is not limited to a method using character data of words or sentences in a search word in the same manner as a search word used in a general search system, but a landscape shown by a data format such as image data or audio data This object is also used to specify the search. Such a landscape or mountain image, bird or animal cry, or one phrase in a musical work that instructs a search indicated by image data or audio data is hereinafter referred to as a search object.

  In the user terminal 30, for example, in the devices such as the commercially available mobile phones and laptop computers shown in the above-described examples, a microphone for inputting voice data is provided (or connection is possible), and the surrounding scenery Many digital cameras that can be easily converted into image data can be connected. Using this, the user can transmit, as a search object, audio data indicating objects such as music and animal calls that can be heard directly by the user, and image data indicating objects such as surrounding scenery.

  In addition, the search object is not limited to a method using voice data recorded by the user on the spot, but also a semiconductor recording circuit, magnetic disk, or other recording medium inside (or other external device) of the user terminal 30 Data files such as sound, images, and moving images recorded in the above may be read out and used. For example, in a digital camera, captured image or video data is recorded on a recording medium in the digital camera, and the recorded data is transmitted to a user terminal 30 such as a personal computer via a code or infrared communication. Can be read.

  In this way, when the user transmits various multimedia data such as voice, image, moving image and the like as search objects to the server apparatus 10 by the user terminal 30, the server apparatus 10 executes a search from the database 20 based on the search objects.

  In the database 20, many objects to be searched for by image, sound, etc., and information related to each object are recorded in advance. For example, in the image data, it is possible to record image data of mountains and scenery of various places and information such as place names related to the mountains and scenery. Also, in the voice data, it is possible to record information such as the sound data of birds and animals, the voice data of music works, and names related to the animals and music works.

  Accordingly, the server device 10 receives, for example, a mountain image as a search object from the user terminal 30, searches the database 20 for a mountain image based on the search object, and records the mountain image corresponding to the corresponding mountain image. It is possible to read out information on the mountain (such as the name of the mountain) and notify the user terminal 30 of this. Similarly, in the case of voice data, for example, a bird call is received as a search object from the user terminal 30, and a bird call is searched from the database 20 based on the search object, and corresponding to the corresponding bird call. The recorded bird information (bird name, etc.) can be read out and notified to the user terminal 30.

  In addition, for example, music titles can be searched from music flowing in supermarkets and department stores, music flowing from televisions and radios, nasal songs sung by users, and the like.

  In addition, since the search target is multimedia data such as an image, the server device 10 does not directly compare the transmitted search object with the object recorded in the database 20 but also the characteristics indicated by the search object as necessary. It is preferable to extract and compare with the characteristics of each object recorded in the database 20. In this case, the process of extracting the part that makes the characteristic from the image data or the sound data can be performed by using a conventional technique such as using a computer program for executing the process.

  Thus, the user can be provided with information such as the name of the mountain from the image data of the mountain, and can be provided with information such as the name of the bird from the sound data of the cry of the bird.

  Furthermore, not only the name but also abundant information is recorded in the database 20 as information related to images and sounds and provided to the user to provide an encyclopedia through the communication line 40. That is, for example, when searching for a mountain image as a search object, not only the name of the mountain but also various information such as a map of the mountain, a mountain climbing route, sightseeing guidance, traffic guidance, weather forecast, etc., and photographed by a photographer It is possible to provide the user with image data and the like of the photograph of that mountain. Similarly, when searching for a bird call as a search object, not only the name of the bird, but also detailed information on the bird, such as the bird's picture book, images of the bird, etc. Can be provided.

  Here, in order to perform a search using multimedia data such as images and sounds as search objects, the information processing apparatus requires extremely high-speed and high-speed processing capability, and furthermore, as in this embodiment, a bird cry Therefore, in order to identify the type of bird, it is necessary to register an extremely large number of types of bird calls in the database 20, and conventionally, such a search cannot be used by general users.

  However, in the information retrieval system 100 according to the present embodiment, the user operates the user terminal 30 via the communication line with respect to the server device 10 which is a high-performance information processing device that performs retrieval based on voice and image data. By executing the search, it is possible to immediately check and provide information that the user wants to know from partial information such as what the user sees at that time and sounds heard by the ear.

  FIG. 1 is a block diagram showing an example of a detailed configuration of the information search system 100 according to the present embodiment.

  In the example of FIG. 1, the Internet 41 is used in the communication line 40 and further connected to the user terminal 30 via the mobile telephone line 43.

  As described above, by using the Internet 41, a provider of an information search service can easily receive search requests from many users. This may be a method of managing a web page for the server device 10 to accept a search request or operating the information retrieval service website by providing the server device 10 with a web server function.

  In addition, since communication with the user terminal 30 can be performed via the mobile telephone line 43, the user can easily obtain information on the scenery and the like seen on the go.

  In the example of FIG. 1, the user terminal 30 includes a photographing unit 31 for photographing a surrounding landscape, a position detecting unit 32 that detects the position of the user terminal 30, and an audio recording unit 33 that records sounds that can be heard outside. I have.

  The photographing unit 31 is a camera for photographing surrounding images, and a CCD (charge coupled device) camera or the like can be used. In addition, the photographing unit 31 is not necessarily limited to the form built in the main body of the user terminal 30, and the user terminal 30 may be connected to an external digital camera, and the digital camera may capture the image.

  The position detection unit 32 detects the position of the user as the current position of the user terminal 30 in the same manner as in the car navigation system by using, for example, GPS (global positioning system). The detected position can be notified to the server device 10.

  In order to identify which mountain or landscape the user has photographed, it is possible to make a more accurate determination by referring to the photographing position rather than using only the image, In addition, since the image that requires the search process in the database 20 can be limited to the vicinity of the position of the user terminal 30 (within an eye reachable range), the search process can be further speeded up.

  Further, the position detection unit 32 is not necessarily limited to the form incorporated in the user terminal 30 main body, and connects the user terminal 30 and a car navigation system including a GPS or the like, and the user terminal 30 uses the current position data detected by the car navigation system. It may be received and notified to the server device 10.

  Further, in the case where the mobile communication terminal is the user terminal 30 as in the example of FIG. 1, the position of the user terminal 30 is recognized by the base station 44 or the like (not including a special device such as GPS). ) Position information recognized by the base station 44 or the like may be used.

  The voice recording unit 33 is a microphone for recording voice. In many portable communication terminals, information processing terminals, and the like, the voice recording unit 33 is built-in or can be connected to a microphone cord.

  In addition, the information search service company will operate the information provision service at the advertising fee of advertising that is collected from the user or is posted on the web page for accepting other information provision services, etc. A method is conceivable.

  Here, when the service fee is collected from the user, the server device 10 is connected to and communicates with a terminal of a settlement organization such as a credit card company that mediates payment of the user's service fee via the communication line 40. However, each time the user uses the search service, it is also possible to automatically execute the settlement of charges by using a credit card number or the like input (or registered in advance) by the user.

  In addition, the method is not limited to a method of making a payment every time it is used, but may be a method in which each user is registered in advance and withdrawals from bank accounts or bank transfers are performed once a month.

  Next, the process of the information provision system 100 of this Embodiment is demonstrated.

  FIG. 3 is a flowchart for explaining the processing of the information search system 100 according to the present embodiment. The user searches the database 20 for a mountain image taken by the user, and the server device 10 uses the name of the mountain as a user. To the user terminal 30.

  Referring to FIG. 3, first, the user connects from the user terminal 30 to the Internet website of the information search service company, and displays a web page for accepting an information search request (steps 301 and 302).

  4, 5, and 6 are examples of information search pages provided by an information search service company, and here, in particular, an example using a user terminal 30 by a mobile communication terminal such as a mobile phone is shown. It is displayed on the display screen 34 by a display or the like. In this way, in this embodiment, a portable communication terminal capable of using the Internet such as i-mode can be used as the user terminal 30.

  FIG. 4 is a diagram illustrating an example of a search request page displayed on the user terminal 30 according to the present embodiment. In the example of FIG. 4, on the search request page, the type of information to be requested (mountain name) and the data format (image data) of the search object can be specified.

  Next, image data of a landscape including “mountains” photographed by a digital camera (which can be connected to the user terminal 30) is transmitted as a search object from the user terminal 30 to the server device 10 via the search request page. Further, it is notified that the requested information is the name of the mountain (steps 303 to 306).

  Next, the server device 10 searches the database 20 of the information search service company for “mountains” that match the transmitted mountain image data (step 307), and determines the number of peaks that match the search from the user terminal of the user. 30 (step 308).

  FIG. 5 is a diagram illustrating an example of the corresponding number page displayed on the user terminal 30 according to the present embodiment. In the example of FIG. 5, the number of mountains that match the search is displayed, and the user terminal 30 can notify the server device 10 of whether or not to receive the search result.

  When the information on the number of cases matching the search is received (step 309), the user determines whether to receive the search result and notifies the server device 10 of the selection (step 310). If it is not received, the process of the information search system 100 ends here. If it is provided, the server device 10 receives information on the retrieved mountain name.

  FIG. 6 is a diagram illustrating an example of a search result page displayed on the user terminal 30 according to the present embodiment. In the example of FIG. 6, the name of the mountain that matches the search is displayed as “Mt. Fuji”, and the server device 10 determines whether to display or end the name of another mountain that matches the search. Can be notified.

  Also, the usage fee for this search service is such that the server device 10 automatically communicates with a payment institution such as a credit card company via the communication line 40, communicates the user's credit card number, etc. A payment can be requested and received (steps 314-317).

  The processing of the embodiment in which the search is performed using the image data of FIG. 3 has been described above, but the same applies to the case where the search is performed using audio data or moving image data.

  In addition, in the case where a search is immediately requested for the image data of the landscape in front of the eyes photographed by the photographing unit 31, by using the data of the current position (photographing point) detected by the position detecting unit 32, Extremely high search accuracy can be realized. For this reason, for example, a user can take a picture of a building, a store, a station, or the like that is noticeable in the city and search for it, and can receive information about the store. In this case, when the image data to be searched in steps 303 and 304 is transmitted, the data of the current position is also transmitted to the server device 10. By limiting the search target correspondingly to (restrict to objects that can be photographed from the photographing point), processing can be performed in the same manner as in the example of FIG.

  With the information search system 100 according to the present embodiment described above, the user can easily receive information related to what is visible or audible to the user without taking time or effort.

  Note that the information search system 100 according to the present embodiment implements search reception and execution in the server device 10, billing processing, display of search instructions and search results in the user terminal 30, and other functions in hardware. Needless to say, it can be realized by loading a computer program having each function into a memory of a computer processing apparatus. This computer program is stored in a magnetic disk, semiconductor memory, or other recording medium 80 or 90. Each function described above is realized by being loaded from the recording medium into the computer processing apparatus and controlling the operation of the computer processing apparatus.

  Although the present invention has been described with reference to the preferred embodiments and examples, the present invention is not necessarily limited to the above-described embodiments and examples, and various modifications can be made within the scope of the technical idea. Can be implemented.

It is a block diagram which shows an example of a detailed structure of the information search system of the 1st Embodiment of this invention. It is a figure which shows the structure of the information search system of the 1st Embodiment of this invention. It is a flowchart for demonstrating the process of the information search system of the 1st Embodiment of this invention. It is a figure which shows an example of the search request page displayed on the user terminal of the 1st Embodiment of this invention. It is a figure which shows an example of the applicable number page displayed on the user terminal of the 1st Embodiment of this invention. It is a figure which shows an example of the search result page displayed on the user terminal of the 1st Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Information retrieval system 10 Server apparatus 20 Database 30 User terminal 31 Image pick-up part 32 Position detection part 33 Voice recording part 34 Display screen 40 Communication line 41 Internet 42 Mobile telephone line 43 Mobile telephone base station 50 Settlement organization 80 Recording medium 90 Recording medium

Claims (15)

A portable terminal comprising a storage medium and performing communication via a communication line,
Sending the search object recorded in the storage medium via the communication line;
A mobile terminal that receives a search result for the search object via the communication line.   The mobile terminal according to claim 1, wherein the search object is still image data.   The mobile terminal according to claim 1, wherein the search object is moving image data.   The mobile terminal according to claim 1, wherein the search object is sound data. With a display,
The portable terminal according to any one of claims 1 to 4, wherein the search result is displayed on the display. A mobile terminal that communicates via a communication line,
Send the voice data collected by the microphone as a search object via the communication line,
A mobile terminal that receives a search result for the search object via the communication line. A mobile terminal that communicates via a communication line,
Send the image data taken by the camera as a search object via the communication line,
A mobile terminal that receives a search result for the search object via the communication line.   The search object is transmitted to a search server device that provides an information search service via the communication line, and a search result for the search object from the search server device is received. The mobile terminal according to claim 7. A portable terminal having a position detection means, a camera, and a storage medium and performing communication via a communication line,
When shooting image data with the camera, current position information is detected by the position detection means to store the image data and the current position information,
Send the current position information and the image data as a search object via the communication line,
A mobile terminal that receives a search result for the search object via the communication line.   The mobile terminal according to claim 9, wherein the search result is guidance or information related to the search object. With a display,
The mobile terminal according to claim 9 or 10, wherein the search result is displayed on the display. Obtain a search object from an external device, send the search object via a communication line,
A mobile terminal that receives a search result for the search object via the communication line.   The mobile terminal according to claim 12, wherein the search object is acquired from the external device via infrared communication.   The mobile terminal according to claim 12, wherein the search object is acquired from the external device via a code. A storage medium,
The mobile terminal according to any one of claims 12 to 14, wherein the search object is transmitted after the search object acquired from the external device is stored in the storage medium.

Images