JP5614116B2 - Communication terminal - Google Patents

Description

  The present invention relates to a communication terminal.

  2. Description of the Related Art An image pickup apparatus that can place an image data print order is known (for example, see Patent Document 1). Is going.

JP 2007-304697 A

  However, in this imaging apparatus, in order to transmit information for receiving services such as printing of image data to a place other than a pre-registered store, it is necessary to search and register the store again, which is troublesome. Met.

  An object of the present invention is to provide a communication terminal that can superimpose and display information for receiving provision of a specific service on a through image.

A communication terminal according to the present invention provides a photographing unit that photographs a subject, a display unit that displays a through image based on a photographing signal from the photographing unit, a self-position measuring unit that measures self-position, and provision of services. A search condition setting unit that sets a search condition for receiving, a search range setting unit that determines a search range based on the self-position, a transmission unit that transmits the search condition and the search range to an external device, and Map information including the shooting direction and the self-location relating to the receiving unit that receives the search result based on the search condition and the search range, the direction measuring unit that measures the shooting direction by the shooting unit, and the shooting range by the shooting unit was displayed on the through image, a display control unit for displaying an image indicating the service to provide the location of the service in the map information based on the search result, the scan A narrowing unit that narrows down the search result based on the angle of view of the image, and the display control unit, when narrowing down the search result by the narrowing down unit, replaces the map information with the search result A search result image based on the above is displayed .

  According to the communication terminal according to the present invention, it is possible to superimpose and display information for receiving provision of a specific service on a through image.

1 is a block diagram showing a system configuration of a digital camera according to an embodiment of the present invention. It is a flowchart which shows the process for receiving provision of the specific service of the digital camera which concerns on embodiment of this invention. It is a figure which shows the image displayed on the LCD display part of the digital camera which concerns on embodiment of this invention. It is a figure which shows the image displayed on the LCD display part of the digital camera which concerns on embodiment of this invention. It is a figure which shows the image displayed on the LCD display part of the digital camera which concerns on embodiment of this invention. It is a figure which shows the image displayed on the LCD display part of the digital camera which concerns on embodiment of this invention. It is a figure which shows the image displayed on the LCD display part of the digital camera which concerns on embodiment of this invention.

  The communication terminal according to the embodiment of the present invention will be described below using a digital camera as an example. FIG. 1 is a block diagram illustrating a system configuration of a digital camera according to an embodiment. The digital camera 2 includes a CPU 8. The CPU 8 includes a GPS 10 that measures its own position based on a signal received from a GPS satellite, an azimuth sensor 14 that measures the shooting direction of the digital camera 2 based on the self position, and a digital signal for a horizontal plane. A tilt angle sensor 16 that measures the tilt angle of the camera 2, a voice input / output unit 18 that includes a microphone that acquires voice and a speaker that outputs voice, a USB port 20 that connects a USB device, a through image, a map, and the like are displayed. A display control unit 24 that performs display control of the LCD display unit 22, a touch panel 26 that is configured by a transparent electrode and receives an input operation on a screen displayed on the LCD display unit 22, and some lenses provided in the lens barrel unit 28 A motor controller 30 for driving, a CCD for imaging a subject via a lens provided in the lens barrel 28, or Is an image sensor 32 composed of a CMOS or the like, and white balance adjustment is performed on image data generated by performing A / D conversion on an image signal output from the image sensor 32 by an A / D converter (not shown). An image processing unit 36 that performs image processing, an information storage unit 38 that stores position information measured by the GPS 10 and azimuth information measured by the azimuth sensor 14, and a personal information storage unit that stores a user's name, telephone number, mail address, and the like 40, a memory card 44 for storing image data in a predetermined file format such as Exif in a folder, a program memory 46 for storing a program for display, control, etc. on the LCD display unit 24, Bluetooth, Wi-Fi, 3G, LTE Send image data to / from a web server via a network such as the Internet using a communication method such as A wireless communication unit 48 that receives search results, an image analysis unit 50 that analyzes image data and extracts search conditions, a flash memory 52 that is a program boot memory, and an SDRAM 54 that is a work memory. Yes.

  Next, a process for receiving provision of a specific service of the digital camera according to the present embodiment will be described with reference to the flowchart shown in FIG. When the power is turned on by a power button (not shown) (step S1), the CPU 8 starts photographing the subject by the image sensor 32 and displays a through image on the LCD display unit 24 (step S2). Next, when a shooting instruction is given using a release button (not shown) or the touch panel 26, the subject is shot (step S3). At this time, the CPU 8 temporarily stores the self-position information measured by the GPS 10 and the azimuth information measured by the azimuth sensor 14 in the information storage unit 38, and the image data generated by photographing is stored in the personal information storage unit 40. A telephone number and mail address are added and stored in the memory card 44 in a predetermined file format such as Exif. Further, the display control unit 22 superimposes and displays the photographed image on the through image in a thumbnail format (step S4).

  Next, the CPU 8 determines whether or not a mode for receiving provision of a specific service has been selected by the user (step S5). If the mode for receiving provision of a specific service has not been selected, the process returns to step S2.

  On the other hand, when a mode for receiving a specific service is selected, search processing shown in steps S6 to S16 is performed. For example, when an icon indicating the start of mode selection is displayed on the LCD display unit 24, when a predetermined operation such as the user touching the icon using the touch panel 26 is performed, the display control unit 22 A menu for mode selection is displayed on the LCD display unit 24. Here, the mode selection menu includes a “print mode” for ordering prints of designated images, a “repair mode” for requesting repairs of cars, etc., a “diagnosis mode” for finding hospitals and clinics, and electronic devices. A mode such as “price survey mode” for comparing sales prices such as “.” Is displayed.

  When the user selects a mode from the mode selection menu, the CPU 8 determines whether or not the selected mode is a print mode (step S6). That is, in the print mode, it is not necessary to set a search condition using an image, so the process proceeds to step S11. On the other hand, in the repair mode, it is necessary to set search conditions using images in order to identify dealers and malfunction points. In the diagnosis mode, images are used to identify the department to be searched. Since it is necessary to set the search conditions in order to specify the type, model number, etc. of the electronic device in the price survey mode, the process proceeds to the process shown in step S7.

  When it is necessary to set a search condition using an image, the image analysis unit 50 analyzes the image data based on the thumbnail image selected by the user using the touch panel 26 (step S7). It is determined whether or not extraction has been completed (step S8).

  If the search condition can be extracted, the CPU 8 is within 1 km from the current position of the user measured by the condition and the GPS 10 and is displayed on the LCD display unit 24 measured by the direction sensor 14. A predetermined range such as a predetermined range including the shooting direction of the through image is set as a search condition (step S11).

  On the other hand, when the search condition cannot be extracted, the LCD display unit 24 performs a display requesting photographing of an image from which the search condition can be extracted (step S9). In other words, in the repair mode, a display requesting photographing of the manufacturer name and the fault location is displayed, in the examination mode, a display requesting photographing of the affected part is performed, and in the price survey mode, the whole image or model number of the electronic device is photographed. Display to request. When shooting is performed by the user (step S10), the process returns to step S7.

  In the print mode, since it is not necessary to set a search condition using a thumbnail image (step S6: N), it is within a range of 1 km from the store where the print service is performed and the current position of the user measured by the GPS 10 A predetermined range such as a range including the shooting direction of the through image displayed on the LCD display unit 24 measured by the direction sensor 14 is set as a search condition (step S11).

  Next, the set search condition is transmitted to an external device such as a server on the Internet via the wireless communication unit 48 (step S12). When the search result for the transmitted search condition, that is, information indicating the provider of the service set as the search condition that exists within the range set as the search condition is received (step S13), the service provider indicated by the search result It is determined whether there is a large number (step S15). For example, the determination is made based on whether there are more search results than can be displayed in a search result display image 66 (see FIG. 5) described later. Next, if there are many search results, the search results are narrowed down (step S14).

  The search results shown in step S14 may be narrowed down by narrowing the predetermined range set as the search condition in step S11, or the angle of view of the through image 60 (see FIG. 3) displayed on the LCD display unit 24. The range may be narrowed down, or narrowed down by increasing the keywords used in the search.

  Next, the CPU 8 controls the display control unit 22 to display the service provided by the service provider at the location of the service provider based on the search result for the through image 60 as shown in FIG. 65 is superimposed and displayed. Here, FIGS. 3 to 7 are diagrams showing the display state of the LCD display unit 24 when the print mode is selected.

  In FIG. 3, in addition to the icon 65, thumbnail images 61 a to 61 f and map information 62 based on image data to be requested for a print service are superimposed on the through image 60. In the map information 62, a position image 63a indicating the current position of the user measured by the GPS 10, an arrow 63b indicating the shooting direction of the through image 60 measured by the direction sensor 14, and provision of services on the map based on the search result A marker 64 indicating the location of the person and the contents of the provided service is displayed. Here, the map data used for the map information 62 may be one stored in the program memory 46, or downloaded from an external device such as a server on the Internet via the wireless communication unit 48. May be.

  Here, since the search result is also shown in the map information 62, for example, the icon 65 indicating the search result is not displayed within the angle of view of the through image 60, but the map information 62 has a marker based on the search result. When 64 is displayed, the shooting direction of the through image 60 can be changed with reference to the map information 62, and the icon 65 can be displayed in the through image 60.

  In the search result narrowing-down process shown in step S14, when narrowing the search result by changing the range of the view angle of the through image 60, the user changes the view angle of the through image 60 by performing a zoom operation. Then narrow down the search results. That is, when the zoom operation is performed by the user while the display is performed on the LCD display unit 24 as shown in FIG. 3, the CPU 8 controls the display control unit 22 to display the through image 60 as shown in FIG. And the icon 65 is superimposed on the location of the service provider existing within the range of the angle of view of the changed through image 60.

  Note that FIG. 4 shows an example in which the scale of the map indicated in the map information 62 is changed according to the zoom operation when the user performs a zoom operation. It is good also as a structure which does not perform. That is, the map information 62 shown in FIG. 3 may be superimposed and displayed on the through image 60 shown in FIG.

  When the search results are narrowed down to a predetermined number or less and it is determined in step S15 that the number of service providers indicated in the search results is not large, as shown in FIG. 5, the map information 62 shown in FIGS. Instead, the search result image 66 is displayed superimposed on the through image 60 (step S16). Here, since the icon 65 and the search result image 66 in the print mode are displayed in FIG. 5, the search result image 66 includes a name such as a store name of a print service provider such as A, B, C, and the print service. Service provider information 68 such as an e-mail address and address of the provider and a telephone number is displayed. In addition, the names of service providers such as A, B, and C are displayed for the icon 65 superimposed on the through image 60.

  In the display shown in FIG. 5, when the user touches a thumbnail image using the touch panel 26 and performs drag and drop on the search result image 66, the CPU 8 notifies the service provider indicated by the search result image 66. It is then determined whether a request for condition presentation is made or an order is placed (step S17). For example, when the number of service providers shown in the displayed search result image 66 is one, or when the service provider predetermined by the user is included in the search results, etc., estimation is not necessary. Advances to the process shown in step S22 in order to place an order, and otherwise advances to the process shown in step S18 in order to request a condition presentation. Note that the thumbnail image that has been dragged and dropped by the user is superimposed on the original position on the through image.

  When a request for condition presentation is made, a condition to be presented from the service provider is transmitted according to the selected mode (step S18). In the print mode, ask the store that provides the service to present conditions such as price, delivery date, business hours, etc., and in the repair mode, the repair factory or dealer that provides the service, the number of days required for repair, Requests the presentation of conditions such as prices, etc. Requests the hospital and clinics that provide services in the examination mode to present conditions such as consultation hours and waiting times, and provides services in the price survey mode Request the store, etc. to present conditions such as price, availability, points given, etc.

  Here, when a request for condition presentation is made, image data based on the thumbnail image that has been dragged and dropped is also transmitted. As a result, the user's telephone number, e-mail address, etc. added to the image data in a file format such as Exif can be transmitted. In addition, you may transmit a user's telephone number, a mail address, etc. which were memorize | stored in the personal information storage part 40 separately from image data. Moreover, you may transmit the positional information on the user at the time of transmission measured by GPS10.

  Next, a condition answer to the condition presentation request is received (step S19). This answer may be an answer transmitted in response to a request for condition presentation from the server of the service provider, or may be information on a condition acquired by performing a search on the Web.

  Next, it is determined whether or not there is a condition that satisfies a user's desired condition received within a predetermined period after the request for condition presentation in step S18 (step S20).

  Here, in the print mode, the determination is made using at least one of the presented price, delivery date, business hours, distance from the user's current location, and the like. Moreover, you may give priority to these conditions. For example, when equivalent answers are obtained from a plurality of print service providers under the highest priority condition, the determination is performed using the next highest priority condition.

  Further, when the repair mode is selected, the determination is made using at least one condition among the number of days required for repair, the price, the distance from the current location of the user, and the like. Further, when the examination mode is selected, the determination is performed using at least one condition among the presented examination time, waiting time, distance from the user's current location, and the like. Further, when the price survey mode is selected, the determination is made using at least one condition among the presented price, the presence / absence of inventory, the points given, the distance from the current location of the user, and the like. When the distance from the current position of the user is used for determination, the location of the service provider is extracted from the search result in step S13, and the distance from the current position of the user measured by the GPS 10 is calculated. In step S13, the distance between the location included in the received response and the current location of the user measured by the GPS 10 is calculated by requesting the location of the service provider as a condition in step S13. It may be used for determination.

  If none of the received conditions satisfy the user's desired conditions (step S20: N), a request for re-answering whether the delivery date can be shortened, whether the amount can be reduced, etc. Is transmitted (step S21), and the process returns to step S19.

  On the other hand, if there is one that satisfies the user's desired conditions (step S20: Y), the CPU 8 performs processing such as ordering (step S22) and ends the processing. At this time, if there are a plurality of conditions that satisfy the desired condition, the CPU 8 may select one search result that is advantageous to the user and perform processing such as ordering for the selected service provider, When the user performs a touch operation on the service provider information 68 or the condition 72 displayed on the answer condition image 70 shown in FIG. 6 or dragging and dropping the thumbnail image, processing such as ordering may be performed.

  Here, in the processing shown in step S22, in the print mode, a print order is ordered from the print service provider, and in the repair mode, a repair request is issued to a service provider such as a repair shop or a dealer. In the examination mode, appointments are made to the service providers such as hospitals and clinics, and in the price survey mode, the service providers such as stores are requested to keep the products.

  If it is determined in step S17 that an order is placed, the order shown in step S22 is placed, and the process ends.

  As shown in FIG. 7, after performing the process shown in step S22, a response indicating that the ordering process has been successfully received is received from the server of the service provider, and a confirmation image 74 is sent to the through image 60. May be superimposed and displayed. FIG. 7 shows a confirmation image 74 when an order is placed with respect to the service provider A.

  According to the digital camera according to the present embodiment, information for receiving provision of a specific service can be displayed superimposed on the through image. In addition, the location of the service provider can be easily confirmed.

  In addition, it is possible to receive conditions from a plurality of service providers regarding services that the user wants to receive. Therefore, it is possible to place an order or the like under conditions that are advantageous to the user. For example, in the print mode, it is possible to place an order with a short delivery time and a low charge.

  In addition, since the digital camera includes a communication unit, it is possible to perform processing for receiving provision of a desired service by a single terminal without connecting to an external device such as a PC.

  In the above-described embodiment, the configuration in which the search process is performed when the user selects a mode for receiving provision of a specific service from the mode selection menu has been described. You may make it perform based on. That is, after the icon indicating the start of the mode selection described above is touched, image data based on the thumbnail image touched by the user using the touch panel 26 is analyzed by the image analysis unit 50, and the main subject of the image is the car. If it is all or part, it is determined that it is in the repair mode. If the main subject is a part of a human body such as an affected part, it is determined that it is in the examination mode, and the main subject is the model number of the electronic device or product. Or the like, it may be determined that the price survey mode is selected, and if the main subject is a store that provides the print service, the mode selection may be performed by determining the print mode. In this case, the print mode may be selected when it is determined that the main subject does not correspond to any of the repair mode, the examination mode, and the price survey mode.

  In the above-described embodiment, the search result is displayed by superimposing the search result image 66 including service provider information 68 such as an e-mail address, an address such as an address, and a telephone number on the through image 60. However, the service provider information 68 may be displayed in the vicinity of the marker 64 displayed in the map information 62 or in the vicinity of the icon 65 displayed in the through image 60. Good.

  Further, in the above-described embodiment, the explanation has been made by taking as an example the configuration (see FIG. 6) in which the answer condition image 70 including the condition 72 such as the price and the delivery date is superimposed on the through image 60. It may be displayed near the marker 64 displayed in the information 62 or near the icon 65 displayed on the through image 60.

  In the above-described embodiment, the configuration in which the confirmation image 74 is superimposed and displayed on the through image 60 (see FIG. 7) has been described as an example. However, the map information indicates that processing such as ordering has been normally received. It may be displayed in the vicinity of the marker 64 displayed in 62 or in the vicinity of the icon 65 displayed on the through image 60.

  In the above-described embodiment, an example in which the six thumbnail images 61a to 61f are superimposed and displayed on the through image 60 has been described. However, the number of thumbnail images to be displayed is not limited to six, and is arbitrary. The number of thumbnail images can be displayed.

  In the above-described embodiment, in the search result narrowing process shown in step S14 of FIG. 2, the search result is narrowed down by changing the angle of view of the through image 60 according to the zoom operation of the user. As described above, the narrowing-down process may be performed by changing the scale of the map displayed in the map information 62 superimposed on the through image 60 shown in FIG. That is, when the user gives an instruction to change the scale of the map using the touch panel 26 in the state where the display is performed on the LCD display unit 24 as shown in FIG. 3, the map information 62 is displayed as shown in FIG. While changing the scale of the map to be displayed, the angle of view of the through image 60 displayed on the LCD display unit 24 may be changed according to the specified scale.

  In the above-described embodiment, when the angle of view of the through image 60 is changed according to the zoom operation of the user, an icon is displayed at the place of the service provider existing within the range of the angle of view of the changed through image 60. The configuration of performing the superimposed display of 65 has been described, but the icon 65 is displayed at the place of the service provider existing within the range of the angle of view of the moved through image 60 even when the shooting range of the through image is moved vertically and horizontally. May be displayed in a superimposed manner. For example, when the angle of view of the through image 60 moves upward, the icon 65 is displayed at the place of the service provider located on the fifth floor, the tenth floor, etc. of the building using the tilt angle measured by the tilt angle sensor 16. Is superimposed.

DESCRIPTION OF SYMBOLS 2 ... Digital camera, 8 ... CPU, 10 ... GPS, 14 ... Direction sensor, 22 ... Display control part, 24 ... LCD display part, 26 ... Touch panel, 32 ... Imaging element, 48 ... Wireless communication part, 50 ... Image analysis part 60 ... through image, 65 ... icon

Claims (5)

A shooting section for shooting the subject;
A display unit for displaying a through image based on a photographing signal from the photographing unit;
A self-position measuring unit for measuring the self-position;
A search condition setting section for setting a search condition for receiving service provision;
A search range setting unit that determines a search range based on the self-position;
A transmission unit for transmitting the search condition and the search range to an external device;
A receiving unit for receiving a search result based on the search condition and the search range;
An azimuth measuring unit for measuring a shooting direction by the photographing unit;
The map information including the shooting direction and the self-location regarding the shooting range by the shooting unit is displayed on the through image, and the service is provided to the service providing location in the map information based on the search result. A display control unit for displaying an image to be shown ;
A narrowing unit that narrows down the search results based on the angle of view of the through image;
With
The display control unit displays a search result image based on the search result instead of the map information when the search result is narrowed down by the narrowing-down unit . A storage unit for storing image data based on an image captured by the imaging unit;
The communication terminal according to claim 1, further comprising: a search condition extraction unit that extracts the search condition based on the image data. An operation unit stacked on the display unit;
The display control unit displays a thumbnail image based on the image photographed by the photographing unit on the through image, and when the thumbnail image moves with respect to the image indicating the service by an operation using the operation unit, communication terminal according to claim 1 or 2, wherein the transmission unit and transmits the information including the personal information of the image data and the user based on the thumbnail image to the service provider of the image indicating the service. A condition determining unit for determining a condition included in a response to the transmission of the information received by the receiving unit;
The communication terminal according to claim 3 , wherein the transmission unit transmits predetermined information to the service provider based on a determination result by the condition determination unit. The communication terminal according to claim 4 , wherein the condition determination unit assigns a priority order based on the condition when receiving a plurality of the responses via the reception unit.

Images