JP2003174579A - Image utilization service system and terminal equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing image utilization service system capable of accurately performing a service utilizing a photographed image in a short time of period and terminal equipment used in it. <P>SOLUTION: In the case of desiring an image processing service accompanying a editing or analyzing of photo image information, a service management server 40 is accessed through the terminal equipment 20, transmission of photographing supporting information corresponding to the service stored in a supporting information storage part 50 is received and it is fetched to a digital camera 10. Then, in the digital camera 10, the photographing supporting information is utilized and the image suited to the image processing service is photographed. The photographed image information is transmitted to the service management server 40, a prescribed image processing is performed in service processing parts 60-1 and 60-2 and a processing result is transmitted to the terminal equipment 20. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image utilization service system for providing a service utilizing image information transmitted via a network and a terminal device used for the image utilization service system.

[0002]

2. Description of the Related Art A print service has been realized as a service using photographic image information transmitted via a network, but recently, a service involving editing processing or analysis processing of photographic image information transmitted. Is also going to be done. As a service accompanied by the editing process, there is a service of combining with a predetermined template image and providing the created composite image information or a print based on the composite image information to the client. In addition, as services involving analysis processing, fortune-telling services using face images or hand images,
There is a similar celebrity search service that uses face images.

In order to edit or analyze photographic image information, a photographic image having a predetermined composition is preferable in terms of processing amount and processing accuracy. For example, when performing a combining process with a template image, it is preferable to obtain a desired combined image by superimposing the photographed images taken by the user as they are. It has to be photographed. In addition, when performing analysis processing such as human figure fortune telling using a face image, palm telling using a hand image, and similar celebrity search using a face image, the outline of the image and the partial shape are extracted. In this case, in order to improve the accuracy of analysis, it is necessary that the size of the face or hand is a predetermined size and that position is located at a predetermined position.

On the other hand, it is not always easy for a general user to take a picture with a desired composition, so that
A digital camera has been proposed in which auxiliary image information is stored in a digital camera and desired auxiliary image information is displayed on a display unit of the digital camera so that it can be used as a reference when deciding a composition (for example, Japanese Patent Laid-Open No. Hei 10 (1999) -135242). 10-243274). However, even in this case, the auxiliary image information for the photographic image of the composition required for the service is not always stored in the digital camera, and it is not easy to select them because they are stored.

[0005]

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and a captured image utilizing service system and a terminal used therefor capable of accurately performing a service utilizing a captured photograph image in a short time. A device is provided.

[0006]

An image utilization service system of the present invention provides a service utilizing image information transmitted via a network, is connected to the network, and manages the service. A service management server, a service processing unit that executes a service process involving an image information editing process or an analysis process, and shooting assistance information including shooting assistance image information that assists the shooting of an image used by the service processing unit. When the service management server receives a service request from a terminal device connected to the network, the service management server acquires shooting assistance information according to the requested service from the support information storage unit. And send it to the terminal device,
When the image information captured by using the transmitted image capturing support information is received, the service processing unit is caused to execute the service process using the received image information.

As the image capturing auxiliary image information in the image utilizing service system of the present invention, image information that supports image capturing of a composition suitable for the service processing is used.

The image capturing auxiliary image information in the image utilizing service system of the present invention is used for superimposing display with the subject image on the display device of the digital camera.

In the image utilization service system of the present invention, the service is a fortune telling service using face photograph image information or palm photograph image information, and the service management server obtains the result of the fortune telling executed by the service processing unit on the terminal. It is to be sent to the device.

The service in the image use service system of the present invention is a similar celebrity search service using face photograph image information, and the service management server stores the search result executed by the service processing unit in the terminal device. It is something to send.

In the image utilization service system of the present invention, the service is a composite photograph creation service with an arbitrary template image, and the service management server transmits the composite photograph image information executed by the service processing unit to the terminal device. It is something to send.

In the image utilization service system of the present invention, the service is a composite photograph creation service with an arbitrary template image, and the service processing section is for instructing print creation based on the composite photograph information.

The support information storage unit in the image utilization service system of the present invention stores the shooting support information according to the model of the digital camera, and is used for image shooting in response to a service request from the terminal device. The service management server acquires from the support information storage unit the shooting support information corresponding to the information indicating the model of the digital camera included in the service request. It is transmitted to the terminal device.

The terminal device of the present invention makes a request for a service using image information transmitted via a network, and can access a service management server for managing the service connected to the network. Is capable of communicating with a digital camera, and receives shooting assistance information including shooting assistance image information for assisting shooting of an image used for the service in response to a service request to the service management server, and receives the received shooting assistance information. Photography assistance information is transmitted to the digital camera, image information photographed using the photography assistance information is received from the digital camera, and the received image information is transmitted to the service management server.

The terminal device of the present invention is portable and can communicate with the digital camera by near field communication or by wire connection.

The terminal device of the present invention is portable and is formed integrally with the digital camera.

The terminal device of the present invention receives, as the image capturing auxiliary image information, image information that supports image capturing of a composition suitable for the execution of the service, and the image capturing auxiliary image information is of a digital camera. The display device is used for superimposing display with a subject image.

[0018]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a schematic overall configuration of an embodiment of a service system of the present invention.
A service management server 40 is connected to the network 30, and the support information storage unit 5 is connected to the service management server 40.
0, service processing units 60-1, 60-2 are connected.
Further, the terminal device 20 can be connected to the network 30, and the digital camera 10 can be connected to the terminal device 20.

The service management server 40 receives and manages a service accompanied by an image information editing process or an analysis process. Is received from the support information storage unit 50 and transmitted to the terminal device 20, and when the image information captured by using the transmitted image capture support information is received, the service processing unit 60-performs a service process using the received image information. 1, 60-2.

The service processing units 60-1 and 60-2 execute an image processing service accompanied by editing processing or analysis processing of photographic image information, and are mainly composed of a processor which operates based on a predetermined program. . In FIG. 1, the two service processing units 60-1 and 60-2 are described as separate units connected to the service management server 40, but it is also possible to configure them with one processor. Depending on the capability of the management server 40, it can also be used as the service management server 40. Further, the number of service processing units is not limited to two and may be one or three or more. Further, in FIG. 1, two service processing units 60-
Although 1 and 60-2 are directly connected to the service management server 40, the service processing units 60-1 and 60-2 may be connected to the service management server 40 via the network 30 or another network.

As the image processing service accompanied by the edit processing or analysis processing of the photograph image information executed by the service processing units 60-1 and 60-2, for example, a fortune-telling service using face photograph image information or palm photograph image information, a face There are similar celebrity search services that use photo image information, and composite photo creation services with arbitrary template images. Since the processing result of the fortune-telling service and the similar celebrity search service can be provided as electronic information, it is transmitted to the terminal device 20 via the network 30. The composite photo creation service is provided as electronic information of composite image data at the request of the user.
Or, it is provided as a print. The provision of electronic information is
The print is provided via the network 30, and the print is provided by a method used in a conventional print service, for example,
It is provided by delivery, over-the-counter delivery, etc. When providing the print, the service processing units 60-1 and 60-2
The composite image information obtained in step 1 is sent to a print server (not shown).

The support information storage unit 50 includes a service processing unit 6
The information for supporting the photographing of photographic images necessary for the image processing service accompanied by the photographic image information editing processing or analysis processing executed by 0-1 and 60-2 is stored for each service. The information for supporting shooting includes shooting auxiliary image information for supporting shooting of an image having a composition suitable for service processing. Then, this shooting auxiliary image information is used for superimposition display with the subject image on the display device of the digital camera. Although the support information storage unit 50 is described as being separate from the service management server 40 in FIG. 1, it can be omitted by using the internal memory (not illustrated) of the service management server 40.

The terminal device 20 includes a service management server 40.
After the service is requested, the shooting support information including the shooting support image information for supporting the shooting of the image used for the service is received from the service management server 40, and the received shooting support information is stored in the digital camera. 10, the image information captured by using the image capturing support information is received from the digital camera 10, and the received image information is transmitted to the service management server 40. As long as the terminal device 20 can be connected to the network 30, a personal computer such as a personal computer or a mobile terminal such as a mobile phone can be used.

The digital camera 10 can communicate with the terminal prime minister 20 through a wired connection such as a USB interface or a close proximity wireless connection such as Bluetooth or infrared. Then, it is possible to take a photograph using the photographing support information received from the terminal device 20, and the image information photographed using the photographing support information is transmitted to the terminal device 20.

FIG. 2 is a diagram showing a schematic configuration of the digital camera 10 which constitutes the service system of FIG. Figure 2
The digital camera 10 includes an image pickup unit 11 and an image memory 1.
2, compression / decompression unit 13, image recording unit 14, control unit 15,
Operation unit 16, input / output interface unit 17, display unit 18
including.

The image pickup section 11 includes an optical system such as a photographing lens and C
It is configured to include an image pickup device such as a CD and a signal processing unit (neither is shown). The subject image formed on the light receiving surface of the image pickup device through the taking lens is photoelectrically converted in the image pickup device and sequentially read out as a video signal. And
The signal is sent to the signal processing unit, subjected to predetermined analog processing by a gain adjusting circuit or the like, A / D converted, further subjected to digital image processing, and stored in the image memory 12. Digital image processing in the signal processing unit is realized by a DSP.

The image memory 12 temporarily stores the digital image signal obtained by the image pickup section 11, and the photographed image can be displayed on the display section 18 based on this signal. In addition, an image signal obtained by expanding the image information stored in the image recording unit 14 is stored and displayed on the display unit 18. The display unit 18 is composed of a liquid crystal panel or the like, and also displays various information such as digital camera status information and operation support information under the control of the control unit 15.

The compression / expansion unit 13 compresses the digital image signal temporarily stored in the image memory 12 and sends it to the image recording unit 14, and also expands the compressed image information recorded in the image recording unit 14. And is stored in the image memory 12. The image recording unit 14 stores image information obtained by compressing a captured image signal in a predetermined file format. The image recording unit 14 is configured by, for example, a flash memory and can be configured by a memory built in the digital camera 10, or a medium such as a memory card can be used. The contents of the image recording unit 14 are
The input / output interface unit 17 is controlled by the control unit 15.
It can be taken out via the. An interface dedicated to image transfer may be separately provided in order to transfer the image information from the image recording unit 14.

The control unit 15 includes a photographing support information storage unit 151.
And controls the overall operation of the digital camera 10. Specifically, the main component is a processor that operates according to a program. Shooting support information storage unit 1
The shooting assistance information including the shooting assistance image information is stored in 51, and the shooting assistance image information can be superposed on the shot image when the shot image is displayed on the display unit 18. The shooting auxiliary image information includes an auxiliary line or the like that assists in determining the composition of the captured image. When the subject is imaged along this auxiliary line, it is possible to shoot an image suitable for use in the service.

The operation unit 16 is used to perform various operations of the digital camera 10, such as a shutter release button or other photographing operation, and an image display operation based on the image information stored in the image recording unit 14. Includes items and operations for creating print request information. The input / output interface unit 17 exchanges information between the digital camera 10 and an external device by a wired connection such as a USB interface or a close proximity wireless connection such as Bluetooth or infrared.

The digital camera 10 configured as described above
Is capable of performing a normal shooting operation by operating the operation unit 16 and is capable of taking a picture using the shooting assistance information received from the terminal device 20 and the image information taken by using the shooting assistance information. Can be sent to.

FIG. 3 is a diagram showing a schematic configuration of the terminal device 20 which constitutes the service system of FIG. The terminal device 20 of FIG. 3 includes a control unit 21 and an input / output interface unit 2
2. The information recording device 23, the display unit 24, the operation unit 25, and the communication unit 26 are included, but the information recording device 23 can be omitted.

The control unit 21 controls the entire terminal device 20, and is mainly composed of a processor operated by a program. Input / output interface unit 22
Is an input / output interface unit 17 of the digital camera 10.
The digital camera 10 can be connected to the digital camera 10 to exchange information with the digital camera 10.

The information recording device 23 records the photographed image information and the like from the input / output interface unit 22, and is composed of, for example, a hard disk device. The display unit 24 displays the state of the terminal device 20, operation guidance, and the like. The operation unit 25 is for performing various operations of the terminal device 20. The communication unit 26 is connected to the network 30 and performs transmission / reception processing of information accompanying a service request to the service management server 40.

FIG. 4 shows a schematic configuration of the service management server 40 which constitutes the service system of FIG. The service management server 40 includes a control unit 41, a storage unit 42, a file device 43, and a communication unit 44. The control unit 41 controls the overall operation of the print order management server 40, and is specifically configured mainly by a processor that operates according to a program stored in the storage unit 42. Storage unit 4
2 stores the above-mentioned program and various data for controlling the operation of the print order management server 40, and also stores information regarding the service request transmitted from the terminal device 20 via the network 30. It is used as a temporary storage area for information required for service processing and a work area for the processor.

The file device 43 holds registration information and the like regarding service system users. As the registration information regarding the service system user, information such as the user's name, address, electronic mail address, receiving method when requesting composite printing, and payment method of print fee is held.

In the system of FIG. 1, the terminal device 20
The digital camera 10 is described as a separate device, but when a mobile terminal such as a mobile phone is used as the terminal device 20, the digital camera 10 may be integrated into the mobile terminal 20.

Next, the operation of the service system shown in FIG. 1 will be described. FIG. 5 is a diagram showing a schematic flow when the service system of FIG. 1 is used. It should be noted that here, an example will be described in which a personal fortune telling service is performed based on an image captured by the digital camera 10.

In order to receive a personalized fortune telling service using face photograph information, the personalized face telling service is selected from the service menu of the terminal device 20 (step 501).
Since the human-fortune telling service is a service that uses captured images, the terminal device 20 confirms the connection with the digital camera 10 and, if not connected, outputs a message prompting the connection. If connected, digital camera 1
A model information request of 0 is made to the digital camera 10 (step 502), and the model information is transmitted from the digital camera 10 (step 503).

Upon receiving the model information, the terminal device 20
The service management server 40, which provides a personal fortune-telling service, is accessed via the network and a service request is transmitted (step 504). At this time, requester information regarding the service requester is also transmitted. As the requester information, necessary information, such as the requester's name, address, e-mail address, method of receiving prints when making prints, method of paying service fee, etc., is displayed in advance on the display unit 18 Select or enter according to the guidance displayed in. It is also possible to register the requester information in advance or at the time of first use, and to send only the registered requester identification information when using the service.
When a mobile phone is used as the terminal device, the mobile phone number can be used as the identification information.

In the above description, the terminal device 20 is
The case where the menus of various application services are registered together with the access destination information has been described as an example. However, when such menus are not registered, first, the management service server 40 is connected to obtain the service menu information, Select the service you want to receive. Since the subsequent operation is the same, the description is omitted.

Upon receiving the service request, the service management server 40 registers the service request (step 50).
5), The shooting support information corresponding to the received service type is acquired from the support information storage unit 50. The shooting support information includes shooting auxiliary image information for supporting image shooting of a composition suitable for service processing. FIG. 6 is an example of an image capturing auxiliary image that assists in capturing a face image used for a personal horoscope service. Shooting auxiliary image information for displaying such a shooting auxiliary image is prepared in advance for each service and for each model of digital camera used. The reason for preparing for each model is to easily display the shooting auxiliary image according to the number of display pixels of the display unit 18 of the digital camera 10. If the shooting auxiliary image information for each model is not prepared, the terminal device 2
0 or the digital camera 10 needs to convert captured image information according to the number of display pixels. As the shooting assistance information, not only the shooting auxiliary image information but also information about the shooting process such as the number of pixels of the shot image is stored.

When the shooting support information is acquired from the support information storage unit 50, the service management server 40 transmits the acquired shooting support information to the terminal device 20 (step 507).
At this time, the service request acceptance information is also provided to the terminal device 2
0 to terminate the communication between the terminal device 20 and the service management server 40 once. The service request acceptance information is information for identifying each individual service request, and is used for associating captured image information received later with the accepted service request.

When the photographing support information is received, the terminal device 20
Transmits the received photographing support information to the digital camera 10 to prompt photographing of a face image (step 508). At this time, if the service request reception information received from the service management server 40 and the address information of the service management server 40 are transmitted to the digital camera 10 together with the shooting assistance information, the communication between the terminal device 20 and the digital camera 10 may be temporarily terminated. You can Since it is not always possible to perform the required shooting in a short time after receiving the shooting support image information, it is preferable that the connection between the digital camera 10 and the terminal device 20 can be terminated once.

When the digital camera 10 receives the shooting support information, the digital camera 10 stores the shooting support information in the shooting support information storage unit 151 and starts shooting (step 509). When shooting
An image based on the captured image of the subject and the supplementary image information is
It is superimposed and displayed on the display unit 18. FIG. 7 shows an example of images displayed in an overlapping manner. In this way, by superimposing the shooting auxiliary image at the time of shooting the subject, it is possible to shoot the shot image having the composition suitable for the service processing accurately in a short time.

When the photographing using the photographing support information is completed, the photographed image information from the digital camera 10 is transferred to the terminal device 2.
0 (step 510). Service request reception information and service management server 40 when the shooting support information is received
If the address information is received, the information is also transmitted. Next, the terminal device 20 accesses the service management server 40 again, and transmits the captured image information received from the digital camera 10 together with the service request acceptance information (step 511).

Upon receiving the photographed image information and the service request acceptance information, the service management server 40, after confirming that the service request is registered, instructs the service processing unit for performing the fortune telling service to execute the process (step 51
2). In the personal divination, for example, the contour of the image or the partial shape is extracted to obtain the feature data of the face image, and the divination result is output by referring to the table storing the feature data and the divination information. Since various methods have been proposed for the fortune-telling process, it can be appropriately selected.

When the processing result is obtained from the service processing unit (step 513), the service management server 40 transmits the processing result to the terminal device 20 (step 514).
Since the terminal device 20 displays the received processing result (fortune telling result) on the display unit 24 (step 515), the service requester can browse the personality telling result based on the captured face image.

In order to carry out the services described above, the terminal device 20 and the digital camera 10 require a predetermined program. Such a program may be held in the terminal device 20 and the digital camera 10 in advance, but after connecting to the service management server 40 and requesting the service, the program required for the service is downloaded from the service management server 40. You may do it. By doing so, the amount of information to be stored in the terminal device 20 and the digital camera 10 in advance can be reduced, and the storage device can be used efficiently. In addition, it is possible to flexibly deal with changes in service content.

In addition, when charging for such a service, various proposals can be appropriately adopted. For example, payment by credit card can be adopted, but in the case of a composite photo print service, payment can be made in exchange for receipt of the created image print.

[0051]

As is apparent from the above description, according to the present invention, it is possible to provide a service using photographed photographic images with high accuracy in a short time.

[Brief description of drawings]

FIG. 1 is a diagram showing a schematic overall configuration of an embodiment of a service system of the present invention.

FIG. 2 is a diagram showing a schematic configuration of a digital camera which constitutes the service system of FIG.

FIG. 3 is a diagram showing a schematic configuration of a terminal device which constitutes the service system of FIG.

4 is a diagram showing a schematic configuration of a service management server that constitutes the service system of FIG.

5 is a diagram showing a schematic flow when the service system of FIG. 1 is used.

FIG. 6 is a diagram showing an example of a shooting auxiliary image that supports shooting of a face image.

FIG. 7 is a diagram showing an example of a display image in which a shooting auxiliary image and a subject shooting image are superimposed and displayed.

[Explanation of symbols]

10 ... Digital camera 11 ... Imaging unit 12 ... Image memory 13 ... Compression / decompression section 14 ... Image recording unit 15 ... Control unit 16 ... Operation part 17: Input / output interface section 18 ... Display 20 ... Terminal device 21 ... Control unit 22 ... Input / output interface section 23 ... Information recording device 24 ... Display 25 ... Operation part 26 ... Communication section 30 ... Network 40 ... Service management server 41 ... Control unit 42 ... storage unit 43 ... File device 44 ... Communication section 50 ... Support information storage unit 60-1, 60-2 ... Service processing unit 151 ... Shooting support information storage unit

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) // H04N 101: 00 H04N 101: 00 F term (reference) 5C022 AA13 AC03 AC31 AC69 5C052 AA20 AC08 DD02 DD04 FA02 FA07 FD09 5C054 AA02 DA09 FA04 FE11 GB11 HA14 5C062 AA14 AB21 AB41 AB42 AC51 AE03 AE15 BB03

Claims (14)

[Claims] 1. An image use service system for performing a service using image information transmitted via a network, comprising: a service management server connected to the network for managing the service; and an image information editing process. Or a service processing unit that executes a service process including an analysis process, and a support information storage unit that stores shooting support information including shooting auxiliary image information that supports shooting of an image used by the service processing unit. The management server, when receiving a service request from a terminal device connected to the network, acquires shooting assistance information corresponding to the requested service from the assistance information storage unit and transmits it to the terminal device, When the image information photographed using the transmitted photographing support information is received, the received image information is used. Image utilizing the service system-bis process is intended to be executed by the service processor. 2. The image use service system according to claim 1, wherein the image capturing auxiliary image information is image information that supports image capturing of a composition suitable for the service processing. 3. The image use service system according to claim 2, wherein the shooting auxiliary image information is used for superimposition display with a subject image on a display device of a digital camera. 4. The image use service system according to claim 1, wherein the service is a fortune-telling service using face photograph image information or palm photograph image information, and the service management server. Is an image utilization service system for transmitting the fortune-telling result executed by the service processing unit to the terminal device. 5. The image use service system according to claim 1, wherein the service is a similar celebrity search service using face photograph image information, and the service management server is An image use service system for transmitting a search result executed by the service processing unit to the terminal device. 6. The image use service system according to claim 1, wherein the service is a composite photo creation service with an arbitrary template image, and the service management server is the service. An image utilization service system for transmitting composite photograph image information executed by a processing unit to the terminal device. 7. The image using service system according to claim 1, wherein the service is a composite photograph creating service with an arbitrary template image, and the service processing unit is configured to perform the combining. An image utilization service system for instructing print creation based on photographic information. 8. The image use service system according to claim 1, wherein the support information storage unit stores the shooting support information according to a model of a digital camera, The service request from the terminal device includes information indicating the model of the digital camera used for image capturing, and the service management server responds to the information indicating the model of the digital camera included in the service request. An image use service system for acquiring the photographing support information from the support information storage unit and transmitting the information to the terminal device. 9. A terminal device for requesting a service using image information transmitted via a network, which is accessible to a service management server for managing the service connected to the network, In response to a service request to the service management server, it is possible to communicate with a camera, receive shooting assistance information including shooting assistance image information for assisting in shooting an image used for the service, and receive the received shooting assistance information. A terminal device which transmits to the digital camera, receives image information photographed using the photographing support information from the digital camera, and transmits the received image information to the service management server. 10. The terminal device according to claim 9, which is portable and is capable of communicating with the digital camera by short-range wireless communication. 11. The terminal device according to claim 9, which is portable and is connected to the digital camera by wire. 12. The terminal device according to claim 9, wherein: Portable, A terminal device formed integrally with the digital camera. 13. The terminal device according to claim 9, wherein the image capturing auxiliary image information is image information that supports image capturing of a composition suitable for executing the service. Service system. 14. The terminal device according to claim 13, wherein the shooting auxiliary image information is used for superimposition display with a subject image on a display device of a digital camera.