JP2009017211A - Imaging device and imaging system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging device and an imaging system that can decide the state of an appreciator's reproducing device and transmit an image that the appreciator can enjoy in that state. <P>SOLUTION: A camera 100 has a transmission destination state decision and database 9d, which stores information reproducing equipment (a large-screen television 34a, a mobile phone 34b), the photographic mode, the image size, or the like, of a transmission destination. Reproducing equipment is detected with that a user 31 at a transmission destination to which an image photographed by the camera 100 is desired to be sent, is currently viewing. The state of the reproducing equipment at the transmission destination is displayed with a text 331 or 332 on a display panel 8 of the camera 100, according to the detection result. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

The present invention relates to an image pickup apparatus and an image pickup system, and more particularly to an image pickup apparatus and an image pickup system that change a transmission destination of image data according to a use state of a reproduction apparatus such as a television.

In recent years, an image appreciation method has been widely used in which images are transmitted using PC communication, the Internet, a mobile phone line, etc., and the images can be enjoyed in that environment, taking advantage of the ease of image transmission of an imaging device such as a digital camera. ing. As a method of using these networks, a photograph on the blog or other page can be posted on a server on the Internet so that many people can view it, and it can also be sent to personal computers such as acquaintances and mobile phones. It is possible to show an image as soon as possible.

Traditionally, people who want to view photos have only created an album for viewing at home after shooting, but this change in the use of photos can lead to a significant change in the way the camera is taken. . In other words, the preference of the photographer has been important in the past, but since a third party also appreciates, it is important to take a picture that considers what kind of photograph is pleased.

In addition, as a method of reproducing an image, various viewing scenes are assumed, for example, on a television set for a family party, on a mobile phone when going out, and on a personal computer (PC) when surfing the Internet. In recent years, such devices can be connected to a network.

As a technique for connecting such an imaging device such as a digital camera and an image reproduction device via a network, for example, Patent Document 1 includes a monitoring camera system that selects and transmits from a plurality of transmission destination candidates. This surveillance camera system is a system that distributes surveillance video using a network, and switches between the camera and the monitor with a simple configuration. Patent Document 2 discloses an image display device that determines whether or not to display based on image contents. In this image display device, an image displayed on an electronic advertisement device that is placed outdoors and displays an advertisement on a large flat display is determined by the harmful image determination unit, and an image permitted to be displayed is displayed. ing.

Furthermore, Patent Document 3 discloses a communication system that selects a transmission image in accordance with a data format suitable for a receiving apparatus. In this communication system, in a communication system such as a digital camera and a printer, an optimum format for processing on the transmission side and the reception side is selected from, for example, a VGA locking type, a Q-VGA format, or the like. Further, Patent Document 4 discloses an image data transmission system that determines and transmits the function of a receiving device. This image data transmission system can search image data on the transmitting side in a short time even when the receiving device does not have a decompression function, and effectively transmits the image data.
JP 2006-246051 A JP 2006-254222 A Japanese Patent Laid-Open No. 10-341327 JP-A-8-237490

As described above, various systems for connecting an imaging device and an image reproduction device through a network have been proposed, but none of them is performed by detecting the state of a transmission destination. That is, the surveillance camera disclosed in Patent Document 1 does not transmit an image reflecting the state of the transmission destination. In addition, none of the apparatuses and systems disclosed in Patent Documents 2 to 4 detects the state of a playback apparatus that is a transmission destination for which an image is to be displayed, and transmits the image.

The present invention has been made in view of such circumstances, and an object of the present invention is to provide an imaging device and an imaging system capable of judging the status of a viewer's playback device and transmitting an image that can be enjoyed in that status. And

In order to achieve the above object, an image pickup apparatus according to a first invention includes an image pickup means for taking an image, a database for storing use priority information of a plurality of image reproducing devices that can be used by a viewer who views the image, An image for transmitting image data representing the image to the image reproduction device that has been determined to be currently used by the utilization status determination unit, and a usage status determination unit that sequentially determines the current usage status of the image reproduction device A transmission means is provided.

According to a second aspect of the present invention, there is provided an imaging apparatus according to the first aspect, further comprising a display unit for displaying photographing information for performing photographing corresponding to the destination image reproducing device to which the image data is transmitted.
In the image pickup apparatus according to the third invention, in the second invention, the shooting information is an aspect ratio of a display screen of an image reproducing device having the highest use priority.
Furthermore, the imaging apparatus according to a fourth aspect of the present invention is the imaging apparatus according to the first aspect, wherein, as a result of the determination by the usage status determination means, if none of the image playback devices are currently being used, the image data is stored as the image data. Store in a storage device other than the playback device.
Furthermore, the imaging apparatus according to a fifth aspect of the present invention is the imaging apparatus according to the first aspect, wherein the usage status determining unit sequentially determines the current usage status of the image playback device. Repeat until.

In order to achieve the above object, an imaging method according to a sixth invention is an imaging method of an imaging apparatus having an imaging means for capturing an image, and uses a plurality of image reproducing devices that can be used by a viewer who views the image. Priority information is stored in the storage unit, the current usage status of the image playback device is sequentially determined, and the image playback device determined to be currently used based on the determination result of the usage status Transmitting image data representing the image.

In order to achieve the above object, an imaging system according to a seventh invention includes an imaging means for capturing an image, a database for storing usage priority information of a plurality of image reproducing devices that can be used by a viewer who views the image, An image for transmitting image data representing the image to the image reproduction device that has been determined to be currently used by the utilization status determination unit, and a usage status determination unit that sequentially determines the current usage status of the image reproduction device A transmission means is provided.

In order to achieve the above object, an imaging apparatus according to an eighth invention includes an imaging means for capturing an image, a database for storing use priority information of a plurality of image reproducing devices that can be used by a viewer who views the image, Usage status determining means for sequentially determining the current usage status of the image playback device, and display means for displaying the image playback device determined to be currently used by the usage status determination means.

In order to achieve the above object, an image pickup apparatus according to a ninth aspect of the invention is an image pickup means for picking up an image, use priority information of a plurality of image playback devices that can be used by a viewer who views the image, and the image playback device. A database for storing shooting information suitable for each of the above, a usage status determination unit for sequentially determining the current usage status of the image playback device, and the image playback device determined to be currently used by the usage status determination unit Display means for displaying photographing information suitable for the camera.

According to a tenth invention, in the eighth or ninth invention, the shooting information includes at least one of a shooting mode and an aspect ratio.
An imaging apparatus according to an eleventh aspect of the present invention is the image processing apparatus according to the eighth or ninth aspect, further comprising image transmission means for transmitting image data representing the image, and the database includes a transmission destination for the viewer. The image transmission means includes the information, and transmits the image data based on the transmission destination information.

In order to achieve the above object, an image pickup apparatus according to a twelfth aspect of the invention comprises an image pickup means for taking an image, a database for storing shooting information suitable for playback of an image playback device that can be used by a viewer who views the image, A usage status determination unit that determines a current usage status of the image playback device, and image data representing the image is transmitted to the image playback device when the usage status determination unit determines that the current usage status is currently used. Image transmitting means.

In order to achieve the above object, a server according to a thirteenth invention comprises a communication means for communicating with a plurality of image reproducing devices and imaging devices that can be used by a viewer who views images, and a storage for storing information on the viewer. Based on the output of the storage unit and the usage state determining means, and determining the usage state of the image playback device of the viewer. And a database to be stored, and the usage state of the image reproduction device stored in the database is output to the imaging apparatus.
A reproduction method according to a fourteenth aspect of the present invention is a reproduction method in a reproduction apparatus having display means for dividing and displaying a main screen and a sub-screen, and determines whether a photographed image is received from the outside. If it is received as a result of the determination, the transmission source is displayed on the secondary screen, and it is determined whether or not the captured image is to be played back. Display the captured image.
Further, in the reproduction method according to the fifteenth aspect of the present invention, in the fourteenth reproduction method, it is further determined whether or not enlargement reproduction is to be performed, and when enlargement reproduction is to be performed, the reproduction is displayed on the main screen.

ADVANTAGE OF THE INVENTION According to this invention, the imaging device and imaging system which can judge the condition of a viewer's reproducing | regenerating apparatus and can transmit the image which can be enjoyed in the condition can be provided.

Hereinafter, preferred embodiments using a digital camera to which the present invention is applied will be described with reference to the drawings. The camera according to the first embodiment of the present invention has a live view function in which a subject image is photoelectrically converted by an image pickup device, and the acquired image data is displayed as a moving image in real time. The image data can be recorded on a recording medium. In addition, this camera can be connected to a server through a network, and the state of the viewer's image reproduction device can be detected therefrom and fed back to the camera.

FIG. 1 is a block diagram of a digital camera and its surroundings according to the first embodiment of the present invention. A camera 100 used by a user includes a photographic lens 2, an AF (autofocus) control unit 2a, an aperture 2b, an aperture control unit 2c, an image sensor 3, and an analog front end (hereinafter referred to as AFE) unit 4. Yes. The taking lens 2 has a focus lens inside, and forms an image of the incident subject 20 on the image sensor 3.

The AF control unit 2a performs image processing in an image processing unit 5 to be described later, detects an in-focus position of the photographic lens 2, detects it by a so-called hill-climbing method, drives the focus lens, and moves it to the in-focus position. Note that the hill-climbing method is a method for detecting the in-focus position (focus position) from the contrast signal peak of the photographed image. In addition to the hill-climbing method, for example, a known focusing method such as a phase difference method or a triangulation method can be used. It may be replaced. When the in-focus position is reached by AF, the distance can be determined by detecting the photographing lens 2 at this time. In this case, when the photographing lens 2 is a zoom lens, the distance is determined in consideration of the zoom position and the like.

A diaphragm 2b that provides the effects of a shutter and a diaphragm is provided in or near the photographing lens 2. The diaphragm 2b is opened to a predetermined aperture at the time of photographing, and is closed when the exposure is finished to finish the exposure. The aperture control unit 2c drives the aperture 2b to set the aperture diameter. By changing the aperture, the depth of field of the lens changes, so you can change the expression by adjusting the blurring of the background, etc. Can do. The image pickup device 3 is a CCD or CMOS sensor having a large number of light receiving surfaces (pixels), and receives an image from the subject 20 via the photographing lens 2 and converts it into an image signal.

The analog front end (AFE) unit 4 includes analog-to-digital conversion (AD) means, and converts a signal from the image sensor 3 into a digital signal. The AFE unit 4 performs various processes on the image signal output from the image sensor 3. The AFE unit 4 is also provided with a function of reading several pixels of the image pickup device 3 together and reading them together. For example, when the signal level of each pixel is small, such as 4 pixels (2 × 2) and 9 pixels (3 × 3), several pixel signals can be added to improve the S / N. Sensitivity can also be increased.

Sensitivity can be increased by such processing, and it is possible to devise photography such as increasing the shutter speed. When the shutter speed is high, it is possible to shoot as if the moving subject is stopped. In addition, camera shake and the like can be prevented.

The AFE unit 4 has a function of selecting signals output from the image sensor 3 and can extract image data in a limited range from the light receiving range. In general, when pixel signals thinned out from the pixels of the image sensor 3 are extracted, high-speed reading is possible. Thus, the image signal for composition confirmation is processed at high speed by the image processing unit 5 and displayed on the display panel 8 via the display control unit 8a, thereby enabling framing.

The output of the AFE unit 4 is connected to the image processing unit 5. The image processing unit 5 corrects the color, gradation, and sharpness of the input signal. Further, it has an intensifying unit that amplifies the image signal obtained from the image sensor 3 to a predetermined level and sets the correct gray level and the correct gray level. This is a digital operation so that the digitized signal level becomes a predetermined level. In addition, the image processing unit 5 includes a resizing unit that processes a signal from the image sensor 3 to a size that can be displayed on the display panel 8 so that a live image can be displayed on the display unit in real time. By this function, an image incident on the image sensor can be confirmed prior to shooting, and the timing and photo opportunity at the time of shooting can be determined while viewing this.

In addition, the image processing unit 5 has an image determination function for determining characteristics of an image input from the image sensor using the signal of the image processing unit 5. As the image determination function, a face detection unit 5a for determining a part of a person's face such as an eye or a mouth from contour information obtained by processing image information, and using the face detection unit 4a to express facial expressions such as a face. It has a facial expression determination unit 5b for determining and a personal authentication unit 5d for identifying an individual's face and authenticating the individual. The image processing function further includes a distance determination unit 5c that determines the distance of the subject by determining the contrast of the signal level of the image. The image processing unit 5 and its peripheral auxiliary unit are also used to adjust the appearance of the captured image in cooperation with the MPU 1.

In this way, the image processing unit 5 and the peripheral auxiliary units (the face detection unit 5a, the facial expression determination unit 5b, the personal authentication unit 5d, etc.) determine what kind of photograph the user is going to take when taking a picture. Further, it is used to determine the preference of the viewer who sees the picture and optimize the shooting control.

The camera 100 includes a compression unit 6, a recording unit 9a, a recording medium 9, a transmission / reception unit 9c, a transmission destination state determination & database (DB) 9d, a transmission setting unit 9e, a display panel 8, a display control unit 8a, and a multi-image processing unit. 8b is provided. The compression unit 6 compresses the signal output from the image processing unit 5 at the time of shooting. The compression unit 6 includes MPEG (Moving Picture Experts Group) 4 and H.264. A compression unit for moving images composed of a compression core unit such as H.264 and JPEG (Joint
A still image compression unit such as a Photographic Experts Group) core unit is provided. The compression unit 6 also performs image expansion when reproducing an image recorded on the recording medium 9 on the display panel 8.

The recording unit 9 a records the compressed image signal on the recording medium 9. The recording medium 9 is a storage recording medium that can be attached to and detached from the camera. In recording an image signal, time information when a photograph is taken may also be recorded. The shooting time information is measured by a clock unit 1t in the MPU 1 described later, and the MPU 1 associates with the image.

The captured image data recorded on the media 9 or the recording unit 9a is transferred to other devices such as the server 33 that manages images via the communication network 32 such as the Internet, a mobile phone network, and a telephone line by the transmission / reception unit 9c. be able to. The transmission / reception unit 9c is connected to the transmission setting unit 9e, and the transmission setting unit 9e is a designation unit that designates a transmission destination when transmitting an image. The captured image can be sent immediately to a designated destination. At this time, the viewer's preference information may be acquired.

The display panel 8 is composed of, for example, a liquid crystal, an organic EL, or the like, and displays a subject image as a through image (also referred to as a live view display) for observation at the time of photographing, and reproduces and displays an expanded recorded image during reproduction.

The display control unit 8 a controls display on the display panel 8. The multi-image processing unit 8b is a control unit for displaying a plurality of images on the display panel 8. By this multi-image processing unit 8b, it is possible to display characters of a destination address and various warnings on the captured image and the captured image. The display panel 8 displays a list of images that have been shot and transmitted, and from there, an image to be uploaded to a blog service or the like operated by the server 33, or a layout for uploading and displaying the image on a blog can be selected. You may do it. In addition, the multi-screen display function 8b makes it possible to display various auxiliary displays such as information for assisting shooting and examples of images that the viewer likes.

Further, the display on the display panel 8 is displayed by switching the aspect ratio according to the screen of the transmission device of the transmission destination based on the output of the transmission destination state determination & database (DB) 9d, and shooting is also performed in this aspect. I do it in ratio. For example, when the playback device of the transmission destination has a 16: 9 screen, it takes a picture with that aspect ratio, and when it has a 4: 3 screen, it takes a picture with that aspect ratio and displays the live view on the display panel 8. Displays a frame according to the aspect ratio and shoots only within that range.

The transmission destination state determination & database (DB) 9d is a database that records a tendency such as what device the viewer designated as the transmission destination views. In the present embodiment, based on the information in this database, it is determined whether or not viewing is possible with the playback device at the transmission destination, and the photographer is prompted to take a picture. The transmission destination state determination & database 9d acquires information on the transmission destination state from the server 33 described later.

The camera 100 is provided with an auxiliary light emitting unit 11, a microphone 12, an MPU (Micro Processing Unit) 1, a release switch 1a, a mode switch 1b, and another switch 1c. The auxiliary light emitting unit 11 includes a white LED and a Xe discharge light emitting tube, and the amount of light can be controlled by the amount of current. Depending on the situation, the subject 20 is irradiated with light to prevent lack of brightness and uneven brightness. The microphone 12 collects sound, takes in surrounding audio information, compresses the audio by the compression unit 6, and records it on the recording medium 9 in association with the image data by the recording unit 9.

The MPU 1 is a control unit that controls the entire camera. A release switch 1a, a mode switch 1b, another switch 1c, and a ROM (not shown) storing a program and the like are connected to the MPU 1. A clock unit 1t for detecting the date and time is provided in the MPU 1, and the shooting date and time of the photo is detected and associated with the captured image. Note that the switches 1b and 1c are generically displayed switches, and are actually composed of a large number of switch groups. The MPU 1 is connected to a position determination unit 1d, and the position determination unit 1 detects a position by GPS or the like. Using this detected position, the shooting position at the time of shooting and the above shooting date and time are recorded on the medium 9 together with the image data.

Each switch 1a-1c detects a user's operation, and notifies the result to MPU1 which is a calculation control means consisting of a microcontroller. The MPU 1 switches the operation according to the operation of these switches. Also, the MPU 1 performs a shooting control function for controlling the AF control unit 2a, the aperture control unit 2c, and the like, and a recording control function for recording the acquired image data / acquired audio data in the recording unit 9a and the recording medium 9 at the time of shooting.

The camera 100 configured as described above is connected to a server 33 via a communication network 32, and a personal computer (PC) 34 owned by the user 31 can be connected to the server 33. The server 33 can be connected to a playback device such as a large screen television 34a or a mobile phone 34b. The server 33 determines the usage status of these playback devices, and the determination result is transmitted via the communication network 32. It can be transmitted to the camera 100. The configuration of the server 33 and its peripheral circuits will be described later with reference to FIG.

Next, the operation of the camera configured as described above will be described with reference to the drawings. FIG. 2 is a diagram showing a typical usage state. FIG. 2 shows an example of a grandmother 31 (viewer) who is looking forward to the growth of grandchildren. The grandmother (viewer) 31 looks forward to seeing the grandchild's photos. I'm looking forward to receiving it, but depending on the situation, the image may not be easily seen. For example, when watching a large television (TV) 34a, even if an image is sent to the mobile phone 34b, the power of the mobile phone 34b may be turned off or the ring tone may not be noticed, and the mobile phone 34b may be used as it is. There are also many. Also, it is nice to watch on a large screen television (TV) 34a because it looks powerful and large, but when you go out you can only watch it on your mobile phone 34b.

In the transmission destination state determination & database (DB) 9d described above, information on playback devices used by the viewer as shown in FIG. 3 is recorded. As will be described later, in the flowchart of FIG. 4, display and warning control are performed so as to determine the device environment that can be used by the transmission partner when using the camera 100 and to prompt the user of the camera 100 to perform shooting suitable for the viewing device of the transmission partner. Is performed by the camera 100. As a result, an image that is easy for the viewer to view can be taken and sent in a timely manner.

The large-screen television (TV) 34a and the mobile phone 34b have different screen sizes and resolutions, and different images suitable for reproduction, such as whether audio can be effectively reproduced. Therefore, in this description, it is assumed that the grandmother (viewer) 31 is always watching the large screen television (TV) 34, and first, the home appliance network determines whether the large screen television (TV) 34a is on. If it is turned on, it captures and transmits a moving image that can withstand a large screen and has a sound recorded. Such a determination result of the playback device status is displayed on the display unit on the back of the camera 100 (see FIG. 2).

However, when the grandmother (viewer) 31 goes out, the power of the large-screen television (TV) 34a is turned off. Therefore, the power-off is determined through the home appliance network, and in that case, an image suitable for the mobile phone 34b (for example, VGA (Video Graphics Array) still image) is transmitted to the mobile phone 34b. Of course, if the grandmother (viewer) 31 has many opportunities to go out, the priority order is reversed, and the power supply of the mobile phone 34b is first determined to increase the priority of image transmission to the mobile phone 34b. You may make it do.

When the mobile phone 34b is turned off, the power source of the large screen television (TV) 34a is determined. If it is turned on, an image to be transmitted to the large screen television (TV) 34a may be taken. . When both of them are off, we will give up sending them on the spot and send them to the mobile phone later, so that the VGA still image is taken and the image is held in the camera.

In this way, control is performed according to the priority order of the device information used by the viewer shown in FIG. 3, but the user is other than the grandmother, and FIG. 3 shows an example of the device used by the grandfather. Here, the grandfather likes to watch on a large screen because his eyes are bad. For example, when both the mobile phone and the large-screen TV (TV) are turned on, the large-screen TV (TV) 34a having a large screen is used. Expect to send to.

If the grandfather uses a personal computer (PC) to enjoy the Internet and mail, even if the large-screen TV (TV) 34a is off, it is displayed on the personal computer (PC) having the next largest screen. I want it. When such a viewer is assumed, the power supply of the personal computer (PC) is checked before the power supply of the mobile phone 34b is checked. When the personal computer (PC) is also turned off, an image is transmitted to the mobile phone 34b.

Further, as can be seen on the screen of a personal computer (PC), the image may be recorded on a server that provides an image storage service or a server 35 of a home server (see FIG. 5). A user of a personal computer (PC) can easily find and view an image recorded in such a place. Therefore, since the image is stored on the mobile phone 34b, a prompting display that prompts browsing is performed. Although lacking in immediacy, it is possible to view images on the large screen that my grandfather likes.

Next, the operation of this embodiment will be described using the flowchart shown in FIG. When the main routine for image shooting is entered, it is first determined whether or not the camera is in shooting mode (S0). If shooting is performed using the camera 100, the shooting mode is determined. For example, if shooting using the camera 100 is not performed such as transmission setting, playback mode, transmission mode, etc., the non-shooting mode is set as step S1. Proceed to

Subsequently, it is determined whether or not transmission is set (S1). This is a determination as to whether or not to perform presetting when transmitting image data to the viewer (eg, grandmother, grandfather) 31. As a result of the determination, if transmission setting is to be performed, a sender is selected from the transmission destinations recorded in the transmission destination state determination & database (DB) 9d (S2), and the transmission destination state determination & database (DB) 9d The recorded contents are referred to (S3). That is, reference is made to the priority and mode / image size of the playback device.

Next, based on the transmission destination state determination & reference result of the database (DB) 9d, it is determined whether or not the power of the device with the higher priority is turned on (S4). In this determination, the power supply state may be detected directly if communication between the camera 100 and the playback device can be performed, but if the playback device is connected to the server 33 via the communication network 32, A power state is detected through the server 33. In the example shown in FIG. 3, if the grandmother is selected as the transmission destination, the high-priority device is the large-screen television (TV) 34a. In step S4, the large-screen television (TV) 34a is It is determined whether or not the power is currently on.

If the result of determination in step S4 is that the power is on, the type of playback device is displayed and a shooting mode is instructed according to the recorded contents of the destination status determination & database (DB) 9d (S5). In other words, the transmission destination state determination & database (DB) 9d stores the optimum mode and image size according to the device. In the case of a grandmother, for example, in the case of a large screen television (TV) 34a, Select HD (high definition size) for the moving image. The shooting mode and the like are automatically set, but may be manually set.

On the other hand, if the result of determination in step S4 is that the device with the higher priority is turned off, the device with the higher priority will not be able to view the image immediately, so the device with the next highest priority is searched. (S6).

Next, it is determined whether or not the device has been searched as a result of the device search in step S6 (S7). As a result of the determination, if there is a device with the next highest priority, the process returns to step S4 to search whether the device is powered on. In this way, it is detected whether or not the power is turned on in order of priority, and if the device is turned on, a shooting instruction is issued in a shooting mode suitable for the device. This photographing instruction is performed by character display or icon display, and the aspect ratio of the screen is performed by changing the effective area 8c (see FIG. 5) of the display screen of the display panel 8.

If it is detected in step S7 that all the playback devices are not turned on, the specific shooting mode is set (S8). That is, in this case, a shooting mode instruction is performed assuming a default device. When there is no target device, the shooting mode assuming the default device is a shooting mode on the premise that recording in the camera or recording to the image storage server is performed.

When the specific shooting mode setting is finished in step S8 or the shooting mode instruction in step S5 is finished, it is next determined whether or not the mode is another mode (S9). This other mode is a mode other than the destination setting, for example, a playback mode or a transmission mode. If any other mode is set, that mode is executed (S11). If no other mode is set, or when the execution of the other mode ends, the process returns and executes from step S0.

If the result of determination in step S0 is that the camera is in the shooting mode, live view display for displaying the image data from the image sensor 3 on the display panel 8 is performed, and at this time, it is necessary for shooting. If, for example, the shutter speed is displayed or if transmission is set, the destination device is also displayed on the display panel 8 (S21).

Next, it is determined whether or not the corresponding image is taken (S22). That is, it is determined whether the shooting is the shooting with the transmission destination set in step S1 (corresponding image shooting, processing in step S22 and subsequent steps) or other normal shooting (processing in step S31 and lower steps). This can be set, for example, by operating a button on the back of the camera. If shooting is performed assuming a transmission destination by button operation, shooting is performed in a mode suitable for the transmission destination. However, in the case of shooting without this operation, the shooting sequence is the same as that of a general camera that records an image in the camera without being aware of transmission.

As a result of the determination in step S22, if it is determined that the corresponding image is not captured, it is next determined whether or not it is other image capturing, that is, whether or not normal image capturing other than the corresponding image capturing is performed ( S31). As a result of the determination, if it is another shooting, or if it is determined that the subject is not a predetermined subject as a result of the determination in step S23, the release button is fully pressed to determine whether or not it is a release operation (S32). ). If the release button is fully pressed as a result of the determination, a shooting operation is performed and normal image data is recorded on the recording medium 9 (S33).

On the other hand, if the result of determination in step S22 is that the image has been taken and there is a destination designation, a live view display that displays the image from the image sensor 3 on the display panel 8 and a person who wants to send a photo If there is device information for viewing (such as the type of device such as a large-screen television, shooting mode, image size, etc.), it is also displayed on the display panel 8 together. Subsequently, it is determined whether or not the current image is a subject that the viewer wants to see, in the example of FIG. 3, whether or not it is a grandmother of the grandmother (S23). This determination is made based on detection outputs from the face detection unit 5a, the facial expression determination unit 5b, the personal authentication unit 5d, and the like.

If the result of determination in step S23 is that the predetermined subject has been requested, the predetermined mode is set (S24). That is, shooting is performed in a mode (see FIG. 3) suitable for shooting and viewing according to the shooting mode stored in the transmission destination state determination & database (DB) 9d. In this step, there is a case where transmission is set in step S1 and, for example, even if it is intended to take a picture of the grandchild, it may be desired to take another subject that has entered the eyes. The image taken in such a case does not need to be transmitted, so the determination in step S23 is made, but it can be omitted.

Once the predetermined mode is set, it is next determined whether or not a release operation has been performed (S25). If the result of determination is that a release operation has been performed, shooting is performed and the captured image data is transmitted (S26). This image transmission is transmitted to a person who wants to show through the transmission / reception unit 9c by operating the transmission setting unit 9e according to the destination device information in the transmission destination state determination & database (DB) 9d.

Note that when all the transmission destination devices are turned off and cannot be transmitted, they are recorded in the memory in the camera 100 without being transmitted, or temporarily stored in the transmission recording unit in the server 33. When shooting in a special mode, tips for shooting may be displayed in step S22 to assist shooting. If it is determined in step S31 that no other image is taken and no release operation is performed in step S32, the process returns.

As described above, in the flowchart of the camera according to the first embodiment of the present invention, the transmission destination is preset based on the transmission destination stored in the transmission destination state determination & database (DB) 9d. (S1-S8). Further, when entering the shooting mode, it is determined whether or not the corresponding image to be transmitted to the transmission destination is shot, and if it is detected as a predetermined subject, it is stored in the transmission destination state determination & database (DB) 9d. Shooting is performed in a predetermined mode. For this reason, it is possible to easily take a photograph suitable for the playback device of the viewer.

Next, the server 33 for acquiring information about the playback device of the viewer will be described with reference to FIG. FIG. 5 is a block diagram showing the server 33 and its surroundings. In the server 33, a communication unit 33a for communicating with the camera 100 is provided. A diary / image recording unit 33b for recording images and comments received by the communication unit 33a is provided. The calendar unit 33i stores calendar information such as events. The display control unit 33c performs display control of content such as images recorded in the diary / image recording unit 33b when accessed from a personal computer.

In addition, the communication unit 33a in the server 33 can be connected to the above-described camera 100, a playback device (a large screen television (TV) 34a or a mobile phone 34b) owned or viewed by a grandmother, a grandfather, or the like through a network or the like. The server 33 can monitor whether or not the playback device is turned on and can be displayed via the communication network 32 and the communication unit 33a. It is also connected to an image storage server 35.

In the server 33, a user information unit 33e and a state determination unit 33f are provided, and user information, power supply and operation state determinations are recorded in association with each other. Further, an alternative database (DB) 33g connected to these parts is provided, and when the target device is powered off, it stores which device is to be replaced. If the other party is a very limited relative, data as shown in FIG. 3 may be recorded directly in the memory inside the camera 100. However, when a large number of viewers are assumed, it is difficult for the photographer to input viewing devices for all viewers. Therefore, it is better to provide a server for creating a database (DB) as shown in FIG. Good.

The server 33 has an appreciation content determination unit 33d, which appropriately monitors the content of the image that the user views (including resolution, file size, format, aspect ratio, etc.), and from this tendency, this alternative database (DB ) Create 33g content. Further, the diary / image recording unit 33b and the calendar unit 33i in the server 33 have a function for inputting and recording a schedule such as a diary, a blog article, an image, a calendar, and the like. It can also be read. Further, when an image cannot be transmitted to each device, the image may be temporarily stored in such a diary / image recording unit 33b.

Since it is configured as described above, when the camera 100 accesses the server 33, it is possible to determine a device that can be viewed by the user and to capture an image suitable for it. For example, in the case of a vertically long screen on the mobile phone 34b and a large-screen TV (TV) 34a having a wide screen, the method of determining the composition at the time of shooting also changes, so that shooting with a composition that matches the playback device is possible. In the example illustrated in FIG. 5, an example of a screen display that can record a high-definition (HD) moving image having an aspect ratio of 16: 9 is illustrated. By operating a switch for transmission setting (not shown) provided on the back of the camera 100, transmission setting can be performed, device information of the transmission partner is sent, and the screen size of the partner device is reflected, Information display as shown in FIG. 5 can be performed by a balloon.

Next, a second embodiment of the present invention will be described with reference to FIGS. In the first embodiment, the state of the transmission destination is determined before shooting, but in the second embodiment, the state of the transmission partner device is determined to prompt camera shooting. Since the configuration of the camera 100 and the server 33 in the second embodiment is the same as that of the first embodiment, detailed description thereof is omitted.

The operation in this embodiment will be described with reference to the flowchart shown in FIG. Steps S0 to S3 are the same as in the first embodiment. When the database reference in step S3 is completed, it is subsequently determined whether or not a device with high priority is on (S41). If the high-priority device has been turned on, it is next determined whether or not the priority has been changed (S44). If the priority is changed, a shooting instruction is given (S46). On the other hand, if the priority has been changed, the device information with the next highest priority is searched (S45), and the process proceeds to step S46, where an imaging instruction is given based on the searched device information.

In step S41, when the power of the high-priority device is off, the next-highest-priority device is searched (S42), and it is determined whether or not it is in another mode (S43). Other modes are the same as in step 9 (FIG. 4). If it is not the other mode, the process returns to step S41, and the above steps are repeated. If the other mode is selected in steps S10 and S43, the other mode is executed as in step S11.

If the result of determination in step S <b> 0 is shooting mode, step S <b> 21 and the subsequent steps are executed, but the processing here is the same as in the flowchart of FIG. 4 in the first embodiment, and detailed description thereof is omitted. .

As described above, in the flowchart shown in FIG. 6, the camera 100 constantly monitors whether the power of the destination device is turned on (S41 → 42, 43 → N). Is immediately ready to enjoy the image, the process proceeds from step S41 to step S46, and a shooting instruction, that is, information indicating which device is turned on is displayed to encourage shooting.

In addition, even if the priority of the mobile phone is initially high, the priority may change, such as the viewer's viewing environment changes and he / she wants to watch on a large screen television (TV) 34 from the middle (see FIG. 7). In this case, a priority switching signal may be received (S44 → 45) to prompt transmission to another device.

Next, a third embodiment of the present invention will be described with reference to FIGS. In the third embodiment, transmission information is displayed when a captured image is transmitted while viewing a playback device. That is, in the third embodiment, transmission information indicating that image transmission has occurred is displayed at the corner of the large-screen television (TV) 34a (FIG. 8A), and the captured image is played back in earnest. Start (FIG. 8 (b) → (c)). In this case, for example, when the operation is performed by the remote controller 342 as shown in FIG.

The configuration of the third embodiment is the same as that of the first and second embodiments, but a screen division control unit 34a1 is provided inside the large screen television 34a as shown in FIG. The screen division control unit 34a1 can display two screens, and performs display control of the main screen 340 and the sub screen 341 (see FIG. 8).

Next, the operation of the large screen television (TV) 34a will be described with reference to the flowchart shown in FIG. First, it is determined whether an image is received directly from the camera 100 or via the server 33 (S101). If the result of determination is that no reception has been made, only the main screen 340 is displayed on the display screen of the large-screen television 34a. If it is received as a result of the determination in step S101, a reception display is performed (S102). As this reception display, as shown in FIG. 8A, the transmission source is displayed as text on the sub-screen 341. In addition to this, display may be appropriately performed such as displaying a symbol or the like.

Next, it is determined whether or not playback is OK (S103). Whether or not this reproduction is OK is performed by the remote controller 342 or the like. If playback OK is not performed, the process returns, but if playback OK is performed, the large-screen television (TV) 34a starts playback of an image captured by the camera 100. Subsequently, it is determined whether or not enlargement reproduction is performed (S105). Enlarged reproduction is also performed by the remote controller 342 or the like. As a result of the determination, when enlarged reproduction is performed, the captured image is enlarged and displayed on the main screen, while the television screen is reduced and displayed on the secondary screen 341 as shown in FIG.

If enlargement reproduction is not performed in step S105, it is determined whether or not reproduction is NG (S107). That is, when the photographed image is not reproduced as a viewer, the photographed image is transferred to the next candidate (S108). If the reproduction is to be continued, step S107 is skipped and the process returns.

In addition, when everyone is watching a large-screen TV (TV) 34a, there are cases where it is not desired to display a photographed image. Only when it may be displayed on the screen television 34a, image reproduction on the large screen television 34a may be permitted. In this case, the large screen television 34a may be operated instead of the mobile phone 34b. Such a system is possible by using the second embodiment (see FIG. 6).

In a playback device viewed by many people such as a large-screen TV, the viewer may be confused when the playback of a captured image suddenly starts. However, according to the third embodiment, the photographed image is displayed only when it is permitted after the photographed image is transmitted, so that the above-described problems can be prevented. Can do.

As described above, in each embodiment of the present invention, image transmission is performed when the transmission partner is in a state of viewing an image. Therefore, shooting suitable for the playback device is pursued while pursuing immediacy. It is possible to perform shooting with high satisfaction.

In the embodiment of the present invention, the display information of the camera 100 is displayed on the display panel 8 of shooting information for shooting corresponding to the playback device of the transmission destination, for example, switching between moving images and still images, and the image size. . For this reason, it is possible to perform shooting optimal for the playback apparatus of the transmission destination. Furthermore, in the embodiment of the present invention, when no playback device as the transmission destination is used (when the power is turned off and reception is impossible), the storage device other than the playback device such as the camera 100 or the server 33 is used. I remember it. For this reason, it becomes possible to transmit at a later date.

Furthermore, in the embodiment of the present invention, it is possible to set a plurality of playback devices as transmission destinations, and sequentially determine whether or not the other party is in use. If any playback device is available, it can be transmitted. Moreover, since it is made to perform in order from the reproduction | regeneration apparatus with a high priority in determination of whether it is a utilization state, possibility that it can transmit to the optimal reproduction | regeneration apparatus is high.

In each embodiment of the present invention, when the shooting mode is entered, it is not determined whether the viewer's playback device is in a usable state. However, when live view display is performed in step S21 or the like. Of course, the state of the viewer's playback device may be determined.

The camera in the present embodiment may be a compact camera or a single-lens reflex camera, or may be a camera built in a mobile phone or a PDA. The present invention can be applied to any imaging device that can transmit an image to a playback device.

It is a block diagram of the camera concerning 1st Embodiment of this invention, and its periphery. It is a figure which shows the typical use condition of the camera concerning 1st Embodiment of this invention. It is a figure which shows an example of the transmission destination recorded on the transmission destination & database in the camera concerning 1st Embodiment of this invention. It is a flowchart which shows the image | photographing operation | movement of the camera concerning 1st Embodiment of this invention. It is a block diagram which shows the internal structure of the server concerning 1st Embodiment of this invention, and its periphery. It is a flowchart which shows the image | photographing operation | movement of the camera concerning 2nd Embodiment of this invention. It is a figure which shows the use condition with the reproducing | regenerating apparatus concerning 2nd Embodiment of this invention. It is a figure which shows the use condition with the reproducing | regenerating apparatus concerning 3rd Embodiment of this invention. It is a flowchart which shows the operation | movement of the television concerning 3rd Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... MPU, 1a ... Release switch, 1b ... Mode changeover switch, 1c ... Other switch, 1d ... Position determination part, 1t ... Clock part, 2 ... Shooting lens 2a ... AF (autofocus) control unit, 2b ... aperture, 2c ... aperture control unit, 3 ... imaging device, 4 ... analog front end (AFE) unit, 5 ... Image processing unit, 5a ... face detection unit, 5b ... expression determination unit, 5c ... distance determination unit, 5d ... personal authentication unit, 6 ... compression unit, 8 ... display panel, 8a: Display control unit, 8b: Multi-image processing unit, 8c: Effective area, 9: Recording medium, 9a: Recording unit, 9c: Transmission / reception unit, 9d: Transmission Prior state determination & database (DB), 9e ... transmission setting unit, 11 ... auxiliary light emitting unit, 12 .. Microphone, 20 ... Subject, 31 ... User (viewer), 32 ... Communication network, 33 ... Server, 33a ... Communication unit, 33b ... Diary / image recording unit, 33c: Display control unit, 33d: Appreciation content determination unit, 33e: User information unit, 33f: State determination unit, 33g: Alternative database (DB), 33i: Calendar unit, 34a ... large screen television (TV), 34b ... mobile phone, 35 ... server, 100 ... camera, 340 ... main screen, 341 ... sub-screen, 342 ... remote control

Claims (15)

Imaging means for taking an image;
A database for storing usage priority information of a plurality of image playback devices that can be used by a viewer who views the image;
Usage status determining means for sequentially determining the current usage status of the image playback device;
Image transmitting means for transmitting image data representing the image to the image reproducing device determined to be currently used by the utilization status determining means;
An imaging apparatus comprising:   The imaging apparatus according to claim 1, further comprising a display unit that displays shooting information for performing shooting corresponding to the image playback device that is the transmission destination of the image data.   The imaging apparatus according to claim 2, wherein the shooting information is an aspect ratio of a display screen of the image playback device having the highest usage priority.   The image data is stored in a storage device other than the image reproducing device when none of the image reproducing devices is currently used as a result of the determination by the usage status determining means. Imaging device.   The imaging apparatus according to claim 1, wherein the usage status determination unit repeatedly performs an operation of sequentially determining a current usage status of the image playback device until any of the image playback devices is in a usage status. An imaging method of an imaging apparatus having an imaging means for capturing an image,
Use priority information of a plurality of image playback devices that can be used by a viewer who views the image is stored in the storage unit,
Sequentially determine the current usage status of the above image playback devices,
Based on the result of the determination of the usage status, image data representing the image is transmitted to the image reproduction device determined to be currently used.
An imaging method comprising steps. Imaging means for taking an image;
A database for storing usage priority information of a plurality of image playback devices that can be used by a viewer who views the image;
Usage status determining means for sequentially determining the current usage status of the image playback device;
Image transmitting means for transmitting image data representing the image to the image reproducing device determined to be currently used by the usage status determining means;
An imaging system comprising: Imaging means for taking an image;
A database for storing usage priority information of a plurality of image playback devices that can be used by a viewer who views the image;
Usage status determining means for sequentially determining the current usage status of the image playback device;
Display means for displaying the image reproduction device determined to be currently used by the use state determination means;
An imaging apparatus comprising: Imaging means for taking an image;
A database for storing usage priority information of a plurality of image reproducing devices that can be used by a viewer who views the image, and shooting information suitable for each of the image reproducing devices;
Usage status determining means for sequentially determining the current usage status of the image playback device;
Display means for displaying shooting information suitable for the image reproduction device determined to be currently used by the use state determination means;
An imaging apparatus comprising:   The imaging apparatus according to claim 9, wherein the shooting information includes at least one of a shooting mode and an aspect ratio. Furthermore, it has image transmission means for transmitting image data representing the image,
The database contains the destination information for the viewer,
The imaging apparatus according to claim 9 or 10, wherein the image transmission unit transmits the image data based on the transmission destination information. Imaging means for taking an image;
A database for storing shooting information suitable for playback on an image playback device that can be used by a viewer who views the image;
Usage status determining means for determining the current usage status of the image playback device;
An image transmission unit that transmits image data representing the image to the image reproduction device when the use state determination unit determines that the image is currently being used;
An imaging apparatus comprising: A communication means for communicating with a plurality of image playback devices and imaging devices that can be used by a viewer who views images;
A storage unit for storing the viewer information;
Usage status determination means for determining the current usage status of the image playback device;
A database for determining and storing a use state of the image reproduction device of the viewer based on outputs of the storage unit and the use state determination unit;
Comprising
A server that outputs a usage state of the image reproduction device stored in the database to the imaging device. A playback method in a playback device having display means for displaying a screen divided into a main screen and a sub-screen,
Determine whether you have received a shot image from the outside,
If it is received as a result of the determination, the sender is displayed on the sub-screen,
Determine whether or not to replay the captured image,
As a result of the determination, when the reproduction is performed, the captured image is displayed on the secondary screen.
A reproduction method characterized by the above.   15. The reproduction method according to claim 14, further comprising: determining whether or not to perform enlargement reproduction, and displaying the enlargement reproduction on the main screen.