JP2003174578A - Electronic camera, image display device and image display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To instantaneously extract and display relating information (individual information and explanations, etc.), relating to an object in the case that a browsing person is interested in the object (a human body and a structure, etc.), projected on a screen when reproducing and browsing image data photographed by an electronic camera. <P>SOLUTION: When performing photographing with an electronic camera, the electronic camera detects the position of an object in a photographing image and the electronic camera gathers the relating information regarding the object by communicating with the object, adds the relating information to the image data in relation to the position within the photographing image and stores it. When reproducing and browsing the image data, when a user specifies the object that the/she is interested in on a reproducing image, the relating information corresponding to the specified position on the reproducing image is read and displayed. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention stores electronic image data of a desired subject photographed by an electronic camera in a storage medium, reads the electronic image data from the storage medium, and displays the electronic image data on a predetermined screen. The present invention relates to an electronic camera, an image display device, and an image display system for reproducing and displaying, and more particularly to an electronic camera, an image display device, and an image display system for displaying information related to image data from a screen on which image data is reproduced and displayed.

[0002]

2. Description of the Related Art Image data taken by an electronic camera is stored in a memory card at a travel destination and the image data is later transferred from the liquid crystal display screen of the electronic camera equipped with the memory card or the memory card. The image data is reproduced and displayed on the screen of the personal computer.

[0003]

In the conventional browsing of electronic image data as described above, it is only possible to view the reproduced and displayed image, and it is difficult to develop the information utilization other than the browsing using the image. Met. For example, while browsing the image, if you want to know about the historical buildings in the image, stop browsing the image and look it up in the encyclopedia or search on the Internet. I had to do it. Also, while browsing the image, personal information (name, hobby) of the person shown in the image
Even if I was interested in such things, I could not immediately know the personal information of the person on the spot.

In view of the above, the present invention simplifies information relating to a subject appearing in a screen that is of interest when reproducing and displaying electronic image data in cooperation with reproducing and displaying the electronic image data. An object of the present invention is to provide an electronic camera, an image display device, and an image display method that can be quickly viewed.

[0005]

In order to achieve the above object, in an electronic camera, an image display device, and an image display method according to the present invention, the relevant information of the subject associated with the position of the subject in the screen is displayed as an electronic image. In addition to storing the data in addition to the data, when the electronic image data is reproduced and displayed, the related information of the subject is displayed according to the position on the screen.

[0006]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a conceptual diagram of an embodiment of the present invention, in which an electronic camera photographs a subject within a photographing range and obtains relevant information from a subject and an information source in the vicinity of the camera by wireless communication. Further, the relevant information of the subject is associated with the position of the subject in the photographing screen, and is added to the photographed image data together with other relevant information to form an image file.

When reproducing an image file, first, image data taken as a home screen is reproduced and displayed. Next, by specifying a position on the home screen, the related information regarding the subject reproduced and displayed at that position is displayed on the screen. From the displayed related information, related information that links to the information can be displayed.

FIG. 2 is a conceptual diagram of an electronic camera to which the present invention is applied and an electronic image communication system using the electronic camera. In FIG. 1, the electronic camera 100 includes a memory card, and stores electronic image data or digital image data (hereinafter referred to as image data) obtained by photographing a field that is within a photographing screen of a predetermined size in the memory card. The electronic camera 100 also has a short-range wireless communication function (for example, Bluetooth with a communicable range of about 10 m in radius), and communicates with the mobile phone 160 also having the short-range wireless communication function. It is assumed that the person who is the subject of the electronic camera 100 carries the mobile phone 160.
A UIM card (User Identity Module card) 170 in which personal information of the user is stored is attached to the device 60. This mobile phone 160 is G
Positioning means (position detecting means) such as PS is built in.

When the electronic camera 100 photographs a person as a subject, the personal information of the person as a subject is transferred to the electronic camera 100 by communication between the electronic camera 100 and a mobile phone 160 carried by the person as a subject. . Further, the electronic camera 100 detects the position of the person who is the subject in the photographing screen by a method described later, sets the position information in the screen and the personal information as a set, and stores the photographed image data in the memory card as an image file. Remember. In addition, the electronic camera 100 transfers the image file to the wireless mobile phone line 190 via the wireless base station 120, and a wired or wireless general public phone line or the Internet 130.
Is further transferred to the personal computer 140 or the image database 150 for personal use.

The electronic camera 100 has a liquid crystal display screen,
The image file stored in the memory card can be read and reproduced and displayed on the liquid crystal display screen. Further, the electronic camera 100 accesses various information servers and information sites based on the related information of the subject through the wireless mobile phone line 190 and the Internet 130, obtains detailed information about the subject, and the information is stored in the liquid crystal. It can be reproduced and displayed on the display screen.

Further, the personal computer 140 has a CRT display screen, and can read out an image file stored in the image database 150 and reproduce and display it on the CRT display screen. Further, the personal computer 140 accesses various information servers and information sites based on the related information of the subject through the Internet 130, obtains detailed information about the subject, and reproduces and displays the information on the CRT display screen. be able to.

3 and 4 show the electronic camera 1 shown in FIG.
00 is an external view (front view and rear view) of the embodiment of No. 00. As shown in FIG. 3, on the front surface of the electronic camera 100, a photographing lens 10 for forming a subject image, a viewfinder 11 for confirming a photographing screen, a strobe 12 for illuminating the subject at the time of photographing, and a brightness of the subject are displayed. A photometric circuit 13 for detection, a grip portion 14 protruding from the camera body for holding the electronic camera 100 by hand are provided, and a release button 16 for instructing the start of photographing on the upper surface, and a power source for the electronic camera 100. A power switch 17 (a momentary switch, which switches between ON and OFF for each operation) for performing ON / OFF control is provided.

As shown in FIG. 4, on the rear surface of the electronic camera 100, a left LCD (left screen) 21 having an eyepiece of the finder 11 and a substantially rectangular screen for displaying text and images.
And a right LCD (right screen) 22 having a substantially rectangular screen for text display and image display is arranged.
1, an up button 23 and a down button 24 for switching the image displayed on the left screen 21 and a right L
Around the CD 22 and the left LCD 21, a shooting mode button 25 for setting the electronic camera 100 to the shooting mode, a playback mode button 26 for setting the playback mode, and an information display mode button 2 for setting the information display mode.
8. Confirmation button 29 used to determine the selection item
Are arranged. A memory card slot 30 for mounting the memory card 104 is provided on the side surface.

The release button 16 and the upward button 2
3, the down button 24, the shooting mode button 25, the reproduction mode button 26, the information display mode button 27, the transmission button 28, and the enter button 29 are all operation keys operated by the user. The left LCD 21 and the right LCD
A so-called touch tablet 66 having a function of outputting position data corresponding to a position designated by a touch operation of a finger is arranged on the surface of 22 and is used for selecting a selection item or a subject displayed on the screen. be able to. The touch tablet 66 is made of a transparent material such as glass resin, and the user can observe images and texts formed inside the touch tablet 66 through the touch tablet 66.

FIG. 5 is a block diagram showing an internal electrical configuration example of the electronic camera 100 shown in FIGS. 3 and 4, and each component is data / control for transmitting various information data and control data. They are connected to each other via a bus 51. Each component is roughly classified into the following 5 blocks. A block centering on a photographing control circuit 60 for performing a photographing operation of image data, a wireless communication circuit 71 for communicating by radio communication (Bluetooth etc.) with an electronic device near the electronic camera 100, and a wireless mobile phone line. A block centering on the wireless telephone circuit 72 for transmitting and receiving data to and from the outside, a block of the memory card 104 for storing and storing image files, and a screen control circuit 92 for displaying image data and its related information. CPU 50 that performs overall control of each control circuit and user interface such as blocks and operation keys 65
Is a block centered on.

The CPU 50 (central processing unit) is means for controlling the entire electronic camera 100, and the operation keys 6
5, touch tablet 66, various detection circuits 70, power switch 17, timer 74, photometric circuit 13, GPS circuit 6
1. Various instructions are given to the photographing control circuit 60, the wireless communication circuit 71, the wireless telephone circuit 72, the screen control circuit 92, and the power supply control circuit 64 according to the input information from the attitude detection circuit 62.

Under the control of the CPU 50, the recording circuit 80 records the voice of the subject at the time of photographing and the voice of the memo emitted by the photographer after the photographing as voice data, and the voice data is stored in the image file together with the image data. . Under the control of the CPU 50, the audio reproduction circuit 81 reproduces the audio data stored in the image file together with the image data when reproducing the image data, or reproduces other audio data.

The photometric circuit 13 measures the brightness of the subject and outputs the photometric data as the measurement result to the CPU 50.
The CPU 50 sets the exposure time and sensitivity of the CCD 55 by the CCD drive circuit 56 according to the photometric data, and controls the aperture value of the aperture 53 by the aperture control circuit 54 via the photographing control circuit 60 according to the set data.

In the photographing mode, the CPU 50 controls the photographing operation via the photographing control circuit 60 according to the operation of the release button 15. When the subject is dark based on the photometric data, the CPU 50 causes the strobe 12 to emit light via the strobe drive circuit 73 during shooting.

The GPS circuit 61 (global positioning system circuit) detects the position information of the electronic camera 100 using the information from a plurality of satellites orbiting the earth, and the shooting position information to the CPU 50 at the time of image capturing. Supply. The posture detection circuit 62 includes a well-known posture sensor (gyro sensor, orientation sensor) or the like for detecting the posture of the electronic camera 100, detects the posture information of the camera, and supplies the photographing posture information to the CPU 50 at the time of image capturing. To do.

The timer 74 has a built-in clock circuit, detects date and time information corresponding to the current date and time, and supplies the photographing date and time information to the CPU 50 at the time of photographing. The CPU 50 is the ROM 67
Each unit is controlled according to a control program stored in (read only memory). The EEPROM 68 (electrically erasable and writable ROM) is a non-volatile memory,
The setting information and the like necessary for the operation of the electronic camera 100 are stored. The CPU 50 detects the operating state of the power switch 17 and controls the power source 63 via the power source control circuit 64.

The photographing control circuit 60 includes a lens drive circuit 52.
Focusing and zooming of the taking lens 10 are performed by the
The CCD drive circuit 56 is controlled by controlling the exposure amount of D55.
Controls the operation of the CCD 55. The light flux from the subject is formed as a subject image on the CCD 55 by the taking lens 10 through the diaphragm 53 for adjusting the light amount, and the subject image is captured by the CCD 55. A CCD 55 (charge coupled device) having a plurality of pixels is a charge storage type image sensor for picking up a subject image, and an electric image signal formed on the CCD 55 according to the intensity of the subject image is CCD driven. The signal is output to the analog processing unit 57 according to the drive pulse supplied by the circuit 56.
It should be noted that an object field that falls within the angle of view determined by the effective screen size of the CCD 55 and the focal length of the taking lens 10 is taken as image data on the taking screen.

The photographing control circuit 60 repeats the above-mentioned operation, and the screen control circuit 92 controls the photographing buffer memory 59.
Digital data sequentially stored in the data / control bus 5
1 is read out through 1 to be temporarily stored in the frame memory 69, the digital data is converted into display image data and stored again in the frame memory 69, and the display image data is displayed on the left screen 21. . Further, the screen control circuit 92 sends text display information to the CPU if necessary.
The display text data is obtained, converted into display text data and stored in the frame memory 69, and the display text data is displayed on the left screen 21 and the right screen 22. In this way, in the shooting mode, since the image taken by the CCD 50 is displayed on the left screen 21 in real time, it is possible to use this through screen as a monitor screen to set the composition for shooting. Become.

The photographing control circuit 60 includes a photographing buffer memory 5
The degree of high frequency component of the digital data stored in 9 is analyzed to detect the focus adjustment state of the taking lens 10, and the lens driving circuit 52 adjusts the focus of the taking lens 10 according to the detection result. The shooting control circuit 60 is a CPU 50 at the time of shooting.
When a photographing instruction is received from the CCD 55, an image of the subject is picked up by the CCD 55 via the CCD driving circuit 56, and the image signal generated by the picking up is processed by the analog processing unit 57 and the A / D conversion circuit 5.
It is temporarily stored as digital data (raw data) in the image pickup buffer memory 59 via 8. The photographing control circuit 60 converts or compresses the digital data once stored in the photographing buffer memory 59 into a predetermined recording format (JPEG or the like) to form image data, and stores the image data in the photographing buffer memory 59 again.

The CPU 50 communicates with an electronic device such as a mobile phone carried by the subject through the wireless communication circuit 71 to collect related information about the subject and obtain position information of the electronic device. Further, the CPU 50 has a GPS circuit 61.
From the photographing position information, the posture detecting circuit 62 from the photographing posture information, and the photographing control circuit 60 from the photographing distance information of the photographing lens 10 to obtain the position information of the electronic device, the photographing position information, the photographing posture information and the focal length information. Based on the above, the in-screen position information indicating the position of the subject in the screen is calculated by the method described later. The CPU 50 stores the image data, the related information about the subject, and the in-screen position information of the subject in the memory card 104 as an image file.

In the reproduction mode, the screen control circuit 92
Reads out an image file instructed by the CPU 50 from the memory card 104, temporarily stores it in the frame memory 69, converts the image data into display image data and stores it again in the frame memory 69, and the display image data is stored in the left side. In addition to displaying on the screen 21, according to the instruction of the CPU 50, the text data such as the explanation of the reproduction mode is written in the frame memory 6
9, and the text data is displayed on the right screen 22. In the reproduction mode, the wireless telephone circuit 72 has the CPU 50
When the transmission instruction is received from, the designated image file is read from the memory card 104 and the image file is wirelessly transmitted to the outside.

In the information display mode, first, the CPU 5
In the case of 0, similar to the reproduction mode, the screen control circuit 92 reproduces and displays predetermined image data on the left screen 21, and superimposes the information icon at a position corresponding to the in-screen position information of the subject. Further, the text data for explanation is displayed on the right screen 22. When the information icon is selected by the touch tablet 66 in the information display mode, the CPU 50 determines the wireless telephone circuit 72 based on the subject-related information associated with the in-screen position information.
Sources of information on the Internet (homepage, etc.)
To display the homepage screen and the like on the left screen 21 and the operation explanation screen on the right screen 22.

FIG. 6 shows the data structure of an image file stored in the memory card 104. As shown in FIG. 6, a plurality of image files are stored in the memory card 104. Each image file is composed of image data and additional information data. The additional information data includes shooting information data (FIG. 7) indicating various settings at the time of shooting, date and time information data indicating the date and time when the shooting was performed, position information data indicating a position at which the shooting was performed, and camera information at the time of shooting. Posture information data indicating the posture, audio information data recorded during or after shooting, general information data (FIG. 8) indicating general information regarding shooting input during or after shooting, input during or after shooting It is composed of subject information data indicating information related to the subject.

The subject information data is composed of relevant information of the subject (person, building, landscape, etc.) that has been transferred to the photographed screen. For example, when the subject is a person, it is composed of personal information data (FIG. 9) of the person and when the subject is a building or the like, general information data about the building.

FIG. 7 is a diagram showing the structure of the photographing information data, which is composed of setting information relating to the setting of the photographing lens and the setting of the camera at the time of photographing. FIG. 8 is a diagram showing the structure of general information data. The access data (homepage address etc.) of the information corresponding to each information on the Internet, the data representing the content of the information content, and the position of the transmission source of the information It is composed of information data.

FIG. 9 is a diagram showing the structure of the personal information data. In-screen position information indicating which subject in the screen the personal information corresponds to, and the electronic device of the sender of the personal information. Location information, Internet access information data (URL of homepage, etc.) of the individual, e-mail address, personal name, date of birth, language used, physical data (eyesight, diopter, dominant hand), preference (color, etc.), It is composed of other data.

FIG. 10 is a state transition diagram of the embodiment of the electronic camera 100 according to the present invention. There are three operation modes of the electronic camera, that is, a shooting mode, a reproduction mode, and an information display mode, and three operation buttons (shooting mode button 2
5, playback mode button 26, information display mode button 2
By the operation of 7), each mode is switched. Power on
Then, the mode first shifts to the shooting mode. In the shooting mode, shooting operation, wireless communication operation, and image file creating / storing operation are executed. In the reproduction mode, the image file is reproduced and the image file is transmitted to the outside. In the information display mode, the information related to the image data is collected and displayed by accessing the Internet based on the additional information data corresponding to the image data.

FIG. 11 is a main flowchart of the operation of the electronic camera 100 (CPU 50) in the above embodiment. First, when the power switch 17 is operated in S10, the power is turned on, and in S20, the shooting mode subroutine is executed to enable the shooting. When the release button 16 is operated in the shooting mode, the release interrupt processing subroutine of S30 is executed and the shooting operation is performed. At the same time as the shooting, the release interrupt processing subroutine of S30 calls the wireless interrupt subroutine of S40 to wirelessly communicate with the electronic devices existing around the electronic camera.
Collect subject information data and general information data. The collected subject information data and general information data are configured as additional information data together with the shooting information data, and are stored in the memory card 104 as an image file together with the image data.

Further, when the three operation buttons (shooting mode button 25, reproduction mode button 26, information display mode button 27) are operated in each operation mode, the mode switching interrupt process of S50 is activated, depending on the type of operation button. Switching to each mode is performed.

In the reproduction mode of S60, the image file stored in the memory card 104 is read, the image data is reproduced and displayed on the display screen, and when the send button 28 is operated, the transmission interrupt processing subroutine of S70 is executed. An image file including image data reproduced in the reproduction mode is transmitted to the outside.

In the information display mode of S80, as will be described later, the image data is first reproduced and displayed on the display screen, and the screen position information corresponding to the position designated by the user by the touch tablet 66 on the display screen is provided. Information collected by accessing the Internet based on the subject information itself or the Internet access information included in the subject information is displayed on the display screen.

FIG. 12 is a detailed flow chart of the photographing mode subroutine. When started in S20, S201
The process of is repeated. In S201, the image data sequentially generated by the CCD 55 based on the shooting setting conditions set by the user is displayed on the left screen 21 as shown in FIG. 13, and the shooting setting conditions at that time are displayed in text on the right screen 22. It is a detailed flowchart of the release interrupt processing subroutine. When started in S30, it is checked in S301 whether the shooting mode is set.
Return at 305. In shooting mode, S302
In step S40, the image pickup operation is performed under the image pickup setting condition set by the user to generate image data, and then the wireless communication processing subroutine of S40 described later is executed to generate additional information data. In step S303, the image data and the additional information data are combined to generate an image file, which is stored in the memory card 104. In S304, the image data is displayed on the screen for a predetermined time, and the process returns in S305. It should be noted that the image data has a predetermined shooting screen size, and the photographed subject is arranged at some position within this shooting screen according to the shooting composition.

FIG. 15 is a detailed flow chart of the radio communication processing subroutine. When started in S40, S40 is executed.
It is checked in 1 whether or not the photographing mode is set. If the photographing mode is not set, the process returns in S408. In shooting mode,
In step S402, the electronic camera 100 is operated by the wireless communication unit 71.
Wireless communication to electronic devices (a mobile phone owned by the person who is the subject and an electronic tourist guide device that is fixedly set near the historic site and can transmit tourist information of the historic site by wireless communication) around it. Try. At that time, the signal transmission output at the time of wireless communication is changed according to the focal length of the photographing lens. For example, it is estimated that the subject exists at a longer distance as the focal length is longer, so the signal transmission output level is increased. If communication is not established in S403, the process returns in S408. If the communication is established, the position information data of the electronic device and the subject information data (or general information data) are acquired by wireless communication from the electronic device of the communication partner with which the communication is established in S404. In S405, the electronic camera 10
The position information of the electronic camera 100 itself is received from the GPS circuit 61, and the position information of the electronic camera 100 itself is received from the GPS circuit 61.
2, the position of the subject (electronic device) with respect to the electronic camera 100 is obtained from the position information of the electronic device, the position information of the electronic camera 100, and the attitude information of the electronic camera 100, as will be described later. In step S407, the focal length information of the photographing lens 10 is received from the photographing control circuit 60, the angle of view at the time of photographing is calculated from the focal length information and the effective screen size of the image sensor, and the electronic camera 1 is operated as described later.
Based on the position information of the subject with respect to 00, the position of the subject within the captured screen (in-screen position information data) is generated, and the process returns in S408.

FIG. 16 is a sequence diagram for explaining the wireless communication operation performed between the electronic camera and the electronic device during the release interrupt process and the wireless communication process. First, the release operation is performed on the electronic camera 100 side. Then, the photographing operation is performed accordingly, and then the electronic camera 100 side attempts a wireless communication requesting a communication with electronic devices in the vicinity. In the communication request, the electronic camera 10 showing the transmission source
Identification information of 0 is also transmitted.

In response to this communication request, the electronic device responds to the electronic camera 100 to transmit the identification information of the transmission source electronic device and the transmission destination electronic camera identification information. Electronic camera 10 that received the response
0 confirms the communication partner based on the identification information of the electronic device, and transmits an information request to identify the electronic device of the communication partner and request the related information. In the information request, the identification information of the electronic device of the transmission destination, the identification information of the electronic camera 100 of the transmission source, the content of the requested information, and the like are transmitted to the electronic device side.

The electronic device corresponding to the identification information of the electronic device included in the information request transmits the requested related information (position information, access information, etc.) to the electronic camera. The information transmission includes identification information of the electronic camera 100 of the transmission destination, identification information of the electronic device indicating the transmission source, and related information.

The electronic camera 100 receives information transmitted from the electronic device. The electronic camera 100 sequentially makes an information request to all the electronic devices that have responded to the communication request, and when receiving the information transmission from the electronic device, the wireless communication is ended, an image file is generated, and the image file is generated. Are stored in the memory card 104.

17 and 18 are explanatory views of how to obtain the in-screen position information data of the subject. The subject position information data and the shooting position information data are centered on a predetermined reference origin.
It is given as a position coordinate in the dimensional coordinate system. First, FIG.
As shown in, the origin of the reference coordinate system is set to the electronic camera 100.
Coordinate system (axis P:
The optical axis direction of the camera, the axis Q: the horizontal direction of the camera, the axis R: the vertical direction of the camera) are converted, and the position coordinates of the converted subject 203 are obtained.

Further, as shown in FIG. 18, an angle of view 5 (shown by a chain line) is calculated in the photographing optical axis direction (P axis) from the focal length information of the photographing lens and the effective screen size of the CCD 20.
Next, the direction of the straight line connecting the origin 3 and the subject position 203 is calculated. By comparing the angle of view 5 and the direction of the straight line 4, it is possible to calculate whether or not the subject is within the screen and the position of the subject within the screen (in-screen position information data) as shown in FIG. it can.

FIG. 20 shows operation buttons (shooting mode button 2
5, playback mode button 26, information display mode button 2
7 is a detailed flowchart of a mode switching interrupt processing subroutine that is activated by the operation of 7). When activated in S50, it is checked whether the button operated in S501 is the photographing mode button 25. If it is the photographing mode button 25, The process proceeds to the shooting mode subroutine of S20.
If it is not the shooting mode button 25, it is checked whether the button operated in S501 is the reproduction mode button 26, and if it is the reproduction mode button 26, the process proceeds to the reproduction mode subroutine of S60. Play mode button 26
If not, the process proceeds to the information display mode subroutine of S80.

FIG. 21 is a detailed flow chart of the reproduction mode subroutine. When started in S60, S601
The process of is repeated. Direction buttons 23 and 24 in S601
The image data in the image file stored in the memory card 104 is selected and read according to the operation of, and is reproduced and displayed on the left screen 21 as shown in FIG.
The explanation of the operation method is displayed on 2.

FIG. 23 is a detailed flowchart of the transmission interrupt processing subroutine.
In 01, it is checked whether it is in the reproduction mode. If it is not in the reproduction mode, the process returns in S703. In the reproduction mode, the destination is displayed on the right screen 22 as shown in FIG. 24 in S702. The transmission destination also includes the transmission destination to the subject in the screen currently reproduced and displayed on the left screen 21. When the destination is designated by the user, the image file including the image data currently reproduced and displayed on the left screen 21 is read from the memory card 104, and the image file is transmitted to the destination designated by the user by the wireless telephone circuit 72. Send and S
It returns at 703.

FIG. 25 is a detailed flowchart of the information display mode subroutine. When started in S80, the home screen in the information display mode is first displayed in S801. On the home screen, image data is displayed on the left screen 21 as shown in FIG. When the reproduction mode is changed to the information display mode, the image data reproduced and displayed on the left screen 21 in the reproduction mode is displayed as it is, and when the photographing mode is changed to the information display mode, the last captured image is displayed. The image data of the file is displayed. Further, on the left screen 21, icons 82 and 83 indicating the subject information are displayed at a position corresponding to the in-screen position information data included in the additional information data by being superimposed (superimposed) on the image data, and the shooting position is also displayed. An icon 85 for displaying a map according to the information data, an icon 84 for displaying news on the shooting date and an icon 86 for displaying general information according to the shooting date / time information data are displayed. Right screen 22
Displays an explanation of the operation on the left screen 21.

When the user touches a desired icon on the left screen 21 in S802, the position on the screen touched by the user is detected by the touch tablet 66, and the process branches to the following steps according to the touched position. When the icon 85 is touched in FIG. 26, the process branches to S803, the map database on the Internet is accessed via the wireless telephone circuit 72, and the shooting position is included according to the shooting position information of the image data displayed on the home screen. The map data is downloaded from the map database and displayed on the left screen 21 as shown in FIG. On the left screen 21, a reduction icon 87 and an enlargement icon 88 are displayed so as to be superimposed on the map screen, and when the user touches them, the map screen is reduced or enlarged according to the touched icon. The image data displayed on the home screen is displayed on the right screen 22 as thumbnail images (reduced images). When the user touches this thumbnail image portion, the screen returns to the home screen of S801.

When the icon 84 is touched in FIG. 26, the process branches to S804 to access the news database on the Internet via the wireless telephone circuit 72,
According to the shooting date / time information of the image data displayed on the home screen, the news data generated at the shooting date / time is downloaded from the news database and displayed on the left screen 21 as shown in FIG. 28. A news list and a detail icon 89 are displayed on the left screen 21, and when the user touches the detail icon, the details of the touched news are further displayed on the left screen 21. The image data displayed on the home screen is displayed on the right screen 22 as thumbnail images (reduced images). When the user touches this thumbnail image portion, the screen returns to the home screen of S801.

In FIG. 26, when the icon 82 or the icon 83 is touched, the process branches to S805, and is related to the subject on the Internet via the wireless telephone circuit 72 according to the internet access information data included in the subject information indicated by the icon. Access the information source (home page or database) that stores detailed information and display the top screen of the home page. For example, icon 8
When 2 is touched, the top screen of the home page of the person who is the subject is the left screen 2 as shown in FIG.
No. 1 is displayed, and by operating the touch tablet 66, it is possible to display a lower screen or link to another home page. Further, when the icon 83 is touched, as shown in FIG. 30, the explanation screen of the historical building shown on the screen is displayed on the left screen 21, and the touch tablet 66 is operated to display a more detailed explanation and image. It can be displayed on the left screen 21. The image data displayed on the home screen is displayed on the right screen 22 as thumbnail images (reduced images). When the user touches this thumbnail image portion, the screen returns to the home screen of S801.

FIG. 31 shows a wireless communication circuit 71 in the electronic camera.
2 is an explanatory diagram showing the configuration of the wireless communication circuit 71, which is surrounded by an electromagnetic shield film 79 on the back surface of the camera (the direction opposite to the shooting optical axis direction = the direction of the photographer), the bottom surface, the top surface, and the left and right side surfaces. . Therefore, the wireless communication circuit 71 can easily communicate with the portable device 160 possessed by the subject located in the photographing direction of the camera, can reliably collect the subject information, and can carry the subject other than the subject not in the photographing optical axis direction. Since it is difficult to communicate with existing mobile devices, it is possible to avoid collecting unnecessary information other than the subject.
FIG. 32 is a diagram showing the directivity of communication of the wireless communication circuit 71, that is, the front direction of the electronic camera 100 (direction of the optical axis 40).
It has a strong directivity and a weak directivity in the back direction.

As described above, by providing the radio communication circuit 71 with a strong directivity in the shooting direction of the camera with the configuration shown in FIG. 31, it is possible to increase the probability of communicating with the electronic device carried by the subject. Note that the directivity can be adjusted by the configuration of the antenna instead of the electromagnetic shield film.

In the wireless communication process of FIG. 16, the electronic camera 100 communicates with surrounding electronic devices at the time of shooting to collect subject information. The subject information may be transmitted. For example, as shown in FIG. 33, in the mobile phone 160 carried by the subject, personal information of the user carrying the mobile phone 160 is stored and saved by mounting a UIM card or the like. The mobile phone 160 includes a display screen 161 and operation buttons 162. When the person who is the subject transmits the personal information of the person to the electronic camera side, first, when the operation button 162 of the mobile phone 160 is operated, the mobile phone 160 enters the personal information transmission mode and transmits the subject information to the electronic camera. When the transmission is completed, the electronic camera of the transmission destination and the fact that the transmission is completed are displayed on the display screen 161 in FIG. In this way, the subject side can determine whether or not the personal information can be transmitted, so that the personal information can be prevented from being accidentally leaked.

In detecting the position of the subject on the screen shown in FIG. 18, the position information of the electronic camera and the position information of the electronic device detected by GPS are used. May be detected. Fig. 35
Is a narrow directional wireless antenna 75 used as a communication antenna of the wireless communication circuit 71 (the directivity 43 thereof has an extremely strong directivity in one direction 42 as shown in FIG. 36).
This is an example of the case where the position of the subject in the photographing screen is detected using. The detailed structure of such a small directional antenna is disclosed in Japanese Patent Laid-Open No. 2000-278037.

The electronic camera 100 incorporates a narrow directional radio antenna 75 and a drive unit 76 for mechanically scanning and changing the direction of the narrow directional radio antenna 75. During wireless communication processing at the time of shooting, the CPU 50 drives the narrow directional wireless antenna 75 so that the narrow directional wireless antenna 75 scans the inside of the shooting screen by the driving unit 76, and communicates with the subject within the screen by the wireless communication circuit 71 to obtain subject information. Collect data. This makes it possible to associate the scanning position (= in-screen position information data) of the narrow directional wireless antenna 75 with the subject information data.

FIG. 37 is a detailed flowchart of the radio communication processing subroutine using the narrow directional radio antenna 75. When started in S40, it is checked in S411 whether the photographing mode is set. If it is not the photographing mode, the process returns in S419. . In the shooting mode, the scanning position of the narrow directional wireless antenna 75 is initialized in S412. The screen size is determined by the focal length information of the taking lens and the effective screen size of the CCD. In step S413, the wireless communication unit 71 sets the electronic device around the electronic camera 100 (a mobile phone owned by a person as a subject or a historic site is fixedly set, and tourist information of the historic site can be transmitted by wireless communication. Attempts wireless communication with the electronic tourist guide device). If communication is not established in S414, S41
Proceed to 7. When the communication is established, the subject information data is acquired by wireless communication from the electronic device of the communication partner for which the communication is established in S415. In S416, the in-screen position information of the subject information data is used as the scanning position information of the narrow directional wireless antenna 75. In S417, the scanning position of the narrow directional wireless antenna 75 is updated. In S418, it is checked whether the scanning position of the narrow directional wireless antenna 75 is the end position. If it is not the end position, the process returns to S413 to repeat the above operation, and if it is the end position, the process returns in S419.

FIG. 38 shows a display example of the home screen in the information display mode. Unlike the screen shown in FIG. 26, no icon is displayed on the left screen 21. When the user touches a person or a building displayed on the left screen, the touch position is detected by the touch tablet 66, and the subject information having in-screen position information data corresponding to the touch position is displayed on the right screen 22 as shown in FIG. Is displayed in. Further, an arrow mark 44 is displayed at the position of the subject on the left screen 21 corresponding to the subject information. In this way, the image data reproduced and displayed on the left screen 21 can be viewed without disturbing icons, and by touching the subject of interest on the left screen 21, the image data can be displayed on the left screen 21, It is possible to browse the subject information on the right screen 22 and check the relationship between the subject information and the subject on the image. Further, in this way, it is possible to integrate the information display mode and the reproduction mode and display the subject information directly from the reproduction mode.

When the contour of the subject image reproduced and displayed by image analysis is extracted as shown in FIG. 40 and the user touches the area near the contour (area 46 near the person 45 in FIG. 40). The subject information corresponding to the in-screen position information data included in the area 46 may be displayed on the left screen 21. By doing so, the subject information of the person can be displayed even when a face portion other than the position where the electronic device that has transmitted the subject information to the electronic camera was touched.

FIG. 41 is a detailed flow chart when a new process is added between S801 and S802 of the information display mode subroutine shown in FIG. This new process is a process of transferring the subject information of a similar image file having the subject information to the image file having no subject information.

After the home screen is displayed in S801, S8 is displayed.
In step 11, image analysis of the image data reproduced and displayed on the left screen 21 is executed to identify a main subject (a subject occupying a relatively large area such as a person or a building on the screen), and S
At 812, it is checked whether or not subject information having in-screen position information data exists in the area of the main subject, and if it exists, the process proceeds to S802. If it does not exist, an image file having the same shooting date / time data as the shooting date / time data of the image data reproduced and displayed in S813 is stored in the memory card 104.
Search in and extract. Next, the image data of the image file is subjected to image analysis to further extract image data having a subject similar to the main subject in the image data currently reproduced and displayed. Next, it is checked whether the similar subject in the extracted image data has in-screen position information, and if there is, the subject information is used as subject information of the main subject of the image data currently reproduced and displayed, The image file of the image data currently reproduced and displayed is updated by adding the in-screen position information according to the position in the screen of the main subject specified by the image analysis.

In step S814, the shooting position information data, the shooting posture information data, and the focal length information data are read from the image file containing the image data that is currently being reproduced and displayed, and the map database on the Internet and the image in step S813 are read according to the information data. The main subject is specified based on the analysis result. For example, if a triangular mountain-like object is captured on the screen taken from the vicinity of Lake Yamanaka toward the south, it is specified as Mt. Fuji. When the main subject is specified, the name of the main subject is used as a keyword to search on the Internet, access information of the home page that describes the main subject is acquired, and the main subject screen determined by image analysis is displayed. The image file of the image data currently reproduced and displayed is updated with the position information on the screen according to the position.

After the subject information is transferred from another image file or the Internet to the image file having no subject information as described above, the process proceeds to S802. In this way, even if the subject information could not be obtained during shooting (such as when there is no tourist guide device that wirelessly supplies the subject information to the vicinity of the electronic camera such as a landscape image), the image data is reproduced in the information display mode. In this case, information about the subject can be displayed. The range of image files searched in S813 is not limited to the same shooting date and time. For example, a predetermined number of image files captured before and after an image file having no subject information may be searched for. Further, in S814, the camera automatically specifies the subject from the shooting position information data, the shooting posture information data, and the focal length information data, and downloads the information of the specified subject from the Internet, but the user browses the image data. The image file may be updated by specifying the object, inputting or downloading the information of the specified object from the Internet, and pasting the information at the object position on the screen.

FIG. 42 is another conceptual diagram of an electronic camera to which the present invention is applied and an electronic image communication system using the electronic camera. In the electronic image communication system of FIG. 2, the electronic camera 100 and the mobile phone 160 owned by the user perform short-distance wireless communication so that the personal information data stored in the UIM card 170 attached to the mobile phone 160 is electronically stored. Although it is designed to be read by the camera 100, in the electronic image communication system of FIG. 42, when a wireless tag (contactless IC card) storing personal information data approaches the electronic camera 100 having a contactless wireless reader,
The personal information data is automatically read by the electronic camera 100 from the wireless tag.

As described above, in the electronic image communication system shown in FIG. 42, the object can communicate with the electronic camera 100 simply by holding a small wireless tag (contactless IC card) which does not require a power source. . In the above-described embodiment (FIGS. 1 and 11), wireless communication is performed between the electronic camera and the portable device that the subject has when the image data is captured, and the electronic camera receives subject information (including position information). Since it is automatically transferred, no special operation for acquiring the subject information is required, and the position information of the subject at the time of shooting the image data can be acquired. When obtaining information data, it is possible to obtain a position that exactly corresponds to the actual position on the screen. As for the acquisition timing of the position information of the subject, if it is a timing in the vicinity of the subject photographing timing (preferably within about 1 second), a position accurately corresponding to the actual position on the screen can be obtained.

In the above-described embodiment (FIGS. 1 and 11), the information relating to the subject appearing in the screen of interest when the image data is reproduced and displayed and browsed is displayed in the screen position information. According to the above, it is possible to browse easily and quickly simply by touching the icon or the subject displayed on the screen.

In the above embodiment (FIGS. 1 and 15), since short-distance wireless communication is used when the subject information is acquired from the subject by wireless communication, the probability of communicating with the subject existing near the electronic camera is increased. In addition to increasing the number, it is possible to eliminate electronic devices that are distant from the electronic camera and are unrelated to the subject. Also, since the signal transmission output level during wireless communication is adjusted according to the focal length of the shooting lens, it is possible to establish wireless communication with the subject reliably, and to establish wireless communication with other subjects. Can be reduced.

In the above-described embodiment (FIG. 23), the image data reproduced and displayed in the reproduction mode can be transmitted to the transfer destination included in the subject information data acquired at the time of photographing the image data. It is possible to easily send the image data to the person who is the subject without having to ask for the address or e-mail address of the other person when taking a picture of the person who happens to meet. This is convenient because it saves the trouble of sending image data, especially when taking a group photo of a large number of people.

In the above embodiment (FIG. 27, etc.),
When the subject information specified by the user in the information display mode is displayed on the screen, the image data of the original subject is simultaneously displayed (thumbnail image), so the relationship between the image data and the subject can be intuitively understood. Since it is possible to return to the home screen immediately by specifying the image data with the touch tablet 66,
It is possible to easily browse subject information centered on image data.

In the above-described embodiment (FIGS. 31 and 32), the directivity of the wireless communication of the wireless communication circuit 71 is limited to the direction in which there is a high probability of existence of the subject with respect to the electronic device body by an electromagnetic shield sheet or the like. Therefore, when the subject information is acquired by wireless communication, it is possible to surely establish wireless communication with the subject and reduce the possibility of establishing wireless communication with other than the subject.

In the above-described embodiment (FIGS. 33 and 34), the subject information is transmitted to the electronic camera when the subject side is activated, so that personal information and the like may be unnecessarily leaked to the outside when necessary. Can be prevented. In the above embodiment (FIG. 37), the narrow directional wireless antenna is used to scan the inside of the screen to collect the in-screen position information of the subject. Therefore, special positioning such as electronic equipment on the subject side or GPS is performed. It is not necessary to provide any means, and the system can be constructed at low cost.

In the above-described embodiment (FIG. 41), the in-screen position information of the subject is detected by image analysis, and the subject information is copied from the similar image file. It becomes possible to refer to the subject information when browsing. In addition to detecting the in-screen position information of the subject by image analysis, the subject is specified by image analysis and position information, and the subject information regarding the identified subject is collected from an information source such as the Internet. It is possible to refer to the subject information at the time of browsing, even for subjects that could not be captured.

In the above-described embodiment (FIG. 42), the electronic camera is provided with a non-contact IC card (radio tag) reading circuit, and the subject information is non-contacted from the non-contact IC card (radio tag) carried by the subject. Since the object is read, the subject only holds a non-contact IC card that is lightweight, small, and does not require a power source, and does not require any operation. (Explanation of Modifications) The present invention is not limited to the embodiments described above, and various modifications and changes are possible.

In the above-described embodiment (FIG. 1), the subject information is acquired by wirelessly (radio frequency) communicating between the electronic camera and the electronic device held by the subject, but it is possessed by a person other than the true subject. In order to prevent unreasonable communication with existing electronic equipment, assuming that the electronic equipment has average reception performance, the output range of the wireless transmission signal is limited to within the specified value, and the range of communication is possible. It is desirable to limit The distance range is determined in consideration of how the electronic camera is used, the presence or absence of a radio wave shield between the electronic camera and the electronic device, the performance of the receiver of the electronic device, etc. In, it is better to be within 10 m.

In the above-described embodiment (FIG. 1), the wireless communication circuit communicates by short-distance wireless communication such as Bluetooth.
AN (IEEE 802.11) and infrared communication (IrD
Short-range wireless communication may be performed according to A),
Communication may be performed by simultaneously using a plurality of short-range wireless systems. By doing so, no matter what short-range wireless function the electronic device held by the subject has, it is possible to perform wireless communication with the electronic camera side.

In the above-described embodiment (FIG. 1), the object information is transferred by wirelessly (radio frequency) communicating between the electronic camera and the electronic device possessed by the object. Alternatively, the subject information may be transferred by a contact method. In the above embodiment (FIG. 5), the sound can be recorded by the recording circuit 80 at the time of shooting, but at the time of shooting, the sound of the subject existing in a part of the screen is recorded by using the narrow directional microphone. The recorded data is stored in an image file in association with the in-screen position information of the subject, and the recorded voice is played when the subject is specified by a touch tablet or the like on the screen displayed in the information display mode. You may do it. In addition, it has multiple narrow directional microphones, and simultaneously records on multiple subjects in the screen, and responds to each subject when it is specified by a touch tablet etc. on the screen that is played back and displayed in the information display mode. The sound may be reproduced.

Further, regardless of the shooting time or the shooting timing, the sound emitted from the subject or the subject is recorded by wireless communication from an electronic device with a microphone carried by the subject or an electronic device that stores information about the subject in advance as voice data. Even if it is sent to the electronic camera as subject audio information as subject audio information, the subject audio information is associated with the position of the subject in the shooting screen by the in-screen position information, added to the image data of the captured object, and saved. Good. When reproducing and browsing the image data in the information display mode, if each subject is designated by a pointing device such as a touch tablet on the display screen, the subject stored in association with the position of each subject Play audio information. In this way, the information of the subject can be provided to the viewer in various directions by utilizing not only the visual information but also the audio information.

In the above embodiment (FIG. 5), the touch tablet 66 is used to specify the position on the left screen 21 and the right screen 22, but a pointing device other than this may be used. For example, a trackball or a mouse can be used as the screen position designation means. Further, when an electronic finder (a finder displayed by a small screen display means for enlarging the screen by an optical system to allow the user to observe) is used, by detecting the user's gaze direction (gaze position, gaze position), You can specify the screen position. When using the touch tablet 66, a member (pen) dedicated to position specification other than the user's finger is used to specify a more accurate position, or the subject information is unnecessarily touched by just touching the screen with a finger. May not be displayed.

In the above-described embodiment (FIG. 9), the subject information is transferred by wirelessly (radio frequency) communicating between the electronic camera and the electronic device possessed by the subject, but the subject information is transmitted to the electronic camera. It is also possible to notify the electronic device of reception of subject information from the electronic camera and display that subject information has been transferred in the electronic device on the subject side. Further, the electronic device may notify the person who is the subject that the subject information has been transferred, using the sounding means.

In this way, the subject side can recognize that the subject information has been transferred. In addition, even if the electronic device does not have a display means by notifying by sound, it can be recognized that the subject information has been transferred,
Even if the electronic device is kept in the pocket of the subject's clothes, the person who is the subject can recognize that the subject information has been transferred.

In the above-described embodiment (FIG. 11), the electronic camera performs the shooting mode operation, the playback mode operation, and the information display mode operation. However, the electronic camera performs shooting to generate image data and wireless communication is performed. Image information is created by collecting subject information and in-screen position information, this image file is transferred online or offline to an image display device other than an electronic camera, and the operation of the reproduction mode and information display mode is performed in the image display device. It may be executed.

In the above-described embodiment (FIG. 11), the reproduction mode and the information display mode are switched by a manual operation. However, the user uses the touch tablet to touch the object at a predetermined position on the display screen reproduced in the reproduction mode. When specified, subject information related to the subject may be displayed. In this way, it is possible to immediately see the information about the subject at the point of interest while browsing the image data without switching the reproduction mode and the information display mode.

In the reproduction mode and the information display mode of the above embodiment (FIG. 11), the audio data recorded by the recording circuit 80 at the time of shooting may be reproduced by the audio reproduction circuit 81 at the time of image data reproduction. Alternatively, music that was in fashion at that time may be downloaded from the music database on the Internet based on the shooting date data, and the music may be automatically reproduced as background music when the image data is reproduced. In this way, it becomes easier to remember what was happening at the time of shooting, both visually and audibly, and you can enjoy viewing the image.

In the above-described embodiment (FIG. 14), the electronic camera does not notify the photographer of the subject information collected by communicating with the subject at the time of shooting, but a list of the subject information collected together with the shot image data is displayed. You may do it. In this way, the photographer can recognize what kind of subject information was collected at the time of shooting, and can take further measures to collect information if necessary, if there is insufficient information.

In the above-described embodiment (FIG. 15), the electronic camera attempts wireless communication with electronic devices in the vicinity of the electronic camera to collect subject information at the time of shooting. The device may be set in advance so that wireless communication is not performed. Further, when wireless communication is performed with the electronic device possessed by the photographer at the time of photographing, it may be recorded as photographer information as one item of photographing information data.

In the above-described embodiment (FIG. 15), the electronic camera attempts wireless communication with electronic devices in the vicinity of the electronic camera in order to collect subject information at the time of shooting. At this time, wireless communication (radio waves, infrared rays) is transmitted. The transmission signal output level may be changed according to the subject distance (the output level increases as the subject distance increases). As the subject distance, a distance detected by a known distance detecting device or a manually set shooting distance of a shooting lens can be used. By doing so, it is possible to communicate with the electronic device held by the subject with a high probability, and it is possible to reduce the probability of establishing communication with the electronic device held by the subject other than the subject.

In the above embodiment (FIG. 16), wireless communication is performed between the electronic camera and the electronic device held by the subject at the time of shooting, and subject information is automatically transferred to the electronic camera. However, when the electronic device receives a communication request or information request from the electronic camera, the electronic device notifies the subject and switches whether to continue subsequent communication according to the instruction of the subject. May be. In this way, the subject can refuse communication if necessary, and it is possible to prevent personal information from leaking to the outside more than necessary.

When the electronic device receives a communication request or information request from the electronic camera, the electronic device uses the identification number of the electronic camera that has transmitted the communication request as the identification number of the electronic camera registered in advance in the electronic device. By comparison, if the electronic camera is not registered, the subsequent communication may not be performed. In this way, the range of leakage of personal information can be automatically controlled.

In the above-described embodiment (FIG. 16), wireless communication is performed between the electronic camera and the electronic device held by the subject at the time of shooting, and subject information is automatically transferred to the electronic camera. However, wireless communication may be performed between the electronic camera and the electronic device held by the subject at a time other than the time of shooting, and the subject information may be automatically transferred to the electronic camera. By doing this, if you want to take several shots with the same composition (exposure bracket shooting, etc.), you do not need to make wireless communication each time you shoot, and you can quickly end a series of shooting and Moreover, subject information for a plurality of image data can be collected by one wireless communication automatically or manually.

In the above embodiment (FIG. 16), wireless communication is always performed between the electronic camera and the electronic device held by the subject at the time of photographing so that the subject information is automatically transferred to the electronic camera. However, if a delay occurs in the shooting operation due to wireless communication, the wireless communication operation for obtaining subject information may be prohibited. For example, in the case of performing continuous shooting (continuous shooting), if wireless communication is automatically prohibited, it is possible to prevent the frames of continuous shooting from becoming long due to the wireless communication operation.

In the above embodiment (FIG. 18), the in-screen position information of the subject is calculated from the attitude information of the electronic camera and the positioning information of the electronic camera and the electronic device by GPS. The in-screen position information of may be detected. For example, when an electronic device and an electronic device held by a subject communicate by using infrared rays, the light receiving position on the image pickup device is detected from the image data picked up by the two-dimensional infrared image pickup device provided on the electronic camera side, and the electronic device is detected. You may make it specify the position on the screen of a device. Alternatively, the position of the infrared point light source emitted from the electronic device may be detected by the two-dimensional infrared imaging device, and only the in-screen position information may be detected, and wireless communication (radio waves) may be used to communicate the subject information. In that case, the infrared point light source is turned on at the timing when the electronic device performs wireless communication.

In the above embodiment (FIG. 25), the subject information corresponding to the user's touch position on the screen is displayed by accessing the Internet in the information display mode, but it is not always necessary to access the Internet. If the subject information collected at the time of shooting is sufficient, only the subject information may be displayed on the screen. In this way, since it is not necessary to access the Internet when displaying the subject information, it is possible to display the subject information quickly and reduce the stress on the user waiting for browsing.

In the above-described embodiment (FIG. 26), the image data photographed in the information display mode with a predetermined photographing screen size is reproduced and displayed in conformity with the display screen size and designated by the user. The subject information corresponding to the position on the display screen is displayed on the display screen, but it is not necessary to match the size of the shooting screen with the size of the display screen, and the shooting screen is enlarged or reduced on the display screen. You may do it. Alternatively, the image data may be transformed, rotated, or the like and displayed on the display screen. If the shooting screen and display screen do not match in this way, coordinate conversion (enlargement, reduction, shift, rotation, etc.) of the specified position on the display screen to the position on the shooting screen is performed, and the converted position coordinates are obtained. The subject information is displayed based on this. By doing so, it is not necessary to make the shapes of the shooting screen and the display screen congruent, it becomes possible to use the information display mode in various image display devices, and in the case where the subjects are mixed in close proximity. A desired subject can be designated after enlarging the display screen.

In the above-described embodiment (FIG. 27), the electronic camera has two display screens, displays the subject information of one screen in the information display mode, and displays the image data including the subject on the other screen. Although a (thumbnail image) is provided, when the electronic camera has only one screen, the subject information may be displayed on the entire screen and the image data including the subject may be superposed on a part of the screen. With this configuration, even when there is only one display screen, the subject information and the image data that is the source of the subject information can be viewed at the same time, so that the relationship between the subject information and the image data can be intuitively grasped.

[0095]

As described above, in the electronic camera, the image display device and the image display method according to the present invention, the relevant information of the subject associated with the position of the subject in the screen is added to the electronic image data. In addition to storing the information, when the electronic image data is reproduced and displayed, the related information of the subject is displayed according to the position on the screen, so that the electronic image data is reproduced and displayed. At this time, information related to the subject appearing on the screen of interest can be easily and quickly viewed in cooperation with the reproduction display of the electronic image data.

[Brief description of drawings]

FIG. 1 is an explanatory diagram showing a concept of an embodiment of the present invention.

FIG. 2 is an explanatory diagram showing a system configuration of an embodiment of the present invention.

FIG. 3 is an external view (front view) of the electronic camera according to the present invention.

FIG. 4 is an external view (back view) of the electronic camera according to the present invention.

FIG. 5 is a block diagram showing an electrical configuration of an electronic camera according to the present invention.

FIG. 6 is a configuration diagram of data in a memory.

FIG. 7 is a configuration diagram of shooting information data.

FIG. 8 is a configuration diagram of general information data.

FIG. 9 is a configuration diagram of personal information data.

FIG. 10 is a state transition diagram of the electronic camera according to the present invention.

FIG. 11 is a flowchart of a main program.

FIG. 12 is a flowchart of a subroutine.

FIG. 13 is a display example of a screen.

FIG. 14 is a flowchart of a subroutine.

FIG. 15 is a flowchart of a subroutine.

FIG. 16 is an explanatory diagram of a communication sequence.

FIG. 17 is an explanatory diagram of position information detection.

FIG. 18 is an explanatory diagram of position information detection.

FIG. 19 is an explanatory diagram of position information detection.

FIG. 20 is a flowchart of a subroutine.

FIG. 21 is a flowchart of a subroutine.

FIG. 22 is a display example of a screen.

FIG. 23 is a flowchart of a subroutine.

FIG. 24 is a display example of a screen.

FIG. 25 is a flowchart of a subroutine.

FIG. 26 is a display example of a screen.

FIG. 27 is a display example of a screen.

FIG. 28 is a display example of a screen.

FIG. 29 is a display example of a screen.

FIG. 30 is a display example of a screen.

FIG. 31 is an explanatory diagram of a configuration of a wireless circuit.

FIG. 32 is an explanatory diagram of communication directivity.

FIG. 33 is an external view of a mobile phone.

FIG. 34 is a display example of a screen.

FIG. 35 is an explanatory diagram of in-screen position information detection.

FIG. 36 is an explanatory diagram of communication directivity.

FIG. 37 is a flowchart of a subroutine.

FIG. 38 is a display example of a screen.

FIG. 39 is a display example of a screen.

FIG. 40 is an explanatory diagram of subject specification.

FIG. 41 is a flowchart of a subroutine.

FIG. 42 is an explanatory diagram showing a system configuration of another embodiment of the present invention.

[Explanation of symbols]

10 Shooting lens 16 Release button 17 Power switch 19 Mode dial 21 Left LCD (left screen) 22 Right LCD (right screen) 23 Up button 24 Down button 25 Shooting mode button 26 Play Mode Button 27 Information display mode button 28 Send button 29 decision button 50 CPU 51 data / control bus 55 CCD 60 Shooting control circuit 63 power supply 66 touch tablet 71 wireless communication circuit 72 wireless telephone circuit 100 electronic camera 104 memory card 130 Internet 160 mobile phone 170 UIM card 180 wireless tag

─────────────────────────────────────────────────── ─── Continued Front Page (51) Int.Cl. ⁷ Identification Code FI Theme Coat (Reference) G09G 5/14 H04N 5/76 Z 5/377 5/907 B H04B 7/26 101: 00 H04N 5/76 G09G 5/00 555D 5/765 5/36 520M 5/907 H04N 5/91 L 5/91 Z H04Q 7/20 H04B 7/26 M 7/34 K // H04N 101: 00 106A H04Q 7/04 Z F Term (reference) 5C022 AA13 AC42 AC69 5C052 AA17 AC02 DD02 EE03 EE08 GA02 GA07 GB01 GB09 GE08 5C053 FA08 FA14 FA27 GB06 HA22 HA30 JA01 KA04 KA24 KA25 LA02 LA14 5C082 AA00 BA02 BA12 BA27 BB01 CA55 CA06 DA21 CB05 CA06 CA05 CA06 CA05 CA06 CA05 CA76 DD52 EE02 EE10 EE16 FF02 FF03 FF23 FF31 HH22 JJ52 KK15 KK17

Claims (79)

[Claims] 1. An electronic camera for photographing a subject, wherein the photographing optical system photographs a subject in a photographing screen,
Information collecting means for collecting subject information related to the subject from the electronic device by communicating between the image capturing means for generating image data and the electronic device held by the subject, and the subject information for the photographing screen. And an associating means for associating with a position in the electronic camera. 2. The electronic camera according to claim 1, wherein
The electronic camera, wherein the information collecting unit performs wireless communication with an electronic device held by the subject. 3. The electronic camera according to claim 2,
The information collecting means communicates with a counterpart electronic device using a radio signal and limits a wireless communication range to a predetermined distance range from the electronic camera by limiting a transmission output level of the radio signal. And electronic camera. 4. The electronic camera according to claim 2, wherein:
The electronic camera, wherein the information collecting means communicates with a counterpart electronic device using a radio signal and changes a transmission output level of the radio signal according to a distance to the subject. 5. The electronic camera according to claim 4, wherein:
The electronic camera, wherein the information collecting means increases the transmission output level of the radio signal as the distance to the subject increases. 6. The electronic camera according to claim 2, wherein:
The electronic camera, wherein the information collecting means communicates with a counterpart electronic device using a radio wave signal and changes a transmission output level of the radio wave signal according to a focal length of the photographing optical system. 7. The electronic camera according to claim 6,
The electronic camera, wherein the information collecting unit increases the transmission output level of the radio signal as the focal length of the photographing optical system increases. 8. The electronic camera according to claim 2, wherein:
The electronic camera, wherein the information collecting means has a strong directivity of wireless communication in a direction in which a subject is likely to exist. 9. The electronic camera according to claim 8, wherein:
The electronic camera, wherein the information collecting unit has a strong directivity of wireless communication in a shooting direction along an optical axis of the shooting optical system. 10. The electronic camera according to claim 1, wherein the information collecting unit is activated by operating an electronic device held by the subject and collects subject information related to the subject from the electronic device. And electronic camera. 11. The electronic camera according to claim 1, wherein the information collecting unit does not collect subject information from a predetermined electronic device. 12. The electronic camera according to claim 11, wherein the predetermined electronic device is an electronic device owned by a photographer who operates the electronic camera. 13. The electronic camera according to claim 1, wherein the information collecting unit communicates with an electronic device held by the subject at a timing near a timing at which the imaging unit photographs the subject. An electronic camera that collects subject information related to a subject from the electronic device according to the above. 14. The electronic camera according to claim 1, wherein the information collecting unit is manually activated at a timing irrelevant to a timing at which the image capturing unit photographs a subject, and an electronic device held by the subject. An electronic camera, which collects subject information related to a subject from the electronic device by communicating between the electronic devices. 15. The electronic camera according to claim 1, wherein the information collecting unit is activated once for a plurality of photographing operations by the image pickup unit and communicates with an electronic device held by the subject. An electronic camera, which collects subject information related to a subject from the electronic device by performing the operation. 16. The electronic camera according to claim 1, wherein the electronic camera has a continuous shooting mode for continuously shooting a subject by the image pickup means, and prohibits the operation of the information collecting means in the continuous shooting mode. An electronic camera comprising a prohibition unit. 17. The electronic camera according to claim 2, wherein the information collecting unit performs wireless communication with an electronic device held by the subject by a plurality of types of wireless systems. 18. An electronic camera for photographing a subject, wherein the photographing optical system photographs a subject within a photographing screen to generate image data, and information for collecting subject information related to the subject. An electronic camera comprising: collecting means and associating means for associating the subject information with a position in the photographing screen. 19. The electronic camera according to claim 1, wherein the associating unit detects in-screen position information indicating a position of the subject in the shooting screen and uses the in-screen position information. An electronic camera, characterized in that the subject information is associated with a position in the photographing screen. 20. The electronic camera according to claim 19, wherein a positioning unit that detects a position of the electronic camera and generates camera position information, and a posture that detects a posture of the electronic camera and generates camera posture information. Further comprising detection means,
The associating unit collects subject position information indicating the position of the subject from the electronic device by communicating with the electronic device held by the subject, and the focal length of the photographing optical system and the image capturing unit. It is characterized in that in-screen position information indicating a position of the object in the shooting screen is detected based on the shooting angle-of-view information obtained from the shooting size, the subject position information, the camera position information, and the camera posture information. Electronic camera. 21. The electronic camera according to claim 19, wherein the associating unit performs wireless communication with an electronic device held by the subject while scanning the photographing screen with a narrow directivity wireless communication antenna. The electronic camera is characterized in that it performs on-screen position information indicating the position of the subject on the shooting screen based on the scanning position when wireless communication is established with the electronic device on the shooting screen. 22. The electronic camera according to claim 19, wherein the associating unit receives infrared rays emitted by an infrared point light source included in an electronic device held by the subject by a two-dimensional infrared sensor and detects the light receiving position. The electronic camera is characterized by detecting in-screen position information indicating the position of the subject in the shooting screen. 23. The electronic camera according to claim 19, wherein the associating unit detects the in-screen position information at a timing near a timing at which the image capturing unit captures a subject. 24. The electronic camera according to claim 19, wherein the associating means manually activates at a timing irrelevant to a timing at which the image capturing means photographs a subject, and detects the in-screen position information. An electronic camera characterized by. 25. The electronic camera according to claim 19, wherein the associating unit analyzes a subject position in a shooting screen by performing image analysis on the image data to determine a position of the subject in the shooting screen. An electronic camera characterized by detecting position information on the screen shown. 26. The electronic camera according to claim 25, wherein the information collecting unit retrieves similar image data similar to the image data of the subject and retrieves subject information added to the retrieved similar image data. At the same time as extracting, the associating unit associates the subject information with the position in the photographing screen based on the in-screen position information obtained by the image analysis. 27. The electronic camera according to claim 25, wherein the information collecting unit identifies a subject by analyzing the image data, and obtains subject information regarding the identified subject from an information source on the network. While acquiring by communication, the associating means,
An electronic camera, wherein the subject information is associated with a position in the photographing screen based on the position information in the screen obtained by the image analysis. 28. The electronic camera according to claim 1, further comprising a storage unit that adds the subject information associated with a position in the photographing screen to the image data to generate and store an image file. An electronic camera characterized by being provided. 29. The electronic camera according to claim 1, wherein an image display unit for displaying the image data on a display screen and a position on the display screen where the image data is displayed are designated. An electronic camera comprising: a position designating unit; and an information display unit for displaying subject information associated with a position in the photographing screen corresponding to the position designated by the position designating unit. 30. The electronic camera according to claim 29, wherein the position designating means has a light-transmissive position designing touch tablet installed on the display screen, and is displayed on the display screen. An electronic camera characterized in that, when a user designates a subject with a finger or another member, the designated position is detected by the touch tablet, and the position on the display screen is designated according to the detected position. 31. The electronic camera according to claim 29, wherein the subject information includes access information of an information source on a network that stores detailed information about the subject, and the information display unit displays the subject information. An electronic camera, which acquires detailed information about the subject by network communication from an information source on the network indicated by the included access information and displays the acquired information. 32. The electronic camera according to claim 29, wherein the image display means and the information display means use a common display screen, and the information display means displays the subject information on the display screen. An electronic camera which displays reduced image data in a partial area of the display screen. 33. The electronic camera according to claim 1, wherein the subject information includes audio information. 34. The electronic camera according to claim 33, wherein the information collecting unit acquires voice information emitted from the subject using a narrow directional microphone from the subject in the photographing screen at the time of photographing, and the associating unit. The electronic camera is characterized in that the audio information is associated with a position in the photographing screen based on in-screen position information obtained according to a direction in which the narrow directional microphone has high directivity. 35. An electronic camera for photographing a subject, comprising: an image pickup means for photographing a subject in a photographing screen by a photographing optical system to generate image data; and an electronic device held by the subject at the time of photographing. Information collecting means for collecting transmission destination information of the image data from the electronic device to the subject by communicating between the electronic device, and transmission means for transmitting the image data to the subject based on the transmission destination information after photographing. An electronic camera comprising: 36. An image storing image data of a subject in a shooting screen and subject information which is information associated with the position of the subject in the shooting screen and which is information relating to the subject. Reading means for reading out a file, image display means for displaying image data included in the image file on a display screen, position specifying means for specifying a position on the display screen where the image data is displayed,
An image display device, comprising: an information display unit that displays subject information associated with a position in the photographing screen corresponding to the position designated by the position designation unit. 37. The image display device according to claim 36, wherein the position designation means is a pointing device operated by a user. 38. The image display device according to claim 37, wherein the pointing device is a light-transmissive position-specifying touch tablet installed on the display screen, the pointing device being displayed on the display screen. An image display device, characterized in that, when a user designates a subject with a finger or another member, the designated position is detected, and the position on the display screen is designated according to the detected position. 39. The image display device according to claim 36, wherein the position designating unit is a line-of-sight detecting unit that detects a line-of-sight position of the user with respect to the display screen. 40. The image display device according to claim 36, wherein the subject information includes access information of an information source on a network in which detailed information regarding the subject is accumulated, and the information display means includes the subject information. An image display device, which acquires detailed information about the subject by network communication from an information source on the network indicated by the access information included in, and displays the acquired information. 41. The image display device according to claim 36, wherein the image display means and the information display means use a common display screen, and the information display means displays the subject information on the display screen. An image display device, wherein reduced image data is displayed in a partial area of the display screen. 42. The image display device according to claim 36, wherein the subject information includes audio information. 43. Read-out means for reading out image data in which image data of a subject is photographed and image-taking date and time information in which the subject is photographed, and image display means for displaying image data contained in the image file on a display screen. An image display device, comprising: information display means for acquiring related information regarding the shooting date and time from an information source on a network based on the shooting date and time information and displaying the acquired related information. 44. The image display device according to claim 43, wherein the related information is music information popular at the time of shooting, and the information display means reproduces the music information while the image data is being displayed. An image display device characterized by: 45. The image display device according to claim 43, wherein the related information is news information generated at the time of shooting. 46. An image display method for displaying image data photographed by an image pickup device having an image pickup optical system, comprising: an image pickup step of photographing an object in a photographing screen by the image pickup device to generate image data. An information collecting step of collecting subject information related to the subject from the electronic device by communicating with an electronic device held by the subject; an associating step of associating the subject information with a position in the photographing screen; An image display step of displaying the image data on a display screen, a position specifying step of specifying a position on the display screen where the image data is displayed, and a photographing screen corresponding to the position specified by the position specifying step. An image display step of displaying subject information associated with the position of the image display method. 47. The image display method according to claim 46, wherein in the information collecting step, wireless communication is performed with an electronic device held by the subject. 48. The image display method according to claim 47, wherein in the information collecting step, a radio signal is used to communicate with an electronic device of the other party, and a transmission output level of the radio signal is limited to thereby establish a wireless communication. An image display method, characterized in that a communication range is limited to a predetermined distance range. 49. The image display method according to claim 47, wherein in the information collecting step, a radio signal is used to communicate with a partner electronic device, and a transmission output level of the radio signal is set to a distance to the subject. An image display method characterized by being changed according to. 50. The image display method according to claim 49, wherein in the information collecting step, the transmission output level of the radio wave signal is increased as the distance to the subject increases. . 51. The image display method according to claim 47, wherein in the information collecting step, a radio signal is used to communicate with a counterpart electronic device, and a transmission output level of the radio signal is set by the photographing optical system. An image display method characterized by changing according to a focal length. 52. The image display method according to claim 51, wherein in the information collecting step, the transmission output level of the radio wave signal is increased as the focal length of the photographing optical system increases. Display method. 53. The image display method according to claim 47, wherein in the information collecting step, wireless communication with strong directivity is performed in a direction in which a probability that a subject is present is high. . 54. The image display method according to claim 53, wherein in the information collecting step, wireless communication having strong directivity of wireless communication in a shooting direction along an optical axis of the shooting optical system is performed. Image display method characterized by. 55. The image display method according to claim 46, wherein the information collecting step includes a request step of issuing a communication request to an electronic device held by the subject, and the communication in the electronic device held by the subject. A determination step of determining whether or not to respond to the request, and an information transmission step of transmitting subject information related to the subject from the electronic device when it is determined in the determination step to respond to the communication request Image display method characterized by. 56. The image display method according to claim 46, wherein the information collecting step includes a request step of issuing a communication request to an electronic device held by the subject, and subject information related to the subject from the electronic device. And a notification step of notifying the subject that the electronic device has transmitted the subject information. 57. The image display method according to claim 46, wherein in the information collecting step, wireless communication is performed with an electronic device held by the subject by a plurality of wireless systems. . 58. An image display method for displaying image data photographed by an image pickup device having an image pickup optical system, comprising: an image pickup step of photographing an object in a photographing screen by the image pickup device to generate image data. An information collecting step of collecting subject information related to the subject, an associating step of associating the subject information with a position in the photographing screen, an image displaying step of displaying the image data on a display screen, and displaying the image data. A position specifying step for specifying a position on the display screen, and an information displaying step for displaying subject information associated with a position on the photographing screen corresponding to the position specified by the position specifying step. Characteristic image display method. 59. The image display method according to any one of claims 46 to 58, wherein the information collecting means step is activated by an operation of an electronic device held by the subject, and the subject information related to the subject from the electronic device. An image display method characterized by collecting the image. 60. The image display method according to claim 46, wherein the information collecting step relates to the subject from the electronic device by communicating with the electronic device held by the subject. An image display method comprising: a collection step of collecting subject information, and a display step of displaying the collected subject information. 61. The image display method according to claim 46, wherein the information collecting step communicates with an electronic device held by the subject at a timing near the operation timing of the imaging step. An image display method comprising collecting subject information related to a subject from the electronic device by performing the operation. 62. The image display method according to claim 46, wherein the information collecting step is manually activated at a timing unrelated to the operation timing of the imaging step, and the electronic device held by the subject. An image display method comprising collecting subject information related to a subject from the electronic device by communicating with the subject. 63. The image display method according to claim 46, wherein in the associating step, in-screen position information indicating a position of the subject in the shooting screen is detected and the in-screen position is detected. An image display method comprising associating the subject information with a position in the photographing screen by information. 64. The image display method according to claim 63, wherein the associating step includes a positioning step of detecting a position of the image pickup device to generate shooting position information, and a posture of the image pickup device to detect an image. A posture detecting step of generating posture information; a step of collecting subject position information indicating a position of the subject from the electronic device by communicating with the electronic device held by the subject; and a focus of the photographing optical system. Detecting in-screen position information indicating the position of the subject in the shooting screen based on the distance and the shooting angle information obtained from the image pickup size of the image pickup device, the subject position information, the camera position information, and the camera posture information. And a step of associating the subject information with a position in the photographing screen based on the position information in the screen. Law. 65. The image display method according to claim 63, wherein in the associating step, wireless communication is performed with an electronic device held by the subject while scanning the photographing screen with a narrow directivity wireless communication antenna. The step of detecting the in-screen position information indicating the position of the subject in the shooting screen based on the scanning position when wireless communication is established with the electronic device in the shooting screen; And a step of associating the subject information with a position in the photographing screen according to information. 66. The image display method according to claim 63, wherein in the associating step, a two-dimensional infrared sensor receives infrared rays emitted by an infrared point light source included in an electronic device held by the subject, and the two-dimensional Detecting in-screen position information indicating the position of the subject in the shooting screen by detecting the light receiving position of the infrared sensor; and associating the subject information with the position in the shooting screen based on the in-screen position information. An image display method comprising: 67. The image display method according to claim 63, wherein the associating step is performed at a timing near a timing at which the subject is photographed by the imaging step. 68. The image display method according to claim 63, wherein the associating step is manually activated at a timing irrelevant to a timing at which the subject is photographed by the imaging step, and the in-screen position information is detected. Image display method characterized by. 69. The image display method according to claim 63, wherein in the associating step, a subject position in a photographing screen is analyzed by analyzing the image data, and the subject position in the photographing screen is analyzed. An image display method characterized by detecting in-screen position information indicating a position. 70. The image display method according to claim 69, wherein in the information collecting step, similar image data similar to the image data of the object is searched, and the object added to the searched similar image data. An image display method comprising extracting information and associating the subject information with a position in the photographing screen in the associating step based on the in-screen position information obtained by the image analysis. 71. The image display method according to claim 69, wherein in the information collecting step, a subject is identified by analyzing the image data of the image, and subject information regarding the identified subject is provided on an information source on a network. The image display method is characterized in that the subject information is obtained by network communication from the computer, and in the associating step, the subject information is associated with the position in the photographing screen based on the in-screen position information obtained by the image analysis. 72. The image display method according to claim 46, further comprising a storage step of adding the subject information associated with a position in the photographing screen to the image data to generate and store an image file. An image display method comprising: 73. The image display method according to any one of claims 46 to 72, wherein the subject information includes access information of an information source on a network that stores detailed information about the subject, and in the information displaying step. Is a method for displaying an image, in which detailed information regarding the subject is acquired from an information source on a network indicated by access information included in the subject information, and the acquired information is displayed. 74. The image display method according to claim 46, wherein a common display screen is used in the image display step and the information display step, and the subject information is displayed in the information display step. An image display method characterized by displaying reduced image data in a partial area of the display screen when the image data is displayed on the screen. 75. The image display method according to claim 46, wherein the subject information includes audio information. 76. The image display method according to claim 75, wherein in the information collecting step, voice information emitted by the subject is acquired from the subject in the shooting screen using a narrow directional microphone at the time of shooting. In the associating step, the image display method is characterized in that the audio information is associated with a position in the photographing screen based on in-screen position information obtained in accordance with a direction having high directivity of the narrow directional microphone. 77. An image display method for displaying image data shot by an image pickup device having an image pickup optical system, comprising: an image pickup step of shooting an object in a photographing screen by the image pickup device to generate image data. An information collecting step of collecting subject information related to the subject from the electronic device by performing wireless communication with an electronic device held by the subject, and a display step of displaying the image data and the subject information. In the image display method, in the information collecting step, wireless communication having strong directivity of wireless communication in a photographing direction along an optical axis of the photographing optical system is performed. 78. An image display method for displaying image data photographed by an image pickup device having an image pickup optical system, comprising: an image pickup step of photographing an object in a photographing screen by the image pickup device to generate image data. An information collecting step of collecting subject information related to the subject from the electronic device by performing wireless communication using an electric wave signal with the electronic device held by the subject at the time of shooting; and the image data and the subject information. An image display method comprising a display step of displaying, wherein in the information collecting step, the transmission output level of the radio wave signal is changed according to the focal length of the photographing optical system. 79. An image display method for displaying image data shot by an image pickup device having an image pickup optical system, comprising: an image pickup step of shooting an object in a photographing screen by the image pickup device to generate image data. An information collecting step of collecting subject information related to the subject from the electronic device by performing wireless communication using an electric wave signal with the electronic device held by the subject at the time of shooting; and the image data and the subject information. In the image display method comprising a display step of displaying, in the information collecting step, the distance to the subject is detected at the time of shooting, and the transmission output level of the radio wave signal is changed according to the distance to the subject. Image display method characterized by.