JP2004356718A - Apparatus and method for information recording control, recording medium and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To record information so as to be correlated to a picked-up image, particularly, even if an object to be picked up is not fixed to a specific position. <P>SOLUTION: A video camera 1 picks up an image 11, and detects position information (latitude and longitude) of the image picking-up point. An information storage device 51 stores the identification information of the object to be picked up and relating information relating to the object to be picked up. The video camera 1 searches the relating information 12 of the object to be picked up stored in the device 51 on the basis of the position information of the object to be picked up and the image, and records the relating information so as to relate it to the image 11. This apparatus is applicable to a video camera. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an information recording control device, an information recording control method, a recording medium, and a program, and more particularly, to an information recording control device and an information recording control device capable of recording a captured image or sound together with information related to an imaging target. The present invention relates to an information recording control method, a recording medium, and a program.
[0002]
[Prior art]
In recent years, image recording apparatuses such as digital cameras for recording digital data of images and sounds on magnetic tapes, memory cards, and the like have been widely used. Some digital cameras can simultaneously record the date and time of imaging and camera parameters in addition to image information of a captured image.
[0003]
Further, position information of an imaging location is acquired by a GPS (Global Positioning System), and related information related to an imaging target that has captured the image is searched based on the position information, and the relevant information is associated with the image. A camera device for recording is also proposed (for example, Patent Document 1).
[0004]
[Patent Document 1]
JP-A-11-72348
[Problems to be solved by the invention]
However, when the related information related to the imaging target is searched based on the position information (imaging position) of the imaging location, the related information is not obtained for the imaging target (for example, a running car) that is not fixed at a specific position. There was a problem that it was difficult to search.
[0006]
In addition, when there are a plurality of imaging targets at the same position, there is a problem that it is difficult to identify the imaging target only by the positional information of the imaging position by GPS.
[0007]
The present invention has been made in view of such a situation, and it is an object of the present invention to accurately specify an imaging target and record correct related information of the imaging target together with its image.
[0008]
[Means for Solving the Problems]
The information recording control device of the present invention is an image acquisition unit that acquires an image of an imaging target, a detection unit that detects an imaging position of the imaging target, and based on the imaging position and the image of the imaging target detected by the detection unit. A related information acquiring unit for acquiring related information related to an imaging target; and a recording control unit for recording an image acquired by the image acquiring unit together with the related information acquired by the related information acquiring unit. .
[0009]
When a plurality of pieces of related information are obtained by the related information obtaining means, the information processing apparatus further includes a selection means for selecting desired related information from the plurality of pieces of related information, and It can be recorded.
[0010]
The related information acquisition means can acquire related information by performing communication via a network.
[0011]
The related information acquiring means can acquire related information related to the imaging target based on RF (Radio Frequency) tag information.
[0012]
An information recording control method according to the present invention includes an image acquisition step of acquiring an image of an imaging target, a detection step of detecting an imaging position of the imaging target, and a process of detecting the imaging position and the image of the imaging target detected by the processing of the detection step. A related information acquisition step of acquiring related information related to the imaging target, and a recording control step of recording the image acquired in the process of the image acquisition step together with the related information acquired in the process of the related information acquisition step. It is characterized by including.
[0013]
A program according to the present invention includes an image acquisition step of acquiring an image of an imaging target, a detection step of detecting an imaging position of the imaging target, and an imaging step based on the imaging position and the image of the imaging target detected by the processing of the detection step. A related information acquisition step of acquiring related information related to the target, and a recording control step of recording an image acquired in the processing of the image acquisition step together with the related information acquired in the processing of the related information acquisition step. Features.
[0014]
A recording medium on which the program of the present invention is recorded includes an image acquisition step of acquiring an image of an imaging target, a detection step of detecting an imaging position of the imaging target, and an imaging position and an imaging target detected by the processing of the detection step. A related information acquisition step of acquiring related information related to an imaging target based on the image of the image, and recording the image acquired in the process of the image acquisition step together with the related information acquired in the process of the related information acquisition step. And a program comprising a control step.
[0015]
In the present invention, an image of an imaging target is acquired, and an imaging position of the imaging target is detected. Related information related to the imaging target is acquired based on the imaging position and the image of the imaging target, and the image is recorded together with the relevant information.
[0016]
BEST MODE FOR CARRYING OUT THE INVENTION
Embodiments of the present invention will be described below. The correspondence between constituent elements described in the claims and specific examples in the embodiments of the present invention is as follows. This description is for confirming that a specific example supporting the invention described in the claims is described in the embodiment of the invention. Therefore, even if there is a specific example which is described in the embodiment of the invention but is not described here as corresponding to the configuration requirement, the fact that the specific example is It does not mean that it does not correspond to the requirement. Conversely, even if a specific example is described here as corresponding to a configuration requirement, this means that the specific example does not correspond to a configuration requirement other than the configuration requirement. not.
[0017]
Furthermore, this description does not mean that the invention corresponding to the specific examples described in the embodiments of the invention is all described in the claims. In other words, this description is an invention corresponding to the specific example described in the embodiment of the invention, and the existence of the invention not described in the claims of this application, that is, It does not deny the existence of the invention added by the amendment.
[0018]
The information recording control device according to claim 1 (for example, the video camera 1 in FIG. 2) includes: an image acquisition unit (for example, the image input unit 31 in FIG. 2) that acquires an image of an imaging target; A detecting unit for detecting a position (for example, the detecting unit 33 in FIG. 2), and a related unit for acquiring related information related to the imaging target based on the imaging position and the image of the imaging target detected by the detecting unit. An information acquisition unit (for example, the search unit 34 in FIG. 2) and a recording control unit (for example, FIG. 2) for recording the image acquired by the image acquisition unit together with the related information acquired by the related information acquisition unit. Recording control unit 35).
[0019]
The information recording control device according to claim 2, wherein, when a plurality of pieces of related information are acquired by the related information acquiring unit, a selecting unit that selects desired related information from the plurality of related information (for example, FIG. 2). And the recording control means causes the related information selected by the selection means to be recorded.
[0020]
The information recording control method according to claim 5, wherein an image acquisition step for acquiring an image of the imaging target (for example, step S1 in FIG. 3) and a detection step for detecting the imaging position of the imaging target (for example, FIG. Step S5) and a related information acquisition step of acquiring related information related to the imaging target based on the imaging position and the image of the imaging target detected by the processing of the detection step (for example, step S8 in FIG. 3). ) And a recording control step (for example, step S11 in FIG. 3) for recording the image acquired in the image acquiring step together with the related information acquired in the related information acquiring step. It is characterized by.
[0021]
A specific example of each step of the program according to claim 6 and the program of the recording medium according to claim 7 is the same as the specific example in the embodiment of the invention of each step of the information recording control method according to claim 5. It is.
[0022]
FIG. 1 is a diagram showing an outline of processing of a video camera 1 to which the present invention is applied.
[0023]
The video camera 1 captures an image 11 of an imaging target, and at this time, detects position information (imaging position) indicating an imaging location where the imaging target was imaged. The video camera 1 searches for and acquires related information 12 related to the imaging target based on the image 11 and the imaging position of the imaging target. Then, the video camera 1 records the image 11 together with the related information 12.
[0024]
FIG. 2 is a diagram illustrating a configuration example of the video camera 1.
[0025]
The video camera 1 includes an image input unit 31, an audio input unit 32, a detection unit 33, a search unit 34, a recording control unit 35, a recording unit 36, and an operation unit 37. Further, the video camera 1 can be connected to the information storage device 51 via a network such as the Internet, and can perform wired or wireless communication with the information storage device 51. .
[0026]
The image input unit 31 captures an image of an imaging target, acquires digital data (image data) of an image (signal) of the imaging target, and supplies the digital data (image data) to the search unit 34 and the recording control unit 35. The image input unit 31 is configured by, for example, a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) imager.
[0027]
The audio input unit 32 acquires digital data (audio data) of the audio (signal) by collecting the audio (sound), and supplies the digital data (audio data) to the recording control unit 35. The voice input unit 32 is configured by, for example, a microphone.
[0028]
The detection unit 33 detects the date and time when the image was captured by the image input unit 31 and the location. That is, the detection unit 33 detects the imaging date and time measured by a clock unit (not shown) and detects position information (imaging position) such as latitude and longitude, which indicates the imaging location of the image by GPS. The detection unit 33 supplies the detected imaging date and time and position information to the search unit 34.
[0029]
The search unit 34 extracts (or data of) an image (hereinafter, appropriately referred to as a representative image) representative of the image data for specifying the imaging target from the image data supplied from the image input unit 31. Generation). Then, the search unit 34 accesses the information storage device 51 via the network, and the information storage device 51 stores the information based on the position information supplied from the detection unit 33 and the representative image extracted from the image data. The information is acquired by searching the registration data for related information related to the imaging target, and is supplied to the recording control unit 35.
[0030]
Further, the search unit 34 supplies the imaging date and time supplied from the detection unit 33 to the recording control unit 35.
[0031]
The recording control unit 35 encodes the image data supplied from the image input unit 31 and the audio data supplied from the audio input unit 32, and converts the encoded image data and audio data into the related data supplied from the search unit 34. Control is performed to record in the recording unit 36 together with the information and the imaging date and time. Note that the image data and the audio data and the related information can be recorded in the same file or in different files, but are recorded in different files here. As the recording unit 36, for example, a magnetic tape or a memory card for recording digital data can be used.
[0032]
The operation unit 37 is operated by a user, and supplies, for example, a signal instructing start of imaging or end of imaging to the image input unit 31 and the audio input unit 32 in accordance with the operation of the user, or the image signal or the audio signal. Is supplied to the recording control unit 35. When a plurality of pieces of related information are acquired by the search unit 34, when the user operates the operation unit 37 to instruct selection of desired related information from the plurality of pieces of related information, The operation unit 37 supplies the selection information to the recording control unit 35.
[0033]
The information storage device 51 stores identification information for identifying various types of imaging targets as registration data together with related information related to the imaging targets (for example, text describing the name of the imaging target and a detailed description of the imaging target). I have. As the identification information of the imaging target, for example, there is position information where the imaging target exists and a reference pattern of an image obtained by imaging the imaging target from one or more directions.
[0034]
FIG. 3 is a flowchart illustrating the image capturing and recording processing of the video camera 1 in FIG. The imaging recording process is started when the user operates the operation unit 37 to give an instruction to start imaging.
[0035]
In step S1, the image input unit 31 and the audio input unit 32 start imaging. That is, the image input unit 31 acquires the image data of the imaging target, supplies the image data to the search unit 34 and the recording control unit 35, and the audio input unit 32 acquires the audio data of the imaging target, The audio data is supplied to the recording control unit 35.
[0036]
After the process of step S1, the process proceeds to step S2, where the recording control unit 35 encodes the image data supplied from the image input unit 31 and the audio data supplied from the audio input unit 32, and encodes the encoded image data. The voice data is recorded in the recording unit 36, and the process proceeds to step S3.
[0037]
In step S3, the operation unit 37 determines whether or not the user has instructed to stop the imaging. If it is determined that the imaging has not been instructed, the operation unit 37 returns to step S2 and repeats the above-described processing.
[0038]
On the other hand, in step S3, when it is determined that the user has instructed to stop imaging, the operation unit 37 proceeds to step S4, supplies a signal for instructing to stop imaging to the image input unit 31 and the audio input unit 32, and proceeds to step S5. Proceed to. When a signal for instructing to stop imaging is supplied from the operation unit 37 to the image input unit 31 and the audio input unit 32, the image input unit 31 stops acquiring image data of the imaging target, and the audio input unit 32 The acquisition of the audio data of the imaging target is stopped.
[0039]
In step S5, the detection unit 33 detects the imaging date and time measured by a clock unit (not shown) and position information (imaging position) indicating the imaging location of the image using GPS, and supplies the information to the search unit 34. move on. In step S6, the search unit 34 uses the image data supplied from the image input unit 31 (the image data supplied from the image input unit 31 and recorded in the recording unit 36) as a representative image for specifying an imaging target. For example, one frame image (data) is extracted.
[0040]
After the process in step S6, the process proceeds to step S7, in which the search unit 34 associates the imaging target in the representative image with the position information supplied from the detection unit 33 in step S5 and the representative image extracted in step S6. Get information.
[0041]
That is, the search unit 34 accesses the information storage device 51, and from the registered data stored in the information storage device 51, the position information as the identification information in the registered data and the reference pattern of the image are set to A search is made for images that match the position information and the image pattern of the representative image, respectively.
[0042]
For example, when the imaging target of the representative image is a poster, the search unit 34 searches the registration data stored in the information storage device 51 based on position information (imaging position) indicating the imaging location of the poster. A search is made for registered data having position information of a position close to the imaging position as identification information, and further, for the searched registered data, a reference pattern of an image stored as identification information of the registered data, and a representative image Of the image pattern of the representative image and searching for the image pattern most similar to the image pattern of the representative image.
[0043]
In the case where the reference data of the image stored as the identification information of the registered data has no reference pattern similar to the image pattern of the representative image in the registered data having the position information of the position close to the imaging position as the identification information. Performs matching on all registered data, and searches for the one that is most similar to the image pattern of the representative image.
[0044]
By searching the registered data based on both the position information and the representative image as in step S7 described above, an imaging target that is difficult to specify only with the position information is specified more accurately by the image pattern of the representative image. be able to.
[0045]
Further, the search unit 34 supplies the acquired related information and the imaging date and time supplied from the detection unit 33 to the recording control unit 35, and proceeds from step S7 to step S8.
[0046]
In step S8, the recording control unit 35 selects the related information supplied from the search unit 34. That is, for example, when a plurality of related information (related information of each of a plurality of targets) is supplied from the search unit 34, the recording control unit 35 displays the plurality of related information on a display unit (not illustrated). The user operates the operation unit 37 so as to select desired related information from the related information displayed on the display unit, and the operation unit 37 supplies the selected information to the recording control unit 35. When one or a plurality of pieces of related information are supplied from the search unit 34, in step S8, the related information can be edited according to the operation of the operation unit 37 by the user. Further, the processing in step S8 can be skipped.
[0047]
In step S <b> 8, when a plurality of pieces of related information are supplied from the search unit 34, a predetermined number (one or more) of the plurality of pieces of related information is set in descending order of the degree of matching (degree of matching) of the representative image or the position information. ) May be selected.
[0048]
After the process in step S8, the process proceeds to step S9, in which the operation unit 37 determines whether or not recording start of the related information has been instructed by the user. Wait until it is done.
[0049]
On the other hand, when it is determined in step S9 that the recording start has been instructed by the user, the operation unit 37 supplies a signal to instruct recording start to the recording control unit 35, and proceeds to step S10. In step S10, the recording control unit 35 stores the related information and the imaging date and time selected in step S8 or acquired in step S7 in the recording unit 36 in association with the image data and the audio data recorded in the immediately preceding step S2. Record and end the process.
[0050]
In the above-described processing, the related information is searched based on the position information and the representative image. However, the detection unit 33 detects the RF tag information indicating the information of the imaging target from the RF tags attached to the imaging target, The search unit 34 can also search for related information related to the imaging target based on the RF tag information in addition to the position information and the representative image. In this case, the imaging target represented by the RF tag information is also stored in the identification information of the information storage device 51.
[0051]
For example, when a picture is captured in a museum, the detection unit 33 detects RF tag information indicating that the imaging target is a painting from the RF tag attached to the painting, and the search unit 34 determines the position of the museum. Based on not only the positional information and the representative image but also the RF tag information, related information related to the picture to be imaged is searched. This makes it possible to accurately specify an imaging target that is difficult only by matching the position information and the representative image.
[0052]
The detection unit 33 performs matching between the image of the imaging target and the image captured in the past and recorded in the recording unit 36, and matches or is similar to the image of the imaging target in the past. Can be detected from the related information associated with. In this case, the search unit 34 can also use the information for identifying the imaging target detected by the detection unit 33 to search for related information of the imaging target.
[0053]
FIG. 4 is a diagram illustrating an outline of processing of the video camera 1.
[0054]
The video camera 1 captures an image 11 of an imaging target, and at this time, detects latitude and longitude as position information (imaging position) indicating an imaging location where the imaging target was imaged. The video camera 1 uses the image 11 of the imaging target and the imaging position as keys, and selects, from the registration data stored in the information storage device 51, related information 12 (for example, a tourist spot at the imaging point) related to the imaging target. (A text that describes a detailed description of the imaging target, such as a detailed text of the subject).
[0055]
As described above, the video camera 1 searches the registration data based on not only the position information but also the image of the imaging target, and further, if necessary, the RF tag information and other information for identifying the imaging target. In addition, it is possible to specify an imaging target that cannot be specified only by the position information, for example, a running car or the like, and acquire related information related to the imaging target.
[0056]
In addition, the video camera 1 records the related information 12 obtained from the information storage device 51 together with the captured image 11. Thus, when searching for a desired image from the recorded images, it is possible to easily search for the image from the related information without inputting a title or a comment in advance.
[0057]
That is, when searching for a desired image from the recorded images, a method is conceivable in which an image list is displayed by thumbnail display or the like, and the user selects the desired image from the image list. Is small, it may be difficult to determine whether the image is a desired image.
[0058]
Therefore, there is a method in which a user manually adds a title or comment to an image and searches for the title or comment. In this case, it is easy to search for a desired image, but it is troublesome since the user has to type a title or a comment for each image.
[0059]
In the video camera 1, an image can be easily searched from related information without a user typing a title or a comment.
[0060]
Further, since the related information 12 is recorded together with the image 11, by using the related information, the recorded image can be stored and used simply and conveniently.
[0061]
In the above description, the position information is detected using GPS, but may be detected using other functions such as DGPS (Differential Global Positioning System).
[0062]
In the above description, the search unit 34 of the video camera 1 has searched for the related information. However, the search unit 34 may cause the information storage device 51 to search for the related information and obtain the search result.
[0063]
Further, the image data used for image matching in the search unit 36 may be data of a thinned image or a feature amount. When the thinned images are used for image matching, the processing amount of image matching in the search unit 36 can be reduced.
[0064]
The above-described series of processes can be executed by hardware or can be executed by software. In this case, the above-described processing is executed by a personal computer 600 as shown in FIG.
[0065]
In FIG. 5, a CPU (Central Processing Unit) 601 performs various processes in accordance with a program stored in a ROM (Read Only Memory) 602 or a program loaded from a storage unit 608 into a RAM (Random Access Memory) 603. Execute. The RAM 603 also appropriately stores data necessary for the CPU 601 to execute various processes.
[0066]
The CPU 601, the ROM 602, and the RAM 603 are mutually connected via an internal bus 604. The internal bus 604 is also connected to an input / output interface 605.
[0067]
The input / output interface 605 includes an input unit 606 including a keyboard and a mouse, a display including a CRT and an LCD (Liquid Crystal Display), an output unit 607 including a speaker, a storage unit 608 including a hard disk, and a modem. And a communication unit 609 including a terminal adapter and the like. The communication unit 609 performs communication processing via various networks including a telephone line and a CATV.
[0068]
A drive 610 is connected to the input / output interface 605 as necessary, and a removable medium 621 composed of a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted. It is installed in the storage unit 608 as needed.
[0069]
When a series of processing is executed by software, a program constituting the software executes various functions by installing a computer built in dedicated hardware or installing various programs. For example, it is installed on a general-purpose personal computer or the like from a network or a recording medium.
[0070]
As shown in FIG. 5, this recording medium is not only constituted by a package medium consisting of a removable medium 621 on which the program is recorded, which is distributed in order to provide the user with the program, separately from the computer. And a hard disk including a ROM 602 and a storage unit 608 in which a program is recorded, which is provided to the user in a state where the program is incorporated in the apparatus main body in advance.
[0071]
In this specification, the processes described in the flowcharts are not only performed in chronological order according to the order described as steps, but are not necessarily performed in chronological order, but are performed in parallel or individually. It also includes processing.
[0072]
【The invention's effect】
As described above, according to the present invention, information can be recorded in association with a captured image. In particular, even when the imaging target is not fixed at a specific position, correct relevant information can be recorded for the imaging target.
[Brief description of the drawings]
FIG. 1 is a diagram showing an outline of processing of a video camera to which the present invention is applied.
FIG. 2 is a block diagram illustrating a configuration example of the video camera in FIG.
FIG. 3 is a flowchart illustrating an imaging recording process in the video camera of FIG. 2;
FIG. 4 is a diagram showing an outline of processing of a video camera.
FIG. 5 is a block diagram illustrating a configuration example of a personal computer.
[Explanation of symbols]
1 video camera, 11 images, 12 related information, 31 image input section, 32 sound input section, 33 detection section, 34 search section, 35 recording control section,
36 recording unit, 37 operation unit, 51 information storage device

Claims (7)

Image acquisition means for acquiring an image of an imaging target,
Detecting means for detecting an imaging position of the imaging target;
Related information acquisition means for acquiring related information related to the imaging target based on the imaging position and the image of the imaging target detected by the detection means;
An information recording control device comprising: a recording control unit configured to record the image acquired by the image acquiring unit together with the related information acquired by the related information acquiring unit. When a plurality of pieces of related information are acquired by the related information acquiring means, the information processing apparatus further includes a selection unit that selects desired related information from the plurality of pieces of related information,
2. The information recording apparatus according to claim 1, wherein the recording control unit records the related information selected by the selection unit. 2. The information recording control device according to claim 1, wherein the related information acquiring unit acquires the related information by performing communication via a network. The information recording control device according to claim 1, wherein the related information acquisition unit acquires related information related to the imaging target based on RF (Radio Frequency) tag information. An image acquisition step of acquiring an image of an imaging target,
A detecting step of detecting an imaging position of the imaging target;
A related information acquisition step of acquiring related information related to the imaging target based on the imaging position and the image of the imaging target detected by the processing of the detection step;
A recording control step of recording the image acquired in the image acquiring step together with the related information acquired in the related information acquiring step. In a program for causing a computer to perform a predetermined information recording control process,
An image acquisition step of acquiring an image of an imaging target,
A detecting step of detecting an imaging position of the imaging target;
A related information acquisition step of acquiring related information related to the imaging target based on the imaging position and the image of the imaging target detected by the processing of the detection step;
A recording control step of recording the image acquired in the image acquiring step together with the related information acquired in the related information acquiring step. In a recording medium in which a program for causing a computer to perform a predetermined information recording control process is recorded,
An image acquisition step of acquiring an image of an imaging target,
A detecting step of detecting an imaging position of the imaging target;
A related information acquisition step of acquiring related information related to the imaging target based on the imaging position and the image of the imaging target detected by the processing of the detection step;
A recording medium, comprising: a recording control step of recording the image acquired by the image acquiring step together with the related information acquired by the related information acquiring step. .

Images