JP2004147298A - Photography system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make a digital camera more convenient, and enhance the convenience for each of its function. <P>SOLUTION: A photography system 1 has a photographing device 10 for photographing an object to acquire image information, and a separate portable data processing device 20 for storing the image information. The photographing device 10 comprises an image information transmitting means 12 for transmitting the acquired image information directly to the data processing device 20. <P>COPYRIGHT: (C)2004,JPO

Description

The present invention relates to an imaging system that includes an imaging device and a data processing device that stores image information captured by the imaging device, and more particularly to an imaging system that transmits captured image information from the imaging device to a data processing device. Is.

In general, a photographing device such as a digital camera performs image processing such as encoding and compression on image information obtained by photographing a subject using image processing means provided in the device body, and then smart media loaded in the device. It is stored in a storage medium such as (registered trademark). That is, one photographing device performs from photographing to generation of image data in a predetermined data format and stores it in a storage medium loaded in the device.

Here, since the storage capacity of the storage medium used when storing the image data is limited, the amount of image data that can be captured is limited. Therefore, it has been proposed to store image data captured by a digital camera in a memory inside the camera body, and then transfer the image data to an image management server or the like via a network without storing the image data in a storage medium. Yes.

Specifically, image data captured by a digital camera is transferred to a lab store via data transfer means such as the Internet, and the lab store side stores and prints the transferred image data in an image recording file for printing to the user. A system has been proposed in which a large-capacity storage medium does not have to be prepared on the camera side by providing a photograph or the like (see, for example, Patent Document 1). In this method, since the captured image data is transferred to the laboratory store, a large number of images can be acquired without worrying about the storage capacity on the digital camera side.
JP-A-9-322114

However, in Patent Document 1, since it is necessary to connect a digital camera to the Internet in order to transfer photographed image data to a laboratory store, a communication usage fee is incurred due to the use of the Internet, which is an economic burden on the user. It will take.

Furthermore, since the conventional digital camera has an image capturing unit, a data recording unit, and an image processing unit integrated, for example, when replacing the CCD with a larger number of pixels or increasing the processing speed of the image processing unit. However, there is a problem that it is necessary to replace the digital camera itself, which places an economic burden on the user.

Therefore, the present invention provides a shooting system that solves the problem of storage capacity on the digital camera side, improves convenience, and further improves performance specialized for each function such as shooting and image processing. It is intended to do.

The photographing system of the present invention has a photographing device that photographs a subject and acquires image information, and a portable data processing device that is configured separately from the photographing device and stores the image information acquired by the photographing device. In addition, the imaging apparatus includes an image information transmission unit that directly transmits the acquired image information to the data processing apparatus.

Here, the imaging device is specialized for imaging functions such as an imaging lens for imaging and a CCD, and may have a temporary small-capacity memory, but not a large-capacity storage device. It may be portable and may be portable, or may be fixed at the detection shooting location.

Furthermore, the image capturing system only needs to include at least one image capturing device and one data processing device, and may include a plurality of image capturing devices and one data processing device. The apparatus may include an apparatus and a plurality of data processing apparatuses, and may further include a plurality of photographing apparatuses and a plurality of data processing apparatuses.

At this time, the photographing apparatus may have unique identification information, and the image information transmission unit may have a function of transmitting the identification information and the image information to a plurality of data processing apparatuses.

Further, the data processing device receives image information from a plurality of imaging devices, and receives image information to be received according to unique identification information attached to each imaging device transmitted from the image information transmission means. It may be provided with received image selection means for selecting.

Note that the data processing device sets correction conditions for correcting image information for each of a plurality of imaging devices so that various known corrections are performed on the captured image data so as to obtain appropriate photographic images. You may have.

Further, the data processing apparatus may have a function of encrypting and storing image information.

Further, the data processing device may be any device provided with a large-capacity storage medium and capable of storing image information acquired by the image capturing device, and stores image information itself transmitted from the image capturing device. The image processing means for encoding the image information and the storage means for storing the image information encoded by the image processing means may be provided, and the encoded image information is stored. It may be a thing.

Further, the image processing means acquires shooting condition acquisition means for acquiring shooting conditions when the shooting apparatus acquires image information, a database storing reference image information obtained by shooting an arbitrary subject in advance, and shooting conditions Based on the photographing conditions acquired by the acquiring means, reference image information searching means for searching for reference image information most similar to image information from the database, reference image information and image information searched by the reference image information searching means Difference calculating means for calculating the difference between the reference image information and the encoding means for encoding the difference between the reference image information calculated by the difference calculating means and the image information.

In addition, the data processing apparatus captures image capturing conditions when the image capturing apparatus acquires image information, reference image information obtained by capturing an arbitrary subject in advance, and when the subject is captured. A reference image for searching for reference image information most similar to image information taken from the database based on the database storing the reference shooting conditions, the shooting conditions acquired by the shooting condition acquisition means, and the reference shooting conditions. Information retrieval means, image comparison means for comparing reference image information retrieved by reference image information retrieval means with image information, and main subject detection for detecting a main subject in image information based on a comparison result in image comparison means A photographing state analyzing means for analyzing a photographing state of the main subject in the image information detected by the main subject detecting means, and a photographing state analysis And an error processing unit that performs processing so as to be able to perform shooting to acquire image information of a subject in a good shooting state when the shooting state analyzed in the stage is analyzed to be bad Good.

Furthermore, the data processing device may include data transfer means for transferring data with an external device.

According to the photographing system of the present invention, the photographing device for photographing the subject and acquiring the image information and the portable data processing device for encoding and storing the image information acquired by the photographing device are configured separately. Therefore, when you want to improve the function of only the image capturing device or only the data processing device, you only need to change the image capturing device or only the data processing device, so there is no need to replace the digital camera set and improve the performance specialized for each function Can be achieved.

Further, the data processing apparatus is portable, and the image information captured by the imaging apparatus is directly transmitted to the data processing apparatus, so that the image information is stored reliably and at high speed without being influenced by the line congestion state. be able to.

Furthermore, since the photographing device and the data processing device are configured separately, the photographing device operated when photographing can be reduced in size and weight, and the size of the DSP or storage medium used for image processing can be reduced. Therefore, it is possible to perform high-speed and advanced image processing using a higher-grade DSP and to store a large number of images taken with a larger storage capacity.

If the image capturing device is configured to transmit image information to a plurality of data processing devices, for example, all the family members possess the image capturing device, and the image information captured by the family is stored in one data processing device. In a group trip in which each person possesses a photographing device and a data processing device, when photographing with each photographing device possessed, the photographed image information is transmitted to the data processing device possessed by each person, Each can share image information.

Further, if any one of the plurality of users having the photographing device possesses the data processing device, the image information photographed by the plurality of users can be stored in one data processing device. Therefore, user convenience can be improved.

In addition, when image information such as a group photo is distributed to a plurality of users, the image information can be distributed to each user on the spot. It is convenient because there is no need to make a copy (reprint).

At this time, the image information transmission means of the imaging apparatus has a function of transmitting identification information unique to the imaging apparatus, and the data processing apparatus determines whether to receive image information according to the transmitted identification information. Thus, only image information photographed by a predetermined user can be stored in the data processing apparatus.

If the data processing device includes an image processing unit that encodes image information and a storage unit that stores the image information encoded by the image processing unit, the capacity of the image information acquired by the imaging device Therefore, a large amount of image information can be stored in the data processing apparatus.

Further, if the data processing apparatus is configured to include image processing means for classifying the encoded image information for each identification information and storing the information in the storage means, the image information is classified for each photographing apparatus and each user. Thus, the work of storing and re-categorizing the image information by the user is unnecessary, and usability can be improved.

In addition, if the image processing means has correction conditions for correcting image information for each of the plurality of imaging devices, image processing optimized for each imaging device can be performed, so image quality can be improved. You can plan.

Further, the image processing means acquires shooting condition acquisition means for acquiring shooting conditions when the shooting apparatus acquires image information, a database storing reference image information obtained by shooting an arbitrary subject in advance, and shooting conditions Based on the photographing conditions acquired by the acquiring means, reference image information searching means for searching for reference image information most similar to image information from the database, reference image information and image information searched by the reference image information searching means The difference calculation means for calculating the difference between the image information and the encoding means for encoding the difference between the reference image information calculated by the difference calculation means and the image information, the image stored in the data processing device Since the data capacity of the information can be reduced, a larger amount of image information can be stored in the data processing device.

In addition, the data processing apparatus captures image capturing conditions when the image capturing apparatus acquires image information, reference image information obtained by capturing an arbitrary subject in advance, and when the subject is captured. A reference image for searching for reference image information most similar to image information taken from the database based on the database storing the reference shooting conditions, the shooting conditions acquired by the shooting condition acquisition means, and the reference shooting conditions. Information retrieval means, image comparison means for comparing reference image information retrieved by reference image information retrieval means with image information, and main subject detection for detecting a main subject in image information based on a comparison result in image comparison means A photographing state analyzing means for analyzing a photographing state of the main subject in the image information detected by the main subject detecting means, and a photographing state analysis If it is provided with error processing means for processing so as to be able to perform shooting to acquire image information of a subject in a good shooting state when it is analyzed that the shooting state analyzed in the stage is bad, For example, even when shooting is performed in a state where the shooting state is poor due to camera shake or the like, it is possible to perform shooting that acquires image information of the subject in a good shooting state such as shooting again.

Furthermore, if the data processing device has a data transfer means for transferring data with an external device, the stored image information can be transmitted to, for example, the laboratory store side.

In addition, when the image processing means encrypts the image information and stores it in the storage means, the detected image information is decrypted only at the detection laboratory, and the stored image information is printed or photographed. It is possible to prevent others from seeing image information.

In addition, if this photographic system is applied when subjects that can be photographed are limited, such as zoos, museums, factories, etc., the photographing device can be fixed at the photographing location and only the subject within the detection range can be photographed. Even if it is not possible, the user can receive and store an image from the fixed imaging device in the data processing device using the fixed imaging device, and the administrator side of such a place can take an image. In addition to being able to limit the places to be photographed, the user can receive photographing services at places where photographing is possible.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a preferred embodiment of the photographing system of the present invention. First, the imaging device 10 constituting the imaging system 1 will be described with reference to FIG. The imaging apparatus 10 includes only an imaging unit 11 and an image information transmission unit 12 in the main body. The imaging unit 11 includes an imaging optical system that collects the light of the subject, and an imaging device such as a CCD that receives the light of the subject collected by the imaging optical system and outputs image information. The image information thus transmitted is sent to the image information transmission means 12.

The image information transmission means 12 has a function of directly transmitting the acquired image information to the data processing device 20. Further, the image information transmission means 12 transmits identification information unique to each photographing apparatus 10 together with the image information.

As described above, unlike the conventional digital camera, the photographing apparatus 10 is configured only by the imaging unit 11 and the image information transmission unit 12, and therefore it is not necessary to mount a DSP or the like necessary for image processing. And weight reduction can be achieved.

Next, the data processing device 20 will be described with reference to FIG. The data processing device 20 includes a communication unit 21 that receives image information transmitted from the imaging device 10, an image processing unit 22 that performs image processing such as compression by encoding the received image information, and an image processed image. It has storage means 23 for storing information.

Here, the data processing device 20 is composed of a small portable housing and is accommodated in a user's pocket or bag. A narrow-area network such as a PAN (Personal Area Network) is formed between the photographing apparatus 10 and the data processing apparatus 20. For this reason, it becomes possible to directly transmit image information without going through a gateway or an access point in the middle like the Internet or LAN, and the use fee of the Internet becomes unnecessary.

Note that the data transfer between the image information transmission unit 12 and the communication unit 21 may be any method that transmits image information or the like to the data processing device 20 wirelessly or using a wired or IC card.

Further, the communication unit 21 includes a received image selection unit 21 a that determines whether to receive an image according to the identification information transmitted from the photographing apparatus 10. The received image selection means 21a has identification information of the photographing apparatus 10 capable of receiving image information in advance, and receives only the image information sent together with the receivable identification information. That is, the image information transmission unit 12 of the imaging device 10 transmits the image information and identification information unique to each imaging device 10 to the data processing device 20, and the received image selection unit 21a stores the image information based on the identification information. Is supposed to be selected. As a result, even when there is another person photographing using the photographing apparatus 10 near the user who possesses the data processing apparatus 20, the image information photographed by the other person is stored in the user data processing apparatus 20. Can be prevented.

Further, the data processing device 20 includes data transfer means 24 for transferring data with an external device 30 such as a personal computer, a mobile phone, a PDA, a voice recorder, an electronic pen (for character input), etc. The transfer unit 24 can transmit the stored image information to the external device 30. Therefore, it is possible to transfer the image information stored in the storage unit 23 to the external device 30, and it is possible to order a photographed image, store it in a large capacity storage medium, or the like.

As described above, the imaging device 10 and the data processing device 20 are configured separately, so that even when there is a demand for increasing the number of pixels of the imaging unit or for speeding up the image processing, the imaging unit. If it is desired to increase the number of pixels, only the photographing device 10 may be replaced. If it is desired to increase the image processing speed or increase the storage capacity, only the data processing device 20 may be replaced. Therefore, the user can improve the performance of the detection functional portion only by purchasing only the portion whose performance is desired.

Moreover, since the imaging device 10 and the data processing device 20 are configured separately, the imaging device 10 itself can be reduced in weight, and further, the user can perform imaging using only the imaging device 10. It is possible to improve the performance of the image processing means 22 by using a high-grade DSP having a relatively large area as a DSP for performing processing of the data processing device 20. Further, it is not necessary to reduce the size of the storage unit 23, and a large-capacity storage unit such as a hard disk can be used as the storage unit 23. The image information stored in the data processing device 20 can be ordered by bringing the data processing device 20 into a lab store or transferring it from the data transfer means 24 to a server installed in the lab store. Can do.

Furthermore, although digital cameras that have been commercially available use storage media with different standards depending on models, in the photographing system 1, image information is stored in storage means built in the data processing device 20, and data transfer means is stored. Therefore, even if the storage medium standard is unified or the standard becomes obsolete, it is not affected by the standard change.

Here, although the imaging system 1 of FIG. 1 illustrates the case of one imaging device 10 and one data processing device 20, it is configured by a plurality of imaging devices 10 and one data processing device 20. Alternatively, it may be configured by one imaging device 10 and a plurality of data processing devices 20. Furthermore, the imaging system 1 including a plurality of imaging devices 10 and a plurality of data processing devices 20 may be used. Such a photographing system 1 is suitable for photographing at amusement parks, theme parks, museums, and the like described below, and photographing with a plurality of people such as group trips and family trips.

The imaging system 1 shown in FIG. 2A includes a plurality of imaging devices 10 and one data processing device 20. For example, a plurality of users each have a photographing device 10, and one of them has a data processing device 20. When another user takes a picture with the photographing apparatus 10, the image information is stored in the data processing apparatus 20. Further, if the whole family has the photographing device 10 and puts the data processing device 20 in a pocket, a bag or the like, the image information photographed by each family is stored in the data processing device 20.

The imaging system 100 in FIG. 2B is configured by a single imaging device 10 and a plurality of data processing devices 20. For example, in the case of a group trip, each user of the group has the data processing device 20, and when one user takes a picture using the photographing device 10, the photographed group photo is another user of the group. Is stored in the data processing device 20 possessed by. Therefore, when image information taken by one of the users, such as a group photo, is handed over to another user, it is not necessary to reprint a copy of the data or a print of the image information, and the imaging system is easy for the user to use. 100 can be provided.

Furthermore, in the imaging systems 1 and 100 shown in FIGS. 2A and 2B, a plurality of imaging apparatuses 10 and one data processing apparatus 20 or a single imaging apparatus and a plurality of data processing apparatuses 20 are used. However, the present invention can also be applied to a photographing system having a plurality of photographing devices 10 and a plurality of data processing devices 20 by combining them.

For example, in a zoo, a museum, a factory, or the like where a subject that can be photographed is limited, the photographing device 10 is fixed at a plurality of places where photographing can be performed, and a plurality of users each want to have the data processing device 20 and take a photograph. When photographing is performed by operating the photographing device 10 at the place, the image information can be stored in the data processing device 20 possessed by the photographing device 10. Thereby, in a zoo or the like, it is possible to provide a photographing service only to a place where photographing may be performed, and the user is not prohibited from photographing at all, and the photographing service can be improved.

In addition, for example, photographing devices 10 with telephoto lenses that cannot be possessed by individual users are installed in a plurality of places on an observation deck of Tokyo Tower, for example, and image information photographed using the photographing device 10 is stored in each place. It can also be transmitted to the data processing apparatus 20 possessed by the individual.

Furthermore, a rental system for the photographing apparatus 10 or the data processing apparatus 20 can be constructed using the photographing system 1 shown in FIGS. For example, the user has the photographing device 10 and a lab store or a theme park rents the data processing device 20. At this time, the data processor 20 stores in advance information, programs, and the like related to shooting techniques and shooting points. At the same time, carry the external device 30 having the position detection function (which may also be rented as a set with the data processing device 20) to identify the position of the user, transmit the position information to the data processing device 20, and Based on the position information, the data processing device 20 provides the user with shooting techniques at each point.

Then, the user performs photographing using the photographing device 10 and stores the image information in the data processing device 20. Thereafter, when the user returns the data processing apparatus 20 to the laboratory store or the theme park, an image taken by the laboratory store or the like is printed or stored in a large-capacity storage medium such as a CD-R and provided to the user. As described above, if the user has only the photographing device 10, the photographed image can be acquired by using the data processing device 20 that is rented at a theme park or the like.

According to the above embodiment, the photographing apparatus 10 that captures image information by photographing a subject and the portable data processing apparatus 20 that stores the image information acquired by the photographing apparatus 10 are configured separately. Therefore, when it is desired to improve the functions of only the image capturing device 10 or only the data processing device 20, it is only necessary to change only the image capturing device 10 or only the data processing device 20, so that it is not necessary to replace a set of digital cameras and specialized for each function. The performance can be improved.

Further, the data processing apparatus 20 is portable, and the image information captured by the imaging apparatus 10 is directly transmitted to the data processing apparatus 20, whereby the captured image information is transferred to the image storage server via the Internet or the like. There is no need, and image information can be stored reliably and at high speed without being affected by a line congestion state or the like.

In particular, if the data processing device 20 stores image information sent from a plurality of photographing devices 10, any one of the plurality of users who possess the photographing device 10 owns the data processing device 20. In this case, image information taken by a plurality of users can be stored, so that user convenience can be improved.

Further, if the image capturing apparatus 10 transmits image information to a plurality of data processing apparatuses 20, image information that is distributed to a plurality of users, for example, image information captured by one image capturing apparatus 10 such as a group photo. Sometimes, it is not necessary to copy the image information later, and the image information can be distributed to each user on the spot, so that a high quality photographing service can be provided to the user.

At this time, the image information transmission unit 12 has a function of transmitting identification information unique to the imaging apparatus 10, and whether the communication unit 21 receives image information according to the identification information transmitted from the image information transmission unit 12. By determining whether or not, only the image information photographed by a predetermined user is stored in the data processing device 20. Further, the image processing unit 22 stores the image information for each photographing apparatus 10 in the storage unit 23 based on the identification information, whereby the stored image information can be easily managed. In addition, registration of cameras to be received can be set for a plurality of cameras, and can be freely added or deleted.

Furthermore, since the data processing device 20 has the data transfer means 24 that performs data transfer with the external device 30, the stored image information can be transmitted to, for example, a personal computer.

The embodiment of the present invention is not limited to the above embodiment. For example, the data processing device 20 illustrates the case where the image information acquired by the photographing device 10 is encoded and compressed by the image processing means 22 and stored in the storage means 23, but without using the image processing means 22. You may make it memorize | store the image information transmitted from the imaging device 10 in the memory | storage means 23 as it is. That is, in the case of the portable data processing device 20, the performance of an image processing function by a device having a high data processing capability such as a personal computer is often better than that of an image processing function constituted by a DSP or the like. Therefore, there is a limit to obtaining high quality image information that has been subjected to image processing by the data processing device 20. Therefore, when photographing, the image information photographed by the photographing device 10 is stored in the storage means 23 of the data processing device 20 as it is, and the image information is read from the data processing device 20 later in a personal computer and image processing is performed. High quality images can be acquired.

Furthermore, in the above embodiment, the case where the photographing apparatus 10 includes only the imaging unit 11 and the image information transmission unit 12 is illustrated. However, the photographing apparatus 10 is a known reversible image having a relatively small amount of computation, for example. After encoding using the encoding method, the encoded image information may be transmitted to the data processing device 20. On the data processing device 20 side, the encoded image information may be once decoded and then re-encoded with the latest encoding method.

In FIG. 2A, the image processing means 22 of the data processing device 20 has different correction conditions (for example, white balance) for each photographing device 10, and the image transmitted from each photographing device 10. You may have a function which correct | amends using different correction conditions for every information. In other words, since the image processing optimized for each imaging device 10 can be performed on the plurality of imaging devices 10, the image quality can be improved.

Further, the data processing device 20 may have a function of downloading an image processing program from the external device 30, and may have a function of correcting the processing content of the image processing means 22 by executing the image processing program. This makes it possible to apply the latest algorithms for image encoding, image processing, and the like.

Further, in the imaging system 1 of FIG. 1, the imaging unit 11 always performs imaging at a high resolution, and the image processing means 22 on the data processing device 20 side determines the amount of image data and the necessity for each image, thereby compressing the image. May be selected and the encoding process may be executed.

In the above embodiment, the photographing apparatus 10 transmits identification information unique to the photographing apparatus. In addition to the identification information, the user ID assigned to each user is transmitted. Also good. Further, the image processing unit 22 may store image information in the storage unit 23 for each user ID.

Further, the data processing device 20 shown in FIG. 1 may be provided with a display unit such as a liquid crystal display monitor, and the captured image may be displayed on the display unit.

Further, in the data transfer means 24 of FIG. 1, when image information is transmitted from the photographing apparatus 10, the image information subjected to image processing and the identification information are transferred to a server such as a lab store for storage. Also good. Then, the captured image information may be sent to the data transfer unit 24 at a timing different from the timing when the image is captured from the server.

Further, when the photographing system 1 is used in a theme park, amusement park, etc., a GPS transmission means is provided for each subject such as each attraction, and a GPS transmission means prepared separately by the photographer is provided in the photographing apparatus 10 or the data processing apparatus 20. It may be attached. Then, when the photographer photographs an attraction or the like, the focus of the imaging unit 11 may be adjusted to the subject from the position information of the subject and the position information of the photographer. At this time, the focus control data is derived on the data processing device 20 side and transmitted to the photographing device 10.

Further, since the data processing device 20 has a function of downloading an image processing program from the external device 30 and a function of correcting the image processing means 22 by executing the image processing program, image coding and image processing are performed. Etc. The latest algorithms can be applied.

Further, the image processing means 22 encrypts the image information and stores it in the storage means 23 so that the stored image information can be reproduced only at the detection laboratory, or the photographed image information cannot be seen by others. can do.

Further, in each of the above-described embodiments, the case where the shutter function when photographing is provided on the photographing device 10 side is illustrated, but a shutter button is provided on the housing of the data processing device 20 and the shutter button is pressed. If so, the photographing by the photographing device 10 may be performed wirelessly. Then, even when the photographing apparatus 10 is fixed, the user can move within the photographing range and press the shutter, so that a high photographing service can be provided to the user.

FIG. 3 is a block diagram showing another embodiment of the photographing system of the present invention. The photographing system 200 will be described with reference to FIG. 3, parts having the same configuration as that of the imaging system 1 of FIG. 1 are denoted by the same reference numerals and description thereof is omitted.

3 differs from the imaging system 1 in FIG. 2 in the configuration of the imaging apparatus and the image processing method for image information. Specifically, the imaging device 210 of the imaging system 200 in FIG. 3 includes an imaging condition acquisition unit 211 that acquires imaging conditions at the time of imaging when acquiring image information. The imaging condition acquisition unit 211 acquires, for example, camera information and imaging time of the imaging apparatus 210 itself as imaging conditions. The imaging condition acquisition unit 211 sends the acquired imaging conditions to the data processing device 220 via the image information transmission unit 12.

FIG. 4 is a block diagram showing an example of the image processing means 222 of the data processing device 220. The image processing unit 222 in FIG. 4 stores an image from the database 231 based on the database 231 storing reference image information obtained by photographing an arbitrary subject in advance and the photographing conditions acquired by the photographing condition obtaining unit. Reference image information search means 230 for searching for reference image information most similar to information, difference calculation means for calculating a difference between the reference image information searched by reference image information search means 230 and image information acquired by photographing 232 and an encoding unit 233 for encoding the difference between the reference image information calculated by the difference calculation unit 232 and the image information.

Here, the reference image information in the database 231 has been subjected to preprocessing such as decoding or size normalization, and is based on, for example, image information taken by the user, image information transferred (downloaded) from the external device 30, or the like. It has become. In the database 231, the reference image information is stored in association with imaging conditions when the reference image information is acquired and identification data for identifying the reference image information such as a file name. Then, the reference image information search means 230 searches the reference image information most similar to the image information from the database 231 by searching for the shooting condition of the reference image information closest to the shooting condition of the image information. ing.

It should be noted that the reference image information search means 230 may detect the reference image information using not only the shooting conditions but also the position information. In this case, the reference image information search unit 230 acquires position information from the external device 30 such as a mobile phone having a GPS function via the data transfer unit 24, and the position information is stored in the database 231. It is stored in association with information. Then, the reference image information search unit 230 searches for the reference image information using the position information together with the shooting conditions.

The difference calculating unit 232 has a function of calculating a difference between the reference image information searched by the reference image information searching unit 230 and the acquired image information, and the encoding unit 233 encodes and stores the calculated difference. The means 23 has a function of storing. Here, a known encoding algorithm can be used as the encoding used.

Further, the encoding unit 233 has a function of encoding reference image information identification data (for example, a file name) indicating reference image information together with the difference data, and decodes the image information using the reference image information and the difference data. Can be made. In this way, it is possible to reduce the data amount of the encoded image information by encoding the difference from the reference image information, instead of encoding and storing all of the image information acquired by photographing. it can.

It should be noted that the decoding of the image information obtained by encoding the difference data is performed by adding the decoding result of the reference image information and the decoding result of the difference. Further, when image information taken by the user is transferred from the data processing device 220 to the user's personal computer or the like, the image information decoded by the above-described method is transferred to the personal computer, and the entire image information on the personal computer side. Encoding is performed for a known encoding algorithm. That is, on the portable data processing device 220 side, the data amount of image information is stored in a reduced state, and when using an image taken by the user, the image can be viewed and processed on a personal computer or the like. Coding is possible.

As described above, since not all of the photographed image information is encoded and stored in the storage unit 23 but the image difference information is stored in the storage unit, the data amount of the image information can be reduced. A lot of image information can be stored by the means 23.

Note that the difference calculation means 232 calculates the difference between the image information and the reference image information in one entire screen, but as shown in FIG. 5, the input image and the reference image information are divided into a plurality of blocks. The difference between the input image and the reference image information may be calculated for each block, and the difference for each block may be encoded. At this time, the contents of the encoded data stored in the storage unit 23 are block position information, reference image identification data, block position information in the reference image, and differentially encoded data.

Further, FIG. 3 illustrates the case where the reference image information is stored in the storage unit 23 in the data processing device 220 that generates the difference image information, but FIG. 2 (a) and FIG. 2 (b). As shown in FIG. 5, when there are a plurality of data processing devices 20 in the photographing systems 1 and 100, any one of the data processing devices 20 only needs to have reference image information, and the other data processing devices 20 The reference image information may be acquired from the data processing device 20 having the reference image information.

FIG. 6 is a block diagram showing a third embodiment of the photographing system, and the photographing system 300 will be described with reference to FIG. In the imaging system 300 of FIG. 6, parts having the same configuration as that of the imaging system 200 of FIG. 3 are denoted by the same reference numerals and description thereof is omitted.

The imaging system 300 in FIG. 6 is different from the imaging system 200 in FIG. 3 in that the data processing device 320 has a good imaging state such as warning the user to take another subject when the subject is in a poor imaging state. This is the point that a photographing auxiliary means 310 is provided to enable acquisition of image information.

Specifically, FIG. 7 is a block diagram showing an example of a photographing assistance means. The imaging assistance unit 310 in FIG. 7 is a reference image most similar to the image information captured from the database 312 based on the database 312 storing the reference image information and the imaging conditions acquired by the imaging condition acquisition unit 211. Based on the reference image information search means 311 for searching information, the image comparison means 313 for comparing the reference image information searched by the reference image information search means 311 with the image information, and the comparison result by the image comparison means 313 The main subject detecting means 314 for detecting the main subject in the information, the main subject analyzing means 315 for analyzing the photographing state of the main subject in the image information detected by the main subject detecting means 314, and the main subject analyzing means 315 have been analyzed. And error processing means 316 for determining whether or not an error has occurred in the shooting state. To have.

Here, the reference image information in the database 312 has been preprocessed such as decoding or size normalization, for example, from image information taken by the user, image information transferred (downloaded) from the external device 30, or the like. It has become. In the database 312, the reference image information is stored in association with the photographing condition when the reference image information is acquired and identification data for identifying the reference image information such as a file name. Further, the reference image information search means 311 acquires position information from the external device 30 such as a mobile phone having a GPS function via the data transfer means 24, and the reference image is obtained using the photographing condition and the position information. Information is to be detected. The database 312 stores position information in association with reference image information. Then, the reference image information search unit 311 searches for the reference image information most similar to the image information from the database 312 by searching for the shooting condition of the image information, the shooting condition of the reference image information closest to the position information, and the position information. To search.

The image comparison unit 313 has a function of detecting a matching portion between the image information and the reference image information by comparing the image information with the reference image information. The main subject detection unit 314 analyzes the main subject based on the matching portion detected by the image comparison unit 313 and the user position information transferred from the external device 30. Note that the photographing condition acquisition unit 211 of the photographing apparatus 210 has an orientation detection function for detecting the direction of the photographing apparatus 210 when photographing, and the main subject detection means 314 detects the main subject from the position information and the orientation of the photographing apparatus 210. If analyzed, the accuracy of detection of the main subject can be improved.

The main subject analysis unit 315 analyzes the image quality of the main subject in the image information detected by the main subject detection unit 314. For example, the main subject analysis unit 315 compares the image quality of the main subject in the image information and the main subject in the reference image information. Do more. For example, when the sharpness of the main subject of the image information is lower than the sharpness of the main subject of the reference image information by a predetermined level or more, the main subject analyzing unit 315 may cause a shooting failure such as defocus or camera shake. It is determined that the shooting state of the subject is bad.

Note that the image quality may be determined using not only the sharpness but also the S / N ratio. In addition, the main subject analysis unit 315 may analyze the shooting state from the main subject of the image information such as the analysis of the edge component without comparing the main subject of the image information with the main subject of the reference image information. . Further, the main subject analysis means 315 uses the density component of the image information as an analysis parameter, and determines whether the density of the main subject of the image information is a predetermined amount or more away from the density of the main subject of the reference image information. You may make it do.

The error processing means 316 performs processing so as to be able to perform shooting to acquire image information of a subject in a good shooting state when it is analyzed that the shooting state of the image information is bad. Specifically, the error processing means 316 outputs, to the display unit, that an error has occurred in shooting when a display unit such as a liquid crystal display is attached to the shooting device 210, or the shooting device 210, When a speaker is attached to the data processing device or the external device, a message to that effect is output. Thus, even when the user fails to acquire a high-quality image due to camera shake or the like when shooting, the same subject can be shot again by the warning output from the shooting system.

Note that although the error processing means 316 is exemplified for the case where an error has occurred, the control method of the photographing apparatus 210 may be changed. For example, the error processing means 316 may change the setting so that the shutter speed is faster than in the standard mode, or may take two shots at a shutter speed faster than that in the standard mode and record two images at the time of recording in the storage means 23. Images may be combined to reduce noise.

FIG. 8 is a flowchart showing an example of the operation of the imaging system of FIG. 6, and an example of the operation of the imaging system will be described with reference to FIGS. First, the user performs shooting using the shooting device 210. At this time, shooting conditions are acquired by the shooting condition acquisition unit of FIG. 6 and sent to the data processing device 320. On the other hand, when photographing is started by the photographing device 210, position information is acquired from the external device 30 or the like in the data processing device 320 (step ST1).

Next, the reference image information search unit 311 in FIG. 7 searches for the reference image information most similar to the acquired image information from the database 312 based on the acquired shooting conditions and position information (step ST2). . Thereafter, the image information acquired by photographing and the retrieved reference image information are compared by the image comparison means 313, and a coincidence point between the two images is detected. Then, the main subject detection means 314 specifies the main subject of the image information based on the coincidence / difference (step ST3).

Next, the main subject that has been identified is compared with the main subject of the reference image information by the main subject analysis means 315, and a difference in sharpness is detected (step ST4). Then, the error processing means 316 determines whether or not the sharpness difference is within the allowable range (step ST5). If the sharpness does not exceed the allowable range, the image is taken as it is (step ST6). On the other hand, if the sharpness of the image information is lower than the allowable range, error processing such as outputting an error message on the display unit of the photographing apparatus 210 is performed (step ST7). ).

In the above embodiment, the shooting state is determined based on the sharpness. However, if the density of the main subject is more than a predetermined distance from the reference image information, an exposure error warning message may be output. . Further, the main subject analysis means 315 checks the tilt of the screen, for example, displays a horizontal line for checking a horizontal line, a horizon line, a horizontally long structure, or displays a vertical line for checking a vertical line of a high structure. Such an instruction may be issued to display a horizontal / vertical line on the camera monitor for assisting photographing in accordance with the main subject.

Furthermore, the main subject detection unit 314 specifies the main subject based on the coincidence / difference between the image information and the reference image information. However, the present invention can be applied even when the main subject is a person. At this time, by using a well-known face extraction algorithm, image blurring, defocusing, exposure mistakes (for example, close-up strobe light, backlight, etc.) can be obtained by comparing the image feature amount between the face area in the captured image and the face area in the reference image. ).

The embodiments of the present invention are not limited to the above embodiments. For example, in the data processing devices 20, 220, and 320 in each of the above-described embodiments, control means for causing the external device 30 to share various functions assigned to the imaging device 10 according to the type of the external device 30. You may have. Specifically, for example, when the external device 30 is an image display device, the control unit may stop the operation of the display unit on the photographing apparatus 10 side. When the external device 30 is a PDA with a microphone function, the control unit may stop the operation of a microphone provided on the photographing device 10 side.

Further, in each of the above embodiments, the image processing means 22 and 222 refer to the processing of image information, but various information is acquired from the external device 30 via the data transfer means 24, and the acquired information is imaged. The information may be stored in association with the information. Specifically, the image processing means acquires time information, position information, audio data, various downloaded content data, etc. from the external device 30 and stores them in the storage means 23 in association with the image information. Good.

In the case of the imaging systems 1, 100, 200, and 300 having a plurality of data processing devices 20, 220, and 320 as shown in FIG. 2, the data processing devices 20, 220, and 320 are connected to the data processing devices 20, 220, respectively. , 320 may have a function of transferring image information. Thereby, the free capacity of a specific data processing apparatus can be expanded. Furthermore, the image information stored in each data processing device 20, 220, 320 may be classified and stored in each data processing device 20, 220, 320 for each scene.

The block diagram which shows preferable embodiment of the imaging | photography system of this invention Schematic diagram showing an example of use of the imaging system of the present invention The block diagram which shows 2nd Embodiment of the imaging | photography system of this invention. FIG. 3 is a block diagram showing an example of image processing means in the data processing apparatus of FIG. FIG. 4 is a schematic diagram showing an example of division of image information in the image processing means of FIG. The block diagram which shows 3rd Embodiment of the imaging | photography system of this invention. The block diagram which shows an example of the imaging | photography assistance means in the data processor of FIG. The flowchart which shows the operation example of the imaging | photography assistance means of FIG.

Explanation of symbols

1, 100, 200, 300 Imaging system 10, 210 Imaging device 11 Imaging unit 12 Image information transmission means 20, 220 Data processing device 21a Received image selection means 21 Communication means 22 Image processing means 23 Storage means 24 Data transfer means 30 External device 211 Imaging condition acquisition means 222 Image processing means 230 Reference image information search means 231 Database 232 Difference calculation means 233 Encoding means 310 Imaging assistance means 311 Reference image information search means 312 Database 313 Image comparison means 314 Main subject detection means 315 Main subject analysis Means 316 Error processing means

Claims (11)

A photographing device for photographing a subject and acquiring image information; and a portable data processing device configured separately from the photographing device and storing image information obtained by the photographing device;
An imaging system, wherein the imaging apparatus includes image information transmission means for directly transmitting the acquired image information to the data processing apparatus. The imaging device has identification information unique to the imaging device, and the image information transmission means has a function of transmitting the identification information and the image information to a plurality of the data processing devices. The imaging system according to claim 1. The data processing device receives the image information from a plurality of the photographing devices, and receives the image information according to unique identification information attached to each photographing device transmitted from the image information transmission means. The imaging system according to claim 1, further comprising reception image selection means for selecting the image information. The imaging system according to any one of claims 1 to 3, wherein the data processing device classifies and stores the image information for each identification information. 5. The photographing system according to claim 1, wherein the data processing device has a correction condition for correcting the image information for each of the plurality of photographing devices. The imaging system according to claim 1, wherein the data processing device has a function of encrypting and storing the image information. 2. The data processing apparatus includes: an image processing unit that encodes the image information; and a storage unit that stores the image information encoded by the image processing unit. The imaging system according to any one of items 1 to 6. The image processing means
Shooting condition acquisition means for acquiring shooting conditions when the shooting apparatus acquires the image information;
A database storing reference image information obtained by photographing an arbitrary subject in advance;
Reference image information search means for searching for the reference image information most similar to the image information from the database, based on the shooting conditions acquired by the shooting condition acquisition means;
A difference calculating means for calculating a difference between the reference image information searched by the reference image information searching means and the image information;
8. The photographing system according to claim 7, further comprising an encoding unit that encodes a difference between the reference image information calculated by the difference calculation unit and the image information. The data processing device is
Shooting condition acquisition means for acquiring shooting conditions when the shooting apparatus acquires the image information;
A database storing reference image information obtained by photographing an arbitrary subject in advance and reference photographing conditions when the subject is photographed;
Reference image information search means for searching for reference image information most similar to the image information taken from the database based on the shooting conditions and the reference shooting conditions acquired by the shooting condition acquisition means;
Image comparison means for comparing the reference image information retrieved by the reference image information retrieval means with the image information;
Main subject detection means for detecting a main subject in the image information based on a comparison result in the image comparison means;
Main subject analysis means for analyzing a photographing state of the main subject in the image information detected by the main subject detection means;
Error processing means for performing processing so as to perform photographing to acquire the image information of the subject in a good photographing state when it is analyzed that the photographing state analyzed by the main subject analyzing means is bad. The imaging system according to any one of claims 1 to 8, wherein the imaging system is any one of the above. The imaging system according to any one of claims 1 to 9, wherein the data processing device includes data transfer means for transferring data with an external device. The imaging system according to any one of claims 1 to 10, wherein the imaging device is fixed to a detected imaging location.

Images