JP2016081173A - Image processor, image processing method, image processing program, image transmitter and use scene analysis method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appreciate collected picked-up images without stress by sharing the picked-up images from a plurality of a photographing apparatuses in a short period of time.SOLUTION: An image processor includes a reception part for collecting a plurality of picked-up images including picked-up images from at least one opposite apparatus, a use scene analysis part for determining a use scene on the basis of a use scene analysis condition, and a control part for generating a combination photograph based on the plurality of picked-up images collected in the reception part, or an album based on the plurality of picked-up images collected in the reception part in accordance with a determination result of the use scene, and transmitting the generated combination photograph or album to at least one opposite apparatus.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing apparatus, an image processing method, an image processing program, an image transmission apparatus, and a use scene analysis method suitable for a digital camera or the like that creates a group photo of collected images.

  In recent years, portable devices with a photographing function (photographing devices) such as digital cameras have become widespread. Some types of photographing apparatuses have a display unit and a function of displaying a photographed image. Some display screens display a menu screen to facilitate operation of the photographing device. In addition, there is a display device in which a touch panel is arranged so that the photographing apparatus can be operated by a touch operation on the touch panel.

  In addition, in this type of photography equipment, technology has been developed that uses image processing to add various effects to a photograph that has been taken. Photography devices that generate group photos are also being developed. A group photo displays each expression of multiple images on a single image, enables them to be compared, read between lines, combined and comprehensive image viewing, and promotes communication. effective.

  For example, Patent Document 1 proposes a technique for creating a group photo with a plurality of cameras.

JP 2014-1555011 A

  However, considering the advantages and convenience of the output format when collecting images shared by multiple cameras and sharing them with each other, the group photo and album mode settings are made according to the situation up to the sharing. The device has not been developed, and it is necessary for the user to perform various complicated operations such as mode setting. For example, when collecting and sharing images obtained by a plurality of photographers, conventionally, each user has to perform complicated operations such as a transmission operation and a reception operation, and transfer a relatively large amount of data for each person. Therefore, a relatively long time is required to view the captured image.

  The present invention relates to an image processing apparatus, an image processing method, an image processing program, an image transmission apparatus, and a use capable of sharing captured images from a plurality of photographing devices in a short time and appreciating captured images collected without stress. An object is to provide a scene analysis method.

  An image processing apparatus according to the present invention includes a receiving unit that collects a plurality of captured images including captured images from at least one counterpart device, a use scene analysis unit that determines a use scene based on use scene analysis conditions, Depending on the determination result of the use scene, a combined photograph based on a plurality of captured images collected in the receiving unit or an album based on a plurality of captured images collected in the receiving unit is generated, and the generated combined photograph or album is A control unit that transmits to the at least one counterpart device.

  The image processing method according to the present invention collects a plurality of captured images including captured images from at least one counterpart device, determines a use scene based on a use scene analysis condition, and determines the use scene determination result. In response, a group photo based on the collected plurality of captured images or an album based on the collected plurality of captured images is generated, and the generated group photo or album is transmitted to the at least one counterpart device.

  The image processing program according to the present invention collects a plurality of captured images including captured images from at least one counterpart device in a computer, determines a use scene based on use scene analysis conditions, and Depending on the determination result, a combined photograph based on the collected multiple captured images or an album based on the collected multiple captured images is generated, and the generated combined photograph or album is transmitted to the at least one partner device. , Execute the step.

  The image transmission apparatus according to the present invention includes a use scene analysis unit that analyzes a use scene according to a shooting time and a reception time of a captured image received from another imaging apparatus, and a combined photograph based on the analysis result of the use scene. When the image sharing is instructed, a control unit that generates a group photo based on the received captured image and a communication unit that transmits the group photo generated by the control unit to the other photographing device are provided. .

  The use scene analysis method according to the present invention is a use scene analysis method in an apparatus that collects captured images from a plurality of photographing devices and performs image sharing using a group photograph or other than a group photograph. The use scene suitable for the image sharing by the group photograph is determined according to the photographing time and the receiving time of the photographed image received from.

  The present invention has an effect of effectively sharing captured images from a plurality of photographing devices according to the situation, and allowing the shared members to view the captured images without stress.

1 is a block diagram showing an image processing apparatus according to a first embodiment of the present invention. Explanatory drawing which shows the utilization form of 1st Embodiment. Explanatory drawing which shows the utilization form of 1st Embodiment. Explanatory drawing which shows the utilization form of 1st Embodiment. Explanatory drawing which shows the time passage of the utilization of 1st Embodiment. The flowchart which shows the operation | movement flow of 1st Embodiment. Explanatory drawing which shows an example of a screen display. Explanatory drawing which shows an example of a screen display. The block diagram which shows the 2nd Embodiment of this invention. Explanatory drawing which shows the external appearance of FIG. Explanatory drawing which shows the use scene where appreciation by album-izing is preferable. Explanatory drawing which shows the general digital camera which has a wireless function. The flowchart which shows an example of the analysis method of the use scene analysis part 81. FIG. The flowchart for demonstrating the camera control in the lens type camera 90, and control of the smart phone 80. FIG. Explanatory drawing which shows the example of a screen display in 2nd Embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing an image processing apparatus according to the first embodiment of the present invention. According to the image processing apparatus of the present embodiment, it is possible to share images acquired by a plurality of photographing devices in a short time.

  In general, as a method of sharing images obtained by a plurality of cameras, a method of obtaining captured images obtained by photographing with each camera through communication, editing them with a personal computer, etc., and displaying them can be considered. However, in this method, it takes a relatively long time from photographing with a camera to displaying an image on a monitor.

  For example, when traveling with friends, etc., when viewing images acquired on the road, the images acquired by each person are sent to each other, edited by each person's camera, etc., and viewed. The method to do may be adopted. For example, when three people share images taken by their respective cameras, it is possible to view all captured images on their cameras by performing six image communications between each other's cameras. Become.

  That is, in such a case, conventionally, each person communicates many times and displays an image after editing work, etc., so that it takes a relatively long time for image communication and a complicated work is required. Necessary. In recent years, with the increase in memory capacity, the number of shots has been increasing, and the communication time has become longer due to the increase in the amount of image information to be communicated. It takes a long time for each person to share an image and view it.

  Therefore, in this embodiment, in such a use scene, after collecting images from each photographing device and generating a group photo with a plurality of images to reduce the amount of information, The group photo is transmitted to each photographing device.

  In FIG. 1, the image processing apparatus 10 includes an imaging unit 20. The imaging unit 20 has an imaging element 21 configured by a CCD, a CMOS sensor, or the like. The imaging unit 20 has an optical path unit (not shown) that guides a subject image to the imaging device 21. The optical path unit is provided with a plurality of lenses, a diaphragm, and the like (not shown) for zooming and focusing. .

  The control unit 22 is constituted by a processor such as a CPU (not shown). The control unit 22 is provided with a shooting control unit 22a, and the shooting control unit 22a controls shooting of the imaging unit 20. The imaging control unit 22a controls focusing, aperture adjustment, zooming, and the like in the imaging unit 20.

  In addition, the imaging control unit 22 a outputs a drive signal to the image sensor 21. The image sensor 21 photoelectrically converts a subject optical image incident through a lens to obtain a captured image. The imaging control unit 22a reads a captured image from the imaging element 21. The imaging control unit 22a performs predetermined signal processing, for example, color adjustment processing, matrix conversion processing, noise removal processing, and other various signal processing on the read captured image.

  The imaging unit 20 has a clock unit 23. The clock unit 23 generates time information and gives it to the control unit 22. The control unit 22 can associate information such as a shooting time with the captured image.

  The control unit 22 is provided with a communication control unit 22b. The communication control unit 22b can exchange information with the communication control unit 32 of the control unit 31. When the communication control unit 22b receives a control signal from the control unit 31 via the communication control unit 32, the communication control unit 22b gives the control signal to the imaging control unit 22a. Thereby, the imaging control unit 22 a controls each unit of the imaging unit 20 based on the control signal of the control unit 31. In addition, the communication control unit 22 b can also transmit the captured image from the shooting control unit 22 a to the control unit 31.

  Further, in the present embodiment, a communication unit 24 is provided. The communication unit 24 is controlled by the communication control unit 22b and can communicate with an external communication unit (not shown) via a predetermined transmission path. As the transmission path, various wired and wireless transmission paths, for example, a wireless LAN transmission path such as a USB (Universal Serial Bus) cable or WiFi (Wireless Fidelity) can be employed. Of course, various technologies can be used from radio waves such as Bluetooth and NFC to infrared communication. The communication control unit 22b can control communication by the communication unit 24. For example, when communication is established with an external communication unit, information such as a captured image acquired by the shooting control unit 22a is transmitted to the outside. Be able to.

  The communication unit 33 of the image processing apparatus 10 has the same configuration as the communication unit 24, and is controlled by the communication control unit 32 to communicate with a communication unit (not shown) of an external device via a predetermined transmission path. Communication is possible. As the transmission path, various technologies such as wired and wireless transmission paths, for example, wireless LAN transmission paths such as USB cables and Wifi, etc., from radio waves such as Bluetooth and NFC, to infrared communication, etc. Can be done. The communication control unit 32 can control communication by the communication unit 33. For example, when communication is established with an external communication unit, the control unit 31 receives information such as a captured image transferred from the external communication unit. Can be imported.

  In the present embodiment, a plurality of captured images obtained by a plurality of photographing devices are collected to generate a combined photograph, and the image processing apparatus 10 collects, edits, and transmits images. The imaging unit 20 may be omitted as long as it has a function (hereinafter, these functions are referred to as a share processing function). Note that the imaging unit 20 can function as one of a plurality of imaging devices that acquire a captured image that is a source of a group photograph.

  The image processing apparatus 10 is provided with an operation unit 38. The operation unit 38 includes various operation mechanisms that control imaging and image processing. For example, the operation unit 38 includes a release button, a function button, various switches such as an imaging mode setting (not shown), a touch panel, and the like, and generates an operation signal based on a user operation on the operation unit 38 to the control unit 31. It is designed to output. The control unit 31 controls each unit based on the operation signal.

  The control unit 31 uses the communication control unit 32 to acquire a captured image from the imaging unit 20 and also acquires a captured image transmitted from an external imaging device (not shown) via the communication unit 33. The resizing unit 36 resizes a plurality of captured images acquired by the control unit 31 to reduce the image size. The image composition unit 35 combines a plurality of resized captured images to generate a combined photograph that is one image. The resizing unit 36 and the image composition unit 35 operate in cooperation to generate a combined photograph in which the size, shape, and arrangement of each captured image are appropriately set according to the number of captured images, the presence or absence of a person, and the like. It can be done.

  For example, the image compositing unit 35 and the resizing unit 36 may generate a combined photograph from captured images having a preset number, shape, and size, and the user can change the size, position, and the like of each captured image constituting the combined photograph. You may make it set according to. It is also possible to make settings such as making the size of a captured image in which a preset person is captured larger than other captured images.

  The image processing apparatus 10 is also provided with a clock unit 40. The clock unit 40 generates time information and gives it to the control unit 31. The control unit 31 can manage the shooting time of the captured image and the time when the image is collected.

  For example, the control part 31 is good also as an image which uses the captured image for which the collected time is in a predetermined time range as a group photograph. Moreover, the control part 31 is good also as an image which uses the captured image in the imaged time within the predetermined time range as a group photograph. Further, the control unit 31 may use, as a combined photograph, a captured image in which the difference between the captured time and the collected time is within a predetermined time range. By such time management, the control unit 31 can also automatically select an image to be used as a group photo.

  The control unit 31 can give the collected captured image and the generated combined photograph to the recording unit 39 for recording. In this case, the control unit 31 can compress the collected captured image or group photograph and give the compressed image to the recording unit 39 for recording. For example, a card interface can be adopted as the recording unit 39, and the recording unit 39 can record image information, audio information, and the like on a recording medium such as a memory card.

  The display control unit 34 of the control unit 31 executes various processes related to display. The display control unit 34 can give the collected captured image and the generated combined photograph to the display unit 37. The display unit 37 has a display screen such as an LCD, and displays an image given from the display control unit 34. Further, the display control unit 34 can display various menu displays on these display screens.

  The display unit 37 has a display screen for displaying a captured image. Further, a touch panel (not shown) may be provided as the operation unit 38 on the display screen. The touch panel can generate an operation signal corresponding to the position on the display screen pointed by the user with a finger. This operation signal is supplied to the control unit 31. As a result, when the user touches or slides on the display screen, the control unit 31 touches the user, moves the finger closer or away, positions reached by the slide operation or slide operation, slide Various operations such as a direction and a touch period can be detected, and processing corresponding to a user operation can be executed.

  Note that the display unit 37 is disposed so as to occupy substantially the entire rear surface of the image processing apparatus 10, and the photographer can display a through image displayed on the display screen of the display unit 37 when the image capturing unit 20 captures the image. Can be confirmed, and shooting operations can be performed while checking through images. Further, on the display screen of the display unit 37, a display necessary for generating a group photo can be performed, and an operation for generating a group photo can be performed by operating a touch panel.

  Next, the operation of the embodiment configured as described above will be described with reference to FIGS. FIGS. 2 to 4 are explanatory diagrams showing the usage pattern of the first embodiment, and FIG. 5 is an explanatory diagram showing the passage of time of usage according to the first embodiment. FIG. 6 is a flowchart showing the operation flow of the first embodiment, and FIGS. 7 and 8 are explanatory diagrams showing examples of screen display.

  The image processing apparatus 10 according to the present embodiment can be used by being incorporated in a digital camera, a smartphone, or the like. In FIG. 2, persons 45 to 47 hold the compact camera 48, the single-lens reflex camera 49, and the smartphone 50 in their hands, respectively. The cameras 48 and 49 and the smartphone 50 have the same configuration as that of the image processing apparatus 10 in FIG.

  In the present embodiment, captured images acquired by a plurality of photographing devices are collected by one image processing apparatus 10, and the image processing apparatus 10 is incorporated in all of the cameras 48 and 49 and the smartphone 50. There is no need, and any one of them may be incorporated with a share processing function excluding the function of the imaging unit 20 of the image processing apparatus 10. For example, when the smartphone 50 has a share processing function, the cameras 48 and 49 have the same function as the imaging unit 20, that is, a function of acquiring a captured image by shooting and transmitting and receiving the acquired captured image for sharing. Only need to have.

  In FIG. 2, a person 45 shoots a predetermined subject with a camera 48, and a person 46 shoots a predetermined subject with a camera 49. In addition, the person 47 photographs the dragonfly and the flower subject 52 with the imaging unit 20 (see FIG. 1) of the smartphone 50. Thereafter, the respective photographing results are communicated as shown in FIG. 3, but here, they are collected in 50 devices to create a group photo. Fig. 4 shows the group photo at that time. Here, as much as possible, the person's dissatisfaction will not come out if everyone is shown. I made it. Also, images without people are made smaller. Of course, in addition to this, it is possible to set various rules, such as displaying a good-quality image as the main image, reducing the other images, increasing the size of the first shot, and displaying in time series. However, the game characteristics will be enhanced and shooting and image sharing will be fun. Since one image is displayed, comparison and integration effects are enhanced, and image transmission can be easily performed in a short time.

  FIG. 5 shows the state of shooting during travel by these persons 45 to 48 along the flow of time. In the traveling small event E1, the person 45 performs the shooting P1, the person 46 performs the two shootings P2 and P3, and the person 47 performs the shooting P4. In the next small event E2 during the trip, the person 45 performs the photographing P5 to P7, the person 46 performs the photographing P8 and P9, and the person 47 performs the photographing P10 and P11. In other words, every time an event is performed, everyone takes a picture, so individual users are required to act independently. In many cases, one person is a photographer, the next person is just a subject, the person who is shooting is dissatisfied with not being photographed, and the person being photographed can not shoot unless everyone is ready However, there are cases where time constraints are unsatisfactory, such a system, method, or apparatus enables new participatory photography that eliminates such dissatisfaction. In the current situation where each person has an individual mobile terminal, which has a shooting function, everyone can enjoy this shooting method. Such a way of enjoying is clearly different from the shooting and sharing method as shown in FIG.

  In the present embodiment, in view of the above-described situation, the cameras 48 and 49 and the smartphone 50 can share the captured images for each event in a short time and easily. In other words, the above-described way of enjoying can be actively proposed by the proposed technique of the present invention. Therefore, the present invention provides a use scene of how to use a photographing apparatus suitable for creating a group photo according to reception of photographed images from a plurality of photographing apparatuses and photographing times of the received photographed images. It can be said that it has proposed a use scene analysis method to analyze. Specifically, a situation in which an image is received from a participant and the user wants to compare images taken at approximately similar times corresponds to the use scene. Therefore, the shooting time of the captured image and the time of reception are important judgment materials.

  If only the person who sent the image can receive the group photo, the community management of give and take becomes possible. It can be said that it is a real community activity that encourages the exchange of individual members through photography and appreciation through content rather than virtual. To that end, it is needless to say that not only creating a group photo but also prompt and appropriate sharing is important.

  Here, the sharing method will be described with the display screen of the display unit 37 of the cameras 48 and 49 as the display screen 61 and the display screen of the display unit 37 of the smartphone 50 as the display screen 37a.

  The flow of FIG. 6 shows the processing of the image processing apparatus 10. The image processing apparatus 10 has operation modes of a shooting mode, a playback mode, a transmission mode, a reception mode, and an editing mode. In the share mode, the capture or playback mode, the transmission mode, and the reception mode are executed in the device that acquires the captured image, and the reception mode, the edit mode, and the transmission mode are executed in the device that executes the share processing function. .

  FIG. 7 shows an example of screen display in an apparatus (cameras 48 and 49) that acquires and transmits captured images. 7A and 7B, the display screen 61 is provided with a display area 62 for captured images, and various button displays 61a to 61e for operation can be displayed at the end of the display screen 61. It is. The user can switch to the mode set for each button display by touching the display positions of the button displays 61a to 61e.

  FIG. 8 shows an example of screen display in an apparatus (smart phone 50) having a share processing function. 8A to 8C, the display screen 37a is provided with a captured image display area 72, and various button displays 71a to 71d, 74a to 74a for operation are provided at the end of the display screen 37a. 74d, 75a to 75d can be displayed. When the user touches the display positions of these button displays 71a to 71d, 74a to 74d, and 75a to 75d, it is possible to switch to the mode set for each button display.

  In step S1, the control unit 31 of the image processing apparatus 10 incorporated in the cameras 48 and 49 and the smartphone 50 determines whether or not a shooting mode is designated. When the shooting mode is designated, a through image is displayed on the display areas 61 and 72 of the display screen 61 of the cameras 48 and 49 and the display screen 37a of the smartphone 50.

  When the person 45 performs a touch operation on the button display 61 a on the display screen 61 of the camera 48, shooting is performed by the camera 48. Further, when the person 46 performs a touch operation on the button display 61 a on the display screen 61 of the camera 49, the camera 49 performs shooting. Similarly, when the person 47 performs a touch operation on the button display 71a on the display screen 71 of the smartphone 50, shooting is performed on the smartphone 50 (step S2).

  By these photographing operations, the captured image from the image sensor 21 is taken into the photographing control unit 22a. The imaging control unit 22a performs predetermined image signal processing on the captured image, and then transmits it to the control unit 31 via the communication control unit 22b. The control unit 31 gives the received captured image to the recording unit 39 and records it (step S3).

  In the cameras 48 and 49 and the smartphone 50, the respective photographings P1 to P4 in FIG. 5 are performed, and captured images based on these photographings P1 to P4 are recorded in the recording units 39 of the cameras 48 and 49 and the smartphone 50.

  Here, it is assumed that the persons 45 to 47 share the captured images acquired by each person with each other. In this case, the buttons 48c are touched on the cameras 48 and 49. As a result, the process proceeds from step S4 to step S5, and a list display 63 of the captured images captured so far is displayed in the display area 62 on the display screen 61 of the cameras 48 and 49 (FIG. 7B). ). The persons 45 and 46 select an image desired to be shared from the captured images on the list display 63. When the button display 61e is touched, a transmission image is determined and the selected image is transmitted (step S5).

  On the other hand, the smartphone 50 shifts to an image reception mode by touching the button display 71c on the display screen 37a (step S15). Thereby, the communication control unit 22b of the cameras 48 and 49 and the communication control unit 32 in the smartphone 50 establish communication with each other via the communication units 24 and 33. Thereby, the cameras 48 and 49 transmit the image selected from the captured images acquired in Step S5, and the smartphone 50 shifts to the reception mode in Step S15, and the captured images and the cameras 48, The captured image transmitted from 49 is collected. Note that the communication control unit 22b may transmit all of the non-transmitted captured images.

  FIG. 3 shows the state of this communication work. The persons 45 to 47 bring the cameras 48 and 49 close to the smartphone 50 and the captured images acquired by the cameras 48 and 49 as indicated by arrows in FIG. Is transferred to the smartphone 50. Depending on the transmission path by the communication units 24 and 33, the cameras 48 and 49 and the smartphone 50 may not need to be close to each other, or may need to be connected by wire.

  In addition, although the example of FIG. 3 shows an example in which the cameras 48 and 49 communicate with the smartphone 50 at the same time, the cameras 48 and 49 may perform image transfer individually. For example, the cameras 48 and 49 may be configured to automatically transfer an image to the smartphone 50 each time shooting is performed if the communication mode is set in advance.

  Further, it may be transmitted at the time of reproduction as well as at the time of shooting. In step S6, the control unit 31 determines whether or not the reproduction mode is instructed. When the button display 61b is operated, the playback mode is entered. In step S 7, the image selected by the user is reproduced in the area 62. When the button display 61c is operated during image reproduction, the process proceeds from step S8 to step S9, and the image being reproduced is transmitted. If there is an instruction to select the next image in step S10, the control unit 31 returns the process to step S7, and if there is no instruction to select the next image, whether or not the end of reproduction has been instructed in step S11. Determine. As described above, it is possible to transfer an image acquired by photographing at the time of imaging and reproduction.

  The control unit 31 of the smartphone 50 records the captured image from the imaging unit 20 and the captured images from the cameras 48 and 49 in the recording unit 39 (step S16). Thus, the acquired captured image is collected in the smartphone 50 during the period of the communication C1 of FIG.

  When collecting the captured images from the cameras 48 and 49, the control unit 31 of the smartphone 50 determines whether or not an instruction to shift to the edit mode is given in step S20. For example, a touch operation is performed on the display button 71d of the display screen 37a shown in FIG. The resizing unit 36 of the control unit 31 resizes the collected captured image, and the image composition unit 35 combines the resized captured images to generate a combined photograph that is one image (step S21). The combined photograph may be automatically generated by the image composition unit 35 and the resizing unit 36, or may be generated according to a user instruction while accepting a setting operation by the user.

  For example, when the control unit 31 shifts to the edit mode, the control unit 31 may display the display illustrated in FIG. FIG. 8B shows an example in which a list display 73 of collected images is displayed in an area 72 on the display screen 37a. When the user selects each captured image on the list display 73, it is possible to select a captured image to be a group photograph. When the user touches the button display 74b, the control unit 31 moves to the next screen and displays the next list display. When the user touches the button display 74c, the control unit 31 moves to the previous screen and displays the previous list display. When the user selects the button display 74d, a group photo is created based on the image selected by the user.

  FIG. 8C shows a group photo creation screen. The created group photo is displayed in the area 72 of the display screen 37a (not shown). When the user performs a touch operation on the button display 75c, the control unit 31 confirms the displayed combined photograph, and transmits the confirmed combined photograph when the button display 75d is touched (Step S22). When the user selects the button display 75b, the control unit 31 switches to another set photograph that has already been confirmed and displays it. When the user selects the button display 75a, the control section 31 discards the displayed pair photograph, The display returns to 8 (b). In this way, the user can sequentially transmit the combined photograph while confirming the combined photograph.

  In the cameras 48 and 49, the group photo is received by touching the button display 61d shown in FIG. The cameras 48 and 49 can display the received group photo. In this way, the camera 48, 49 and the smartphone 50 can display and appreciate the group photo.

  FIG. 4 shows an example of a group photo 55 to be appreciated, that is, a group photo 55 generated by the image composition unit 35 of the control unit 31. The group photo 55 includes four resized captured images 56 to 59. The captured image 56 includes an image 46 a obtained by photographing the person 46, the captured image 57 includes a dragonfly image 52 a, and the captured image 58 is an image obtained by photographing the persons 46 and 47. 46b and 47a are included, and the captured image 59 includes an image 45a obtained by photographing the person 45.

  The share SH1 in FIG. 5 is a process for generating a combined photograph based on the captured image acquired and collected by the photographing P4 of the smartphone 50 and the captured image collected by the communication C1, and the generated combined photograph is transmitted to the camera 48, 49 to send to 49. A group photo is generated by resizing a plurality of captured images, and has a relatively small data capacity. Therefore, the time required for the share SH1 is relatively short. Collected images acquired by a plurality of photographing devices are collected in a single device having a share processing function to create a combined photograph, and the created combined photograph is transmitted to a plurality of photographing devices. The number of transmissions required can be reduced as compared with the case of collecting and editing individually. Accordingly, it is possible to appreciate the captured image obtained by photographing with each photographing device in a relatively short time after photographing with each photographing device. Also, based on the information obtained from each image, the atmosphere of the place can be judged comprehensively, and since it can be seen at a time, it is possible to immediately check for missing photos.

  Further, as shown in FIG. 5, the shootings P5 to P11 performed at the small event E2 are also collected by the communication C2. The share SH2 includes a group photograph generation process and a transmission process based on the captured image collected by the communication C2, that is, the captured image captured by the small event E2. The viewing A2 can be performed in a relatively short time after the small event E2, because a group photograph accompanied by the resizing process is generated in the share SH2 and the number of communication times of the transmission process of the communication C2 and the share SH2 is small.

  Note that the image compositing unit 35 and the resizing unit 36 can automatically generate a combined photograph without requiring any work by the user. For example, the image composition unit 35 may extract a prescribed number from the captured image and automatically generate a combined photograph. In this case, for example, the button display 71d in FIG. 8A may be touched to shift to the display in FIG.

  For example, the image composition unit 35 may extract a captured image within a predetermined time range of the collected time. For example, a group photo may be generated only from captured images collected in the last 5 minutes. Alternatively, the image composition unit 35 may extract a captured image in which a captured time is within a predetermined time range. For example, a group photo may be generated only from captured images that have been taken and collected during the last 10 minutes. Furthermore, the image composition unit 35 may select a captured image based on the relationship between the time taken and the time collected. For example, the image composition unit 35 may generate a combined photograph only with images in which the difference between the captured time and the collected time is within a predetermined time range. Further, for example, the image composition unit 35 may generate a combined photograph only with captured images received and collected from other devices other than the captured images acquired by capturing with the own device.

  As described above, in the present embodiment, captured images obtained by a plurality of photographing devices in a predetermined event are collected by the image processing apparatus, and a combined photograph accompanied by resizing processing is generated using the collected captured images. Are sent back to each camera. As a result, even when the captured images acquired by a plurality of imaging devices are shared with each other, it is only necessary to perform communication with a small number of communications and a small data capacity. Comprehensive and complex appreciation and checking are possible.

  The apparatus of FIG. 1 can operate even when it does not have a function for analyzing a use scene. However, the control unit 31 of the apparatus of FIG. 1 has a function for realizing a use scene analysis 81 method as shown in FIG. It may be. That is, FIG. 13 is a flowchart showing an example of determining whether to make a group photo (step S34) by this use scene analysis. This may be executed in step S21 of FIG. Moreover, you may perform after step S16. In addition, when not creating a group photo, the example of creating an album (step S35) has been described, but the present invention is not limited to this.

  For example, the use scene analysis unit (not shown, the component may be hardware or software) of the control unit 31 sets the album period based on the user operation in step S31. The album period designates the shooting period of the captured image used for generating a group photo or creating an album. For example, settings such as using a captured image taken within a specific time can be made. The specific period may be based on the time when transmission / reception is performed as shown in FIG.

  In step S32, the use scene analysis unit determines whether or not this period is smaller than a threshold value (step S33). For example, the use scene analysis unit obtains a difference between the shooting time of the captured image taken earliest in the album period and the shooting time of the captured image taken the earliest. Or you may use the imaging time of the image image | photographed after the last communication. When this difference is smaller than a predetermined threshold, the use scene analysis unit determines that the use scene that the user wants to enjoy viewing the captured image in a relatively short time after imaging is performed, The composition unit 35 and the resizing unit 36 are instructed to generate a combined photograph. When the difference is equal to or greater than a predetermined threshold, the use scene analysis unit determines that the use scene is not used by the user for enjoying the appreciation of the captured image in a relatively short time after imaging. The image compositing unit 35 is instructed to album the captured image. In addition, the number of images may be included in the use scene analysis conditions for determining the generation of the group photo or the generation of the album. If it is too much, it will be too small if it is a group photo, and if it is too little, diversity will be lost.

  In the example of FIG. 13, the use scene is determined based on the album period and the difference between the shooting time and the collection time. However, the images automatically selected and transmitted by each device, and the user at each device The use scene may be determined based only on the difference between the shooting time and the collection time of the selected and transmitted image. Of course, it may be a group photo by designating a device, may be determined by a specific number, or may be used together with grouping at a location on the premise of a GPS-equipped camera. Also, for example, the use scene analysis unit may determine that the use scene is to generate a group photo when the difference between the start or end of the album period and the collection time is smaller than a predetermined threshold. Good. Alternatively, the use scene may be set manually, or shooting may be encouraged depending on the theme of the quiz or game, and the use scene may be set accordingly. The camera may automatically select the one that suits the theme by image judgment or the like. In this case, it is necessary for the camera to acquire a subject or the like before communication or before communication. Of course, a method may be used in which a smartphone searches and retrieves an appropriate image from the recording unit of the camera.

  In addition, although the use scene analysis unit has been described as determining use scenes, the analysis result of the use scene analysis unit 81 may be used to set a captured image to be used for a group photo or an album. In other words, here, a use scene that analyzes the use scene of how to use a photographing device suitable for creating a group photo according to the reception of a photographed image from another photographing device and the photographing time of the received photographed image. Explains that analysis methods, analysis devices, systems, and programs can be provided. The analysis may be performed in consideration of the designated time, the designated time, the contents of the images collected during the period (classification result), and the characteristics of the device with which communication was performed. For example, it is possible to analyze whether the communication partner is a specific device, and the received device side also has a photographing result and is in a specific relationship. For example, if your face is in the image sent from the other device, and there is an image of the other person's face on your device, you can use face detection technology to determine such a use scene. If the analysis condition is satisfied, a group photo may be used. Although this method is also used for graduation photos, etc., it may be considered as a use scene suitable for a group photo in a scene where it is important to complete and gather in the same image. In other words, in this case, specific use scene analysis conditions are held in advance, and images received from a plurality of devices are determined. However, in a one-to-one transmission / reception relationship, since only exchange is performed, it goes without saying that a plurality of communication partners and a large number of communication partners are more effective. A scene where communication and shooting are performed alternately may be considered as a use scene suitable for a group photo. Further, for example, a group photo may be generated when a plurality of devices can be determined based on IDs or the like and images are received from all of the imaging devices having IDs specified by use scene analysis conditions. Further, for example, it may be set as a use scene analysis condition for generating a set photograph that a predetermined number of images are received from a predetermined number or more of photographing devices. Further, for example, when a person included in an image is specified and an image including all image parts of a plurality of specific persons specified by use scene analysis conditions is collected, a group photo may be generated. .

  A plurality of images are collected by communication on one device, and this is used to create a combined photograph. However, various applications are possible for image arrangement. For example, the image of a person is displayed larger, and the person image with a blur is made smaller. Also, images without people are made smaller. Of course, if the person's face is too big, it's embarrassing, so the reverse is also possible. In addition to this, it is possible to set a variety of rules such as displaying a good-quality image as the main image, reducing the other images, increasing the first taken image, displaying in time series, etc. Game nature will be enhanced, and shooting and image sharing will be fun. Since one image is displayed, comparison and integration effects are enhanced, and image transmission can be easily performed in a short time.

  The share processing function of the image processing apparatus 10 can be realized by hardware or can be realized by software processing. For example, the share processing function can be easily realized by reading and executing an application program describing the share processing function in a digital camera, a smartphone, or the like. For example, in an event or the like, by collecting captured images taken by each person on a device having a share processing function, the images taken by each person can be easily and quickly shared by a group photo on each person's device. be able to.

(Second Embodiment)
FIG. 9 is a block diagram showing a second embodiment of the present invention. In FIG. 9, the same components as those of FIG. The present embodiment shows an example in which a smartphone 80 in which an imaging unit is omitted is adopted as an image processing apparatus, and a lens-type camera 90 is adopted as an imaging unit. FIG. 10 is an explanatory view showing the appearance of FIG. FIG. 10A shows the front side of the smartphone, and FIG. 10B shows the back side of the smartphone.

  By the way, in family trips and the like, photographing may be performed by a plurality of cameras. However, in the case of a family trip or the like, there are many cases where it is only necessary to watch after returning home, and it may not be necessary to share in a short time. In this case, it may be preferable to view the album by arranging the order of the captured images, rather than the group photo that is resized.

  FIG. 11 is an explanatory view showing a use scene in which appreciation by such an album is preferable. FIG. 11 shows a state of photographing along a time flow during a family trip by a family of four of father, mother, and children 1 and 2. Traveling events include travel, zoo, meals, and travel, and family members get together after returning home. In each event, it is shown that photographing of only the child 1, only the child 2, or both the children 1 and 2 is performed by the parents. After returning home, all the captured images taken during the trip by the father and mother are made into an album, and viewing is performed using a television receiver or the like as a monitor.

  Thus, in the case of a family trip or the like, appreciation is often performed after returning home, and appreciation may not be performed in the middle of each event. Therefore, the smartphone 80 according to the present embodiment is provided with a use scene analysis unit 81 for determining whether to generate a group photo or an album.

  In FIG. 9, photographing devices 91 and 92 have the same functions as the lens-type camera 90. The lens-type camera 90 and each of the photographing devices 91 and 92 are provided with a communication unit 24, and the smartphone 80 is provided with a communication unit 33. The lens-type camera 90 and each of the photographing devices 91 and 92 and the smartphone 80 are The communication units 24 and 33 are configured to be able to communicate with each other.

  As shown in FIGS. 10A and 10B, an attachment device 85 is detachably attached to the housing 80 a of the smartphone 80, and the attachment device 85 is for attaching the lens type camera 90. A mounting portion 86 is provided. The lens-type camera 90 is provided with a mounting portion 90a on the base end side, and the mounting portion 90a can be attached to the mounting portion 86 of the mounting device 85 by fitting or screwing.

  The lens barrel 95 of the lens-type camera 90 is provided with an optical system including a lens 96, and an optical image of a subject is incident on the image pickup device 21 via the optical system. The lens barrel 95 is provided with a focus lens that is movable to set a focus (in-focus) state by focusing, a zoom lens that changes magnification in the focus state, and the like. The lens barrel 95 also includes a mechanism (not shown) that drives these lenses and the diaphragm. The control unit 22 can drive and control the focus lens, zoom lens, diaphragm, and the like in the lens barrel 95.

  In addition, the lens-type camera 90 is provided with an operation unit 97 such as an operation ring for setting operation of parameters relating to shooting by the user, for example, parameters relating to focus, zoom, and aperture. The control unit 22 can detect a user operation on the operation unit 97 and perform control based on the detection result. Further, the control unit 22 can control each unit of the lens-type camera 90 based on a signal from the smartphone 80.

  A display screen 37 a of the display unit 37 is provided on the back surface of the housing 80 a of the smartphone 80. FIG. 10B shows a state in which a through image 88 is displayed on the display screen 37a. In addition, a touch panel 37b that functions as the operation unit 38 is disposed on the display screen 37a. The smartphone 80 can control the imaging and image communication of the lens-type camera 90 based on the operation of the touch panel 37b. Note that the smartphone 80 may incorporate an in-camera 89 that photographs the photographer.

  As the photographing devices 91 and 92, for example, as shown in the explanatory diagram of FIG. 12, a general digital camera having a wireless function can be employed. The casing 100 of the photographing devices 91 and 92 is provided with a lens barrel 101, and the photographing devices 91 and 92 capture a captured image based on the subject optical image incident on the imaging element 21 via the lens in the casing 100. get.

  The lens-type camera 90 and the communication control unit 22b of the photographing devices 91 and 92 can transmit the captured image including time information at the time of capturing the captured image. The smartphone 80 is provided with a use scene analysis unit 81. The use scene analysis unit 81 manages shooting time information for each captured image to be collected. The use scene analysis unit 81 also manages information about the collection time of the captured image collected by the communication control unit 32.

  The use scene analysis unit 81 determines whether or not a captured scene acquired by a plurality of imaging devices is a use scene that is preferably shared in a short time. When it is determined that the use scene analysis unit 81 should be shared in a short time, a combined photograph is generated using the collected captured images and transmitted to each photographing device, and it is determined that it is not necessary to share in a short time In this case, the image composition unit 35 and the resizing unit 36 may be controlled so that the collected captured images are made into an album.

  FIG. 13 is a flowchart showing an example of an analysis method of the use scene analysis unit 81.

  In step S31, the use scene analysis unit 81 sets an album period based on a user operation. The album period designates the shooting period of the captured image used for generating a group photo or creating an album. For example, it is possible to use settings such as using captured images taken from 12:00 to 12:05.

  In step S32, the use scene analysis unit 81 obtains the difference between the shooting time and the collection time for the captured images in the album period, and determines whether this difference is smaller than the threshold (step S33). For example, the use scene analysis unit 81 obtains the difference between the shooting time of the captured image captured earliest in the album period and the shooting time of the captured image acquired the earliest. When this difference is smaller than a predetermined threshold, the use scene analysis unit 81 determines that the use scene is considered to be a use scene that the user wants to enjoy watching the captured image in a relatively short time after the imaging, It instructs the image composition unit 35 and the resizing unit 36 to generate a combined photograph. If the difference is equal to or greater than a predetermined threshold, the use scene analysis unit 81 determines that the use scene is not used by the user for enjoying the appreciation of the captured image in a relatively short time after the image capturing. Then, the image compositing unit 35 is instructed to album the captured image.

  In the example of FIG. 13, the use scene is determined based on the album period and the difference between the shooting time and the collection time. However, the use scene may be determined based only on the difference between the shooting time and the collection time. Good. Of course, it may be a group photo by designating a device, may be determined by a specific number, or may be used together with grouping at a location on the premise of a GPS-equipped camera. In addition, for example, the use scene analysis unit 81 determines that it is a use scene for which a group photo should be generated when the difference between the start or end of the album period and the collection time is smaller than a predetermined threshold. Also good. Alternatively, the use scene may be set manually, or shooting may be encouraged depending on the theme of the quiz or game, and the use scene may be set accordingly.

  In addition, although the use scene analysis unit 81 has been described as determining use scenes, a captured image used for a group photo or an album may be set using the analysis result of the use scene analysis unit 81. In other words, here, a use scene that analyzes the use scene of how to use a photographing device suitable for creating a group photo according to the reception of a photographed image from another photographing device and the photographing time of the received photographed image. Explains analysis methods, analysis devices, systems, and programs. The analysis may be performed in consideration of the designated time, the designated time, the contents of the images collected during the period (classification result), and the characteristics of the device with which communication was performed. For example, it is possible to analyze whether the communication partner is a specific device, and the received device side also has a photographing result and is in a specific relationship. For example, if your face is in the image sent from the partner device and your partner device has an image of the partner's face, it can be determined using face detection technology. If it satisfies, you may make a group photo. However, in a one-to-one transmission / reception relationship, since only exchange is performed, it goes without saying that a plurality of communication partners and a large number of communication partners are more effective.

  Moreover, although this method is also used for graduation photos, etc., it may be considered a use scene suitable for a group photo in a scene where it is important to complete and gather in the same image. That is, in this case, specific use scene analysis conditions are held in advance, and received images from a plurality of devices are determined. However, in a one-to-one transmission / reception relationship, since only exchange is performed, it goes without saying that a plurality of communication partners and a large number of communication partners are more effective. A scene where communication and shooting are performed alternately may be considered as a use scene suitable for a group photo.

  For example, the use scene analysis unit 81 may use an image that is a captured image during the album period and that has a difference between the shooting time and the collection time that is smaller than a predetermined threshold as a combined photo. Further, for example, the use scene analysis unit 81 may use an image in which the difference between the start time or end time of the album period and the collection time of the collected captured images is smaller than a predetermined threshold value for the combined photograph.

  Next, the operation of the embodiment configured as described above will be described with reference to FIGS. FIG. 14 is a flowchart for explaining camera control in the lens-type camera 90 and control of the smartphone 80. In FIG. 14, an arrow connecting the camera control flow of the lens-type camera 90 and the control flow of the smartphone 80 indicates that communication is performed by processing. FIG. 15 is an explanatory diagram illustrating a screen display example according to the second embodiment.

  In step S41, the control unit 22 of the lens type camera 90 determines whether or not the power is turned on. When the power is turned on, the control unit 22 enters a communication standby state (step S42), and acquires a through image (step S43). That is, the control unit 22 drives the image sensor 21 to image the subject. A captured image obtained by the image sensor 21 is captured by the control unit 22 to obtain a through image.

  On the other hand, the control part 31 of the smart phone 80 sets an initial screen in step S51. FIGS. 15A and 15D show the initial screen displayed on the display screen 37 a of the display unit 37. On the display screen 37a of the smartphone 60, as an initial screen, a menu screen including a share button 111, a camera screen button 112, a mail button 113, and a telephone button 114 for setting share, camera screen, mail, or telephone mode, respectively. It is displayed. Note that the buttons 111 to 114 in FIGS. 15A and 15D indicate the mode currently selected by a thick frame.

  The control unit 31 determines whether or not the camera screen mode is set by the user (step S52). When the camera screen mode is set, the control unit 31 performs through image communication control in the next step S53. That is, the control unit 31 establishes communication with the communication unit 24 of the lens-type camera 90 via the communication unit 33 and makes a transmission request for a through image.

  When communication is established with the smartphone 80 in step S44, the control unit 22 of the lens-type camera 90 transmits a through image in step S45. The control unit 31 of the smartphone 60 receives the transmitted through image and displays it on the display unit 37 (step S54).

  In the state of FIG. 15A, the camera screen mode is selected, and as shown in FIG. 15B, a through image 118 captured by the lens camera 90 is displayed at the center of the display screen 37a. In addition, the control unit 31 displays button display of the return button 115, the reception button 116, and the photographing button 117 on the display screen 37a. When the return button 116 is touched by the user, the control unit 31 performs processing to return the mode to the previous mode. When the reception button 116 is touched, the control unit 31 shifts to the reception mode, and the shooting button 117 is pressed. When a touch operation is performed, the shooting mode is entered.

  The control unit 31 determines whether or not a shooting operation has been performed in step S55, and when the shooting button 117 is touched, the process proceeds to step S56 to instruct shooting. The lens-type camera 90 determines whether or not there is a photographing operation in step S46, and when a photographing instruction is received, the photographing result is transmitted in step S47. The captured image from the lens-type camera 90 is given to the control unit 31 via the communication units 24 and 33, and the control unit 31 gives the captured image to the recording unit 39 for recording (step S56).

  In the present embodiment, the lens-type camera 90 transmits shooting time information together with the captured image, and the control unit 31 of the smartphone 80 records the shooting time information in association with the recorded captured image. Furthermore, the control unit 31 records the time when the captured image is received by the communication unit 33 in association with the captured image to be recorded.

  In the photographing devices 91 and 92, captured images are acquired in accordance with the operations of the users who operate the photographing devices 91 and 92. In the present embodiment, shooting time information is also added to captured images acquired by the shooting devices 91 and 92. Each user who operates the photographing devices 91 and 92 can transmit a captured image acquired by photographing to the smartphone 80 via the communication unit 24 of the photographing devices 91 and 92.

  Now, it is assumed that captured images are transmitted from the photographing devices 91 and 92 to the smartphone 80. The control unit 31 of the smartphone 80 determines whether or not a reception mode is designated in step S57. When the user touches the reception button 116 in FIG. 15B, the control unit 31 shifts to the reception mode, receives the captured images from the photographing devices 91 and 92, and records them in the recording unit 39 (step S58). . Also in this case, the control unit 31 records information on the shooting time and the collection time in association with the captured image. Further, in this case, the control unit 31 controls the display control unit 34 to display the displays 119 and 120 indicating that data is being received on the display screen 37a.

  Further, the control unit 31 does not shift to the reception mode by a user operation, but automatically receives and records the transmitted image when the image is transmitted from a preset device. You may make it do.

  Here, as shown by a thick frame in FIG. 15D, it is assumed that the user touches the share button 111 for designating the share mode on the initial screen. The control unit 31 determines whether or not the share mode is designated in step S61, and displays the share screen by operating the share button 111 (step S62).

  FIG. 15E shows a display example of the share screen. The control unit 31 displays a return button 115, an album period setting button 121, and a share start button 122 as a share screen. When the return button 115 is touch-operated, the control unit 31 returns the processing to the previous mode. When the setting button 121 is touch-operated, the control unit 31 shifts to a display screen such as a keyboard (not shown) and sets the album period. And return to the share screen after setting the album period. In addition, when the share start button 122 is touched, the control unit 31 starts processing for sharing.

  In the example of FIG. 15E, the album period is set from the previous time to the current time by the time (minutes) specified by the user. When the album period is set in step S63, the control unit 31 shifts the process to step S64 to display an image selection screen to share.

  For example, the control unit 31 may display a list of captured images taken during the album period and allow the user to select an image to share. Moreover, the control part 31 may select the captured image to share according to the preset rule. For example, the control unit 31 may select only a predetermined number from the latest captured image.

  Next, in step S65, the control unit 31 determines whether or not the difference between the shooting time and the collection time is less than 1 hour. For example, the control unit 31 determines whether or not the difference between the shooting time of the image captured earliest in the album period and the collection time of the image collected earliest is less than one hour. If it is less than one hour, the control unit 31 determines that the user wants to share and view the image in a short time after shooting, and generates a group photo in step S66. On the other hand, if it is longer than one hour, the control unit 31 determines that the user wants to share and view the image slowly later, and generates an album in step S67.

  13 and 14 show an example in which the use scene is analyzed by the use scene analysis unit 81 and it is automatically determined whether to generate a set photograph or an album. Or generating an album may be determined.

  When the control unit 31 generates the group photo, the control unit 31 displays a confirmation screen for confirming the generated group photo. FIG. 15F shows this confirmation screen, and the generated combined photograph 124 is displayed on the display screen 37a. Further, a return button 115 and a transmission button 123 are displayed on the display screen 37a. When the return button 115 is touch-operated, the control unit 31 returns the process to the previous mode and displays the share screen again. In addition, when the transmission button 123 is touched, the control unit 31 transmits the generated combined photograph (step S68). In this case, the control unit 31 controls the display control unit 34 to display the displays 125 and 126 indicating that transmission is in progress on the display screen 37a.

  As described above, according to the present embodiment, the same effects as those of the first embodiment can be obtained, and the group photo and the album can be automatically selected according to the use scene, for example, according to the use scene. Share is possible.

  Furthermore, in each embodiment of the present invention, a digital camera has been described as an apparatus for photographing. However, the camera may be a lens type camera, a digital single-lens reflex camera, or a compact digital camera, a video camera, A camera for moving images such as a movie camera may be used, and a camera built in a personal digital assistant (PDA) such as a mobile phone or a smartphone may of course be used. In addition, it may be an industrial or medical optical device such as an endoscope or a microscope, such as a surveillance camera, an on-vehicle camera, a stationary camera, for example, a camera attached to a television receiver or a personal computer. There may be. Of course, it can be used for observation devices and inspection devices that observe various things from various angles. The obtained image can be comprehensively viewed, observed, and inspected, and there is an advantage that an excess or deficiency of the image can be immediately determined. For scenes where it is important to complete and gather together within the same image, it is considered a use scene suitable for group photography, and specific use scene analysis conditions are stored in advance, and images received from multiple devices are judged. If a group is detected, it may be determined that the use scene is suitable for the group photo, or a scene in which communication and shooting are alternately performed may be determined as the use scene suitable for the group photo. Shooting may be encouraged according to a specific theme, and a use scene may be determined based on whether or not the image satisfies a use scene analysis condition corresponding thereto.

  A plurality of images are collected by communication with a specific device, and this is used to create a combined photograph. However, various applications are possible for image arrangement. For example, the image of a person is displayed larger, and the person image with a blur is made smaller. Also, images without people are made smaller. Of course, if the person's face is too big, it's embarrassing, so the reverse is also possible. An image that stands out in the middle, evaluated using posture, eyes, and facial expressions, may be a good photo. In addition to this, it is possible to set a variety of rules such as displaying a good-quality image as the main image, reducing the other images, increasing the first taken image, displaying in time series, etc. Game nature will be enhanced, and shooting and image sharing will be fun. Since one image is displayed, comparison and integration effects are enhanced, and image transmission can be easily performed in a short time.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  It should be noted that even if the operation flow in the claims, the description, and the drawings is described using “first,” “next,” etc. for convenience, it is essential to carry out in this order. It doesn't mean. In addition, it goes without saying that the steps constituting these operation flows can be omitted as appropriate for portions that do not affect the essence of the invention.

  Of the technologies described here, many of the controls and functions mainly described in the flowcharts can be set by a program, and the above-described controls and functions can be realized by a computer reading and executing the program. it can. As a computer program product, the program may be recorded or stored in whole or in part on a portable medium such as a non-volatile memory such as a flexible disk or a CD-ROM, or a storage medium such as a hard disk or a volatile memory. It can be distributed or provided at the time of product shipment or via a portable medium or communication line. The user can easily realize the image processing apparatus according to the present embodiment by downloading the program via a communication network and installing the program on a computer, or installing the program from a recording medium on the computer.

    DESCRIPTION OF SYMBOLS 10 ... Image processing apparatus, 20 ... Imaging part, 21 ... Imaging element, 22 ... Control part, 23 ... Clock part, 24 ... Communication part, 31 ... Control part, 33 ... Communication part, 35 ... Image composition part, 36 ... Resizing , 37 ... display section, 38 ... operation section, 39 ... recording section, 40 ... clock section.

Claims (12)

A receiving unit that collects a plurality of captured images including captured images from at least one counterpart device;
A use scene analysis unit that determines use scenes based on use scene analysis conditions;
According to the use scene determination result, a combined photograph based on a plurality of captured images collected by the receiving unit or an album based on a plurality of captured images collected by the receiving unit is generated, and the generated combined photograph or album An image processing apparatus comprising: a control unit that transmits a message to the at least one counterpart device. The use scene analysis unit includes at least one of information on a shooting time included in a captured image collected by the reception unit, information on a collection time collected by the reception unit, and information on an album period set by the user. The image processing apparatus according to claim 1, wherein the use scene is analyzed based on the image. The above use scene analysis department
When the time difference between the shooting time and the collection time is shorter than a predetermined threshold, a set photo is generated, and when the time difference is equal to or larger than the predetermined threshold, a determination result for generating an album is obtained. The image processing apparatus according to claim 2. The above use scene analysis department
The image processing apparatus according to claim 1, wherein a use scene is determined based on an image collection state based on the captured image. The above use scene analysis department
The image processing apparatus according to claim 1, wherein when the captured images are collected from all of the counterpart devices specified by the use scene analysis condition, a determination result for generating the combined photograph is obtained. The above use scene analysis department
The image processing apparatus according to claim 1, wherein a determination result for generating the group photograph is obtained when all the captured images including an image portion of a person designated by the use scene analysis condition are collected. The above use scene analysis department
The image processing apparatus according to claim 1, wherein when the captured images are received from a predetermined number or more of the counterpart devices within a predetermined time, it is determined as a use scene for generating the group photograph. The above use scene analysis department
The image processing apparatus according to claim 1, wherein the image processing apparatus prompts photographing according to a specific theme and determines a use scene based on whether or not the captured image satisfies a condition corresponding to the subject. Collecting a plurality of captured images including captured images from at least one counterpart device;
Judgment of use scene based on use scene analysis conditions,
Depending on the determination result of the use scene, a combined photograph based on the collected multiple captured images or an album based on the collected multiple captured images is generated, and the generated combined photograph or album is used as the at least one partner. Send to device,
An image processing method. On the computer,
Collecting a plurality of captured images including captured images from at least one counterpart device;
Judgment of use scene based on use scene analysis conditions,
Depending on the determination result of the use scene, a combined photograph based on the collected multiple captured images or an album based on the collected multiple captured images is generated, and the generated combined photograph or album is used as the at least one partner. Send to device,
An image processing program for executing steps. A use scene analysis unit that analyzes a use scene according to a shooting time and a reception time of a shot image received from another shooting device;
When image sharing by a group photo is instructed by the analysis result of the use scene, a control unit that generates a group photo based on the received captured image;
An image transmission apparatus comprising: a communication unit configured to transmit the group photograph generated by the control unit to the other photographing device. A use scene analysis method in an apparatus that collects captured images from a plurality of photographing devices and performs image sharing by a group photo or other than a group photo,
A use scene analysis method, wherein a use scene suitable for image sharing by the group photograph is determined according to a shooting time and a reception time of a shot image received from the plurality of shooting devices.