JP2009267663A - Imaging device, imaging method, imaging control program, and mobile terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To capture a desired still image by remote controlling a first cellular phone 21 by a second cellular phone 22 while viewing an object being captured by the first cellular phone 21 on the second cellular phone 22. <P>SOLUTION: A short-range wireless communication network 23 is formed between the first cellular phone 21 and the second cellular phone 22. The first cellular phone 21 transmits a still image which is a camera-through image that is currently captured by the first cellular phone 21 to the second cellular phone 22, and then the second cellular phone 22 displays the camera-through image on its display part to allow a user of the second cellular phone 22 to check the still image that is currently captured by the first cellular phone 21. Then, the second cellular phone 22 transmits a shutter command to the first cellular phone 21 at a desired timing, and receives and stores the still image captured and transmitted by the first cellular phone 21. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention has a camera function and a short-range wireless communication function, for example, a mobile phone, a PHS phone (PHS: Personal Handyphone System), a PDA device (PDA: Personal Digital Assistant), a portable game machine, a digital camera device, a digital The present invention relates to an imaging device, an imaging method, an imaging control program, and a mobile terminal device that are suitable for application to a mobile device such as a video camera device, and particularly when a subject is imaged by remotely operating one mobile device with the other mobile device. In particular, the present invention relates to an imaging apparatus, an imaging method, an imaging control program, and a portable terminal device that enable confirmation of a subject currently being imaged by one portable device on the other portable device side.

  Conventionally, a group photograph or the like is picked up by a camera device using a so-called self-timer function, which is picked up after a predetermined time has elapsed from the time when the shutter button is pressed, or a remote control device attached to the camera device. Is operated at a desired timing, and the camera apparatus is remotely operated to perform the imaging.

  Here, many portable terminal devices that are widely used today are provided with a camera function. For this reason, several techniques that enable remote control of the camera function provided in the portable terminal device have been proposed.

  For example, in the case of a mobile phone terminal disclosed in Japanese Patent Application Laid-Open Publication No. 2007-195200 (Patent Document 1), when shooting is performed with the camera module of the mobile phone terminal, the mobile phone terminal of another user is used. Then, a call is made to the mobile phone terminal that performs the shooting. When the CPU of the mobile phone terminal that performs shooting detects an incoming call from another user's mobile phone terminal, the CPU controls shooting of the camera module using this incoming call as a trigger. Thereby, it is possible to perform photographing by remotely operating the camera module by remote operation from the mobile phone terminal of another user.

JP 2007-195200 A (pages 5 to 6, FIGS. 1 and 3)

  However, when imaging is performed by remotely operating the camera function including the mobile phone terminal disclosed in Patent Document 1, the subject is located in the imaging region or the background of the subject is changed. There is a problem that it is difficult to recognize the captured image itself (= remote control from a location away from the mobile terminal device, so the subject, background, etc. There is a problem that the state cannot be recognized.)

  The present invention has been made in view of the above-described problems. When a subject is imaged by remote operation, the subject to be imaged can be confirmed in advance by the user performing the remote operation. An object is to provide an imaging device, an imaging method, an imaging control program, and a portable terminal device.

In order to solve the above-described problem, an imaging apparatus according to the present invention provides
An imaging unit for imaging a subject;
A near field communication unit that performs near field communication;
An imaging control unit that controls imaging of the imaging unit in response to a remote operation command for remotely operating the imaging unit received from a device that remotely operates the imaging unit via the short-range wireless communication unit; ,
The current captured images that are continuously captured by the imaging unit are sequentially short-range wirelessly transmitted to the device that remotely operates the imaging unit via the short-range wireless communication unit, and When a shutter command is received from a device that remotely operates the imaging unit, the captured image obtained by the imaging control unit performing imaging control of the imaging unit is transmitted via the short-range wireless communication unit. A captured image transmission unit that performs near-field wireless transmission to a device that remotely operates the imaging unit.

Moreover, in order to solve the above-mentioned subject, the imaging device concerning the present invention is
A near field communication unit that performs near field communication;
A remote operation command transmission unit that transmits a remote operation command for remotely operating the imaging unit to the device having the imaging unit to be remotely operated via the short-range wireless communication unit;
A display control unit for displaying on the display unit a current captured image that is sequentially captured by the imaging unit sequentially received from the device having the imaging unit to be remotely operated via the short-range wireless communication unit; ,
A storage control unit that stores a captured image transmitted in a short-distance wireless transmission from a device having the imaging unit that is remotely operated by transmitting the shutter command via the remote-operation command transmission unit in a short-distance wireless transmission; .

Moreover, in order to solve the above-described problems, an imaging method according to the present invention provides
In response to a remote operation command for remotely operating the imaging unit received from a device on the remote control side of the imaging unit that performs imaging of the subject, the imaging control unit performs the imaging unit Imaging control step,
The captured image transmission unit sequentially transmits the current captured image continuously captured by the imaging unit to the device that remotely operates the imaging unit via the short-range wireless communication unit. A distance wireless transmission step;
When the captured image transmission unit receives a shutter command from a device that remotely operates the imaging unit, the captured image obtained by performing imaging control of the imaging unit by the imaging control unit is transmitted to the short-range wireless communication. And short-range wireless transmission to a device that remotely operates the imaging unit via the unit.

Moreover, in order to solve the above-described problems, an imaging method according to the present invention provides
A remote operation command transmission unit, for a device having an imaging unit to be remotely operated, transmitting a remote operation command for remotely operating the imaging unit via a short-range wireless communication unit;
The display control unit displays the current captured image continuously captured by the imaging unit sequentially received from the device having the imaging unit that is remotely operated via the short-range wireless communication unit on the display unit. And steps to
A step in which the storage control unit stores a captured image transmitted in a short-distance wireless transmission from a device having the imaging unit to be remotely operated in the storage unit by transmitting a shutter command via the remote-operation command transmission unit in a short-distance wireless transmission; And have.

Moreover, in order to solve the above-described problem, an imaging control program according to the present invention provides
Imaging that controls imaging of the imaging unit in response to a remote operation command for remotely operating the imaging unit received from a device that remotely controls the imaging unit that performs imaging of a subject via a short-range wireless communication unit Let the computer function as a control unit,
While controlling the short-range wireless communication unit so as to sequentially transmit short-distance wireless transmission of current captured images continuously captured by the imaging unit to a device that remotely operates the imaging unit. When a shutter command is received from a device that remotely operates the imaging unit, a captured image obtained from the imaging unit by causing a computer to function as the imaging control unit is transmitted via the short-range wireless communication unit. Then, the computer is caused to function as a captured image transmission unit that controls the short-range wireless communication unit so as to perform short-range wireless transmission to a device that remotely operates the imaging unit.

Moreover, in order to solve the above-described problem, an imaging control program according to the present invention provides
A computer is caused to function as a remote operation command transmission unit that controls a short-range wireless communication unit so that a remote operation command for remotely operating the imaging unit is transmitted to a device having a remote-controlled imaging unit by short-range wireless transmission. ,
As a display control unit that displays on the display unit current captured images that are sequentially captured by the imaging unit sequentially received from the device having the imaging unit that is remotely operated via the short-range wireless communication unit Make the computer work,
When a computer is caused to function as the remote operation command transmission unit, a short distance wireless transmission of a shutter command to the device having the imaging unit to be remotely operated allows a short distance from the device having the remote operation imaging unit. The computer is caused to function as a storage control unit that stores captured images that are wirelessly transmitted in the storage unit.

Moreover, in order to solve the above-mentioned problem, the mobile terminal device according to the present invention
An imaging unit for imaging a subject;
A near field communication unit that performs near field communication;
An imaging control unit that controls imaging of the imaging unit in response to a remote operation command for remotely operating the imaging unit received from a device that remotely operates the imaging unit via the short-range wireless communication unit; ,
The current captured images that are continuously captured by the imaging unit are sequentially short-range wirelessly transmitted to the device that remotely operates the imaging unit via the short-range wireless communication unit, and When a shutter command is received from a device that remotely operates the imaging unit, the captured image obtained by the imaging control unit performing imaging control of the imaging unit is transmitted via the short-range wireless communication unit. A captured image transmission unit that performs near-field wireless transmission to a device that remotely operates the imaging unit.

Moreover, the portable terminal device according to the present invention is a means for solving the above-described problems.
A near field communication unit that performs near field communication;
A remote operation command transmission unit that transmits a remote operation command for remotely operating the imaging unit to the device having the imaging unit to be remotely operated via the short-range wireless communication unit;
A display control unit for displaying on the display unit a current captured image that is sequentially captured by the imaging unit sequentially received from the device having the imaging unit to be remotely operated via the short-range wireless communication unit; ,
A storage control unit that stores a captured image transmitted in a short-distance wireless transmission from a device having the imaging unit that is remotely operated by transmitting the shutter command via the remote-operation command transmission unit in a short-distance wireless transmission; .

  In the present invention as described above, the current captured image continuously captured by the imaging unit is sequentially short-distance to the device on the side remotely controlling the imaging unit via the short-range wireless communication unit. By wirelessly transmitting, it is possible to confirm the captured image currently captured by the device that is remotely operated in the device that remotely operates the imaging unit.

  Further, the present invention provides a display unit with a current captured image continuously received by the imaging unit, which is sequentially received from a device having the imaging unit that is remotely operated via the short-range wireless communication unit. By displaying, it is possible to confirm the captured image currently captured by the device that is remotely operated in the device that remotely operates the imaging unit.

  According to the present invention, when a subject is imaged by remote operation, the subject to be imaged in advance can be confirmed on the device side that performs the remote operation.

  The present invention can be applied to a mobile phone having a camera function and a short-range wireless communication function.

[Configuration of mobile phone]
First, FIG. 1 shows a block diagram of a mobile phone according to this embodiment. As shown in FIG. 1, the mobile phone of this embodiment includes an antenna 1 that performs wireless communication such as voice call, videophone call, e-mail, and Web data (Web: World Wide Web) with a base station. And the communication circuit 2, the speaker unit 3 for outputting the received voice, the microphone unit 4 for collecting the transmitted voice and the like, and the camera through transmitted from the other mobile phone described later by short-range wireless transmission. And an operation menu for operating the camera unit of the other mobile phone, and a display unit 5 for displaying a desired still image, moving image, e-mail, or the like.

  In addition, the mobile phone includes an operation unit 6 provided with various operation keys such as a cross key, a determination key, and a numeric key, a light emitting unit 7 (LED) for notifying a user of incoming / outgoing calls, and the like, A camera unit 8 for capturing a still image or a moving image of the subject, a vibration unit 9 for notifying the user of incoming / outgoing calls by vibrating the casing of the mobile phone, and a timer 10 for counting time have.

  In addition, this mobile phone is close to a mobile phone existing around the mobile phone, such as an ad hoc network using a wireless local area network (LAN) or a Bluetooth (registered trademark) network. A short-range wireless communication antenna 11 and a short-range wireless communication unit 12 for performing short-range wireless communication by forming a distance wireless communication network, a communication program for performing wireless communication processing via the base station, and the short-range In addition to a short-range wireless communication control program for performing short-range wireless communication processing by the wireless communication unit 12 and various application programs, a memory 13 in which various data handled by these application programs are stored, and the entire mobile phone And a control unit 14 for controlling the operation of That.

  In the memory 13, in addition to the communication program and the short-range wireless communication control program, a camera control program for performing imaging control of the camera unit 8, and a camera image (still image) transmitted from another mobile phone (to be described later) by short-range wireless transmission A face recognition processing program for performing face recognition processing to detect the same user as the user registered in the phone book, and an e-mail management program for controlling creation and transmission / reception of e-mails. Has been.

  Further, the memory 13 is disclosed on a schedule book management program for managing a schedule book in which a user's schedule is registered, and on a server device provided on a predetermined network such as a communication network or the Internet. A web browsing program for browsing web pages, a phone book management program for managing phone books, a music player program for playing music data, and the like are stored.

In addition, the memory 13 stores a schedule book in which a user's desired schedule is registered, a user name such as a user's acquaintance or friend, a still image (face photo, etc.), an address, a telephone number, an e-mail address, a date of birth. Phone information in which user information is registered, music data reproduced based on the music player program, still image data and moving image data reproduced based on the viewer function of the camera control program, and transmitted / received electronic data Mail contents, telephone and e-mail call history are stored.

[Remote control of camera unit]
[Overview of remote operation]
As shown in FIG. 2, the mobile phone according to this embodiment is configured so that a mobile phone 21 that images a subject is connected to another short-range wireless communication network 23 from another mobile phone 22 (= a mobile phone that performs remote operation). By remotely operating the mobile phone 21, it is possible to capture a desired subject with the mobile phone 21 while confirming the current captured image taken with the mobile phone 21 with another mobile phone 22.

  Specifically, the cellular phone 21 on the side that captures the subject captures the currently captured camera image (a still image acquired approximately continuously from the imaging unit such as a CCD image sensor or a CMOS sensor at predetermined intervals. = Still image before being stored in the memory 13 = camera through image) is transmitted to the other mobile phone 22 via the short-range wireless communication network 23 by short-range wireless transmission.

  The other mobile phone 22 displays the camera through image transmitted from the mobile phone 21 via the short-range wireless communication network 23 on the display unit. The user of another mobile phone 22 views the camera-through image from the mobile phone 21 on the side that captures the subject displayed on the display unit, so that the state of the subject currently captured by the mobile phone 21 can be determined. recognize. Then, a short-distance wireless transmission operation of a shutter command instructing imaging is performed at a desired timing.

  When the cellular phone 21 on the subject imaging side receives a shutter command instructing imaging from the other cellular phone 22, it stores the still image captured by the camera unit 8 at this timing in the memory 13. In addition, the mobile phone 21 transmits a still image captured by the camera unit 8 to other mobile phones 22 via the short-range wireless communication network 23 in a short-range wireless manner. The other mobile phone 22 displays the still image from the mobile phone 21 transmitted by short-range wireless transmission on the display unit (and stores it in the memory).

As a result, the camera unit of the mobile phone 21 that captures the subject while checking the current captured image (camera through image) captured by the mobile phone 21 that captures the subject on the other mobile phone 22 side. 8 can be remotely operated to image a desired subject.

[Operation of the mobile phone on the side that captures the subject during remote operation]
The flowchart of FIG. 3 shows the flow of the operation of the mobile phone 21 on the side that images the subject during such remote operation. In the case of the mobile phone according to the embodiment, when the camera unit 8 is activated, the “remote operation mode” in which the camera unit 8 is remotely operated to perform imaging, or the camera unit 8 is operated by himself to perform imaging. One of the “normal imaging modes” to be performed is selected and operated. When the control unit 24 of the mobile phone 21 detects that the “remote operation mode” has been selected by the user, the control unit 24 starts the processing shown in the flowchart of FIG. 3 based on the camera control program stored in the memory 13. To do.

  In step S1, the control unit 14 forms a short-range wireless communication network 23 such as an ad hoc network using the wireless LAN with a surrounding mobile phone (another mobile phone 22) as described with reference to FIG. As described above, the short-range wireless communication unit 12 is controlled based on the short-range wireless communication control program stored in the memory 13, and the process proceeds to step S2.

  When this short-range wireless communication network 23 is formed, the user of another mobile phone 22 performs a short-range wireless transmission operation of a camera function activation instruction command to the mobile phone 21 on the side that images the subject. In step S2, the control unit 14 of the cellular phone 21 monitors whether or not a camera function activation instruction command has been received from the other cellular phone 22, and performs processing at the timing at which reception of the camera function activation instruction command is detected. In step S3, the camera unit 8 is controlled to be activated.

  Next, in step S4, the control unit 14 of the mobile phone 21 acquires a camera through image captured by the camera unit 8 (a still image acquired approximately continuously from the imaging unit every predetermined time). At the same time, a predetermined frame rate reduction process is performed on the camera-through image. For example, if the original frame rate of the camera-through image is 30 fps, the control unit 14 reduces the frame rate to 10 fps, and advances the process to step S5. Thereby, as will be described later, it is possible to reduce the transmission data amount of the camera through image transmitted to the other mobile phone 22.

  In this example, such a frame rate reduction process is performed. However, a camera-through image may be transmitted to another mobile phone 22 with the same amount of data without performing the reduction process. In addition, the control unit 14 may form difference information indicating a difference between the camera through image of the previous frame and the camera through image of the current frame, and transmit this difference information to the other mobile phone 22. In this case, the transmission data amount can be further reduced.

  Next, the control part 14 forms remote operation command information in step S5. This remote operation command information is, for example, information indicating an operation menu of the camera unit 8 assigned to each operation key of the operation unit 6. For example, an operation of releasing the shutter of the camera unit 8 is a pressing of the determination key of the operation unit 6. The zoom-up operation of the camera unit 8 is assigned to the operation of pressing the up key of the cross key of the operation unit 6, and the zoom-down operation of the camera unit 8 is assigned to the operation of the cross key of the operation unit 6. This is information such as that assigned to the pressing operation of the down key.

  Such information indicating the operation menu of the camera unit 8 is displayed on the display unit 5 by an icon, a character, or the like together with the camera through image currently being captured. For this reason, the display screen of the display unit 5 may be acquired and used as the remote operation command information.

  In step S5, the control unit 14 sends such remote operation command information to the other through the short-range wireless communication network 23 shown in FIG. 2 together with the camera through image subjected to the frame rate reduction processing as described above. Short-distance wireless transmission is performed to the mobile phone 22.

  As will be described later, on the other mobile phone 22 side, the camera through image and the remote operation command information are displayed on the display unit. The user on the other mobile phone 22 side operates the mobile phone 22 based on the remote operation command information displayed on the display unit together with the camera through image. For example, when a user on the other mobile phone 22 presses the upper key of the cross key of the mobile phone 22, a remote operation command for instructing a zoom-up operation is transmitted to the mobile phone 21 side. The control unit 14 of the control unit 21 controls the camera unit 8 so as to zoom up, and transmits the camera through image captured by the zoom up to another mobile phone 22. Similarly, for example, when a user on another mobile phone 22 presses the down key of the cross key of the mobile phone 22, a remote operation command for instructing a zoom-down operation is transmitted to the mobile phone 21 side. Then, the control unit 14 of the mobile phone 21 controls the camera unit 8 so as to perform zoom-down, and transmits a camera through image captured by the zoom-down to another mobile phone 22.

  The user of the other mobile phone 22 views the camera-through image displayed on the display unit of the other mobile phone 22 while remotely operating the mobile phone 21 in this way, so that the current image is taken on the mobile phone 21 side. Check the subject. Then, at a desired timing, a determination key provided on the operation unit of another mobile phone 22 is pressed. In the case of this example, when the enter key is pressed, the other mobile phone 22 issues a remote operation command (shutter command) for instructing the camera unit 8 of the mobile phone 21 to release the shutter. Short-distance wireless transmission is performed to the mobile phone 21 side.

  In step S <b> 6 of the flowchart of FIG. 3, the control unit 14 of the mobile phone 21 determines whether or not the shutter command has been received from another mobile phone 22. Until the shutter command is received, the processes in steps S4 and S5 are repeatedly executed, and the process proceeds to step S7 when the shutter command is received.

  In step S <b> 7, the control unit 14 of the mobile phone 21 stores the still image captured by the camera unit 8 in the memory 13 at the timing when the shutter command is received. In step S8, the control unit 14 of the mobile phone 21 wirelessly transmits a still image captured by the camera unit 8 to the other mobile phone 22 at a timing when the shutter command is received. All the processes shown in the flowchart of FIG.

In this example, the still image picked up by the camera unit 8 is stored in the memory 13 at the timing when the shutter command is received. In addition to transmitting a still image captured by the camera unit 8 to the telephone set 22, a message asking whether or not to save such as “Do you want to save this image?” Is transmitted from the other mobile phone 22. When a remote operation command instructing storage is received, the still image captured by the camera unit 8 on the mobile phone 21 side may be stored in the memory 13.

[Operation of other mobile phones during remote operation]
Next, the flow chart of FIG. 4 shows the flow of operations of another mobile phone 22 (the mobile phone on the remote control side of the mobile phone 21 that images the subject) during such remote control. When the control unit 14 of another mobile phone 22 receives the short-range wireless communication request signal from the short-range wireless communication unit 12 of the mobile phone 21, the “remote operation mode” is performed based on the camera control program stored in the memory 13. The process shown in the flowchart of FIG. 4 is started.

  In step S11, the control unit 14 of the other mobile phone 22 communicates with the mobile phone 21 that captures the subject as described with reference to FIG. 2, and the short-range wireless communication network 23 such as the ad hoc network using the wireless LAN described above. The short-range wireless communication unit is controlled based on the short-range wireless communication control program stored in the memory 13 so that the process proceeds to step S12.

  In step S12, the control unit 14 of the other mobile phone 22 controls the display unit 5 to display the above camera-through image and remote operation command information transmitted from the mobile phone 21, and the process proceeds to step S13. The user of the other mobile phone 22 remotely operates the mobile phone 21 based on the remote operation command information displayed on the display unit 5 and is currently captured on the mobile phone 21 side based on the camera-through image. The subject is recognized and a shutter command transmission operation is performed at a desired timing. In step S13, the control unit 14 of another mobile phone 22 determines whether or not this shutter command has been transmitted by short-range wireless transmission, and the process proceeds to step S14 at the timing at which the shutter command has been transmitted by short-range wireless transmission.

As described above, the mobile phone 21 capturing the subject captures the still image captured by the camera unit 8 at the timing when the shutter command is received, and transmits it to the other mobile phone 22. (Steps S6 to S8 in the flowchart of FIG. 3). Therefore, in step S14, the control unit 14 of the other mobile phone 22 receives the still image transmitted from the mobile phone 21 and advances the process to step S15.

[User information insertion operation for still images]
Here, when the control unit 14 of another mobile phone 22 receives a still image captured by the mobile phone 21, a person is added to the received still image based on the face recognition processing program stored in the memory 13. It is discriminated whether or not is reflected. If it is determined that a person is not shown on the received still image, the process proceeds to step S18. In this case, the received still image is stored in the memory 13 as it is, and the flowchart of FIG. All the processes shown are terminated.

  On the other hand, if it is determined that a person is reflected on the received still image, the control unit 14 of the other mobile phone 22 proceeds to step S16 and, based on the face recognition processing program, A person photographed on the received still image by matching the face photograph of each user registered in the phone book in the memory 13 with the face image of the person photographed on the received still image. The same person is detected from each user registered in the telephone directory. Then, user information corresponding to the person shown on the received still image is acquired from the telephone directory, and the process proceeds to step S17.

  In step S17, the control unit 14 of the other mobile phone 22 forms a still image containing the user information in which the user information acquired from the phone book is displayed on the corresponding person on the received still image. Is stored in the memory 13 in step S18, and all the processes in the flowchart of FIG.

  FIG. 5 shows an example of this still image containing user information. The example shown in FIG. 5 is an example in which a user name is acquired as user information from the telephone directory and inserted into the received still image. In this case, for example, a still image in which each user name such as the user A, the user B, and the user CA is displayed on each of the three person images. In this example, the user name is acquired from the phone book. In addition, the telephone number, e-mail address, address, etc. of the corresponding user are acquired and displayed on the person image of each user. May be.

  In this way, the face image of the person shown in the received still image and the face photograph of each user registered in the phone book are matched, and user information corresponding to the person shown in the still image is obtained. By acquiring from the telephone directory, a still image in which user information of each person is inserted can be automatically formed, and convenience can be improved.

  In this example, each process of step S15 to step S17 is performed on the other mobile phone 22 side, but each process of step S15 to step S17 may be performed on the mobile phone 21 side. In this case, each process of step S15 to step S17 is executed between the processes of step S7 and step S8 in the flowchart of FIG.

In addition, each processing of step S15 to step S17 may be performed on both the mobile phone 21 side and the other mobile phone 22 side. In this case, since the same user is detected by referring to the phone book on the mobile phone 21 side and the phone book on the other mobile phone 22 side, it is possible to detect more same users. More user information can be displayed on the captured still image.

[Panorama composition operation]
Next, in the case of the mobile phone of this embodiment, it is also possible to panoramicly combine still images captured by a plurality of mobile phones 21 on the other mobile phone 22 side. In the example shown in FIG. 6, one mobile phone 22 that performs remote operation remotely operates the mobile phones 21 a to 21 g that images seven subjects, and is imaged by each of the mobile phones 21 a to 21 g. This is an example in which the still image is panorama synthesized by the mobile phone 22 on the remote operation side and returned to each of the mobile phones 21a to 21g.

  The flowchart of FIG. 7 shows the flow of the panorama composition operation of the mobile phone 22 that performs panorama composition based on each still image obtained by remotely operating a plurality of surrounding mobile phones 21. When performing this panorama composition, the user selects and operates the “remote operation mode” and also selects the “panorama composition” menu. When the control unit 14 of the mobile phone 22 that performs panorama composition detects this “panorama composition” menu selection operation, the process shown in the flowchart of FIG. 7 is performed based on the camera control program stored in the memory 13. Start.

  In step S21, the control unit 14 of the mobile phone 22 forms a short-range wireless communication network 23 such as an ad hoc network using the wireless LAN between the surrounding mobile phones 21a to 21g as shown in FIG. The near field communication unit 12 is controlled based on the near field communication control program stored in the memory 13 and the process proceeds to step S22.

  Each of the mobile phones 21 a to 21 g captures a continuous space area with each camera unit 8, and transmits this camera-through image to the mobile phone 22 by short-range wireless transmission. As described above, each of the mobile phones 21a to 21g performs processing for reducing the frame rate of the camera-through image and transmits remote operation command information together with the camera-through image.

  In step S22, the control unit 14 of the mobile phone 22 receives still images transmitted from each of the mobile phones 21a to 21g by short-distance wireless transmission and forms thumbnail images of the camera-through images. Each thumbnail image is displayed on the display unit 5 together with the remote operation command information. Thereby, the user can recognize the subject currently being imaged with each of the mobile phones 21a to 21g.

  Note that the thumbnail image forming process for each camera-through image in step S22 may be omitted. By omitting the thumbnail image forming process, the burden on the mobile phone 22 can be reduced.

  The user of the mobile phone 22 remotely operates the camera unit 8 of each of the mobile phones 21a to 21g based on the remote operation command information displayed on the display unit 5. Thereby, the thumbnail images from the respective mobile phones 21a to 21g corresponding to the remote operation are displayed on the display unit 5. Then, the user of the mobile phone 22 confirms the subject currently being picked up on each of the mobile phones 21a to 21g by looking at the respective thumbnail images, and the user can use the operation unit 6 of the mobile phone 22 at a desired timing. Pressing the provided enter key.

  When this determination key is pressed, the control unit 14 of the mobile phone 22 sends a remote operation command (shutter command) for instructing the camera unit 8 of each of the mobile phones 21a to 21g to release the shutter. Short-distance wireless transmission is performed to each of the mobile phones 21a to 21g. In step S23 of the flowchart of FIG. 7, the control unit 14 of the mobile phone 22 determines whether or not this shutter command has been transmitted to the mobile phones 21a to 21g by short-range wireless transmission, and the shutter command is sent to each mobile phone. The process proceeds to step S24 at the timing when it is determined that the short-distance wireless transmission is performed to 21a to 21g.

  The control unit 14 of each of the mobile phones 21 a to 21 g stores the still image captured by each camera unit 8 in the memory 13 at the timing when the shutter command is received from the mobile phone 22, and also transmits the still image to the mobile phone 22 to the short distance wireless Send. When the control unit 14 of the mobile phone 22 receives each still image from each of the mobile phones 21a to 21g, in step S24, the control unit 14 performs a panorama composition process for connecting the still images, and proceeds to step S25.

  In step S25, the control unit 14 of the mobile phone 22 determines whether or not a person is shown on the captured image formed by the panorama synthesis process. If it is determined that the person is not captured, the process proceeds to step S28, and the captured image formed by the panorama synthesis process is stored in the memory 13 and transmitted to the mobile phones 21a to 21g by short-range wireless transmission. Then, the entire process shown in the flowchart of FIG. Thereby, for example, each user standing at the top of the mountain obtains a panoramic still image of a 360-degree scenery around the mountain top obtained by imaging each of the scenery around the mountain top with each of the mobile phones 21a to 21g. Can do.

  On the other hand, when the control unit 14 of the mobile phone 22 determines in step S25 that a person is reflected on the captured image formed by the panorama synthesis process, the process proceeds to step S26. In step S26, the control unit 14 of the mobile phone 22 is reflected in the panoramic synthesized still image based on the face recognition processing program stored in the memory 13 as in the description of step S16 in the flowchart of FIG. The same person as the person is detected based on the face photograph of each user registered in the phone book, and user information of the same person as the person shown in this panoramic composite still image is acquired from the phone book. Then, the process proceeds to step S27.

  In step S27, the control unit 14 of the mobile phone 22 performs the same as the description of step S17 in the flowchart of FIG. 4 on the person image shown in the panoramic composite still image and the user name and phone call acquired from the phone book. A panorama still image containing user information displaying user information such as a number is formed, stored in the memory 13 in step S28, and transmitted to the mobile phones 21a to 21g by short-distance wireless transmission. The whole process of is terminated. Thus, for example, each user standing at the top of the mountain uses each of the mobile phones 21a to 21g to capture the scenery around the top of the mountain, and the 360-degree scenery around the top of the mountain and each person reflected in the scenery. A panoramic still image in which the user information is inserted can be obtained.

In this example, on the mobile phone 22 side, the still images captured by the respective mobile phones 21a to 21g are panorama synthesized, and this panoramic still image is transmitted to the respective mobile phones 21a to 21g. The mobile phone 21a transmits the still image captured by the mobile phone 21a to the other mobile phones 21b to 21g and receives the still image captured by the other mobile phones 21b to 21g. The mobile phones 21a to 21g transmit and receive still images captured between the mobile phones 21a to 21g, and each of the mobile phones 21a to 21g performs panorama synthesis based on the still images captured by the own device and the still images received from other mobile phones. Processing may be performed.

[Effect of the embodiment]
As is clear from the above description, in the mobile phone of this embodiment, a short-range wireless communication network 23 is formed between one mobile phone 21 and the other mobile phone 22, and one mobile phone 21 Then, a camera-through image that is a captured still image and remote operation command information for remotely operating the one mobile phone 21 are transmitted to the other mobile phone 22 via the short-range wireless communication network 23.

  On the other mobile phone 22 side, the camera-through image and the remote operation command information transmitted from the one mobile phone 21 are displayed on the display unit 5. The user of the other mobile phone 22 recognizes the subject currently being imaged by the one mobile phone 21 based on the camera through image displayed on the display unit 5. Then, based on the remote operation command information displayed on the display unit 5 together with the camera through image, the shutter button is pressed at a desired timing. As a result, the shutter command is transmitted from the other mobile phone 22 to the one mobile phone 21 by short-range wireless transmission. One mobile phone 21 stores the still image captured by the camera unit 8 in the memory 13 at the timing when the shutter command is received, and transmits the still image to the other mobile phone 22 by short-range wireless transmission.

  As a result, while confirming the current subject imaged by one mobile phone 21 on the other mobile phone 22 side, the one mobile phone 21 is remotely operated by the other mobile phone 22, and a desired subject is obtained. Still images can be taken.

  In addition, when a camera-through image is transmitted from one mobile phone 21 to the other mobile phone 22, the frame rate of the camera-through image is reduced and transmitted by short-range wireless transmission. It is possible to reduce the amount of transmission data of a camera-through image that is wirelessly transmitted from the telephone 21 to the other mobile phone 22 and to effectively utilize the network band to enable smooth short-range wireless communication. it can.

  In addition, when a person is captured on a still image captured by one mobile phone 21, user information corresponding to the person is obtained from the phone book stored in the memory 13 and is captured in the still image. Since a still image containing user information displayed on a person image is formed, a still image to which user information is added can be automatically formed, and convenience can be improved. it can.

Also, by remotely operating a plurality of mobile phones, each still image captured by each mobile phone can be received, and a panoramic still image can be formed by connecting these still images.

[Modification]
Although the above-described embodiment has been described as remote control of still image capturing, moving image capturing may be performed remotely. Even in this case, the same effect as described above can be obtained.

  Moreover, although the above-described embodiment is an example in which the present invention is applied to a mobile phone, the present invention is not limited to the PHS phone (PHS: Personal Handyphone System), PDA device (PDA: Personal Digital Assistant). The present invention may be applied to portable devices such as portable game machines, digital camera devices, and digital video camera devices. In either case, the same effect as described above can be obtained.

  Finally, the present invention is not limited to the above-described embodiment described as an example, and various modifications can be made depending on the design and the like as long as they do not depart from the technical idea according to the present invention. I will add that it is a matter of course.

1 is a block diagram of a mobile phone according to an embodiment to which the present invention is applied. A short-range wireless communication network is formed between one mobile phone and another mobile phone using the mobile phone of the embodiment, and the one mobile phone is remotely operated by another mobile phone, It is a figure which shows a mode that a desired subject is imaged with a telephone. 4 is a flowchart for explaining an operation when imaging a subject in the mobile phone according to the embodiment. It is a flowchart for demonstrating the remote operation in the mobile telephone of embodiment. It is a figure for demonstrating the operation | movement which displays the user information registered into the telephone directory on the still image imaged by the remote operation in the mobile telephone of embodiment. It is a figure for demonstrating the panorama synthetic | combination operation | movement in the mobile telephone of embodiment. It is a flowchart which shows the flow of the panorama synthetic | combination operation | movement in the mobile telephone of embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Antenna, 2 Communication circuit, 3 Speaker part, 4 Microphone part, 5 Display part, 6 Operation part, 7 Light emission part (LED), 8 Camera part, 9 Vibration unit, 10 Timer, 11 Near field communication antenna, 12 near Distance wireless communication unit, 13 memory, 14 control unit, 21 mobile phone for imaging subject, 21a to 21g mobile phone for imaging subject, 22 mobile phone for remote operation

Claims (15)

An imaging unit for imaging a subject;
A near field communication unit that performs near field communication;
An imaging control unit that controls imaging of the imaging unit in response to a remote operation command for remotely operating the imaging unit received from a device that remotely operates the imaging unit via the short-range wireless communication unit; ,
The current captured images that are continuously captured by the imaging unit are sequentially short-range wirelessly transmitted to the device that remotely operates the imaging unit via the short-range wireless communication unit, and When a shutter command is received from a device that remotely operates the imaging unit, the captured image obtained by the imaging control unit performing imaging control of the imaging unit is transmitted via the short-range wireless communication unit. An imaging apparatus comprising: a captured image transmission unit that performs near-field wireless transmission to a device that remotely operates the imaging unit. A user information storage unit in which predetermined user information including a face image of each user is stored for each user;
When the shutter command is received from a device on the remote control side of the imaging unit, the imaging control unit is based on the face image of the user shown in the captured image obtained by imaging control of the imaging unit. A user information acquisition unit that acquires the user information of the user shown in the captured image from the user information storage unit by referring to the face image of each user stored in the user information storage unit;
The captured image transmission unit receives the user image of the user shown in the captured image obtained by the imaging control unit controlling the imaging unit from the user information storage unit by the user information acquisition unit. The imaging device according to claim 1, wherein a captured image with user information to which the acquired user information is added is formed and wirelessly transmitted to a device that remotely operates the imaging unit. The captured image transmission unit reduces the frame rate of the current captured image to a predetermined frame rate and transmits the current captured image to a device that operates the imaging unit when transmitting the current captured image by short-range wireless transmission. The imaging apparatus according to claim 1, wherein short-range wireless transmission is performed. The captured image transmission unit transmits, together with the current captured image, remote operation command information for remotely operating the imaging unit to a device that operates the imaging unit by short-range wireless transmission. The imaging device according to claim 3. A near field communication unit that performs near field communication;
A remote operation command transmission unit that transmits a remote operation command for remotely operating the imaging unit to the device having the imaging unit to be remotely operated via the short-range wireless communication unit;
A display control unit for displaying on the display unit a current captured image that is sequentially captured by the imaging unit sequentially received from the device having the imaging unit to be remotely operated via the short-range wireless communication unit; ,
A storage control unit that stores a captured image transmitted in a short-distance wireless transmission from a device having the imaging unit that is remotely operated by transmitting the shutter command via the remote-operation command transmission unit in a short-distance wireless transmission; Imaging device. A user information storage unit in which predetermined user information including a face image of each user is stored for each user;
Based on the face image of the user shown in the captured image transmitted by the short-distance wireless transmission from the device having the imaging unit to be remotely operated by transmitting the shutter command via the remote-operation command transmission unit. A user information acquisition unit that acquires the user information of the user shown in the captured image from the user information storage unit by referring to the face image of each user stored in the user information storage unit;
The storage control unit forms a captured image with user information obtained by adding the user information acquired from the user information storage unit by the user information acquisition unit to the user image of the user shown in the captured image, The imaging device according to claim 5, which stores the information in the storage unit. The remote operation command transmission unit transmits the shutter command to each of the plurality of devices having the imaging unit to be remotely operated, respectively, by short-range wireless transmission,
The storage control unit synthesizes each captured image transmitted from each of the plurality of devices by short-range wireless transmission by transmitting a shutter command to the plurality of devices via the remote operation command transmission unit. The imaging device according to claim 5, wherein a single captured image is formed and stored in the storage unit. The display control unit displays, on the display unit, a current captured image that is sequentially transmitted from the device having the imaging unit to be remotely operated and that has been subjected to reduction processing at a predetermined frame rate. The imaging device according to any one of the above. The remote operation command transmission unit is configured to perform imaging based on remote operation command information for remotely operating the imaging unit that is wirelessly transmitted together with the current captured image from a device having the imaging unit to be remotely operated. The imaging apparatus according to claim 5, wherein a remote operation command for remotely operating the unit is transmitted by short-range wireless transmission. In response to a remote operation command for remotely operating the imaging unit received from a device on the remote control side of the imaging unit that performs imaging of the subject, the imaging control unit performs the imaging unit Imaging control step,
The captured image transmission unit sequentially transmits the current captured image continuously captured by the imaging unit to the device that remotely operates the imaging unit via the short-range wireless communication unit. A distance wireless transmission step;
When the captured image transmission unit receives a shutter command from a device that remotely operates the imaging unit, the captured image obtained by performing imaging control of the imaging unit by the imaging control unit is transmitted to the short-range wireless communication. And short-range wireless transmission to a device on the remote control side of the imaging unit via the unit. A remote operation command transmission unit, for a device having an imaging unit to be remotely operated, transmitting a remote operation command for remotely operating the imaging unit via a short-range wireless communication unit;
The display control unit displays the current captured image continuously captured by the imaging unit sequentially received from the device having the imaging unit that is remotely operated via the short-range wireless communication unit on the display unit. And steps to
A step in which the storage control unit stores a captured image transmitted in a short-distance wireless transmission from a device having the imaging unit to be remotely operated in the storage unit by transmitting a shutter command via the remote-operation command transmission unit in a short-distance wireless transmission; An imaging method comprising: Imaging that controls imaging of the imaging unit in response to a remote operation command for remotely operating the imaging unit received from a device that remotely controls the imaging unit that performs imaging of a subject via a short-range wireless communication unit Let the computer function as a control unit,
While controlling the short-range wireless communication unit so as to sequentially transmit short-distance wireless transmission of current captured images continuously captured by the imaging unit to a device that remotely operates the imaging unit. When a shutter command is received from a device that remotely operates the imaging unit, a captured image obtained from the imaging unit by causing a computer to function as the imaging control unit is transmitted via the short-range wireless communication unit. An imaging control program that causes a computer to function as a captured image transmission unit that controls the short-range wireless communication unit so as to perform short-range wireless transmission to a device that remotely operates the imaging unit. A computer is caused to function as a remote operation command transmission unit that controls a short-range wireless communication unit so that a remote operation command for remotely operating the imaging unit is transmitted to a device having a remote-controlled imaging unit by short-range wireless transmission. ,
As a display control unit that displays on the display unit current captured images that are sequentially captured by the imaging unit sequentially received from the device having the imaging unit that is remotely operated via the short-range wireless communication unit Make the computer work,
When a computer is caused to function as the remote operation command transmission unit, a short distance wireless transmission of a shutter command to the device having the imaging unit to be remotely operated allows a short distance from the device having the remote operation imaging unit. An imaging control program that causes a computer to function as a storage control unit that stores captured images that are wirelessly transmitted in a storage unit. An imaging unit for imaging a subject;
A near field communication unit that performs near field communication;
An imaging control unit that controls imaging of the imaging unit in response to a remote operation command for remotely operating the imaging unit received from a device that remotely operates the imaging unit via the short-range wireless communication unit; ,
The current captured images that are continuously captured by the imaging unit are sequentially short-range wirelessly transmitted to the device that remotely operates the imaging unit via the short-range wireless communication unit, and When a shutter command is received from a device that remotely operates the imaging unit, the captured image obtained by the imaging control unit performing imaging control of the imaging unit is transmitted via the short-range wireless communication unit. A mobile terminal device comprising: a captured image transmission unit that performs short-distance wireless transmission to a device that remotely operates the imaging unit. A near field communication unit that performs near field communication;
A remote operation command transmission unit that transmits a remote operation command for remotely operating the imaging unit to the device having the imaging unit to be remotely operated via the short-range wireless communication unit;
A display control unit for displaying on the display unit a current captured image that is sequentially captured by the imaging unit sequentially received from the device having the imaging unit to be remotely operated via the short-range wireless communication unit; ,
A storage control unit that stores a captured image transmitted in a short-distance wireless transmission from a device having the imaging unit that is remotely operated by transmitting the shutter command via the remote-operation command transmission unit in a short-distance wireless transmission; Mobile terminal device.

Images