JP3968507B2 - Imaging apparatus, imaging system, and imaging operation control method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an imaging apparatus, an imaging system, and an imaging operation control method in which an imaging operation is remotely operated by radio.
[0002]
[Prior art]
2. Description of the Related Art In recent years, digital still cameras (hereinafter abbreviated as DSCs) that can be easily carried around to take images and record them as digital data have become widespread. For DSC, not only has the resolution and image quality improved year by year, but various additional functions for recorded images, shooting operations, etc. have been proposed to improve convenience and commercial value.
[0003]
For example, as a function for a shooting operation, a function of performing a remote operation of a shutter switch or the like using infrared communication or wireless radio wave communication has been proposed in place of the conventionally provided self-timer function. In particular, in Bluetooth (Bluetooth), which has attracted attention as a short-range wireless communication standard in recent years, the formulation of a program called BIP (Basic Imaging Profile) for the purpose of wirelessly transferring image data is being developed. In this BIP, a communication specification for remotely operating the DSC is defined. By using this BIP, it is possible to remotely control the DSC from a portable device such as a cellular phone or PDA (Personal Digital Assistants) provided with a Bluetooth wireless module.
[0004]
[Problems to be solved by the invention]
By the way, a display unit such as an LCD (Liquid Crystal Display) or an LED (Light Emitting Diode) is usually provided in a DSC. This display unit causes a remaining amount of recording medium, a battery exhaustion, or an error in internal processing. Warning information due to occurrence or the like is notified to the user. However, when the DSC is operated remotely, it is necessary to return to the DSC installation location in order to confirm the warning information. Therefore, a means for confirming warning information from the DSC on the remote control device side is desired.
[0005]
For example, in the Bluetooth BIP described above, a procedure for transmitting information on the DSC side to the remote control device side is not defined. For this reason, it is possible to send the above warning information using the extension area of the header of the packet to be sent. In this case, the receiving side also specifies that the sent warning information is acquired and displayed. Need to be. Therefore, the devices that can display the transmitted warning information are limited, and reliable compatibility cannot be maintained between various devices that support BIP.
[0006]
The present invention has been made in view of such problems, and an object of the present invention is to provide an imaging device that can transmit various information to a device that remotely controls the imaging operation and that is highly compatible. And
[0007]
Another object of the present invention is to provide an imaging system that is capable of acquiring various information from the imaging device when the imaging device is remotely operated and that is highly compatible.
[0008]
[Means for Solving the Problems]
  In the present invention, in order to solve the above-described problem, in an imaging apparatus in which an imaging operation is remotely operated by radio,Communication means for performing wireless communication with an external device in accordance with a predetermined digital wireless communication method, and a transmission request signal for a monitor captured image defined by the digital wireless communication method are continuously received by the communication means. And each time it is received, according to the response procedure for the transmission request signal defined in the digital wireless communication system,Captured image signals sequentially obtained according to the image pickup by the image sensorThrough the communication meansWireless transmissionLetCaptured image transmissioncontrolMeans and the transmission requestWhen an event indicating that information to be notified to the external device has occurred in the imaging device is detected during reception of the signal, the event is detected.Sending the image showing the notification information to the captured imagecontrolmeansControlImage synthesizing means for synthesizing to a part of the image transmitted byDefined by the digital wireless communication systemShootStatueRecord request for imageThe signal isSaidCommunication meansReceived byIsThen, there is provided an imaging apparatus comprising image recording means for recording one frame of the captured image signal obtained sequentially on a recording medium.
[0009]
  In such an imaging apparatus, the recording request is made by the image recording means.signalAs a result, one frame of the captured image signal is recorded on the recording medium, so that the image recording operation is remotely controlled and the captured image is transmitted.controlmeansControlRemote control is performed by wirelessly transmitting the captured image signal byOutsideIn the apparatus, an image captured before requesting a recording operation can be browsed. When this captured image signal is transmitted, remote control is performed by combining an image indicating notification information with a part of the transmitted image by the image combining means.OutsideIn the apparatus, notification information from the imaging apparatus side is also displayed when the received image is displayed.Here, the transmission of the captured image signal to the external device and the image recording operation according to the recording request signal are executed according to a procedure defined in a predetermined digital wireless communication system. Combining is performed at the time of detecting an event indicating the occurrence of information to be notified to the external device, regardless of a request from the external device, thereby notifying the notification information without departing from the specifications of the digital wireless communication system. Is notified to the external device.
[0010]
  Further, in the present invention, in an imaging system for remotely operating an image capturing operation wirelessly,First communication means for performing wireless communication in accordance with a predetermined digital wireless communication system, and a monitor request image transmission request signal defined by the digital wireless communication system are continuously received by the first communication means. And each time it is received, according to the response procedure for the transmission request signal defined in the digital wireless communication system,The captured image signal sequentially obtained according to the imaging by the imaging element,Through the first communication meansWireless transmissionLetCaptured image transmissioncontrolMeans and the transmission requestWhen an event indicating that information to be notified to the transmission side device of the transmission request signal has occurred in the imaging device upon reception of the signal, the event is detected.Sending the image showing the notification information to the captured imagecontrolmeansControlImage synthesizing means for synthesizing to a part of the image transmitted byDefined by the digital wireless communication systemShootStatueRecord request for imageThe signal isSaidFirst communication meansReceived byIsImage recording means for recording one frame of the captured image signal obtained sequentially on a recording medium;Said withAn imaging device;A second communication means for performing wireless communication in accordance with the digital wireless communication system, and the second communication means.The transmission requestsignalWireless transmissionLet that as a responseThe captured image signalReceiveCaptured image acquisition means forReceivedReproduction display means for reproducing and displaying the acquired captured image signal;In response to an operation input by the user for requesting image recording,Request for recordingsignalTheThrough the second communication meansWireless transmissionLetImage recording request meansWithWith imaging remote control deviceHaveAn imaging system is provided.
[0011]
  In such an imaging system, the image recording means of the imaging device requires a recording request from the imaging remote control device.signalAccordingly, by recording one frame of the picked-up image signal on the recording medium, the image recording operation in the image pickup device is remotely operated by the image pickup remote control device. In the imaging remote control device, a request for transmission of a captured image signal by the captured image acquisition meanssignalGet this according to theRegenerationBy being reproduced and displayed by the display means, it is possible to view the captured image before the image recording operation in the imaging apparatus. At the time of transmission of the captured image signal from this imaging device, the image synthesizing unit synthesizes an image indicating the notification information with a part of the transmitted image.RegenerationNotification information from the imaging device side is displayed in the image displayed by the display means.Here, in the imaging device, the transmission of the captured image signal to the imaging remote control device and the image recording operation according to the recording request signal are executed according to a procedure defined by a predetermined digital wireless communication system, but the transmitted imaging The composition of the notification information with respect to the image signal is performed at the time of detecting an event indicating the occurrence of information to be notified to the device regardless of a request from the imaging remote control device, and thereby the specification of the digital wireless communication method described above. The notification information is notified to the imaging remote control device without departing from the above.
[0012]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
The imaging system of the present invention includes an imaging device that captures and records an image, and an imaging remote operation device that remotely operates a recording operation or the like in the imaging device. All data transmission / reception between the imaging device and the imaging remote control device is performed wirelessly. The imaging device is a device having an image capturing function and a recording function, such as a DSC or a digital video camera having a still image recording function. In addition, it is desirable that the imaging remote control device is realized as a device that is portable and often carried around on a daily basis, such as a mobile phone, a PDA, and a wristwatch.
[0013]
In the following, description will be given of an embodiment in which DSC is applied as an imaging device constituting the imaging system and a mobile phone is applied as an imaging remote control device. First, FIG. 1 is a block diagram showing a configuration example of a DSC applicable to the present invention.
[0014]
As shown in FIG. 1, the DSC 1 constituting the imaging system includes a camera block 11 that performs an imaging function, a camera signal processing unit 12 that performs signal processing such as analog-digital conversion of the captured image signal, and an image signal. An image processing unit 13 that performs compression / decompression processing, a memory 14 that temporarily stores image data and data for image synthesis, and an R that performs writing to and reading from a memory card 15a, which is a detachable semiconductor memory. A / W (reader / writer) 15, a display unit 16 that displays an image on a monitor, and a control microcomputer 17 that controls the entire apparatus are connected via a bus. Further, the control microcomputer 17 includes an input unit 18 for operation input by a user, a power supply unit 19 connected to a battery 19a to supply power to the apparatus, and a Bluetooth module for wireless communication with an external device. 20 is connected.
[0015]
The camera block 11 includes an optical system using a lens that receives light from a subject, an iris, a shutter, and an image sensor such as a CCD (Charge Coupled Device) that photoelectrically converts incident light. The camera signal processing unit 12 performs signal processing such as conversion of an output signal from the image sensor into a digital signal, noise removal, image quality correction, and conversion into a luminance / color difference signal.
[0016]
The image processing unit 13 compresses and expands image signals based on a predetermined data format such as JPEG (Joint Photographic Coding Experts Group) standard, converts data specifications such as resolution, and character information read from the memory 14. And image information composition processing.
[0017]
The memory 14 includes a RAM and a ROM. The image quality correction process in the camera signal processing unit 12, the compression / decompression process in the image processing unit 13, the writing / reading process to / from the memory card 15a in the R / W 15, the Bluetooth module In the image data transmission processing or the like, the image data and the like are temporarily stored, and in addition, as will be described later, character information and image information for notifying various information to the remote operation device side are stored in advance. I remember it.
[0018]
The R / W 15 writes the image data converted into a predetermined data format by the image processing unit 13 to the set memory card 15a. Further, the image data recorded in the memory card 15 a is read out and sent to the control microcomputer 17 and the image processing unit 13. Further, it has a function of monitoring the free space in the memory card 15a and notifying the control microcomputer 17 of the information.
[0019]
The display unit 16 is configured by, for example, an LCD (Liquid Crystal Display) or the like, and displays images sequentially output from the camera signal processing unit 12. This image is called a camera-through image and is used for angle-of-view adjustment before recording the image. The display unit 16 can display an image read from the memory card 15a.
[0020]
The control microcomputer 17 is a control processing unit that controls each circuit block of the DSC 1, and each circuit block is based on an instruction input signal from the input unit 18 or a control signal received from an external device via the Bluetooth module 20. To control. Further, based on information from the R / W 15 and the power supply unit 19, it is determined that the memory card 15a has no free space or the battery has run out.
[0021]
The input unit 18 includes, for example, a shutter release button for operating the shutter of the camera block 11, a selection switch for selecting an operation mode, and the like, and an instruction input signal corresponding to the operation by the user is sent to the control microcomputer 17. Output.
[0022]
The power supply unit 19 has a function of supplying a predetermined voltage to each unit in the DSC 1 based on the output voltage from the battery 19 a made of a lithium ion battery or the like and notifying the control microcomputer 17 of the remaining battery level.
[0023]
The Bluetooth module 20 includes, for example, an antenna and an RF transceiver for signal transmission / reception using a frequency hopping spread spectrum system, a processor that performs baseband processing, interface processing with the control microcomputer 17, and the like. Wireless communication with an external device such as a mobile phone is performed according to the communication procedure controlled by
[0024]
In such a DSC 1, under the control of the control microcomputer 17, the image signal captured by the camera block 11 is sent to the display unit 16 via the camera signal processing unit 12 and displayed as a camera through image. Further, when the shutter of the camera block 11 is released by an instruction input signal from the input unit 18, the captured image signal is sent from the camera signal processing unit 12 to the image processing unit 13 and subjected to data compression processing, and a predetermined data format Converted to digital data. The converted data is sent to the R / W 15 and recorded in the memory card 15a. Further, the image data recorded on the memory card 15 a can be read in accordance with an operation by the input unit 18, and decompressed by the image processing unit 13, and then displayed on the display unit 16.
[0025]
Further, as will be described later, in accordance with a control signal received from an external device via the Bluetooth module 20, recording processing of a captured image signal, wireless transmission processing of a camera-through image, or an image read from the memory card 15a, etc. Is done.
[0026]
Next, FIG. 2 is a block diagram showing a configuration example of a mobile phone applicable to the present invention.
A cellular phone 2 shown in FIG. 2 includes a Bluetooth module 21 for wireless communication with a Bluetooth-compatible external device such as DSC 1, a wireless communication module 22 for wireless communication according to a predetermined wireless communication standard for telephone communication, and a device A control microcomputer 23 that controls the entire control, a voice input / output unit 24 that inputs and outputs voice for a telephone call to a user, an image processing unit 25 that performs various data processing on image signals, and a display that displays an image The unit 26 and an input unit 27 for performing operation input by the user.
[0027]
The Bluetooth module 21 has the same function as the Bluetooth module 20 of the DSC 1 shown in FIG. 1, and performs wireless data transmission / reception with a Bluetooth-compatible external device such as the DSC 1 based on the control by the control microcomputer 23. . The telephone call wireless module 22 includes an antenna, a modem circuit, and the like for transmitting and receiving wireless radio waves, and performs wireless data transmission and reception with an external telephone communication base station (not shown) based on control by the control microcomputer 23. . The control microcomputer 23 is a control processing unit that controls each circuit block of the mobile phone 2, and controls the operation of each circuit block based on a control signal from the input unit 27 or the Bluetooth module 21.
[0028]
The voice input / output unit 24 includes a speaker and a microphone, decodes and reproduces the voice signal supplied from the control microcomputer 23 and outputs the voice, and converts the user's voice into a voice signal. Output. The image processing unit 25 performs data conversion processing such as decompression processing of the image signal received by the Bluetooth module 21.
[0029]
The display unit 26 includes a monitor such as an LCD, and receives and displays information indicating an operation state in the apparatus and information corresponding to an input from the input unit 27 via the control microcomputer 23. Further, the output image signal from the image processing unit 25 is reproduced to display an image. The input unit 27 includes various button switches and the like for telephone call operation and remote operation of the DSC 1, and supplies a control signal based on operation input from the user to the control microcomputer 23.
[0030]
The cellular phone 2 has a telephone call function based on different wireless communication standards and a remote operation function for the DSC 1. At the time of executing the telephone call function, the radio communication signal is received from the base station after the radio communication connection with the base station is established in the call radio module 22 based on the operation at the input unit 27, and the demodulation process or the like is performed. Done. Then, the output audio signal is supplied to the audio input / output unit 24 via the control microcomputer 23, decoded, and output from the speaker. At the same time, the audio signal output from the audio input / output unit 24 according to the sound collection of the microphone is converted into a predetermined data format, and then supplied to the call radio module 22 via the control microcomputer 23. Wirelessly transmitted to the base station.
[0031]
On the other hand, when the remote operation function for the DSC 1 is executed, a wireless communication connection with the DSC 1 is established in the Bluetooth module 21 based on the operation at the input unit 27, and a control signal is sent to the DSC 1 according to the operation at the input unit 27. Thus, the operation in the DSC 1 is remotely controlled. The image signal received from the DSC 1 is decompressed by the image processing unit 25 and then displayed on the display unit 26.
[0032]
In the imaging system configured by the DSC 1 and the mobile phone 2 described above, communication is performed using the Bluetooth standard. In the Bluetooth standard, the exchange of signals between corresponding devices is formulated as a profile in the Bluetooth SIG (Special Interest Group). In this profile, for example, GAP (Generic Access Profile) that defines connection, authentication, etc. when devices are discovered for the first time, SDP (Service Discovery Profile) for discovering services registered in the partner device, etc. In addition to the specifications of lower layers commonly provided in general Bluetooth modules, an application level profile corresponding to the use between devices is further defined in an upper layer including them. In the Bluetooth standard, in order to communicate between devices, both of them need to support the same profile.
[0033]
In this embodiment, BIP (version 0.95) is used as a wireless communication specification between the DSC 1 and the mobile phone 2. The BIP is a profile for transmitting and receiving image data, and defines a communication procedure for image data transfer and operations for possible operations in the transfer-side and receiving-side devices.
[0034]
The specification for communication between devices corresponding to the Bluetooth standard is determined as a hierarchical protocol stack by the Bluetooth SIG. BIP is a profile defined on the OBEX (Object Exchange Protocol) layer that defines the procedure (connection, transmission, disconnection, etc.) for object data exchange in the presentation layer.
[0035]
In this OBEX, RFCOMM (RF Communication Protocol), which is a compatible protocol for performing serial port emulation, and a Bluetooth core protocol are defined in a lower layer. Core protocols include, for example, BB (Baseband) that enables a physical RF link between Bluetooth modules, LMP (Link Manager Protocol) that performs link establishment in the network layer, device authentication, etc., and operates in parallel with LMP. L2CAP (Logical Link Control And Adaptation Protocol) for managing logical connections with upper layer data, and SDP (inquiry for mutual service and device information, etc.) that can be provided between clients and servers in the upper layer Service Discovery Protocol) is defined in order from the lower layer.
[0036]
In BIP, specifications for image transmission / reception and remote operation of a camera are defined as features according to the purpose at the application level. In order to remotely control the imaging operation in the DSC 1 by the mobile phone 2, both of them need to support a remote camera feature.
[0037]
In this “Remote Camera Feature”, the request and transmission of data on the OBEX layer are defined by commands called “Function” using “Get” and “Push”, respectively. The “Function” that is normally executed during remote operation of the imaging operation includes “Get Monitoring Image Function” for requesting acquisition of a camera-through image, and “Get Image Function” for requesting transmission of recorded image data. And so on. In “Get Monitoring Image Function”, by setting a flag (Store Flag) for requesting image recording, it is possible to request image recording on a recording medium together with a camera-through image acquisition request.
[0038]
Here, FIG. 3 is a communication sequence diagram showing a typical data transmission / reception procedure based on BIP between the mobile phone 2 and the DSC 1 when the imaging operation is remotely controlled.
[0039]
In FIG. 3, in the previous stage of timing T301, it is recognized that the BIP is supported in the DSC 1 that is “Responder” based on the request from the mobile phone 2 that is “Initiator” in the BIP, and on the OBEX layer. The interconnection at is established. At timing T301, the mobile phone 2 executes “Get Monitoring Image Function” with “Store Flag = 0x00”, and requests transmission of the image signal of the camera-through image captured by DSC1.
[0040]
In BIP, as an object (Monitoring-image Object) to be transmitted as a response to “Get Monitoring Image Function”, it is obliged to convert a camera-through image into JPEG data having a pixel number of 160 × 120 and transmit it. This data format is called “Imaging Thumbnail Format”. When the DSC 1 receives “Get Monitoring Image Function (Store Flag = 0x00)”, the image processing unit 13 compresses one frame of the image signal output from the camera signal processing unit 12 at this time and performs the above processing. Convert to "Imaging Thumbnail Format" image data. Then, at timing T302, the image data is wirelessly transmitted to the mobile phone 2.
[0041]
In the mobile phone 2, the image data is received, and the image processing unit 25 performs decompression / decoding processing to display on the display unit 26. Thereby, the user of the mobile phone 2 can check the camera-through image at a place away from the DSC 1.
[0042]
Thereafter, until the image recording operation is requested at timing T303, the mobile phone 2 executes “Get Monitoring Image Function (Store Flag = 0x00)” an arbitrary number of times to obtain a camera-through image, Can be displayed. As a result, the user can adjust the angle of view for image recording at any time. The execution of “Get Monitoring Image Function (Store Flag = 0x00)” may be performed at regular intervals. Thus, the user can always browse the latest camera-through image without performing an operation input.
[0043]
Then, after the angle of view is correctly aligned, at timing T303, the mobile phone 2 executes “Get Monitoring Image Function” with “Store Flag = 0x01”, and requests the DSC 1 to record an image. Upon receiving this recording request, the DSC 1 extracts one frame of the image signal output from the camera signal processing unit 12 at this time, and compresses it in the image processing unit 13 to convert it into a predetermined data format. The image data is written to the memory card 15a in the R / W 15. At the same time, image data of the “Imaging Thumbnail Format” is generated from the extracted same image signal, and the image data is wirelessly transmitted to the mobile phone 2 at timing T304.
[0044]
In the mobile phone 2, the recorded image can be confirmed by receiving and decoding the image data and displaying it on the display unit 26. Further, when it is desired to obtain data recorded on the memory card 15a instead of the thumbnail image, the recorded image signal can be received from the DSC 1 by executing “Get Image Function” thereafter.
[0045]
As described above, the communication procedure based on the “Remote Camera Feature” of BIP allows the mobile phone 2 side to browse the camera-through image in the DSC 1 and perform the view angle adjustment, and then perform an image recording request. It is possible to capture and record an image as intended by the user while staying at a position away from the DSC 1.
[0046]
By the way, during such remote operation of the DSC 1, if the DSC 1 runs out of free space on the memory card 15a or runs out of battery, it is impossible to know the occurrence at a position away from the DSC 1. Therefore, it is desirable that information notifying such an error occurrence or the operation status of the DSC 1 is transmitted to the mobile phone 2 at a remote location. However, the above BIP rules stipulate such procedures. Not.
[0047]
In the present invention, information notified from the DSC 1 side is embedded in the camera-through image transmitted as a response to “Get Monitoring Image Function”, and is displayed as a character, a symbol, or the like on a part of the camera-through image on the mobile phone 2. Accordingly, it is possible to notify the information from the DSC 1 side to the mobile phone 2 side while maintaining compatibility without changing any of the communication procedures based on the “Remote Camera Feature” of the BIP as described above.
[0048]
In the DSC 1, the control microcomputer 17 always monitors whether any event has occurred in the apparatus. For example, the control microcomputer 17 receives information for notifying the free space of the memory card 15a from the R / W 15, and when this free space becomes a predetermined value or less, an event for warning that the free space has run out. Detects the occurrence of Alternatively, information for notifying the remaining amount of the battery 19a is received from the power supply unit 19, and when the remaining amount becomes equal to or less than a predetermined value, the occurrence of an event for warning the battery exhaustion is detected.
[0049]
When “Get Monitoring Image Function” is received when such an event occurs, characters and images corresponding to the generated event are combined with a part of the camera-through image, and this combined image signal is transmitted to the mobile phone 2. To send.
[0050]
Here, as an example, FIG. 4 is a diagram illustrating a display example of a camera-through image on the mobile phone 2 when it is notified that the free space of the memory card 15a is exhausted.
[0051]
In the screen display example shown in FIG. 4, character information 42 for notifying that there is no more free space in the memory card 15a is displayed above the camera through image 41 captured in the camera block 11 of the DSC 1. As described above, since the image in which the character information 42 is embedded is transmitted from the DSC 1, the character information 42 is displayed together with the camera-through image 41 simply by decoding the received image on the mobile phone 2 side.
[0052]
Information combined with the camera-through image is stored in advance in the memory 14 for each event generated in the DSC 1. For example, character information as shown in FIG. 4 is held in the memory 14 as a template of document data. In addition, the information to be combined may be held in the memory 14 as image data such as symbols and icons.
[0053]
Next, the processing of each device associated with the request and transmission of the camera through image will be specifically described. First, FIG. 5 is a flowchart showing a flow of processing in the DSC 1 until a camera-through image is transmitted.
[0054]
At the start of the flowchart of FIG. 5, in the DSC 1, an image is captured by the camera block 11 and the captured image signal is sequentially supplied to the camera signal processing unit 12. Further, the Bluetooth module 20 operates in, for example, a low power consumption mode, and is in a standby state for receiving from another Bluetooth device. In step S <b> 501, the Bluetooth module 20 receives a signal radio wave from the mobile phone 2 and responds thereto, thereby establishing a Bluetooth connection with the mobile phone 2.
[0055]
In step S502, BIP support information is notified in response to a request from the mobile phone 2. When receiving a search request based on SDP (Service Discovery Profile) from the mobile phone 2, the control microcomputer 17 searches, for example, a service recorder database held in the memory 14, extracts a service record, supports BIP, and The mobile phone 2 is notified that “Image Push Feature” is supported. In step S503, a connection on the OBEX layer in BIP is established.
[0056]
In step S504, a command for requesting transmission of a camera-through image, that is, “Get Monitoring Image Function” is in a reception standby state, and if this is received, the process proceeds to step S505. In step S505, one frame of the captured image signal output from the camera signal processing unit 42 is extracted. This captured image signal is temporarily held in the memory 14, for example.
[0057]
In step S506, it is determined whether there is no more free space in the memory card 15a and whether an event such as battery exhaustion has occurred. If an event has occurred, the process proceeds to step S507. In step S507, document data or image data corresponding to the event that has occurred is read from the memory 14, supplied to the image processing unit 13, and the captured image signal extracted in step S505 is read. Then, the image processing unit 13 combines the captured image signal with document data or image data corresponding to the generated event. As a result, an image in which a character or an image for notifying the occurrence of an event is partially combined on the camera-through image is generated.
[0058]
In step S507, the combined image signal is converted into “Imaging Thumbnail Format” data in the image processing unit 13 to generate an image signal for transmission. On the other hand, if no event has occurred in step S506, the process proceeds to step S508, and the captured image signal extracted in step S505 is converted into data of “Imaging Thumbnail Format” in the image processing unit 13 for transmission. An image signal is generated.
[0059]
In step S509, the image signal for transmission generated by the image processing unit 13 is wirelessly transmitted from the Bluetooth module 20 to the mobile phone 2.
After that, every time “Get Monitoring Image Function” is received, the processing from step S505 to S509 is repeated. If “Store Flag = 0x01” is received when “Get Monitoring Image Function” is received, the processing from step S505 to S509 is performed, and the captured image signal extracted in step S505 is processed by the image processing unit 13. The data is converted into a predetermined recording data format and recorded on the memory card 15a by the R / W 15.
[0060]
Next, FIG. 6 is a flowchart showing the flow of processing in the mobile phone 2 until the camera-through image is acquired and displayed.
At the start of the flowchart shown in FIG. 6, the mobile phone 2 is set to an operation mode for performing remote operation on the DSC 1. In step S601, under the control of the control microcomputer 23, the Bluetooth module 21 establishes a Bluetooth connection with the DSC 1.
[0061]
In step S602, using the search function based on the lower layer SDP (Service Discovery Profile), support information indicating whether or not BIP and “Remote Camera Feature” are supported is acquired from DSC1. Although not shown, if the DSC 1 does not support BIP and “Remote Camera Feature” at this time, the connection is disconnected. In step S603, a connection on the OBEX layer in BIP is established.
[0062]
In step S604, “Get Monitoring Image Function” is executed as “Store Flag = 0x00” in response to an operation input by the user, and a transmission request for a camera-through image is issued to DSC1. Then, it waits for a response from DSC1. In step S605, an image signal of a camera-through image is received from DSC1. In step S606, the received image signal is decoded by the image processing unit 25, and then reproduced and displayed on the display unit 26.
[0063]
Although not shown in the drawing, the user browses the camera-through image displayed on the display unit 26 at this time, performs angle-of-view adjustment, and if the position of the subject as a subject is correctly displayed, the input unit 27 Request a shutter operation. As a result, “Store Flag = 0x01” is set and “Get Monitoring Image Function” is executed. Similar to steps S605 and S606 above, a thumbnail image based on the captured image signal extracted at the time of recording is received and displayed. . On the other hand, when the angle of view is not correctly adjusted by viewing the camera-through image, the processing of steps S604 to S606 is repeated to browse a new camera-through image.
[0064]
In the above processing, information indicating the occurrence of an event in the DSC 1 may be combined with the image signal received by the mobile phone 2 in response to the execution of “Get Monitoring Image Function”. In this case, the mobile phone 2 decodes and displays the received image signal, so that information indicating the occurrence of the event is displayed in a part of the displayed camera-through image. Therefore, on the mobile phone 2 side, the information notified from the DSC 1 is displayed on the display unit 26 without changing the processing procedure associated with the execution of “Get Monitoring Image Function”, and is notified to the user.
[0065]
As described above, the imaging system described above can notify and display arbitrary information from the remotely operated DSC 1 to the mobile phone 2 within the range of the BIP communication specifications. It can be realized while maintaining the characteristics.
[0066]
The information notification from the DSC 1 may be performed not only when an event occurs as shown in the flowchart of FIG. 5 but also continuously. For example, the operation mode of the DSC 1, the resolution and data format of the image to be recorded, the time display based on the timekeeping function of the control microcomputer 17, the free space of the memory card 15a and the remaining number of shootable images, the number of recorded images up to the present, Information indicating the state in the DSC 1 such as the remaining battery level and the remaining usable time is always combined with the camera-through image every time a camera-through image request is received from the mobile phone 2. In addition, whether or not to notify each piece of information may be set in advance by the user from the input unit 18.
[0067]
【The invention's effect】
  As described above, in the imaging apparatus of the present invention, captured image transmission is performed.controlmeansControlRemotely control the imaging operation by wirelessly transmitting the captured image signalOutsideIn the apparatus, an image captured before requesting a recording operation can be browsed. In addition, when the captured image signal is transmitted, the image composition unit performs remote operation by compositing an image indicating the notification information with a part of the transmitted image.OutsideThe device also displays notification information from the imaging device when displaying the received image.ThisofOutsideInformation can be notified to the user of the apparatus from the imaging apparatus side.Furthermore, by combining the notification information with the captured image and transmitting the notification information, the notification information can be transmitted without newly defining a notification information transmission procedure.
[0068]
  In the imaging system of the present invention, a request for transmission of a captured image signal by the captured image acquisition means in the imaging remote control deviceActionThis captured image signal is acquired according to theRegenerationBy being reproduced and displayed by the display means, it is possible to view the captured image before the image recording operation in the imaging apparatus. At the time of transmission of the captured image signal from this imaging device, the image synthesizing unit synthesizes an image indicating the notification information with a part of the transmitted image.RegenerationSince the notification information from the imaging device side is displayed in the image displayed by the display means, the imaging remote control deviceNo YuThe user can be notified of information from the imaging device side.Furthermore, by combining the notification information with the captured image and transmitting the notification information, the notification information can be transmitted to the imaging remote control device without newly defining a notification information transmission procedure.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration example of a DSC applicable to the present invention.
FIG. 2 is a block diagram illustrating a configuration example of a mobile phone applicable to the present invention.
FIG. 3 is a communication sequence diagram illustrating a typical data transmission / reception procedure based on BIP between a mobile phone and a DSC when remote control of an imaging operation is performed.
FIG. 4 is a diagram showing a display example of a camera-through image on a mobile phone when it is notified that there is no more free space on the memory card.
FIG. 5 is a flowchart showing a flow of processing in the DSC until a camera-through image is transmitted.
FIG. 6 is a flowchart showing a flow of processing in the mobile phone until a camera-through image is acquired and displayed.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... DSC, 2 ... Mobile phone, 11 ... Camera block, 12 ... Camera signal processing part, 13 ... Image processing part, 14 ... Memory, 15 ... R / W, 15a ... Memory card, 16 ... Display unit, 17 ... Control microcomputer, 18 ... Input unit, 19 ... Power supply unit, 19a ... Battery, 20, 21 ... Bluetooth module, 22 ... Wireless module for telephone call, 23 ... Control Microcomputer, 24 ...... Voice input / output unit, 25 ... Image processing unit, 26 ... Display unit, 27 ... Input unit

Claims (10)

In an imaging device whose imaging operation is remotely controlled by radio,
A communication means for performing wireless communication with an external device according to a predetermined digital wireless communication method;
When the transmission request signal for the captured image for monitoring specified by the digital wireless communication method is continuously received by the communication means, the transmission request signal specified by the digital wireless communication method every time the communication means receives the signal. following the procedure response to an imaging image transmission control means for sequentially captured image signal obtained according to the imaging by the image pickup device Ru is wirelessly transmitted via the communication means,
When an event indicating that information to be notified to the external device has occurred in the imaging apparatus upon reception of the transmission request signal, an image indicating notification information corresponding to the event is captured. Image compositing means for compositing with a part of the image transmitted under the control of the image transmission control means;
Recording request signal for Zoga image shooting defined by said digital radio communication scheme, when Ru is received by the communication unit, and an image recording means for recording one frame of the captured image signal obtained sequentially on a recording medium,
An imaging device comprising: The event is for indicating the occurrence of information to be alert to the external device, the image synthesizing means, sometimes the transmission request signal is received, only if the previous hearing vent has occurred, the The imaging apparatus according to claim 1 , wherein an image indicating the notification information according to the occurrence of an event is synthesized. Wherein as the information to be alert, the information indicating that the free space of the recording medium is exhausted, and the imaging apparatus according to claim 2, wherein at least one contains Rukoto of the information indicating the dead battery. The notification to the image shown information, characters, symbols and the imaging apparatus according to claim 1, wherein the at least one included among the icons. Claim the captured image transmission control means when the transmission request signal is received by the communication means, for one frame of the captured image signal, and wherein the Rukoto is sent as a thumbnail image obtained by reducing the image size The imaging apparatus according to 1. The captured image transmission control means, the recording request signal is the imaging device according to claim 5, wherein also said Rukoto to transmit the thumbnail image when received by the communication means. When the recording request flag defined in the digital wireless communication method indicates a recording request in the received signal when the transmission request signal is received by the communication unit, the image recording unit imaging device according to claim 1, wherein that you record a signal on the recording medium. 2. The imaging apparatus according to claim 1, wherein an object exchange protocol defined by a Bluetooth standard BIP ( Basic Imaging Profile ) is used as the digital wireless communication system . In an imaging system for remotely operating an image capturing operation wirelessly,
  First communication means for performing wireless communication according to a predetermined digital wireless communication system;
  When the transmission request signal of the captured image for monitoring specified by the digital wireless communication method is continuously received by the first communication unit, the reception request signal for the monitor image is specified by the digital wireless communication method. In accordance with a response procedure for a transmission request signal, a captured image transmission control unit that wirelessly transmits captured image signals sequentially obtained according to imaging by the imaging element through the first communication unit;
  When an event indicating that information to be notified to the transmission-side device of the transmission request signal has occurred in the imaging device upon reception of the transmission request signal, an image indicating notification information corresponding to the event Image synthesizing means for synthesizing a part of the image transmitted by the control of the captured image transmission control means
  A recording request signal for a captured image defined by the digital wireless communication method is the first request signal. Image recording means for recording, on a recording medium, one frame of the captured image signal obtained sequentially when received by the communication means;
  The imaging device comprising:
  Second communication means for performing wireless communication according to the digital wireless communication method;
  Captured image acquisition means for wirelessly transmitting the transmission request signal through the second communication means and receiving the captured image signal as a response;
  Reproduction display means for reproducing and displaying the acquired captured image signal received,
  Image recording requesting means for wirelessly transmitting the recording request signal through the second communication means in response to an operation input by a user for requesting image recording;
  An imaging remote control device comprising:
  An imaging system comprising: In an imaging operation control method for performing an image imaging operation in an imaging apparatus in response to a wireless remote operation,
  When a transmission request signal for a monitor image that is defined in the digital wireless communication method is continuously received by a communication unit that performs wireless communication with an external device in accordance with a predetermined digital wireless communication method, the captured image is transmitted. Each time the transmission request signal is received by the control means, the communication means obtains the picked-up image signals sequentially obtained according to the image pickup by the image pickup device in accordance with a response procedure for the transmission request signal defined by the digital wireless communication system Through wireless transmission,
  When an event indicating that information to be notified to the external device has occurred in the imaging device upon reception of the transmission request signal, the image composition unit indicates notification information corresponding to the event. Combining the image with a part of the image transmitted by the control of the captured image transmission control means,
  When a recording request signal for a captured image defined by the digital wireless communication method is received by the communication unit, the image recording unit records one frame of the captured image signal sequentially obtained on a recording medium.
  An imaging operation control method characterized by the above.

Images