JP2014060500A - Display control device and imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display control device that solves problems that are as follows: although it is possible to display an enlarged live view image by obtaining a high pixel image from a camera and cutting out and enlarging only a partial region of the image at a display device, followability of the live view cannot be expected due to handling of large data; and when a shift instruction on an enlargement position of the live view is given to an imaging device, instinctive and easy operation cannot be provided for a photographer.SOLUTION: A display control device of the invention is characterized by including: specifying means for accepting operation to a touch panel and specifying a partial region of a range imaged by an imaging device; and requesting means for requesting to cut out an image in the region specified by the specifying means and to transmit it via communication means.

Description

  The present invention relates to performing a live view enlargement instruction and an enlargement position moving operation from the display control device 100 to the imaging device when the display control device 100 and the imaging device are connected and can be remotely operated. is there.

  Conventionally, there is a case where an imaging device is installed at a high place for product photography or the like, and photographing is performed by remote control in photographing from a bird's-eye view or photographing a natural animal. In this case, the display control device 100 and the imaging device are connected by communication, and a display similar to the live view display displayed on the rear display screen of the imaging device is displayed on the display of the remote display control device. Convenient.

  On the other hand, in recent years, display devices having a touch panel, such as smartphones and tablet PCs, have become widespread. In such operations on the touch panel of the display device, operations such as image enlargement, reduction, and scrolling can be performed by touch and drag operations. (See Patent Document 1) It is also possible to enlarge an image and change the display position by a gesture operation on the touch panel. (See Patent Document 2.)

JP 2005-234199 A JP 2011-50038 A

  In the remote shooting described above, the photographer uses the enlarged live view image to determine the composition of the shooting target and determine the focus position while referring to the live view image of the imaging device displayed on the display of the display control device. When done, it is highly convenient.

  To display an enlarged live view image, it is possible to acquire a high-pixel image from the camera and cut out and enlarge only a part of the area on the display device. The followability of the view cannot be expected. In addition, the current communication speed such as USB communication is not fast enough to communicate a large image while keeping trackability.

  When the touch panel display of the display control device is small, if an operation member that moves the area to be enlarged during the enlarged live view display is placed on the live view display screen, the live view display is hidden by the member, and the focus position cannot be confirmed. There is a problem that becomes difficult. In addition, when it is arranged outside the live view display screen, the display area of the live view screen becomes small due to the members, making it difficult to check the screen. Although there is a method using a touch operation as in the prior art, when a command for moving the enlargement position of the live view is issued to the imaging apparatus, an operation that is not intuitively understandable to the photographer is required, and a countermeasure for that is required. .

  Therefore, an object of the present invention is to reduce the time lag from shooting to display when performing live view display in remote shooting.

  A further object of the present invention is to reduce the time lag from shooting to display when performing enlarged live view display in remote shooting.

  Furthermore, in the present invention, when an enlarged live view display is performed by remote shooting on a device using a touch panel display, the enlargement position can be moved without disposing a display member that hides the live view image. Become. Then, it is an object to enable the photographer to move the enlargement position of the live view intuitively by operating by combining touch and slide.

  In order to solve such a problem, a display control device according to the present invention is photographed by an imaging device using a communication unit that communicates with the imaging device, a display unit that displays an image, a touch panel disposed on the display unit, and the communication unit. A display control unit that displays the received image, and a display control unit that displays the received image on the display unit, and an operation for accepting an operation on the touch panel, and specifying a part of the region that is captured by the imaging device And a request means for requesting to cut out an image of an area designated by the designation means and transmitting the image via the communication means.

  The imaging device of the present invention communicates with an imaging unit that acquires an image and an external display control device, and transmits image data that is acquired as needed before a shooting instruction is sent to the display control device. And receiving means for receiving an instruction for designating a part of the range being imaged by the imaging unit from the display control device. A part of the image corresponding to a specified part of the imaged range is cut out and transmitted to the image display device.

  According to the present invention, when the photographer operates the touch panel display of the display control device 100 that is remotely connected to the imaging device 2 to move the enlarged position in the remote live view, the live view screen is moved for moving the enlarged position. Without being hidden by the display member, the position of the destination can be easily understood and can be realized by a touch operation with good operability.

  In addition, the imaging device is instructed and only the part corresponding to the enlarged live view image displayed on the display of the display control device is cut out and transmitted on the camera side. It can be expected to improve.

1 is a system configuration diagram showing an embodiment of an imaging apparatus 2 according to the present invention. It is a block block diagram which shows the structure of the imaging device 2 which concerns on this invention. It is a block block diagram which shows the structure of the display control apparatus 100 which concerns on this invention. It is a figure which shows the structure on a remote imaging | photography screen, and the structure which concerns on the movement control of a live view expansion position. It is a figure which shows the structure on a remote imaging | photography screen, and the structure which concerns on the movement control of a live view expansion position. It is a figure which shows the structure on a remote imaging | photography screen, and the structure which concerns on the movement control of a live view expansion position. 5 is a flowchart illustrating a control procedure of the remote live view control method according to the first embodiment. 5 is a flowchart illustrating a control procedure of a live view enlargement position movement control method according to the first embodiment.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is a system configuration diagram according to an embodiment of the present invention.

  Example 1 showing the embodiment of the present invention will be described below.

  FIG. 1 shows a schematic diagram of an interchangeable lens type imaging device 2.

  The interchangeable lens 1 generally includes a zoom lens 11 for changing a focal length, a diaphragm mechanism 12 for controlling brightness, and a focus lens 13 for focusing on a subject. In addition, the interchangeable lens 1 is configured such that the lens-side mount 14 can be mechanically joined to the mount portion 27 of the imaging device 2. The imaging device 2 reflects light that has passed through the lens with a half mirror 21 and forms an image at the position of the focusing plate 24. The light imaged on the focus plate 24 is inverted by the prism 25 and can be observed as an erect image through the eyepiece lens 26.

  Further, at the time of shooting, the half mirror 21 jumps up, the shutter 22 opens, and the light passing through the lens 1 forms an image on the image sensor 23.

  A contact group 15 is incorporated in the mount portion 14 of the interchangeable lens 1. The contact group 15 is a contact (not shown) for supplying power from the imaging device 2 main body and performing communication. The contact group 15 is divided into applications such as power supply, ground, transmission, reception, and clock.

  The mount part 14 of the interchangeable lens 1 is joined to the mount part 27 of the imaging device 2, whereby the contact group 15 in the mount part 14 and the connection terminal in the contact group 28 in the mount part 27 are connected to each other. .

  As a result, power is supplied from the imaging device 2 to the interchangeable lens 1 via the connection terminal, and communication is started between the interchangeable lens 1 and the imaging device 2.

  A communication cable 60 is connected to the external display control apparatus 100 to enable communication. The imaging device 2 and the display control device are each provided with a communication interface (not shown), and can communicate by being connected via a cable 60. The communication interface of the imaging device 2 functions as a transmission unit that transmits an image to the display control device, and also functions as a reception unit that receives various requests and commands from the display control device.

  Next, FIG. 2 shows a block configuration inside the imaging apparatus 2.

  The image sensor 23 is a sensor such as a CCD or a CMOS, and the light imaged on the image sensor 23 is converted into an amount of electric charge corresponding to the amount of incident light in each pixel in the image sensor 23.

  The signal generated by the timing generator 32 drives the image sensor 23, transmits the charge accumulated in the sensor, and is sequentially converted into a voltage signal.

  The converted voltage signal is sampled by correlated double sampling 30 (hereinafter referred to as CDS) and converted to a digital signal by an A / D converter 31.

  The image pickup device 23, the correlated double sampling 30, and the A / D converter 31 can acquire images as a whole, and collectively function as an image pickup unit of the image pickup apparatus.

  The image data converted into the digital signal is input to the IC 33, first enters the WB circuit 33 a for calculating data for white balance with respect to the data, and is temporarily stored in the memory 1 of 35.

  The data stored in the memory 1 of 35 is input again to the IC 33 and subjected to three image processes.

  First, the image data converted into a digital signal is converted into RAW data that has been losslessly compressed by a lossless compression circuit 33d that performs lossless compression (reversible compression), and is sent to the CPU bus 34.

  The image data converted into a digital signal is sent to the CPU bus 34.

  Finally, in order to create an image for jpeg compression, image processing is performed in the image processing circuit 33b, and YcbCr output as a result is subjected to raster block conversion, and jpeg compression is performed in the jpeg compression circuit 33e. It is sent to the CPU bus 34.

  Immediately after the power is turned on, the CPU 36 initializes the imaging device 2 according to the program in the memory 2 37 and starts communication with the interchangeable lens.

  Further, the CPU stores the image data output to the CPU bus 34 as the captured image data once in the memory 1 35 and finally writes it in the external memory 39 via the interface circuit 38.

  A switch 40 connected to the CPU 36 is a release switch. When the switch 40 is pressed, the above-described photographing operation is performed, and an image is written in the external memory 39.

  Further, at the time of live view display, the half mirror 21 jumps up, opens the shutter 22, and the light passing through the lens 1 forms an image on the image sensor 23. The captured image data is stored in the memory 2 of 37, a live view image is written in the VRAM 40, and a live view display is performed on the rear display 43 installed in the imaging apparatus 2 by the video IC 41 for display control.

  Live view display updates the captured images at regular intervals, replacing the confirmation of the subject to be photographed through the optical viewfinder.

  FIG. 3 shows a block diagram as an example of the configuration of the display control apparatus 100 to which the present invention can be applied. The display control apparatus 100 can be configured using a personal computer, a smartphone (hereinafter, referred to as a PC), and the like.

  In FIG. 3, a CPU 101, a memory 102, a nonvolatile memory 103, an image processing unit 104, a display 105 as a display unit, an operation unit 106, a recording medium I / F 107, an external I / F 109, a communication I / O are connected to an internal bus 150. F110 is connected. Each unit connected to the internal bus 150 can exchange data with each other via the internal bus 150.

  The memory 102 is composed of, for example, a RAM (a volatile memory using a semiconductor element). The CPU 101 controls each unit of the display control apparatus 100 using the memory 102 as a work memory, for example, according to a program stored in the nonvolatile memory 103. The nonvolatile memory 103 stores image data, audio data, other data, various programs for operating the CPU 101, and the like. The nonvolatile memory 103 is composed of, for example, a hard disk (HD) or ROM.

  Based on the control of the CPU 101, the image processing unit 104 acquires image data stored in the nonvolatile memory 103 or the recording medium 108, a video signal acquired via the external I / F 109, or a communication I / F 110. Various image processing is performed on the image data. The image processing performed by the image processing unit 104 includes A / D conversion processing, D / A conversion processing, image data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resizing), noise reduction processing, and color conversion. Processing etc. are included. The image processing unit 104 may be configured with a dedicated circuit block for performing specific image processing. Further, depending on the type of image processing, the CPU 101 can perform image processing according to a program without using the image processing unit 104.

  The display 105 serving as a display unit displays an image, a GUI screen configuring a GUI (Graphical User Interface), and the like based on the control of the CPU 101. The CPU 101 also functions as a display control unit, generates a display control signal according to a program, and controls each unit of the display control apparatus 100 so as to generate a video signal to be displayed on the display 105 and output it to the display 105. The display 105 displays a video based on the output video signal. The display control apparatus 100 itself may include an interface for outputting a video signal to be displayed on the display 105, and the display 105 may be configured with an external monitor (such as a television).

  The operation unit 106 is an input device for receiving user operations including a character information input device such as a keyboard, a pointing device such as a mouse and a touch panel, buttons, dials, joysticks, touch sensors, touch pads, and the like. Note that the touch panel is an input device that is configured to be two-dimensionally superimposed on the display 105 so that coordinate information corresponding to the touched position is output. As a result, operations such as designation of a position to be displayed and movement of an enlarged position can be performed.

  The storage medium I / F 107 can be loaded with a recording medium 108 such as a memory card, a CD, or a DVD. Under the control of the CPU 101, data can be read from the loaded recording medium 108 and data can be written to the recording medium 108. I do. The external I / F 109 is an interface that is connected to an external device by a wired cable or wirelessly to input / output a video signal or an audio signal. The communication I / F 110 is an interface for communicating with an external device, the Internet 111, and the like to transmit and receive various data such as files and commands.

  The CPU 101 can detect the following operations on the touch panel included in the operation unit 106. Touching the touch panel with a finger or a pen (hereinafter referred to as touchdown). The touch panel is touched with a finger or a pen (hereinafter referred to as touch-on). The touch panel is moved while being touched with a finger or a pen (hereinafter referred to as a move). The finger or pen that was touching the touch panel is released (hereinafter referred to as touch-up). A state where nothing is touched on the touch panel (hereinafter referred to as touch-off). The CPU 101 is notified of these operations and the position coordinates where the finger or pen touches the touch panel via the internal bus 150, and the CPU 101 determines what operation has been performed on the touch panel based on the notified information. . Regarding the move, the moving direction of the finger or pen moving on the touch panel can also be determined for each vertical component / horizontal component on the touch panel based on the change of the position coordinates. It is also assumed that a stroke is drawn when touch-up is performed on the touch panel through a certain move from touch-down. The operation of drawing a stroke quickly is called a flick. A flick is an operation of quickly moving a certain distance while touching a finger on the touch panel and then releasing it, in other words, an operation of quickly tracing a finger on the touch panel. If it is detected that the moving is performed at a predetermined speed or more over a predetermined distance, and a touch-up is detected as it is, it can be determined that a flick has been performed. In addition, when it is detected that the movement is performed at a predetermined distance or more and less than a predetermined speed, it is determined that the drag has been performed. The touch panel may use any of various types of touch panels such as a resistive film type, a capacitance type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. .

  Next, a method for remote release control in the image pickup apparatus 2 connected to the display control apparatus 100 in FIG. 1 via the external interface 38 of the present invention will be described.

  The live view display screen is displayed on the touch panel display 51 that combines the operation unit 106 of the display control apparatus 100 and the display 105.

  FIG. 4 is a display example of the touch panel display 51 in the display control apparatus 100, and displays an image display in a remote live view and an operation unit. When the display control apparatus 100 and the imaging apparatus 2 communicate with each other by wireless or wired connection, a live view is started by executing a predetermined operation based on a predetermined program. As a result, a live view image is sent from the imaging device 2 to the display control device 100, and a live view display as shown in FIG. 4A is made on the live view display screen 311 installed on the operation / display panel 310 (see FIG. 4A). Remote live view shooting method). This live view display is realized by the camera acquiring images as needed at a predetermined timing and transmitting the images to the display control device via the communication means even if the photographer does not give a shooting instruction.

The display control unit displays an image acquired at any given time to display a live view enlargement frame 315 on the live view display screen 311 when it is not enlarged. When an operation such as tapping the screen 311 twice is performed, the screen is switched to the enlarged live view display as shown in FIG. Alternatively, by operating an enlargement / reduction icon (hereinafter, enlargement / reduction button 312) arranged on the operation / display panel 311 of the remote live view, the display is switched to the enlarged live view display as shown in FIG. .

  During normal live view display that is not enlarged, the entire imaged range is sent to the display control device, and the display control device displays the entire sent image. When the enlargement / reduction button 312 is pressed, the display can be switched to an enlarged live view display. If the enlargement / reduction button 312 is pressed again while the enlarged live view is displayed, the display is switched to the normal live view display.

  The live view enlargement frame 315 can designate a partial area to be enlarged and displayed from the range being imaged. The live view enlargement frame 315 can be changed so as to be generated by designating two rectangular points by a touch panel operation.

  When the photographer changes the live view enlargement position in the state where the live view display is magnified by the photographer's operation, the live view display screen 311 is touched (FIG. 5A) and reverse to the direction in which the user wants to move while touching. Slide your finger in the direction (FIG. 5B). At this time, the live view display screen 311 moves according to the slide. When the photographer performs a slide operation and moves his / her finger away from the operation / display panel 310 at a position where the image displayed on the live view display screen is to be moved, the moving amount of the live view display screen 311 at the time of the release is specified and imaging is performed. The movement amount is determined from the coordinate system of the live view image acquired from the apparatus 2 and the enlargement ratio. Then, the coordinates of the moving destination of the live view enlargement position are transmitted from the display control apparatus 100 to the imaging apparatus 2 with the reciprocal coordinates obtained by subtracting the coordinates in the X axis direction and the Y axis direction of the moving amount as the moving destination coordinates. Based on the received coordinate information of the movement destination, the imaging device 2 moves the region that is cut out from the range being imaged, and transmits the image of the cut region after the movement to the display control device. The display control apparatus 100 acquires the live view enlarged image after movement from the imaging apparatus 2 and displays it on the live view display screen 311 (FIG. 6).

  FIG. 7 is a control flowchart of live view enlargement / reduction according to the present embodiment.

  The imaging device 2 is connected to the display control device 100 via the interface 38. The display control device 100 can communicate with the imaging device 2 and obtain information such as the shooting settings inside the imaging device 2 and the current state.

  In step S101, the imaging apparatus 2 and the display control apparatus 100 are both turned on and energized to be operable.

  In step S102, the display control apparatus 100 notifies the imaging apparatus 2 of the current setting information of the display control apparatus 100, and the imaging apparatus 2 receives the setting state of the display control apparatus 100.

  In step S102, the current camera setting information is notified from the imaging apparatus 2 to the display control apparatus 100, and the display control apparatus 100 receives the state of the imaging apparatus 2.

  The setting information received from the imaging apparatus 2 in step S102 is information such as a shooting mode setting state, white balance setting information, and a live view state.

  The setting information of the imaging device 2 is updated from the imaging device 2 to the display control device 100 when the state of the imaging device 2 is changed by the photographer or when the setting from the display control device 100 to the imaging device 2 is changed. Be notified.

  In step S103, the display control apparatus 100 notifies the imaging apparatus 2 of the start of the remote live view, and the imaging apparatus 2 starts the live view.

  In step S <b> 104, the display control apparatus 100 receives live view images from the imaging apparatus 2 at regular intervals, and updates the live view display on the live view display screen 311 of the touch panel display 51.

  In step S105, coordinate information of an enlarged frame attached to the live view image acquired in step S104 is acquired.

  In step S106, the enlarged frame information and the live view image obtained from the imaging device 2 are displayed on the remote live view screen 311.

  In step S107, it is determined whether the photographer has pressed the enlargement / reduction button 312. If it has been pressed, the process proceeds to step S108. If not, the process proceeds to step S109.

  In step S108, the imaging device 2 is instructed to return the live view to the normal display when the live view is currently enlarged, and the enlargement / reduction command is issued to the imaging device 2 when the live view is normal. .

  In step S109, it is determined that the live view end operation on the imaging device 2 side or the user has performed the remote live view end operation on the computer 50. If the answer is affirmative (YES), the process proceeds to step S109. . If the answer is negative (NO), the process returns to step S104 to determine the user operation (operation).

  In step S110, the operation / display panel 301 is closed, the imaging device 2 is notified of the end of the live view, and the remote live view is ended.

  If communication is disconnected in step S111, the power is turned off in step S112 and the process is terminated.

  FIG. 8 is a flowchart of enlargement position movement control during live view enlargement according to the present embodiment, and shows control after live view enlargement in the enlargement / reduction process shown in the flowchart shown in FIG.

  In step S201, it is determined whether the photographer has slid the live view display screen 311. If it is determined that the photographer has slid, the process proceeds to step S202. If not, the process proceeds to step S203.

  In step S202, the live view display screen 311 is moved following the operation according to the slide operation direction, and the process proceeds to step S203.

  In step S203, it is determined whether or not the photographer has released the finger that has been slid from the live view display screen 311. If it has been released, the process proceeds to step S204. It waits to operate the screen 311.

  In step S204, the horizontal X and vertical Y movement amounts are calculated from the position of the live view display screen 311 when the photographer releases the finger and the initial position of the live view display screen 311 at the start of movement, and the process proceeds to step S205. .

  In step S205, the enlargement ratio of the current live view enlarged image obtained from the imaging apparatus 2 and the reciprocal of the movement amount of the live view display screen 311 (the X-axis direction movement amount and the Y-axis direction movement amount of the live view display screen are respectively minus). ) Is calculated. Thereby, the coordinates of the movement destination in the coordinate system of the live view image are calculated, and the process proceeds to step S206.

  In step S206, the imaging apparatus 2 is instructed to move the enlargement position to the coordinates of the live view enlargement position calculated in step S205, and the process proceeds to step S207.

  In step S207, the slid live view display screen 311 is returned to the original position at the start of the slide, and the process returns to step S201 to determine the user operation.

  As described above, when the imaging device is instructed and only the part corresponding to the enlarged live view image displayed on the display of the display control device is cut out and transmitted on the camera side, the communication load and the display load are reduced. It can be reduced, and it can be expected that the follow-up will improve.

  In addition, it is possible to adjust the focal position while confirming the enlarged live view display, and by performing a slide operation on the touch panel, a command for moving the enlarged position is issued to the imaging apparatus, and the enlarged live view image after movement is transmitted from the imaging apparatus. Acquired and displayed. This makes it possible to change the area to be enlarged in the enlarged live view without displaying a move button, etc., and if only the part corresponding to the enlarged live view image is cut out and sent on the camera side, Communication load and display load can be reduced and follow-up is good.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. A part of the above-described embodiments may be appropriately combined.

  Also, when a software program that realizes the functions of the above-described embodiments is supplied from a recording medium directly to a system or apparatus having a computer that can execute the program using wired / wireless communication, and the program is executed Are also included in the present invention.

  Accordingly, the program code itself supplied and installed in the computer in order to implement the functional processing of the present invention by the computer also realizes the present invention. That is, the computer program itself for realizing the functional processing of the present invention is also included in the present invention.

  In this case, the program may be in any form as long as it has a program function, such as an object code, a program executed by an interpreter, or script data supplied to the OS.

  As a recording medium for supplying the program, for example, a magnetic recording medium such as a hard disk or a magnetic tape, an optical / magneto-optical storage medium, or a nonvolatile semiconductor memory may be used.

  As a program supply method, a computer program that forms the present invention is stored in a server on a computer network, and a connected client computer downloads and programs the computer program.

DESCRIPTION OF SYMBOLS 1 Lens which can be exchanged 2 Image pick-up device 2 which can exchange lens 23 Image sensor 33 Image processing IC
37 Memory for storing optical correction data 38 External storage means, interface for connecting computer and imaging device 2 39 External storage means

Claims (5)

Communication means for communicating with the imaging device;
A display for displaying an image;
A touch panel disposed on the display unit;
A display control unit that receives an image captured by the imaging device by the communication unit and displays the received image on the display unit;
A designation means for accepting an operation on the touch panel and designating a partial area from a range in which the imaging device is imaging;
A display control apparatus comprising: a request unit that requests to cut out an image of an area designated by the designation unit and transmit the image through the communication unit.   The designation means changes the area designated by the designation means in response to accepting a slide operation to the touch panel, and the request means controls the display control of the image of the changed area via the communication means. The display control apparatus according to claim 1, wherein the display control apparatus requests transmission to the apparatus. The imaging device acquires an image at any time at a predetermined timing until a shooting instruction is given, transmits the image to the display control device via the communication unit,
The display control device according to claim 1, wherein the display control unit displays a live view image on the display unit by displaying an image acquired as needed at a predetermined timing.   In the live view display, the imaging apparatus is instructed to switch between an entire display that displays the entire range captured by the imaging apparatus and an enlarged display that displays a part of the area captured by the imaging apparatus. The display control apparatus according to claim 3, further comprising: An imaging unit for acquiring an image;
A transmission unit that communicates with an external display control device and transmits image data that is acquired as needed before a shooting instruction is made to the display control device;
Receiving means for receiving, from the display control device, an instruction for designating a partial area of the range imaged by the imaging unit;
In accordance with the instruction received by the receiving unit, the transmitting unit cuts out an image of a portion corresponding to the specified partial area from the range captured by the imaging unit and transmits the image to the image display device. An imaging apparatus characterized by:

Images