JP2017157892A - Display device and control method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device capable of improving user friendliness by converting reproduction control relevant to images into control values of position and speed of a camera.SOLUTION: The display device includes: a read part 101 that reads out a piece of image data; a flight information acquisition part 105 that acquires a piece of flight information when acquiring an image from the image data; a reproduction control specification part 102 that specifies reproduction control information of the image; a flight information correction part 106 that corrects the acquired flight information based on the reproduction control information; a flight information output section 107 that outputs the corrected flight information; and a display part 110 that displays the image based on a piece of reproduction control information.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a display device capable of outputting photographing conditions and a control method thereof.

  Small aircraft that can fly unattended and operated by remote control or automatic control are widely used, and an imaging method in which a camera is mounted on the small aircraft has become common. When shooting with a camera mounted on a small aircraft flying by such automatic control, if you want to change the shooting conditions such as the camera position and moving speed, you can use a program to control the flight position and flight speed of the small aircraft itself. Need to change.

  Conventionally, as a technique for changing the position and orientation of a camera, a technique of a remote camera control system has been common (see Patent Document 1). The remote camera control system controls the position and orientation of the video camera so that the desired pixel position is located at the center of the image by designating the desired pixel position of the image. According to this technique, the user can intuitively control the position and orientation of the camera by designating the desired pixel position of the image.

JP 2008-288934 A

  However, in the above-described remote camera control system technology, when adjusting shooting conditions such as the camera position and moving speed, it is necessary to directly specify the moving speed control value and re-shoot. It was. In other words, in order to adjust the moving speed of the camera while confirming with the image, it is necessary to repeatedly change the control value of the moving speed, shoot with the changed control value, and confirm the captured image. It was.

  Accordingly, an object of the present invention is to provide a display device that can improve user convenience by converting playback control for video into control values of shooting conditions such as camera position and speed. .

In order to achieve the above object, a display device according to the present invention includes:
A readout unit that reads out video data, a flight information acquisition unit that acquires flight information at the time of shooting from the video data, a playback control specification unit that specifies playback control information of the video, and correction of the acquired flight information based on the playback control information A flight information correction unit for performing, a flight information output unit for outputting the corrected flight information, and a display unit for displaying an image based on the reproduction control information.

  According to the display device of the present invention, user convenience can be improved by converting playback control for video into control values for shooting conditions such as camera position and speed.

1 is a block diagram illustrating a configuration of a display device 100 according to a first embodiment. It is a correction process correspondence table | surface about the correction process which the flight information correction | amendment part 106 performs. 5 is a schematic diagram showing a screen displayed on display unit 110. FIG. FIG. 6 is a block diagram illustrating a configuration of a display device 200 according to a second embodiment.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

[Example 1]
A first embodiment of the present invention will be described. In the embodiment described below, video data captured by a small aircraft stored in an external storage device is reproduced and displayed, and the flight position, flight direction, and flight speed corresponding to the video reproduction are output as flight information. Device. In addition, it is assumed that the flight position, the flight direction, and the flight speed, which are the flight information of the small aircraft at the time of shooting, are assigned to each frame of the video data in the present embodiment as metadata.

  FIG. 1 is a block diagram illustrating the configuration of the display device 100 according to the first embodiment.

  The reading unit 101 reads video data from an external storage device. The read video content data is output to the video decoding unit 103 and the flight information acquisition unit 105.

  The playback control designation unit 102 receives a video playback speed and a deformation instruction from the user through a remote controller or the like. The playback speed of the received video is output to the video decoding unit 103, the deformation information is output to the video deformation unit 104, and the playback speed and the deformation information are output to the flight information correction unit 106.

  The video decoding unit 103 decodes the video data based on the playback speed and generates a video frame. The playback speed in this embodiment indicates the ratio of playback time to shooting time. Specifically, when the value of the reproduction speed is a value smaller than 1, such as ½ times, slow reproduction is performed, and when the value is larger than 1, such as two times, fast-forward reproduction is performed. The generated video frame is output to the video transformation unit 104.

  The video transformation unit 104 transforms the video frame according to the transformation information, and generates a modified video frame. There are various contents of the deformation, but in this embodiment, enlargement / reduction, vertical / horizontal display position shift, and keystone correction are performed. These deformation processes are performed by an image affine transformation process. The generated modified video frame is output to the superimposing unit 109.

  The flight information acquisition unit 105 analyzes the metadata included in the video data, and acquires the flight position, flight direction, and flight speed, which are flight information at the time of shooting. In this embodiment, it is assumed that the video data is motion JPEG data composed of JPEG data arranged in time series, and each JPEG data is given metadata about an image in accordance with the Exif standard. In the flight information acquisition unit 105, from the GPS auxiliary information defined in the Exif standard, the latitude field value and the altitude field value are used as the flight position, the traveling direction field value is used as the flight direction, and the velocity field value is used as the flight. Get as speed. The acquired flight information is output to the flight information correction unit 106.

  The flight information correction unit 106 corrects the received flight information so as to match the video reproduction speed and the deformation information. Details of this processing will be described later. The corrected flight information is output to the flight information output unit 107 and the flight information drawing unit 108.

  The flight information output unit 107 outputs the corrected flight information to an external storage device or the like. The corrected flight information to be output is output as time-series data corresponding to each frame. According to the corrected flight information arranged in chronological order, by performing flight control of the small aircraft when photographing again, photographing at a desired camera position, orientation, and speed becomes possible.

  The flight information drawing unit 108 draws a graphical user interface (Graphical User Interface, hereinafter referred to as GUI) screen showing the corrected flight information. The drawn GUI screen is output to the superimposing unit 109.

  The superimposing unit 109 combines the modified video frame and the GUI screen to generate a display frame. The generated display frame is output to the display unit 110.

  The display unit 110 displays a display frame to the user. There are various techniques for displaying a display frame. In this embodiment, a liquid crystal panel is used.

  FIG. 2 is a correction processing correspondence table showing what correction processing is performed for each video control information with respect to the correction processing performed by the flight information correction unit 106. The left column describes video playback information and video control information which is deformation information. The middle column describes which flight information is corrected for video control. The right column describes what correction processing is performed for the video control. Hereinafter, the video control information and the correction process for the video control information will be specifically described.

  When the playback speed is input as the video control information, it is corrected by multiplying the flying speed by the magnification. As an example, when a reproduction speed ½ times indicating slow reproduction is input, a value obtained by halving the flight speed is output as a corrected flight speed. In the present embodiment, the flight speed is corrected by multiplying the reproduction rate of the video as the flight speed correction coefficient as it is.

  When a zoom value is input as the video control information, the flight position is corrected back and forth. As an example, when the zoom value is input as double magnification, the flight position is corrected by 1 meter before. In this embodiment, the correlation between the magnification of the image zoom value and the correction amount of the flight position is assumed to have a predetermined linear correlation unique to the device.

  When the display position shift value is input as the video control information, the flight position is corrected in the same direction as the display shift. As an example, when a shift value for shifting the display position to the left by 100 pixels is input, the flight position is corrected to the left by 1 meter. In the present embodiment, the correlation between the image shift value and the flight position correction amount is assumed to have a predetermined linear correlation unique to the device.

  When the keystone correction direction and the reduction ratio are input as the video control information, the flight direction is corrected in the direction opposite to the correction direction. As an example, when trapezoidal correction control information is inputted so that the upper side of the video is halved, the flight direction is corrected 45 degrees downward. In this embodiment, the correlation between the reduction rate of the trapezoidal correction of the image and the correction amount in the flight direction is assumed to have a predetermined linear correlation unique to the device.

  In this way, by correcting the video control information and the corresponding flight information, it is possible to adjust the flight information while performing a display simulating the corrected video. That is, since the user can intuitively adjust the flight information, it is possible to save the trouble of repeating photographing, adjustment of flight information, and confirmation of video, and convenience is improved.

  FIG. 3 is a schematic diagram showing an example of a screen displayed on the display unit 110 when an image of a small aircraft taken at a flight speed of 10 kilometers per hour is displayed at a reproduction speed of 1/2 times. The video shows a landscape of a river flowing between two mountains, taken with a small aircraft.

  As described above, when reproduction is performed at a reproduction speed of 1/2, the flight information correction unit 106 corrects the flight speed to 1/2 and outputs it. That is, the corrected flight speed is 5 kilometers per hour. For this reason, the flight information drawing unit 108 draws information of 5 kilometers per hour as a GUI. As a result, as shown on the right side of FIG. 3, the display unit 110 presents a display of 5 kilometers per hour to the user. In the present embodiment, only the corrected flight speed is displayed, but the flight position and the flight direction may always be displayed.

  In this way, by displaying the flight information corrected to correspond to the video control information on the GUI, the user can grasp the details of the correction, and the convenience is improved.

  In this embodiment, the value of each video control information and the correction amount of flight information have a linear correlation unique to the device. However, the user may specify the correlation. As a result, it is possible to adjust the flight information more intuitively specialized for the user's preference and the subject to be photographed.

[Example 2]
Next, a second embodiment of the present invention will be described.

  FIG. 4 is a block diagram illustrating the configuration of the display device 200 according to the second embodiment. Here, the same components as those in the first embodiment are denoted by the same reference numerals, and description thereof is omitted.

  The flight speed control unit 211 receives the corrected flight speed from the flight information correction unit 106. It is determined whether or not the received flight speed exceeds the speed limit, and the determination result is output to the reproduction control designation unit 202.

  The playback control designation unit 202 receives a video playback speed and deformation instruction from the user through a remote controller or the like. The playback speed and deformation information of the received video are output to the flight information correction unit 106, and the determination result is received from the flight speed control unit 211. If the determination result does not exceed the speed limit, the video playback speed is output to the video decoding unit 103 and the deformation information is output to the video deformation unit 104, respectively. If the determination result exceeds the speed limit, the playback speed and deformation instruction of the received video are discarded.

  With such a configuration, it is possible to prevent correction to a flight speed at which flight is impossible.

  In this embodiment, when the speed limit is exceeded, the video playback speed and the deformation instruction are discarded. However, at this time, the fact that the video is discarded may be displayed on the GUI. Thereby, it can be recognized that the user has exceeded the speed limit.

  In this embodiment, it is determined whether or not the corrected flight speed exceeds the limit. However, the limit may be determined based on the flight position and the flight direction. As a result, it is possible to prevent the flight from being prohibited in the flight prohibition area and the inappropriate orientation.

  In this embodiment, when the corrected flight speed exceeds the limit, the playback speed of the received video and the instruction for deformation are discarded, but the maximum value not exceeding the limit value is not discarded. It is good also as processing which replaces with a value. Thus, the maximum value that does not exceed the limit can be easily set.

100 display device, 105 flight information acquisition unit, 106 flight information correction unit,
107 flight information output unit, 108 flight information drawing unit

Claims (3)

A readout unit that reads out video data, a flight information acquisition unit that acquires flight information at the time of shooting from the video data,
A playback control designating unit for designating video playback control information;
A flight information correction unit for correcting the acquired flight information based on the reproduction control information;
A flight information output unit for outputting corrected flight information;
A display device comprising a display unit for displaying video based on reproduction control information. The display device according to claim 1, further comprising a superimposing unit that superimposes the acquired flight information on an image. The display device according to claim 1, wherein it is determined whether or not the corrected flight information exceeds a threshold value, and if it exceeds, video control information is not received.