JP2021170819A - Image control device - Google Patents

Abstract

To provide an image control device capable of intuitively performing control operation when reproducing a travel image.SOLUTION: A control unit displays on a display unit a travel image captured by an on-vehicle camera and recorded in a memory. At this time, the control unit fast-forwards the travel image when receiving an operation of swiping or flicking away from a reference point P2 on the screen of the display unit, but rewinds the travel image when receiving an operation of swiping or flicking toward the reference point P2.SELECTED DRAWING: Figure 3

Description

The present invention relates to a video control device, a video control method, and a program for executing a video control method.

In recent years, touch panel display devices such as smartphones and tablets have become widespread. In such a touch panel type display device, it is known that buttons and seek bars are displayed on the screen, and fast forward and rewind are performed by operating these buttons and seek bars. However, it is difficult to intuitively control the image by operating the buttons and seek bars.

Therefore, if the subject is detected from the image and the screen is flicked in the same direction as the subject's movement direction, the subject is fast-forwarded to the point where the subject is framed out, and if the screen is flicked in the direction opposite to the subject's movement direction, the subject is framed in. An image reproduction method for rewinding to a point is known (Patent Document 1).

JP-A-2015-84483

However, this image reproduction method is based on the premise that an image of a person (subject) crossing in front of the camera is being reproduced, and when applied to reproduction of a running image taken by a camera mounted on a vehicle such as a drive recorder. One example is the problem of discomfort.

The present invention makes it an example of a problem to deal with such a problem. That is, it is an object of the present invention to provide, for example, an image control device capable of intuitively performing control operations when reproducing a traveling image.

In order to solve the above problem, the video control device according to claim 1 includes a display unit for displaying an image, a reception unit for receiving a user operation based on a reference point, and the user operation received by the reception unit. Correspondingly, it is characterized by including a control unit that controls an image displayed on the display unit.

It is a block diagram which shows one Example of the navigation device as the image control device of this invention. (A) is a diagram showing a traveling image taken by the camera shown in FIG. 1 at time t, and (B) is a diagram showing a traveling image taken by the camera shown in FIG. 1 at time t + Δt. It is a figure for demonstrating the user operation based on the reference point in 1st Example. It is a flowchart which shows the reproduction processing procedure performed by the control part of the navigation apparatus shown in FIG. 1 in 1st Example. It is a figure for demonstrating the user operation based on the reference point in the 2nd or 3rd Example. It is a figure for demonstrating the user operation based on the reference point in the 2nd or 3rd Example. It is a flowchart which shows the reproduction processing procedure performed by the control part of the navigation apparatus shown in FIG. 1 in 2nd Example. (A) is a figure which shows the user operation at the time of changing the viewpoint of the image in 6th Example.

Hereinafter, the image control device according to the embodiment of the present invention will be described. The image control device according to the embodiment of the present invention is displayed on a display unit for displaying an image, a reception unit for receiving a user operation based on a reference point, and a display unit according to the user operation received by the reception unit. It is provided with a control unit for controlling the moving image.

In the running image, the background (stationary object) flows radially around the vanishing point. For example, a reference point is set at a position on the display unit corresponding to the vanishing point of the traveling image, and the traveling image is reproduced by controlling the image displayed on the display unit according to the user operation based on the reference point. You can intuitively control the image when you do.

Further, the reference point may be set at a position corresponding to the vicinity of the center or the vicinity of the center of the image displayed on the display unit. As a result, a reference point can be set at or near the vanishing point of the traveling image.

Further, the reference point may be determined based on the vanishing point of the image displayed on the display unit. As a result, a reference point can be set at or near the vanishing point of the traveling image.

Further, the user operation may include an operation of moving away from the reference point or an operation of approaching the reference point. As a result, it is possible to intuitively control the image when reproducing the traveling image.

In addition, the control unit either sends or returns the image when the reception unit accepts an operation away from the reference point, and sends or returns the image when the reception unit accepts an operation approaching the reference point. Either one may be done. As a result, when playing back the traveling image, the image can be intuitively forwarded or returned.

Further, when the reception unit receives an additional operation after the operation of moving away from the reference point, the control unit either sends or returns the image, and the reception unit adds the operation following the operation of approaching the reference point. When the operation of is accepted, either the video may be sent or returned. This allows the feed and return to be swapped with additional operations. For example, if an additional operation is performed when a running image of the vehicle being backed up is displayed, the image can be intuitively forwarded or returned even if the running image of the vehicle is backing up. Can be done.

Further, the control unit may change the video control time according to the user operation according to the length from the start point to the end point in the operation of moving away from the reference point or the operation of approaching the reference point. As a result, the control operation of the control time can be intuitively performed.

Further, when the reception unit receives an operation of moving away from the reference point or an operation of approaching the reference point and stopping at the end point, the control unit ends the control of the image according to the user operation and pauses the image. You may. As a result, it is possible to intuitively perform a control operation for pausing the image.

Further, the control unit may control the video when the reception unit receives an additional operation after the user operation based on the reference point. As a result, it is possible to intuitively control the image when reproducing the traveling image.

Further, the user operation includes an operation of straddling the reference point, and the control unit may switch the viewpoint of the image when the reception unit accepts the operation of straddling the reference point. This makes it possible to easily switch the viewpoint of the image.

Further, in another embodiment of the present invention, in the display control method, the reception process for receiving the user operation based on the reference point and the image displayed on the display unit are controlled according to the user operation received in the reception process. It is provided with a control process for the operation. As a result, it is possible to intuitively control the image when reproducing the traveling image.

Further, in another embodiment of the present invention, the program executed by the computer is a reception unit that accepts a user operation based on a reference point, and an image displayed on the display unit according to the user operation received by the reception unit. The computer functions as a control unit that controls the above. The program is preferably recorded on a recording medium. As a result, it is possible to intuitively control the image when reproducing the traveling image.

(First Example)
Hereinafter, the navigation device as the video control device of the present invention in the first embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing an embodiment of a navigation device as a video control device of the present invention.

The navigation device 1 of this embodiment is mounted on a vehicle. As shown in FIG. 1, the navigation device 1 can reproduce the traveling image captured by the camera 11 recorded in the memory unit 12 in addition to the route guidance.

The navigation device 1 includes a camera 11, a memory unit 12, a GPS receiving unit 13, an operation unit 14, a display unit 15, a touch panel 16 as a contact sensor, a voice output unit 17, and a control unit 18 (reception). Department) and.

The camera 11 is mounted on the vehicle and images the front or the rear of the vehicle. In this embodiment, the camera 11 will be described below assuming that the camera 11 is capturing the front of the vehicle. The memory unit 12 records a running image or the like taken by the camera 11. The memory unit 12 is composed of, for example, a non-volatile memory such as a hard disk or an SD card, and is read / written under the control of the control unit 18 described later.

As is known, the GPS receiving unit 13 receives radio waves oscillated from a plurality of GPS (Global Positioning System) satellites, obtains the current position information, and outputs the current position information to the control unit 18. In this embodiment, the GPS receiving unit 13 is provided integrally with the navigation device 1, but the GPS receiving unit 13 may be configured as a separate body and may be detachable from the navigation device 1. ..

The operation unit 14 is composed of an input unit such as a button and a voice input unit such as a microphone. The operation unit 14 performs various input operations of the navigation device 1 and outputs an operation signal indicating the input operation to the control unit 18.

The display unit 15 is composed of a liquid crystal display, a driver circuit for controlling the liquid crystal display, and the like. The touch panel 16 is arranged on the display screen of the display unit 15, detects contact with a human finger, a touch pen, or the like, and outputs the detection signal to the control unit 18.

The audio output unit 17 is composed of a speaker, an amplifier for driving the speaker, and the like, and outputs audio under the control of the control unit 18.

The control unit 18 is composed of a CPU (Central Processing Unit) having a memory such as a RAM (Random Access Memory) and a ROM (Read Only Memory), and controls the entire navigation device 1. The RAM is a memory in which data can be erased and rewritten, and is a memory for temporarily storing data generated during processing by the CPU. The ROM is a memory in which data cannot be erased or rewritten, and stores processing programs and the like performed by the CPU.

The CPU of the control unit 18 (hereinafter simply abbreviated as the control unit 18) controls the display unit 15 and the audio output unit 17, which will be described later, according to the program written in the ROM to guide the route to the destination. In addition to the processing, drive record processing in which the camera 11 and the memory unit 12 are controlled to record the traveling image taken by the camera 11 in the memory unit 12, and reproduction in which the traveling image recorded in the memory unit 12 is displayed on the display unit 15. Execute the process.

Next, the characteristics of the traveling image captured by the camera 11 that captures the front of the vehicle will be described with reference to FIG. 2A and 2B are running images taken by the camera 11 shown in FIG. 1 when the vehicle is moving forward, FIG. 2A is an image taken at time t, and FIG. 2B is a running image taken at time t + Δt. Is.

As shown in the figure, in the traveling image of the front of the vehicle, a white line 2 on the traveling path on which the vehicle travels and a stationary object such as a signboard or a building are projected as a background 3. In such running image, a plurality of lines parallel to each other as a plurality of white lines 2, meet at the vanishing point P _1, it disappears. When playing or fast-forward the running image, since the vehicle and the background 3 approaches, the background 3, radially around the vanishing point P _1, moves away from the vanishing point P _1. In contrast, when rewinding the traveling image, since the vehicle and the background 3 leaves, the background 3, radially around the vanishing point P _1, moves toward the vanishing point P _1.

In this embodiment, the control unit 18 pays attention to this, and the control unit 18 refers _{to the reference point P 2} on the touch panel 16 provided on the display unit 15 (hereinafter, simply abbreviated as “on the display unit 15”) based on the _{vanishing point P 1.} the determined, according to a user operation based on the reference point P _2, and controls the traveling image to be displayed on the display unit 15. More specifically, the control unit 18, FIG. 3 (A), the radially around the reference point P _2, the reference point P ₂ the user's finger 6 swipe or flick is thereby operated in a direction away from ( when accepting an operation) away from the reference point, and fast-forward running video, as shown in FIG. 3 (B), radially around the reference point P _2, the user in a direction approaching the reference point P ₂ fingers 6 When the operation of swiping or flicking (the operation of approaching the reference point) is accepted, the running image is rewound.

The "swipe" is an operation of sliding a finger in a predetermined direction while touching the screen. Further, "flick" is an operation of moving a finger so as to lightly swipe the screen in a predetermined direction. Further, the finger 6 in FIG. 3 is not displayed on the display unit 15, but represents the actual finger of the user who is touching the display unit 15. The arrow in FIG. 3 is not displayed on the display unit 15, but also represents a locus on the display unit 15 when the user flicks or swipes. The same applies to FIGS. 5, 6 and 8 described later. The circle mark indicating the reference point P2 is not displayed on the display unit 15 in this embodiment, but may be displayed.

The detailed operation of the navigation device 1 described in the above outline will be described with reference to FIG. When the control unit 18 is switched to the reproduction mode of the traveling image captured by the camera 11 in response to the operation of the operation unit 14 or the touch panel 16, for example, the control unit 18 performs the reproduction process. In the reproduction process, the control unit 18 first sets the reference point P2 on the touch panel 16 (step S1).

The setting of the reference point P _2, the reference point P ₂ previously stored in the memory unit 12, it is conceivable to set from the memory unit 12. The vanishing point P ₁ can be obtained in advance from the mounting position of the camera 11. For example, when fitted with the optical axis of the camera 11 so as to be horizontal to the traveling direction of the vehicle, the display screen center or near the center of the display unit 15 a vanishing point P ₁ of the running video. Therefore, the reference point P ₂ is predetermined in the center or the vicinity of the center of the display unit 15 and stored in the memory unit 12. In this way, it is possible to determine the vanishing point P ₁ or vanishing point P ₁ the reference point in the vicinity of P _2. Further, by analyzing the driving image captured by the camera 11, which is recorded in the memory unit 12 obtains the vanishing point P _1, may be determined a reference point P ₂ to the vanishing point P ₁ or vanishing point P ₁ near obtained ..

Next, when the control unit 18 receives a playback operation such as an operation of a play button provided on the operation unit 14 or an operation of the play button displayed on the touch panel 16 (Y in step S2), the control unit 18 is photographed by the camera 11 and stored in a memory. The traveling image stored in the unit 12 is reproduced (step S3). Further, when the control unit 18 receives a pause operation such as an operation of a pause button provided on the operation unit 14 or an operation of the pause button displayed on the touch panel 16 (Y in step S4), the traveling is being reproduced. The video is paused (step S5).

When the control unit 18 receives a swipe or flick operation away from the reference point P2 on the display unit 15 (Y in step S6), the control unit 18 fast-forwards the reproduced traveling image (step S7). The control unit 18 accepts the swipe or flick operation approaches the reference point P ₂ on the display section 15 (Y in step S8), and rewind the traveling image being reproduced (step S9).

Running images, background 3 flows radially around a vanishing point P _1. If the running image photographed in front of the vehicle as in the first embodiment, the background 3 during reproduction or fast-forward flows in a direction away from the vanishing point P _1. On the other hand, the background 3 during rewinding flows toward the vanishing point P _1. Therefore, when receiving the operation away from the reference point P ₂ which is determined based on the vanishing point P ₁ as described above, if the fast-forward, receives an instruction to approach the reference point P _2, by the rewinding , When playing back the running image, the running image can be intuitively fast-forwarded and rewound.

(Second Example)
In the first embodiment described above, fast forward when receiving a swipe or flick operation away from the reference point P _2, had been rewound when accepting a swipe or flick operation approaches the reference point P _2, to Not limited. Travel video obtained by photographing the front of the vehicle, the background 3 during reproduction or fast-forward flow in a direction away from the vanishing point P _1, the background 3 during rewind flows toward the vanishing point P _1, a first embodiment As explained in, this assumes that the vehicle is moving forward. If the vehicle is back, reversed, background 3 during reproduction or fast-forward flow in the direction toward the vanishing point P _1, the background 3 during rewind flows away to the vanishing point P _1.

For this reason, if the finger 6 is swiped or flicked along the flowing direction of the background 3 during playback of the traveling image in front of the vehicle when the vehicle is backing, fast forward and rewind are reversed. That is, the running image when the vehicle is back for background 3 flows toward the vanishing point P _1, the user swipes or flicks the finger 6 in a direction approaching the reference point P ₂ trying fast forward, It will be rewound. Conversely, when the direction away from the reference point P ₂ in an attempt to rewind swiping a finger 6, becomes fast forward.

In the second embodiment, the control unit 18, as shown in FIG. 3 (A), if the direction away from the reference point P ₂ is accepted only operation to swipe or flick the fingers 6, the fast forward driving image performed, as shown in FIG. 5, in a direction away from the reference point P ₂ after operation for swiping the finger 6, operation for swiping the finger 6 in a circular motion continues (hereinafter, be referred to as "additional steps" If) is accepted, it will be rewound. Further, as shown in FIG. 3 (B), if the direction approaching the reference point P ₂ is accepted only operation to swipe or flick the finger 6 performs unwinding of the running video, as shown in FIG. 6, the reference If after the operation for swiping the finger 6 in the direction approaching the point P _2, receives an instruction to swipe a finger in a circular motion continues, performs the fast forward driving image. The direction of drawing the circle may be clockwise as shown in FIGS. 5 (A) and 6 (A), or counterclockwise as shown in FIGS. 5 (B) and 6 (B).

The detailed operation of the navigation device 1 described in the above outline will be described with reference to FIG. 7. In the figure, the steps that perform the same operation as the flowchart shown in FIG. 1 already described in the first embodiment are designated by the same reference numerals, and detailed description thereof will be omitted. When the control unit 18 is switched to the reproduction mode of the traveling image captured by the camera 11 in response to the operation of the operation unit 14 or the touch panel 16, for example, the control unit 18 performs the reproduction process. Since steps S1 to S5 are the same as those in the first embodiment, the description thereof will be omitted.

Control unit 18 receives only the operation to swipe or flick in a direction away from the reference point P ₂ on the display unit 15, if no additional operations (Y at step S10), and fast forward traveling video being played (Step S11). Control unit 18, after swiping toward the reference point P ₂ on the display unit 15, even when receiving additional operations continued (Y in step S12), and fast forward traveling video being played ( Step S11).

In contrast, the control unit 18 receives only the operation to swipe or flick in the direction toward the reference point P ₂ on the display unit 15, if no additional operations (Y at step S13), and is being reproduced The traveling image is rewound (step S14). The control unit 18, after swiping away from the reference point P ₂ on the display unit 15, when receiving additional operations continued (Y in step S15), and rewind the running video being played (Step S14).

According to the second embodiment described above, the feed and the return can be exchanged by performing an additional operation. As a result, for example, if a running image when the vehicle is backing up is displayed and an additional operation is performed, the fast-forwarding operation of the image is intuitively performed even if the running image is when the vehicle is backing up. Alternatively, a return operation can be performed.

(Third Example)
In the first embodiment described above, the control unit 18 accepts an operation to swipe or flick the user's finger 6 toward the direction or the reference point P ₂ away from the reference point P _2, have been fast-forward or rewind However, it is not limited to this. In the third embodiment, the control unit 18, as shown in FIG. 5, to swipe a finger 6 in a circular motion to continue after the finger 6 is swipe in a direction away from the reference point P ₂ on the display unit 15 If an operation (additional operation) is accepted, fast forward. Further, when receiving an operation for swiping the finger 6 in a circular motion followed After swiping the finger 6 in a direction approaching the reference point P ₂ on the display unit 15 as shown in FIG. 6, to rewind.

That is, in the third embodiment, the fast forward or rewind is performed only by swiping the finger 6 in the direction _{away from the reference point P 2} on the display unit 15 or in the _{direction approaching the reference point P 2 as in the first embodiment.} Fast forward or rewind is performed only when the operation of swiping the finger 6 in a circular motion is received. That is, the control of fast-forwarding and rewinding of the traveling image is confirmed by the additional operation. Therefore, even if the user accidentally swipes or flicks on the display unit 15, fast forward or rewind is not performed, so that an erroneous operation can be prevented.

In the second and third embodiments, as an additional operation to be performed after the swipe, the finger 6 is swiped in a circular motion, but the present invention is not limited to this. The additional operation may be an operation that can be distinguished from a swipe, and may be, for example, a double tap.

(Fourth Example)
In the first to third embodiments, when the swipe or flick operation away from the approaching or reference point P ₂ to the reference point P2, a fast-forward or rewind to the other operations, such as subsequent playback operation or pause operation is performed It was continued, but it is not limited to this. In the fourth embodiment, when the reference point approaches the P ₂ or swipe or flick operation away from the reference point P _2, by performing only forward or rewind a predetermined control time, after the control time rewind or fast-forward It may be finished, and it may be played from the time of the end or paused at the time of the end.

At this time, it is also possible to change the control time according to the length from the start point of the swipe or flick operation away from the reference point P ₂ approaching or reference point P ₂ to the end point. That is, the control time may be lengthened as the length from the start point to the end point of the swipe or flick operation becomes longer, and the rewind or fast forward time may be lengthened.

According to the fourth embodiment described above, the rewinding or fast-forwarding time can be intuitively controlled.

(Fifth Example)
In the fifth embodiment, the case where the finger 6 at the end of the swipe away approaching or from the reference point P ₂ to the reference point P ₂ receives an instruction to stop, exit fast forward or rewind, pause a running video You may try to do it. That is, the control unit 18 performs fast forward or rewind while the swipe operation is being performed, and when the finger 6 is stopped at the end point of the swipe operation, the running image is fast forwarded or rewound, and at that time. Pause. Further, if the finger 6 is immediately released without stopping the finger 6 at the end point of the swipe operation, the fast-forwarding or rewinding of the traveling image is continued.

(6th Example)
Further, in recent years, as a camera 11, a wide-angle camera capable of taking a picture of, for example, 360 ° is also on the market. Therefore, as shown in FIG. 8 (A), when receiving a swipe operation of crossing over the reference point P _2, as shown in FIG. 8 (B), it may be changed viewpoint. For example, when the viewpoint is moved to the right, the background 3 such as a building moves to the left. Therefore, when receiving a swipe operation of crossing over the reference point P _2, and displays the running video moving the viewpoint swipe the direction opposite to the direction. As a result, the background 3 moves in the same direction as the swipe direction, and an intuitive viewpoint changing operation can be performed.

In the first to sixth embodiments described above, but I want to perform fast forward or rewind and accepting an operation closer to or away from the reference point P ₂ from the reference point P _2, not limited to this. For example, if an operation of moving away from the _{reference point P 2 or approaching the reference point P 2} is accepted during the pause, frame advance or frame return may be performed.

Further, in the above-described first to sixth embodiments, the camera 11 is installed toward the front of the vehicle and reproduces an image of the front of the vehicle, but the present invention is not limited to this. The camera 11 may be installed toward the rear of the vehicle to reproduce a traveling image of the rear of the vehicle. Image obtained by photographing the vehicle rear, in contrast to the images taken in front of the vehicle flows in the direction the background during playback or fast forward is closer to the vanishing point P _1. Further, the background during rewinding flows away to the vanishing point P _1. Therefore, when reproducing an image obtained by photographing the vehicle rear, reception in contrast to the first embodiment, when receiving a direction of the operation to approach the reference point P _2, to fast forward, the direction of operation away from the reference point P ₂ If so, it may be rewound.

Further, in the first to sixth embodiments described above, the control unit 18 wants to fast forward or rewind at a constant speed regardless of the speed of the swipe or flick operation, but the present invention is not limited to this. The faster the swipe or flick operation, the faster the fast forward or rewind speed may be.

Further, in the above-described first to sixth embodiments, the navigation device is used as the video control device, but the present invention is not limited to this. For example, the video control device may be any device that can reproduce video, and may be, for example, a drive recorder with a display unit, a smartphone, a tablet, or the like.

Further, in the first to sixth embodiments described above, and displays the running image on the entire screen of the display unit 15, had established the reference point P ₂ on the display screen center or the center of the screen near the display unit 15, in which Not limited. For example, the display unit 15 may display the navigation image on the full screen, and the window on which the running image is displayed may be superimposed and displayed on the navigation image. In that case, the reference point P2 is set at a position on the display unit 15 according to the vicinity of the center or the vicinity of the center of the traveling image, that is, at the center or the vicinity of the center of the window.

Further, in the first to sixth embodiments described above, the touch panel 16 is provided on the display unit 15 and the image can be controlled by operating the display unit 15, but the present invention is not limited to this. The touch panel 16 may be provided at a different location from the display unit 15 so that the image of the display unit 15 can be controlled according to the user operation based on the reference point P2 determined at the center or the vicinity of the center of the touch panel 16.

In addition, the above-described examples merely show typical embodiments of the present invention, and the present invention is not limited to the embodiments. That is, it can be modified in various ways without departing from the gist of the present invention.

1 Navigation device (video control device)
15 Display unit 18 Control unit (reception unit)
P ₁ vanishing _{point P 2} reference point

Claims (1)

A display unit that displays images and
A reception unit that accepts user operations based on the reference point,
A control unit that controls an image displayed on the display unit in response to the user operation received by the reception unit.
A video control device characterized by being equipped with.

Images