KR20180053221A - Display device and method for control thereof - Google Patents

Abstract

An electronic device for reproducing an image and a control method thereof are disclosed. The control method of the electronic device according to the present disclosure includes a step of acquiring a first image and a second image including additional information on at least one frame among a plurality of frames, a step of obtaining first additional information corresponding to a first frame to be reproduced among the plurality of frames included in the first image, a step of determining the second frame of the second image corresponding to the first additional information when a predetermined user command for playing the second image is input while the first frame of the first image is being reproduced, and a step of reproducing the second image from the second frame. When a viewer views the second image from the first image, a part of the second image which the viewer wants can be provided.

Description

[0001] DESCRIPTION [0002] DISPLAY DEVICE AND METHOD FOR CONTROL THEREOF [

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and a control method thereof, and more particularly to an apparatus and method for reproducing a necessary image from a desired position when a plurality of images are continuously reproduced.

As mobility is expanded with the generalization and miniaturization of high-performance cameras, shooting of personal images is increasing. Also, due to the development of smartphone technology and wireless internet network, smartphone users can watch video anytime and anywhere. With the development of this technology, the user can easily access the image and watch various images.

However, when a user views a plurality of images, there is an inconvenience that each image must be viewed from the beginning. For example, when a user who enjoys a soccer game wants to view only a goal scene of a specific athlete, the viewer can reproduce a plurality of images if the only scene of the particular athlete does not view the edited image, There was a need to find and watch the scene of scoring goals.

Disclosure of Invention Technical Problem The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a method and apparatus for providing a second image from a desired portion when a viewer views a second image on a first image by inserting additional information into a frame constituting the image .

According to an aspect of the present invention, there is provided a method of controlling an electronic device, the method comprising: obtaining a first image and a second image including additional information on at least one frame among a plurality of frames; The method comprising the steps of: acquiring first additional information corresponding to a first frame to be reproduced out of a plurality of frames included in one image, acquiring first additional information corresponding to a preset first additional information for reproducing the second image while the first frame of the first image is being reproduced Determining a second frame of the second image corresponding to the first additional information when a user command is input, and reproducing the second image from the second frame; .

In this case, the one frame is a frame being reproduced at a time when the user command is input, and the user command is an instruction to reproduce the second image.

The method may further include displaying a plurality of display items corresponding to a plurality of objects on the first image, wherein the user command is an instruction to select one of the plurality of display items, And the first additional information for one frame is additional information corresponding to the selected display item.

In this case, the first frame is a frame including additional information on an object corresponding to the display item to which the user command is input.

In this case, the reproducing step may reproduce the second image from the second frame after the first image is reproduced from the time when the user command is input to the first frame.

In this case, the obtaining of the first additional information may further include filtering only specific additional information among a plurality of additional information inserted in the first frame.

The determining of the second frame may include determining second additional information corresponding to the first additional information, and determining the second frame of the second image corresponding to the second additional information . ≪ / RTI >

Here, the additional information may include at least one of GPS information, azimuth information, time information, object information through image analysis, keyword information, voice keyword information, and hash tag information.

Synthesizing and storing the reproduced first and second images when the reproduction of the first and second images is completed; As shown in FIG.

In this case, when the first image and the second image are panoramic images, the view direction of the first frame and the view direction of the second frame are the same.

On the other hand, in an electronic device according to an embodiment of the present disclosure, a display for reproducing a first image and a second image including additional information on at least one frame among a plurality of frames, and a display When a predetermined user command for playing back the second video is input while the first frame of the first video is being reproduced, the first additional information corresponding to the first frame to be reproduced, And a processor for controlling the display to determine a second frame of the second image corresponding to the first additional information and reproduce the second image from the second frame.

Here, the first frame may be a frame being reproduced at a time when the user command is input, and the user command may be an instruction to reproduce the second image.

In this case, the display may display a plurality of display items corresponding to a plurality of objects in the first image, and the user command is an instruction to select one of the plurality of display items, And the first additional information for the frame is additional information corresponding to the selected display item.

In this case, the first frame is a frame including additional information on an object corresponding to the display item to which the user command is input.

In this case, the display may reproduce the first image from the time when the user command is input to the first frame, and reproduce the second image from the second frame.

In this case, the processor may filter only specific additional information among a plurality of additional information inserted in the first frame.

At this time, the processor may determine second additional information matching the first additional information, and determine the second frame of the second image corresponding to the second additional information.

Here, the additional information may include at least one of GPS information, azimuth information, time information, object information through image analysis, keyword information, voice keyword information, and hash tag information.

In this case, when the reproduction of the first image and the second image is completed, the processor combines the reproduced first image and the second image.

In this case, when the first image and the second image are panoramic images, the display may display the same view direction of the first frame and the view direction of the second frame.

As described above, according to the embodiment of the present disclosure, when a user command for reproducing a second video is input while the first video is being reproduced, the electronic apparatus reproduces from a specific portion of the second video, It is possible to reduce the inconvenience of moving the image to the image.

1A and 1B are block diagrams showing the configuration of an electronic device according to one embodiment of the present disclosure.
2A and 2B are views for explaining an image including additional information according to an embodiment of the present disclosure.
FIG. 3 is a diagram illustrating a process of reproducing a first image and a second image according to an embodiment of the present disclosure.
FIGS. 4A and 4B are views for explaining an image reproducing method according to an embodiment of the present disclosure. FIG.
5A to 5D are diagrams illustrating a method of providing a map service using image playback, according to an embodiment of the present disclosure.
FIGS. 6A and 6B are diagrams for explaining another method of reproducing a first image and a second image according to an embodiment of the present disclosure.
7A and 7B are views for explaining an embodiment of a panoramic image according to an embodiment of the present disclosure.
8A to 8C are views for explaining an image playback method combined with an online service according to an embodiment of the present disclosure.
9 is a diagram illustrating an image reproduction system according to an embodiment of the present disclosure.
10A to 10C are views showing an image reproduction system according to an embodiment of the present disclosure.
11 is a flow chart illustrating a method by which an electronic device reproduces an image, according to one embodiment of the present disclosure.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present disclosure rather unclear. And the terms used below are terms defined in consideration of the functions in this disclosure, which may vary depending on the user, operator or custom. Therefore, the definition should be based on the contents throughout this specification.

Terms including ordinals such as first, second, etc. may be used to describe various elements, but the elements are not limited by terms. Terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. The term " and / or " includes any combination of a plurality of related items or any of a plurality of related items.

The terminology used herein is for the purpose of describing the embodiments only and is not intended to limit and / or to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as "comprising" or "having" mean that a feature, a number, an operation, an element, a component, or a combination thereof described in the specification is to be present and that one or more other features, Elements, parts, or combinations thereof without departing from the spirit and scope of the invention.

In the embodiment, 'module' or 'sub' performs at least one function or operation, and may be implemented in hardware or software, or in a combination of hardware or software. In addition, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module except for 'module' or 'module' which needs to be implemented by specific hardware, and may be implemented by at least one processor.

In the present disclosure, the first video, the second video, the first frame, the second frame, the first additional information, and the second additional information are used as follows unless otherwise specified. Specifically, the first image means an image to be reproduced first, and the second image means an image to be reproduced after the first image. The first frame means the last frame in which the first image is reproduced and the second frame means the first frame in which the second image is reproduced. The first additional information means information inserted in the first frame and the second additional information means information inserted in the second frame.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings. FIG. 1A is a schematic block diagram for illustrating a configuration of an electronic device 100 according to an embodiment of the present disclosure. At this time, the electronic device 100 may be a smartphone, a tablet personal computer, a mobile phone, a video phone, a desktop personal computer, a laptop personal computer, a personal computer, a netbook computer, a workstation, a personal digital assistant (PDA), and a portable multimedia player (PMP). In another embodiment, the electronic device 100 may be implemented as a system including the imaging device 200 and the external server 300, as shown in FIG.

The electronic device 100 shown in FIG. 1A includes a display 110 and a processor 120.

The display 110 may reproduce at least one of a first image and a second image including additional information on at least one frame among the plurality of frames. At this time, the first image and the second image reproduced by the display 110 are composed of a plurality of frames, and at least some of the plurality of frames are inserted with additional information corresponding to the frames.

At this time, if a user command is input, the display 110 can reproduce the second image from the second frame.

When a predetermined user command is input while the first image is being reproduced, the processor 120 determines first additional information for a first frame corresponding to a predetermined user command, and determines a second additional information corresponding to the first additional information, And may control the display 110 to determine the second frame of the image and reproduce the second image from the second frame.

Specifically, the processor 120 may control the display 110 to reproduce the first image up to the first frame, and then reproduce the second image from the second frame of the second image.

1B is a block diagram illustrating in detail the configuration of an electronic device 100 according to one embodiment of the present disclosure.

The electronic device 100 may further include a communication unit 130, an imaging unit 140, an input unit 150, a sensing unit 160, and a memory 170 in addition to the display 110 and the processor 120 have. However, it is needless to say that the present invention is not limited to such a configuration, and new components may be added or omitted.

The display 110 may display various guides, image contents, information, UI, and the like provided in the electronic device 100. The display 110 is implemented by a liquid crystal display (LCD), an organic light emitting diode (OLED) or a plasma display panel (PDP) It is possible to display various screens that can be provided.

In particular, the display 110 may display various guides, image contents, information, UI, and the like provided in the electronic device 100. The display 110 is implemented by a liquid crystal display (LCD), an organic light emitting diode (OLED) or a plasma display panel (PDP) It is possible to display various screens that can be provided.

Specifically, the display 110 can reproduce the first image and the second image.

The communication unit 130 may include at least one of a Wi-Fi chip 131, a Bluetooth chip 132, a wireless communication chip 133, and an NFC chip 134. In particular, each of the Wi-Fi chip 131 and the Bluetooth chip 132 can perform communication using a Wi-Fi system or a Bluetooth system. When the WiFi chip 131 or the Bluetooth chip 132 is used, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The wireless communication chip 133 refers to a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (Third Generation Partnership Project), LTE (Long Term Evolution) The NFC chip 134 means a chip operating in an NFC (Near Field Communication) system using a band of 13.56 MHz among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz and 2.45 GHz.

The communication unit 130 can perform communication with an external server or an external electronic device. For example, when playing an image through a video streaming method, the electronic device 100 can receive image data from an external server. In addition, the processor 120 may control the communication unit 130 to transmit a user command to an external server.

The input unit 140 may receive a user command. Specifically, the input unit 140 may output a user command to reproduce the first image or a user command to reproduce the second image while the first image is being reproduced.

The image pickup section 150 can take an image. Specifically, when the electronic device 100 includes the imaging unit 150, the imaging unit 150 can perform imaging. The image photographed by the image pickup unit 150 may be reproduced on the display 110 or may be transmitted to the external server 300 and transmitted to another electronic device.

In addition, the imaging unit 150 can photograph a general moving image as well as a panorama image. At this time, the panoramic image may mean an image which can ensure a field of view of 360 degrees or more than a predetermined angle (for example, 180 degrees).

Meanwhile, the image sensing unit 150 may be provided in the electronic device 100, but it may be connected to the electronic device 100 in a wired / wireless manner only by way of example.

The sensing unit 160 may sense various data. Further, the data sensed by the sensing unit 160 may be used to generate additional information. Specifically, the sensing unit may include a gyro sensor, a GPS sensor, an acceleration sensor, and the like. However, it is needless to say that the present invention is not limited to the above-described sensors and may include various sensors for generating various additional information.

When the image is captured by the image pickup unit 150, the sensing unit 160 may sense data such as GPS coordinates and orientation for inserting the image frame being shot. At this time, the data may be inserted as additional information in the corresponding image frame.

The memory 170 may store an O / S (Operating System) for driving the electronic device 100. The memory 170 may also store various software programs or applications for operating the electronic device 100 in accordance with various embodiments of the present disclosure. The memory 170 may store various information such as various data inputted or set or generated during execution of a program or an application.

The memory 170 may also include various software modules for operating the electronic device 100 in accordance with various embodiments of the present disclosure and the processor 120 may execute various software modules stored in the memory 170 To perform operations of the electronic device 100 in accordance with various embodiments of the present disclosure.

The memory 170 may store the image captured by the image capturing unit 150 and the data sensed by the sensing unit 160. In particular, the memory 170 may store the first image and the second image. To this end, the memory 170 may include a semiconductor memory such as a flash memory or the like, a magnetic storage medium such as a hard disk, or the like.

The processor 120 may control overall operation of the electronic device 100.

The processor 120 includes a RAM 121, a ROM 122, a main CPU 124, first through n interfaces 125-1 through 125-n, and a bus 126, as shown in FIG. do. At this time, the RAM 121, the ROM 122, the main CPU 124, the first to n interfaces 125-1 to 125-n, etc. may be connected to each other via the bus 126.

The ROM 122 stores a command set for booting the system and the like. When the turn-on command is input and power is supplied, the main CPU 124 copies the O / S stored in the memory 170 to the RAM 121 according to the instruction stored in the ROM 122, executes O / S Boot the system. When the booting is completed, the main CPU 124 copies various application programs stored in the memory 170 to the RAM 121, executes the application program copied to the RAM 121, and performs various operations.

The main CPU 124 accesses the memory 170 and performs booting using the O / S stored in the memory 170. [ The main CPU 124 performs various operations using various programs, contents, and data stored in the memory 170.

The first to n-th interfaces 125-1 to 125-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device via a network.

Specifically, when a predetermined user command is input while the first image is being reproduced, the processor 120 determines first additional information for a first frame corresponding to a predetermined user command, And may control the display 110 to determine the second frame of the corresponding second image to reproduce the second image from the second frame. At this time, the first image and the second image may be related images including the same object or event. That is, the first image and the second image may include additional information including information about the same object or event.

At this time, the processor 120 may determine second additional information corresponding to the first additional information, and determine the second frame of the second video corresponding to the second additional information.

Here, the first frame may be a frame being reproduced at a time when a user command is input, and the user command may be a command to reproduce the second image. Specifically, when a user command for reproducing a second image is inputted while the first image is being reproduced, the processor 120 reproduces the first image up to the first frame, And to control the display 110 to reproduce. At this time, the additional information included in the first frame and the second frame may be the same or related additional information.

At this time, the additional information may include at least one of GPS information, azimuth information, time information, object information through image analysis, keyword information, voice keyword information, and hash tag information. However, it is needless to say that the present invention is not limited to the above-described example, and various kinds of additional information related to the frame may exist.

For example, the additional information may be data sensed by the sensing unit 160. [ However, data not detected by the sensing unit 160 can be utilized as additional information. That is, the processor 120 can generate and collect new information by utilizing the data collected in the past. For example, the processor 120 may crawl information on the web based on the position and time data sensed by the sensing unit 160, and generate an event event corresponding to the sensed position and time as new additional information. For example, the processor 120 may generate additional information called "earthquakes " for video frames photographed at 19:44 on September 12, 2016.

In another embodiment, when a plurality of display items corresponding to a plurality of objects are displayed on the first image, the user command may be a command to select one of the plurality of display items. Here, the first additional information for the first frame may be additional information corresponding to the selected display item. Specifically, when a user command for selecting one of the plurality of display items existing in the first image is inputted, the processor 120 can determine the additional information corresponding to the selected display item. At this time, the additional information corresponding to the selected display item may be additional information about the object corresponding to the display item.

When a user command is input, the processor 120 may control the display 110 to reproduce the first image up to the first frame and then reproduce the second image from the second frame.

On the other hand, the additional information inserted in the first frame and the second frame may be a plurality of additional information. At this time, the processor 120 may filter only the specific additional information among the additional information embedded in each frame.

In addition, when the reproduction of the first image and the second image is completed, the processor 120 may synthesize the reproduced first image and the second image. Specifically, the processor 120 may combine and store an image up to the first frame of the first image and a frame from the second frame to the second image of the second image by a user command. At this time, the synthesized image may be stored in the memory 170.

In addition, when the first image and the second image are panoramic images, the processor 120 may control the display 110 to display the view direction of the first frame and the view direction of the second frame equally. In particular, the field of view of the second frame of the second image may be the same as the field of view of the first frame of the first image.

Figs. 2A to 3 are diagrams showing image data configured according to time according to an embodiment of the present disclosure. Fig. In other words, the left end portion of the image data shown in FIGS. 2A to 3 indicates the start point of the image, and the right end portion indicates the end point of the image.

2A and 2B are views for explaining an image including additional information according to an embodiment of the present disclosure.

As shown in FIG. 2A, the image data 210 may include a plurality of additional information 220-1 to 220-N. Specifically, as shown in FIG. 2B, the plurality of pieces of additional information 220-1 to 220-N may include the image data 210 and the divided image data 210-1 to 210-N. Each of the additional information 220-1 to 220-N may be inserted into each of the image data 210-1 to 210-N. For example, the first additional information 220-1 may be inserted into the first image data 210-1 and the second additional information 220-2 may be inserted into the second image data 210-2 .

On the other hand, in the present disclosure, the case where each of the image data 210-1 to 210-N is one frame has been described as an example. However, it is needless to say that the respective image data 210-1 to 210-N may not be composed of one frame, and a plurality of frames may constitute one image data.

Also, in the present disclosure, one additional information is inserted into one image data. However, it is needless to say that a plurality of embedded data may be included in one image data.

That is, in the embodiment of the present disclosure, the additional information inserted in the frame may be one additional information inserted in one frame, or may be one additional information inserted in one video data composed of a plurality of frames, It may be a plurality of pieces of additional information inserted in one frame or a plurality of pieces of embedded data inserted into one piece of video data composed of a plurality of frames.

Hereinafter, the present disclosure will be limited to the case where each video data is a respective frame. However, it goes without saying that the image frame may mean image data including a plurality of image frames as described above.

FIG. 3 is a diagram illustrating a process of reproducing a first image and a second image according to an embodiment of the present disclosure.

In particular, the first image 310 may include a plurality of frames 311 to 313, and the second image 320 may include a plurality of frames 321 to 324. When the first image 310 is reproduced, the electronic device 100 reproduces the image data in which the additional information is embedded. At this time, if the preset user command is input, the processor 120 may determine the first additional information for the first frame 313 corresponding to the preset user command. At this time, the preset user command may be a command to execute the second image. Also, the predetermined user command may be a command for selecting a display item displayed on the first image, but is not limited thereto. In this case, the display item may be a thumbnail image related to the second image, or may be objects included in the first image (e.g., building, person, etc. included in the image), but is not limited thereto.

When a preset user command is input, the electronic device 100 can reproduce the first image up to the first frame 313, and then reproduce the second image from the second frame 323. [

At this time, the second frame may be a frame corresponding to the first additional information. In particular, when a user command is input during the reproduction of the first image, the processor 120 may determine a first frame corresponding to the user command. The processor 120 may determine second additional information corresponding to the first additional information included in the first frame. At this time, the second additional information may be one of additional information included in a plurality of frames constituting the second image. When the second additional information is determined, the processor 120 may determine a second frame including the second additional information.

At this time, when there are a plurality of frames of the second image including the second additional information, the second frame can be determined by various methods. For example, the fastest frame among the plurality of frames including the second additional information may be the second frame. The fastest frame is the frame that is reproduced first when the second image is reproduced. However, the present invention is not limited to the above-described method, and it is needless to say that the second frame including the second additional information can be determined by various methods.

For example, when the second additional information includes a plurality of additional information, the second frame may determine a frame having the largest additional information among the plurality of additional information as the second frame.

Alternatively, when there are a plurality of frames having the second additional information, the second frame may be determined using the frames adjacent to the frame. For example, the electronic device 100 may include additional information (hereinafter referred to as " 1-1 additional information " hereinafter) included in the previous and subsequent frames of the first frame including the first additional information 1-2 additional information) can be determined. If the additional information included in the adjacent frame of each frame among the plurality of frames of the second image including the second additional information corresponds to the 1-1 additional information and the 1-2 additional information, 100) can determine the frame as the second frame.

However, when there are a plurality of frames of the second image including the second additional information, the method of determining the second frame is not limited to the embodiment, and may be determined by various methods.

Hereinafter, various embodiments for determining the second frame will be described. Specifically, the first additional information and the second additional information may be additional information associated with each other. For example, the first additional information and the second additional information may have the same or similar GPS coordinates or orientation, a shooting time, a hash tag, and the like. However, it is needless to say that the present invention is not limited to the above-described example, and may have various additional information related to the image.

As described above, the additional information may be various types of additional information, and the first additional information and the second additional information may be related to each other. Hereinafter, the first frame and the second frame according to the types of the first additional information and the second additional information will be described.

In one embodiment, when the additional information is additional information relating to GPS coordinates, the first additional information and the second additional information may be additional information having the same GPS coordinates. However, it is not necessarily the same GPS coordinates, and the first additional information and the second additional information may be GPS coordinates within a predetermined range.

For example, if the first additional information includes the GPS coordinates of the 63 building, the second additional information may also have 63 building GPS coordinates. In this case, the first frame and the second frame may all be frames including 63 buildings.

In another embodiment, when the additional information includes azimuth information, the first frame and the second frame may be frames indicating the same direction. A specific embodiment of this will be described later in Fig.

In another embodiment, when the additional information is information on the imaging time, the first frame and the second frame may be images taken at the same time. At this time, the same time may have various ranges such as same year, same month, same week, same date, same time. For example, the first frame and the second frame may be images taken in 2017. As another example, the first frame and the second frame may be images relating to the same season. As another example, the first frame and the second frame may be images relating to the same day of the week. That is, when the additional information is additional information with respect to time, the additional information may be generated according to various classification methods (season, month, day of week, etc.).

In yet another embodiment, the additional information may be information including a web crawl keyword. Specifically, the processor 120 may combine the various additional information described above to generate web crawling information, and insert the generated information into an image frame. For example, as described above, the processor 120 generates additional information called "earthquake" for the image frame photographed at the race (position information) at 19:44 (time information) on September 12, 2016 . In such a case, the first frame and the second frame may be the images of the earthquake that occurred in the race on September 12, 2016. Or the first frame and the second frame may be images related to an earthquake.

In another embodiment, the additional information may be information obtained by analyzing an image existing in an image frame. For example, if a famous actor exists in an image frame, the electronic device 100 may analyze the image frame to generate additional information about a famous actor. In such a case, the first frame and the second frame may be frames including famous actors.

In another embodiment, the additional information may be a text keyword or a voice keyword generated by the user. For example, the first additional information and the second additional information may be a keyword "soccer goal image ". In such a case, the first frame and the second frame may be frames relating to a scene in which a goal enters during a soccer game.

However, it goes without saying that the additional information according to the present disclosure is not limited to the above-described additional information, but may also include various additional information.

Further, the additional information may be inserted into a frame existing in the image at the same time as the image is captured, or may be added after the image capturing is completed. For example, the coordinate information, azimuth information, time information, and the like can be inserted by the measurement sensor while the image is captured. In addition, the keyword-spoken keyword or the like may be inserted after the end of the image capturing.

Although the method of determining the first frame and the second frame using one additional information has been described in the above embodiments, it is needless to say that the first frame and the second frame may be determined using two or more additional information .

On the other hand, when a plurality of additional information is included in one video frame, only desired additional information can be selected through filtering. Specifically, when the first frame includes all additional information such as GPS coordinates, azimuth, time, and keywords, the electronic device 100 can determine the second frame using only GPS coordinate information and azimuth information.

FIGS. 4A to 8C are diagrams illustrating various image reproduction processes according to an embodiment of the present disclosure.

FIGS. 4A and 4B are views for explaining an image reproducing method according to an embodiment of the present disclosure. FIG.

4A is a diagram illustrating a method of viewing a first image and a second image according to an embodiment of the present disclosure.

When a user command for viewing a second image including the second frame 430 is inputted while viewing a first image including a plurality of frames 410 and 420, the electronic device 100 displays the first image It is possible to reproduce up to the first frame and then reproduce the second image from the second frame.

As shown in FIG. 4A, the first image may be an image related to the soccer content. At this time, the first image may be a full image or a highlight image of the corresponding football game.

If a particular player scores a goal while the user views the video, the user may enter a user command to search for a second video that a particular player has scored a goal. Specifically, when the user inputs a first user command while viewing the first image 420, the display 110 displays the second frame corresponding to the first additional information inserted in the first frame of the first image, The UIs 430 and 431 for the second image including the second image. In this case, the UIs 430 and 431 for the second image may be thumbnail images for the corresponding frame, but the present invention is not limited thereto.

At this time, the first user command may be a touch interaction for touching an arbitrary position of the display or an input for clicking the screen, but the present invention is not limited thereto, and an icon (not shown) for displaying the second image may be touched or clicked Of course.

In another embodiment, the display 110 may display the UIs 431 and 432 for the second image even when no user command is input. For example, from the end of the first image until a predetermined time (for example, 95% of the first image is reproduced) to the end of the first image, the display 110 displays the UI Can be displayed. However, it is needless to say that the UI of the second image can be displayed by various methods without being limited to the above-described embodiments.

Meanwhile, as described above, the first additional information inserted in the first frame 420 and the second additional information inserted in the second frame 430 may be related additional information. For example, the first additional information and the second additional information may be composed of the same hashtag (e.g., #OOO goal, #OOO goal scene, etc.). However, the additional information is not limited to the same hash tag, and various additional information can be used.

The user can reproduce the second image through a user command for selecting one of the UIs related to the displayed second image. For example, when the user inputs a user command to touch or click on one of the UIs 430 and 431 displayed on the first image, the display 110 displays the UI 430 corresponding to the selected UI 430 The second video can be played back from the second frame.

4B is a view for explaining a method of reproducing a first image and a second image according to another embodiment of the present disclosure. Specifically, the first image and the second image may be images photographed at tourist spots.

As described above, when the first user command is input while the first image 420 is being watched, the electronic device 100 displays the second image corresponding to the second additional information inserted in the first frame of the first image, And UIs 430 and 431 for the second image including the frame. In this case, the UIs 430 and 431 for the second image may be thumbnail images for the corresponding frame, but the present invention is not limited thereto.

At this time, the first user command may be a touch interaction that touches an arbitrary position of the display or an icon (not shown) for displaying the second image, or an input that clicks the screen, but is not limited thereto.

The first additional information inserted in the first frame 420 and the second additional information inserted in the second frame 430 may be related to each other.

Specifically, the additional information may be additional information about GPS coordinate information, azimuth information, photographing time information, information on in-video objects, and the like. At this time, the objects in the image may be a building, a person, or a specific object existing in the image. The object in the video image can be determined through image analysis, but is not limited thereto.

However, the present invention is not limited to the above-described additional information, and the first additional information and the second additional information may be composed of the same hashtag (e.g., #suununsha, #suunwon summer, etc.).

At this time, the electronic device 100 can select one or more additional information among various additional information existing in the first image.

For example, the user can select the additional information for the GPS coordinates and the shooting time information, and watch the second video corresponding to the selected additional information. In this case, the second frame 430 of the second image may be an image captured at the same or similar GPS coordinate and the same or similar time as the first image. The second frame 430 of the second image is an image photographed at the same position and at the same time as the first frame 420 of the first image so that the first frame 420 and the second image 420 of the first image, The second frame 430 may have similar brightness and saturation. Therefore, the user can watch the image naturally even when the image is switched.

In another embodiment, if the user selects GPS coordinates, additional information about the in-video object, the second frame of the second image 430 may be the frame number of the object selected in the first frame 420 of the first image have. For example, if the video object is a building, the second frame 420 of the second image may be a frame for the interior of the building.

FIGS. 5A and 7B are diagrams illustrating various embodiments in which a first image and a second image according to an embodiment of the present disclosure are panorama images.

5A to 5D are diagrams illustrating a method of providing a map service using image playback, according to an embodiment of the present disclosure.

Specifically, the electronic device 100 can provide a map service using the image reproduction method according to the present disclosure. For example, the electronic device 100 may provide a map service for a corresponding segment image when a first image of a segment to be searched by the user exists.

As shown in FIG. 5A, the electronic device 100 can take a first image of a section to be provided. At this time, the photographed image may be a general image or a panorama image. At this time, the additional information may be inserted at the same time as the image is photographed. For example, GPS coordinates (511 to 514) or time information detected by the sensing unit 160 may be inserted into an image frame to be photographed. However, if there is a first image already captured by the electronic device 100 or if the first image can be received from an external server, the image capturing process may be omitted.

When the photographed first image is reproduced, as shown in FIG. 5B, the display 110 may display a minim map UI or a UI indicating a movement route. At this time, the UI indicating the movement path can be displayed according to the traveling direction of the image.

5C, when the first image is stopped in the first frame during the image playback, the electronic device 100 displays UIs 531 to 533 for the image corresponding to the first additional information embedded in the first frame Can be displayed. In this case, the first additional information may be GPS coordinate information, and the UIs 531 to 533 corresponding to the first additional information may include GPS coordinate information for the rides within a predetermined distance from the GPS coordinates included in the first additional information Lt; RTI ID = 0.0 > UI < / RTI >

The first UI 531 is a UI related to a video that can locate a playground located on the left side where the corresponding video is located, and the second UI 532 searches for a playground located in front of where the corresponding video is located And the third UI 533 may be a UI related to an image that can search for a playground located on the right side where the corresponding image is located.

When the user command for selecting the third UI is input, the electronic device 100 can reproduce the second image corresponding to the third UI. At this time, the second image can be reproduced from the second frame. Specifically, the second additional information may be embedded in the second frame. Here, the second additional information may include GPS coordinate information, and the GPS coordinate information included in the second additional information may be the same as the GPS coordinate information included in the first additional information. Therefore, the first frame and the second frame may be images at the same position.

As shown in FIG. 5D, the electronic device 100 may play the second image until a playground corresponding to the third UI 533 appears.

FIGS. 6A and 6B are diagrams for explaining another method of reproducing a first image and a second image according to an embodiment of the present disclosure.

Specifically, FIG. 6A may be the first frame 610 of the first image currently being played back. When the user command for selecting the first object 611 is input while the electronic device 100 is playing back the first image, the electronic device 100 displays the second frame of the second image, (620).

Specifically, before the first image is reproduced up to the first frame, when the electronic device 100 receives a user command for selecting the first object 611, the electronic device 100 displays the first object 611 corresponding to the first object 1 additional information can be determined. Then, the electronic device 100 can determine the first frame corresponding to the determined first additional information, and reproduce the first image up to the first frame.

Specifically, the first additional information may be information on the first object. For example, the processor 120 of the electronic device 100 may determine that the first object is the Eiffel Tower through image analysis. At this time, the first additional information may include information on the Eiffel Tower.

When the image is reproduced up to the first frame of the first image, the electronic device 100 can reproduce the second image up to the second frame.

On the other hand, the second frame of the second image may include the second additional information. And the second additional information may be additional information corresponding to the first object. That is, the second additional information may include information on the Eiffel Tower. At this time, the second additional information may further include additional information. For example, the second additional information may include information about the Eiffel Tower and information about "the Eiffel Tower at the center of the video frame ".

As shown in FIG. 6B, the second object 621 in the second frame 620 may be located in the center of the second frame 620. That is, the electronic device 100 can position the second object 612 corresponding to the selected object 611 in the first image at the center of the second image.

6A and 6B, the first image and the second image are general images. However, even when the first image and the second image are panorama images, the same technical idea can be applied.

6A, when the first panorama image is received with a user input for selecting the first object 611 in a state where the first object 611 is positioned on the right side, The second image can be reproduced while the second object 612 is positioned at the center as shown in FIG. 6B.

6A, even if the first object 611 is located in an arbitrary region of the first frame, the second frame 620 of the second image may have the second object 621 at the center thereof as shown in FIG. 6B Lt; / RTI >

7A and 7B are views for explaining an embodiment of a panoramic image according to an embodiment of the present disclosure.

Specifically, FIG. 7A is a first diagram showing a first direction 711 and a second direction 712. When the first image is a panorama image, the electronic device 100 may change the view point direction of the image being reproduced in response to a user command.

As shown in FIG. 7A, the first image can be reproduced with the first direction 711 as the viewing direction. In this case, when a user command for displaying a second image progressing in the second direction 712 is input, the electronic device 100 displays a second image (not shown) having the second direction 712 as the viewing direction It can be reproduced from the second frame. At this time, the first additional information and the second additional information may include GPS coordinate information. Accordingly, the second frame of the second image may be a frame photographed at the same position as the first frame of the first image.

However, in the case of the above-described embodiment, the viewing direction of the first frame may be the first viewing direction 711, and the viewing direction of the second frame may be the second viewing direction 712. [

In this case, when the user reproduces the video image from the first image to the second image, the direction of the image changes suddenly and the user may feel inconvenience in viewing the image.

Accordingly, when the first image and the second image are panorama images, the first additional information and the second additional information may further include information on the orientation.

For example, the first frame of the first image may be a frame whose second viewing direction 721 is the viewing direction, as shown in Fig. 7B. In other words, the first image can reproduce the frame shown in FIG. 7A, and the second image (not shown) can be reproduced after rotating in the second viewing direction 721 like the frame shown in FIG. 7B.

However, the present invention is not limited to the above-described embodiment, and the first frame may be the frame shown in Fig. 7A. In this case, the second frame may be the frame shown in Fig. 7B. That is, the first frame may have a first viewing direction 711 and the second frame may have a first viewing direction 721 as well. In this case, the second image may be rotated from the first viewing direction 721 to the second viewing direction 722.

8A to 8C are views for explaining an image playback method combined with an online service according to an embodiment of the present disclosure.

In particular, the video playback method according to the present disclosure can be combined with various online services. For example, the first image and the second image may be combined with an online service for introducing tourist attractions, an online service for providing nearby accommodation, and a social network service (SNS). At this time, the first image and the second image may be images executed in a specific application. For example, the first image and the second image may be images reproduced in an application providing the map service and the surrounding information.

As shown in FIG. 8A, the first image may include a UI for performing various functions. As shown in FIG. 8A, the first UI includes a first UI 810 for selecting whether to display an interest spot around the current image / position, a second UI 820 for displaying information of the current image, A fourth UI 840 for displaying a video progress bar, a fifth UI 850 for controlling an overall operation of the video, a third UI 830 for displaying information related to the first video, A sixth UI 860 that can display a first image to be reproduced and a position of a related image, and the like can be displayed.

However, not all of the various UIs described above are displayed, and may be omitted or added as needed. For example, if there is no peripheral information associated with the first image, the third UIs 831 through 833 may not be displayed. Also, if the first image to be reproduced is not a panorama image, the fifth UI 850 may be omitted.

8B, if there is a second image that can be selected from the first image while the first image is being reproduced, a notification UI (FIG. 8B) indicating that the image exists at the lower end of the sixth UI 860 861 may be displayed.

When a user command for selecting the notification UI 861 is input, as shown in FIG. 8C, the electronic device can display a seventh UI 870 that displays information on the reproducible image.

At this time, the seventh UI 870 may include various information. For example, the seventh UI 870 may include information on the number of reproducible images, information on other online services related to the image, and the like.

When the MOVE UI included in the seventh UI 870 is selected, the electronic device 100 can reproduce the second image from the second frame.

At this time, the reproduced first and second images are reproduced by the above-described various embodiments. Specifically, when a user command to reproduce a second image is input while the first image is being reproduced by the operations described in FIG. 8, the electronic device 100 reproduces the first image up to the first frame, 2 images can be reproduced from the second frame. It goes without saying that the first additional information included in the first frame and the second additional information included in the second frame are related to each other.

9 is a diagram illustrating an image reproduction system according to an embodiment of the present disclosure.

Specifically, the image reproducing system may be constituted by the electronic apparatus 100, the image capturing apparatus 200, and the external server 300. [

The image capturing apparatus 200 can capture various images to be reproduced by the electronic apparatus 100 and transmit them to the external server 300. [ At this time, the image sensing apparatus 200 may be provided with a plurality of sensors for sensing various additional information.

The external server 300 may transmit the requested first image to the electronic device 100 when the electronic device 100 requests the first image. In particular, when the external server 300 transmits the first image to the electronic device 100 in a streaming manner, it may analyze the additional information of the reproduced image and provide the electronic device 100 with a recommended image. The electronic device 100 can select one of the recommended images transmitted from the external server 200 as the second image. At this time, the external server 300 can transmit the second frame of the selected second image to the electronic device 100.

Of course, as described above, the electronic device 100 may include the image capturing apparatus 200 and the external server 300. That is, it is needless to say that the electronic device 100 can capture an image, store it in the memory 170, and reproduce the stored first and second images.

In the above-described various embodiments, the case where an image is reproduced has been described, but the present invention is not limited thereto. For example, when the user command is input, the electronic device 100 may display a second picture corresponding to the first additional information while the first picture is being reproduced. Alternatively, when the electronic device 100 displays a first picture in which the first additional information is inserted, when the predetermined user command for playing the second picture is input, the electronic device 100 displays the first additional information It is possible to reproduce the second video from the corresponding second frame.

10A to 10C are views showing an image reproduction system according to an embodiment of the present disclosure.

10A, the image reproduction system may include an electronic device 100, an image capture device 200, a first server 310, and a second server 320. [ That is, the external server 300 shown in FIG. 9 may include a first server 310 and a second server 320.

At this time, the first server 310 may be a video providing server. In particular, the first server 310 may be a server operated by various content providers or an online video platform. The first server 310 may provide a streaming video service. The moving picture server 310 may provide the moving picture to the electronic device 100 when there is a request for the moving picture from the electronic device 100. [ At this time, the moving picture providing method may be a streaming method as described above, but the present invention is not limited thereto. That is, the electronic device 100 may download the moving image data from the first server 310.

The second server 320 may store additional information about the moving image provided by the first server 310. [ Specifically, the second server 320 may match and store the parameters corresponding to the additional information and the additional information provided by the first server 310. FIG. That is, when the moving image stored in the first server 310 includes a plurality of additional information, the capacity of the moving image may increase. Accordingly, in order to solve such a problem, the first server 310 may store the moving image, and the second server 320 may store the additional information about the moving image. At this time, the second server 320 may store the additional information about the moving image and the corresponding parameter. The parameter corresponding to the additional information may be a parameter for searching for a specific position of the moving image stored in the first server 310. For example, the parameter may include index information on a video file to be played back and index information on a start time and an end time of a portion of the video file to be played back.

In addition, when a user command is received from the electronic device 100, the second server 320 may acquire additional information based on the received user command. Based on the acquired additional information, the second server 320 acquires the parameter corresponding to the additional information and transmits the acquired parameter to the electronic device 100, and the electronic device 100 transmits the received parameter to the first server Lt; / RTI > Needless to say, the second server 320 can directly transmit the acquired parameters to the first server 310.

Meanwhile, the user can view various types of moving pictures using the first server 310 and the second server 320. [ Specifically, when a user command is input through the electronic device 100, the electronic device 100 can transmit a user command to the second server 320. At this time, the inputted user command is transmitted to the various first servers 310, And may be a command for a specific scene or a specific content among the moving images stored in the memory.

When the second server 320 receives a user command from the electronic device 100, it can retrieve the moving image and the additional information corresponding to the user command. The second server 320 may transmit the parameter corresponding to the retrieved moving image and the additional information to the electronic device 100 and the electronic device 100 may transmit the received parameter to the first server 310. [

The first server 310 can reproduce the moving picture corresponding to the parameter information using the received parameter information. In this case, when the first server 310 is a server providing a streaming video service, the first server 310 may stream specific portions of the video corresponding to the parameter information to the user in order.

Meanwhile, the first server 310 or the second server 320 may store and manage parameter information on an image provided to the electronic device 100. [ That is, when a new user command including the same or similar additional information as the additional information corresponding to the previously input user command is input, the first server 310 or the second server 320 acquires additional information and parameters It is possible to provide stored parameter information to the electronic device 100 without any processing.

That is, the first server 310 can provide the reproduced image to the electronic device 100 using only the parameter information, without having to edit and store the stored plurality of original videos to generate a new moving image. However, the present invention is not limited to this, and it goes without saying that the first server 310 may store the reproduced image according to a user command.

FIG. 10B is an exemplary diagram for explaining a moving picture playback process according to an embodiment of the present disclosure.

For example, the user can input a search term such as "OOO Goal Highlight" through the electronic device 100 when the user wishes to view a specific scene or specific content among the videos stored in the first server 310. [

The electronic device 100 may transmit "OOO Goal Highlight" to the second server 320. [ At this time, the second server 320 may obtain additional information related to "OOO goal highlight ". For example, the additional information corresponding to "OOO goal highlight" may be OOO, a goal scene, a highlight, and the like.

The second server 320 may obtain the parameter corresponding to the acquired additional information. The parameter obtained by the second server 320 is transmitted to the electronic device 100 and the parameter received by the electronic device 100 is transmitted to the first server 310. The first server 310 then transmits the received parameter Can be provided to the electronic device 100.

10B, the electronic device 100 displays a specific portion (OOO goal highlight portion) and a second image 1020 of the first image 1010 through a user command for inputting a search word for a desired image, Can be continuously viewed.

On the other hand, as described above, when a search word such as "OOO goal highlight" is inputted again or input from another electronic device, the first server 310 and the second server 320 acquire the additional information and acquire the parameter The image shown in FIG. 10B can be provided to the electronic device 100 using the past stored parameter information.

FIG. 10C is an exemplary view for explaining an image reproducing method according to another embodiment of the present disclosure; FIG. As shown in FIG. 10C, the first server 310 may add a caption or a sticky UI to an image and provide it to the electronic device 100.

For example, when the electronic device 100 receives a user command for adding a caption or a sticky UI to an image provided by the first server 310, The parameter corresponding to the information and the additional information can be obtained. The first server 310 can overlay the caption or sticker UI 1030 corresponding to the received parameter on the image.

Although the first server 310 and the second server 320 are independent servers in the above-described embodiment, the first server 310 and the second server 320 may be configured as one server Of course.

11 is a flow chart illustrating a method by which an electronic device reproduces an image, according to one embodiment of the present disclosure.

First, the electronic device 100 may acquire a first image and a second image including additional information on at least one frame among a plurality of frames (S1110). At this time, the acquired image may be an image stored in the electronic device 100 or an image received from the external server 300. [

If the preset user command for playing the second video is input while the electronic device 100 plays back the first video (S1120), the electronic device 100 displays the first frame corresponding to the preset user command (Step S1130).

The electronic device 100 may acquire the second frame of the second image corresponding to the acquired first additional information (S1140). Specifically, the second additional information corresponding to the first additional information of the electronic device 100 may be acquired, and the second frame corresponding to the second additional information may be acquired.

The electronic device 100 may reproduce the first image up to the first frame of the first image, and then reproduce the image from the second frame of the second image (S1150).

On the other hand, the control method of the electronic device 100 as described above may be implemented as at least one executable program, which executable program may be stored in a non-transitory computer readable medium.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. Specifically, the above-described programs may be stored in a computer-readable recording medium such as a RAM (Random Access Memory), a flash memory, a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electronically Erasable and Programmable ROM) Card, a USB memory, a CD-ROM, or the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.

100: electronic device 110: display
120: processor 130:
140: image pickup unit 150: input unit
160: sensing unit 170: memory

Claims (20)

A method of controlling an electronic device,
Obtaining a first image and a second image including additional information on at least one frame among a plurality of frames;
Obtaining first additional information corresponding to a first frame to be reproduced among a plurality of frames included in the first image;
Determining a second frame of the second image corresponding to the first additional information when a predetermined user command for playing the second image is input while the first frame of the first image is being reproduced; And
Reproducing the second image from the second frame; ≪ / RTI >
The method according to claim 1,
Wherein the first frame is a frame being reproduced at a time when the user command is input,
Wherein the user command is an instruction to reproduce the second image.
The method according to claim 1,
Displaying a plurality of display items corresponding to a plurality of objects on the first image; Further comprising:
Wherein the user command is an instruction to select one of the plurality of display items,
Wherein the first additional information for the first frame is additional information corresponding to the selected display item.
The method of claim 3,
Wherein the first frame comprises:
Wherein the user command is a frame including additional information on an object corresponding to the input display item.
4,
The method of claim 1,
Wherein the second image is reproduced from the second frame after the first image is reproduced from the time when the user command is input to the first frame.
The method according to claim 1,
Wherein the acquiring of the first additional information comprises:
Filtering only specific additional information among a plurality of additional information inserted in the first frame; ≪ / RTI >
The method according to claim 1,
Wherein determining the second frame comprises:
Determining second additional information corresponding to the first additional information; And
Determining the second frame of the second image corresponding to the second additional information; ≪ / RTI >
The method according to claim 1,
Wherein the additional information includes at least one of GPS information, azimuth information, time information, object information through image analysis, keyword information, voice keyword information, and hash tag information.
The method according to claim 1,
When the reproduction of the first video and the second video is finished,
Synthesizing and storing the reproduced first and second images; ≪ / RTI >
The method according to claim 1,
Wherein when the first image and the second image are panoramic images, the view direction of the first frame and the view direction of the second frame are the same.
In an electronic device,
A display for reproducing a first image and a second image including additional information on at least one frame among the plurality of frames; And
A first additional information corresponding to a first frame to be reproduced, of a plurality of frames included in the first image, and for reproducing the second image while the first frame of the first image is reproduced A processor for determining the second frame of the second video corresponding to the first additional information and controlling the display to reproduce the second video from the second frame when the set user command is input; ≪ / RTI >
12. The method of claim 11,
Wherein the first frame is a frame being reproduced at a time when the user command is input,
Wherein the user command is an instruction to reproduce the second video.
12. The method of claim 11,
Wherein the display comprises:
Displaying a plurality of display items corresponding to a plurality of objects on the first image,
Characterized in that the user command is a command for selecting one of the plurality of display items, and the first additional information for the first frame is additional information corresponding to the selected display item Device.
14. The method of claim 13,
Wherein the first frame comprises:
Wherein the user command is a frame including additional information on an object corresponding to the input display item
14. The method of claim 14,
Wherein the display comprises:
Wherein the first image is reproduced from the time when the user command is input to the first frame, and the second image is reproduced from the second frame.
12. The method of claim 11,
The processor comprising:
Wherein only the specific additional information is filtered out of the plurality of additional information inserted in the first frame.
12. The method of claim 11,
The processor comprising:
Determines second additional information corresponding to the first additional information, and determines the second frame of the second video corresponding to the second additional information.
12. The method of claim 11,
Wherein the additional information includes at least one of GPS information, azimuth information, time information, object information through image analysis, keyword information, voice keyword information, and hash tag information.
12. The method of claim 11,
The processor comprising:
And when the reproduction of the first image and the second image is completed, synthesizes the reproduced first image and the second image.
12. The method of claim 11,
Wherein the display comprises:
Wherein when the first image and the second image are panoramic images, the viewing direction of the first frame and the viewing direction of the second frame are the same.

Images