KR102176673B1 - Method for operating moving pictures and electronic device thereof - Google Patents

Abstract

According to an embodiment of the present invention, in a method of operating an electronic device, while playing a first video received or photographed from a server, one or more second videos indicating a reaction of the electronic device user to the first video are displayed. An operation of generating according to the viewpoint of the first video using an image sensor included in the electronic device, and a first video in which some or all of the second video is combined with a partial region of the first video at the corresponding time point of the first video. 3 A method including an operation of creating a video can be provided.
Also, other embodiments are possible.

Description

Video operation method and its electronic device {METHOD FOR OPERATING MOVING PICTURES AND ELECTRONIC DEVICE THEREOF}

The present invention relates to a video operating method and an electronic device thereof.

Recently, with the development of multimedia technology, electronic devices having various functions have appeared. These electronic devices generally have a convergence function that performs one or more functions in combination.

Moreover, mobile terminals, which are broadly classified as so-called'smart phones', are becoming mainstream as electronic devices. In particular, such a mobile terminal is equipped with a display module of a large-screen touch type, and is equipped with a high-pixel camera module in addition to a basic function of communication with a counterpart, so that still images and video can be captured. In addition, multimedia contents such as music and video can be played, and web surfing can be performed by accessing a network.

For example, the electronic device user may upload multimedia contents such as photos, videos, and e-books through a web server such as YouTube, or may receive the contents in a streaming form from the web server. In addition, the user may provide feedback by inputting a review on the corresponding content in the form of a comment or selecting a separate recommended icon.

However, as described above, the method of expressing the feedback is limited. Accordingly, the electronic device needs to provide a service for providing a user response in various ways. In addition, although the electronic device user has a desire to search for different videos taken at different angles in the same place (eg, a concert, etc.), there is no service to satisfy this desire.

According to an embodiment of the present invention, a video operating method for a streaming service of an electronic device and an electronic device thereof may be provided.

According to an embodiment of the present invention, a video operating method for searching for a video having a correlation and an electronic device thereof may be provided.

According to an embodiment of the present invention, a user interface capable of intuitively sharing a user's reaction to content may be provided.

According to an embodiment of the present invention, in a method of operating an electronic device, while playing a first video received or photographed from a server, one or more second videos indicating a reaction of the electronic device user to the first video are displayed. An operation of generating according to the viewpoint of the first video using an image sensor included in the electronic device, and a first video in which some or all of the second video is combined with a partial region of the first video at the corresponding time point of the first video. 3 A method including an operation of creating a video can be provided.

According to the present embodiment, the operation of reproducing the generated third video may be further included.

According to the present embodiment, the viewpoint of the first video may be set in advance.

According to this embodiment, the time point of the first video may be determined by the user.

According to the present embodiment, the operation of displaying the second video according to a user input may be further included.

According to the present embodiment, the operation of transmitting the third video to the server may be further included.

According to the present embodiment, the third video may be played on a second electronic device through the server.

According to an embodiment of the present invention, in a method of operating an electronic device, an operation of receiving a first video from a server, an operation of receiving first information related to the first video from the server, and the first information Accordingly, a method including an operation of reproducing a partial section of the first video may be provided.

According to the present embodiment, the first information may include a reaction video indicating a reaction of a user of the second electronic device who has received the first video from the server.

According to the present embodiment, the reaction video may be displayed in an overlay manner on a partial area of the first video.

According to this embodiment, in the operation of reproducing the partial section of the first video, the partial section of the first video is displayed on the screen of the electronic device, and the reaction video corresponding to the first information is It may be displayed on the screen of the second electronic device.

According to the present embodiment, the first information may be classified and displayed according to a reference condition.

According to an embodiment of the present invention, in a method of operating an electronic device, an operation of capturing a first video of a target and a second video captured by a second electronic device of the target from the second electronic device It is possible to provide a method including an operation of receiving and generating a third video by combining the first video and the second video in synchronization with a recording time point.

According to the present embodiment, it may further include an operation of receiving a specific signal together with an operation of capturing the first video of the target.

According to the present embodiment, the operation of searching for the second video including the specific signal may be further included.

According to various embodiments of the present disclosure, in an electronic device, an electronic device includes at least one image sensor, a memory, and at least one processor, wherein the processor is playing the first video received or photographed from a server. At least one second video representing the user's response to the electronic device is generated according to a viewpoint of the first video using the image sensor, and some or all of the second video is generated at a corresponding time point of the first video. An electronic device may be provided that generates a third moving picture combined with a partial region of the first moving picture and plays the combined third moving picture.

According to the present embodiment, the processor may set the viewpoint of the first video.

According to the present embodiment, the processor may display the second video according to a user input.

According to the present embodiment, the processor may transmit the third video to the server.

According to the present embodiment, the processor may display the first video of the third video on the screen of the electronic device, and display the second video of the third video on the screen of the second electronic device. have.

According to the various embodiments described above, a user interface capable of providing a streaming service, searching for a video having a correlation, and intuitively sharing a user's reaction to content may be provided.

1 is a perspective view of an electronic device according to an embodiment of the present invention;
2 is a reference diagram illustrating a file sharing method of an electronic device according to an embodiment of the present invention;
3 is a block diagram of an electronic device according to an embodiment of the present invention;
4 is a block diagram of a processor according to an embodiment of the present invention;
5 is a flowchart illustrating a method of operating an electronic device according to an embodiment of the present invention;
6 is a flowchart illustrating a method of operating an electronic device according to another embodiment of the present invention;
7 is a flowchart illustrating a method of operating an electronic device according to another embodiment of the present invention;
8 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
9 is a flowchart illustrating an operation method between an electronic device and a second electronic device according to an embodiment of the present invention;
10 is an exemplary diagram for explaining a method of photographing a reaction video according to an embodiment of the present invention; And
11 is an exemplary diagram for explaining a method of setting a recording section of a reaction video according to an embodiment of the present invention.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the embodiments of the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the embodiments of the present invention, a detailed description thereof will be omitted. In addition, terms to be described later are terms defined in consideration of functions in the present embodiment and may vary according to the intention or custom of users or operators. Therefore, the definition should be made based on the overall contents of the embodiments of the present invention.

In describing embodiments of the present invention, an electronic device to which a display device is applied as a display unit and includes at least one image sensor is illustrated and described, but is not limited thereto. For example, an electronic device includes a smartphone, a tablet PC, a mobile phone, a video phone, an e-book reader, and a desktop PC including one or more image sensors. personal computer), laptop personal computer, netbook computer, personal digital assistant (PDA), portable multimedia player (PMP), MP3 player, accessory, electronic appcessory, camera ( camera), wearable device, wrist watch, refrigerator, air conditioner, vacuum cleaner, artificial intelligence robot, TV, digital video disk (DVD) player, audio, oven, microwave oven, washing machine, electronic bracelet, electronic Necklace, air purifier, electronic frame, medical device, navigation device, satellite signal receiver, EDR (event data recorder), FDR (flight data recorder), set-top box, TV box, electronic dictionary, Automotive infotainment devices, electronic equipment for ships, avionics, security devices, electronic clothing, electronic keys, camcorders, game consoles, head-mounted HMDs display, flat panel display device, electronic album, furniture including electronic devices or parts of buildings/structures, electronic boards, electronic signature receiving devices or projectors one or more of (projector) Can include.

1 is a perspective view of an electronic device 100 according to an embodiment of the present invention.

Referring to FIG. 1, the electronic device 100 may have a display device 190 installed on the front surface 101. The display device 190 may display an electrical signal transmitted from the electronic device 100 as an image such as text, graphic, or video. In addition, the display device 190 may be implemented as a touch screen capable of simultaneously inputting and outputting data by applying touch sensor technology.

An ear piece 102 for receiving a voice may be installed on the upper side of the display device 190, and the use of an electronic device 100 such as a proximity sensor or an illuminance sensor around the ear piece 102 A plurality of sensors 103 for convenience and a camera module 104 for photographing a subject may be installed. The camera module 104 may be disposed on the front side 101 of the electronic device 100 to perform a self-camera function, or may be disposed on the rear side to take a background image.

The electronic device 100 may further include a microphone device 105 located under the display device 190 and receiving sound input, and a keypad device 106 on which key buttons are disposed. However, the present disclosure is not limited thereto, and the electronic device 100 may further include various additional devices for implementing other known additional functions.

2 is a reference diagram for explaining a file sharing method of the electronic device 100 according to an embodiment of the present invention.

Referring to FIG. 2, the electronic device 100 may be connected to the server 10 or the second electronic device 20 through a predetermined network 30. The electronic device 100 may connect to the server 10 or the second electronic device 20 to transmit and receive files with the server 10 and the second electronic device 20. The server 10 may include, but is not limited to, a cloud service type cloud server that is connected to the electronic device 100 and the network 30 to provide various contents, or a streaming server to provide media files.

The electronic device 100 may connect the server 10 and the network 30 to upload photo and video files to the server 10. Also, the electronic device 100 may connect the server 10 and the network 30 to receive photo and video files from the server 10.

According to an embodiment, the electronic device 100 may play the first video received from the server 10 and simultaneously capture the second video. Also, the electronic device 100 may reproduce the first video captured through the image sensor and simultaneously capture the second video. The second video may include a reaction video indicating a user's reaction to the first video.

According to another embodiment, the electronic device 100 may generate a third video by combining some or all of the second video with a partial region of the first video at a corresponding time point of the first video. For example, a third video may be uploaded to the server 10 through the network 30, and such a third video may be received by the server 10 so that the second electronic device 20 can receive it through the network 30. Can be controlled.

According to another embodiment, the electronic device 100 uses a peer-to-peer (P2P) method, which is a method of sharing files by being directly connected to the second electronic device 20 without using the server 10. The file can be shared with the second electronic device 20. For example, the electronic device 100 transmits a file with the second electronic device 20 through services such as WiFi Direct, e-mail, SMS (Short Message Service), NFC (Near Field Communication), and SNS (Social Networking Service). Will be able to share. However, the present invention is not limited thereto, and the electronic device 100 may have various ways of sharing files with the second electronic device 20.

The second electronic device 20 includes various devices including at least one communication module, that is, a personal digital assistant (PDA), a laptop computer, a mobile phone, a smart phone, and a netbook. (Netbook), TV (Television), Mobile Internet Device (MID), Ultra Mobile PC (UMPC), Tablet Personal Computer (Tablet Personal Computer), watch, camera device, navigation, MP3, etc. Applicable to the device.

The network 30 includes a wired or wireless network, and depending on the communication network, a Global System for Mobile Communication (GSM) network, an Enhanced Data GSM Environment (EDGE) network, a Code Division Multiple Access (CDMA) network, and a W-CDMA (Wideband Code) network. Division Multiple Access) network, Long Term Evolution (LTE) network, Orthogonal Frequency Division Multiple Access (OFDMA) network, Wireless Fidelity (Wi-Fi) network, WiMax network, Near Field Communication (NFC) network, Infra Red Communication ) It may include at least one of a network and a Bluetooth network.

3 is a block diagram of an electronic device 100 according to an embodiment of the present invention.

Referring to Figure 3, the electronic device 100 is a PDA (Personal Digital Assistant), a laptop computer (Laptop Computer), a mobile phone (Mobile Phone), a smart phone (Smart Phone), a netbook (Netbook), a handheld computer (Handheld) Computer), Mobile Internet Device (MID), Media Player, Ultra Mobile PC (UMPC), Tablet Personal Computer (Tablet Personal Computer), Note PC, Wristwatch, Navigation, MP3, It may be a device such as a camera device or a wearable device. Further, the electronic device 100 may be any device including a device combining two or more functions of these devices.

According to an embodiment, the electronic device 100 includes a memory 110, a processor unit 120, a camera device 130, a sensor device 140, a wireless communication device 150, and an audio device 160. ), an external port device 170, an input/output controller 180, a display device 190, and an input device 200. The memory 110 and the external port device 170 may be configured in plural.

Each component is as follows.

The processor unit 120 may include a memory interface 121, at least one processor 122, and a peripheral device interface 123. Here, the memory interface 121, at least one processor 122, and the peripheral device interface 123 included in the processor unit 120 may be integrated into at least one integrated circuit or implemented as separate components.

The memory interface 121 may control access to the memory 110 by a component such as the processor 122 or the peripheral device interface 123.

The peripheral device interface 123 may control connection of the input/output peripheral device of the electronic device 100 to the processor 122 and the memory interface 121.

The processor 122 may control the electronic device 100 to provide various multimedia services by using at least one software program. The processor 122 may execute at least one program stored in the memory 110 and provide a service corresponding to the corresponding program.

The processor 122 executes various software programs to perform various functions for the electronic device 100 and performs processing and control for voice communication, video communication, and data communication. In addition, the processor 122 may perform the methods of the embodiments of the present invention in conjunction with software modules stored in the memory 110.

The processor 122 may include one or more data processors, image processors, or codecs. Furthermore, the electronic device 100 may separately configure a data processor, an image processor, or a codec.

The processor 122 may include one or more application processors (AP) or one or more communication processors (CP).

Various components of the electronic device 100 may be connected through one or more communication buses (reference numbers not shown) or electrical connection means (reference numbers not shown).

The camera device 130 may perform a camera function such as a photo, a video clip, or recording. The camera device 130 may include a Charged Coupled Device (CCD) or Complementary Metal-Oxide Semiconductor (CMOS). In addition, the camera device 130 may adjust a hardware configuration change, for example, a lens movement, the number of apertures, and the like according to a camera program executed by the processor 122.

According to an embodiment, the camera device 130 may provide a collected image acquired through photographing of a subject to the processor unit 120. The camera device 130 includes an image sensor that converts an optical signal into an electrical signal, an image signal processor that converts an analog image signal to a digital image signal, and an image signal output from the image processing device. It may include a signal processing device (Digital Signal Processor) for processing an image so that it can be displayed on Although not shown, the camera device 130 may include an actuator that moves a lens, a driver integrated circuit (IC) that drives the actuator, and the like.

The sensor device 140 may include a proximity sensor, a Hall sensor, an illuminance sensor, a motion sensor, and the like. For example, the proximity sensor may detect an object that is close to the electronic device 100, and the Hall sensor may sense the magnetic force of the metal body. In addition, the illuminance sensor detects light around the electronic device 100, and the motion sensor may include an acceleration sensor or a gyro sensor that detects movement of the electronic device 100. However, the present invention is not limited thereto, and the sensor device 140 may further include various sensors for implementing other known additional functions.

The wireless communication device 150 enables wireless communication, and may include a radio frequency transmitter/receiver or an optical (eg, infrared) transmitter/receiver. Although not shown, the wireless communication device 150 may include an RF IC unit (Radio Frequency IC unit) and a baseband processor. The RF IC unit can transmit and receive electromagnetic waves, convert the baseband signals from the baseband processing unit into electromagnetic waves, and transmit them through an antenna.

The RF IC unit is an RF transceiver, amplifier, tuner, oscillator, digital signal processor, CODEC chipset (COding DECoding chip set), subscriber identification module (SIM, Subscriber). Identity Module) card, etc.

Depending on the communication network, the wireless communication device 150 is a Global System for Mobile Communication (GSM) network, an Enhanced Data GSM Environment (EDGE) network, a Code Division Multiple Access (CDMA) network, and a Wideband Code Division Multiple Access (W-CDMA) network. , Long Term Evolution (LTE) network, Orthogonal Frequency Division Multiple Access (OFDMA) network, Wireless Fidelity (Wi-Fi) network, WiMax network, Near Field Communication (NFC) network, Infra Red Communication (Infra Red Communication) network, Bluetooth network It may be implemented to operate through at least one of. However, the present invention is not limited thereto, and the wireless communication device 150 may employ various communication methods using a protocol for email, instant messaging, or short message service (SMS).

The audio device 160 may be connected to the speaker 161 and the microphone 162 to perform audio input and output functions such as voice recognition, voice duplication, digital recording, or call function. The audio device 160 may provide an audio interface between the user and the electronic device 100, convert the data signal received from the processor 122 into an electrical signal, and output the converted electrical signal through the speaker 161 I can make it.

The speaker 161 may convert the electrical signal into an audible frequency band and output it, and may be disposed in front or rear of the electronic device 100. The speaker 161 may include a flexible film speaker in which at least one piezoelectric material is attached to one vibration film.

The microphone 162 may convert sound waves transmitted from people or other sound sources into electrical signals. The audio device 160 may receive an electrical signal from the microphone 162, convert the received electrical signal into an audio data signal, and transmit the converted audio data signal to the processor 122. The audio device 160 may include an earphone, an earset, a headphone, or a headset detachable from the electronic device 100.

The external port device 170 may directly connect the electronic device 100 to the counterpart electronic device or indirectly connect the electronic device 100 to the counterpart electronic device through a network (eg, Internet, intranet, wireless LAN, etc.). The external port device 170 may include a Universal Serial Bus (USB) port or a FIREWIRE port.

The input/output controller 180 may provide an interface between an input/output device such as the display device 190 and the input device 200 and the peripheral device interface 123. The input/output controller 180 may include a display device controller and other input device controllers.

The display device 190 may provide an input and output interface between the electronic device 100 and a user. The display device 190 may transmit user's touch information to the processor 122 by applying a touch sensing technology, and may display visual information, text, graphic, or video provided from the processor 122 to the user.

The display device 190 may display state information of the electronic device 100, a text input by a user, a moving picture, and a still picture. In addition, the display device 190 may display application-related information driven by the processor 122. Such a display device 190 includes a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active mode organic light emitting diode (AMOLED), and a thin film transistor-liquid crystal. At least one of a display, a TFT-LCD), a flexible display, and a 3D display may be applied.

The input device 200 may provide input data generated by a user's selection to the processor 122 through the input/output controller 180. The input device 200 may include a keypad including at least one hardware button and a touch pad for sensing touch information.

The input device 200 may include up/down buttons for volume control, and in addition, the input device 200 includes a push button, a rocker button, and a locker to which a corresponding function is assigned. ) It may include at least one of a pointer device such as a switch, a thumb-wheel, a dial, a stick, a mouse, a track-ball, or a stylus.

The memory 110 may include high-speed random access memory or nonvolatile memory, such as one or more magnetic disk storage devices, one or more optical storage devices, or flash memory (eg, NAND, NOR).

The memory 110 stores software, which includes an operating system module 111, a communication module 112, a graphic module 113, a user interface module 114, a codec module 115, and an application module 116. And it may include a reaction video operation module 117. The term module is also expressed as a set of instructions, an instruction set, or a program.

The operating system module 111 may include a built-in operating system such as WINDOWS, LINUX, Darwin, RTXC, UNIX, OS X, Android, or VxWorks, and controls general system operation. It can contain several software components. Control of such general system operation may include memory control and management, storage hardware (device) control and management, power control and management, and the like. In addition, the operating system module 111 may perform a function of facilitating communication between various hardware (devices) and software components (modules).

The communication module 112 may enable communication with a counterpart electronic device such as a computer, a server 10 and an electronic device through the wireless communication device 150 or the external port device 170.

The graphic module 113 may include various software components for providing and displaying a graphic on the display device 190. The term graphics may mean text, web page, icon, digital image, video, animation, and the like.

The user interface module 114 may include various software components related to a user interface. The user interface module 114 may control to display application-related information driven by the processor 122 on the display device 190. In addition, the user interface module 114 may include information on how the state of the user interface is changed or under what conditions the change of the user interface state is made.

The codec module 115 may include a software component related to encoding and decoding of a video file.

The application module 116 may include a software component for at least one application installed in the electronic device 100. These applications include browser, e-mail, phone book, game, short message service, multimedia messaging service, and social networking service (SNS). , Instant message, morning call, MP3 (MPEG Layer 3), scheduler, paint, camera, word processing, keyboard emulation, music player (music player), moving pictures player, address book, touch list, wideget, digital rights management (DRM), voice recognition, It may include voice replication, position determining function, location based service, user authentication service, and the like. The term application is also expressed as an application program.

The reaction video operation module 117 may include various software components for capturing a second video while playing the first video. The second video may include a reaction video indicating a user's reaction of the electronic device 100 to the first video. The reaction video operation module 117 may store time information and location information for the reaction video, and determine a face of a user included in the reaction video.

The processor unit 120 may further include additional modules (commands) in addition to the above-described modules.

Various functions of the electronic device 100 may be executed by hardware or software including one or more processing or application specific integrated circuits (ASICs).

Although not shown, the electronic device 100 may include a power system that supplies power to various components included in the electronic device 100. The power system may include a power source (AC power or battery), a power error detection circuit, a power converter, a power inverter, a charging device, or a power status display device (light-emitting diode). In addition, the electronic device 100 may include a power management and control device that generates, manages, and distributes power.

In the present exemplary embodiment, components of the electronic device 100 have been illustrated and described, but the present invention is not limited thereto. For example, the electronic device 100 may have a larger number of components or a smaller number of components than those illustrated in this drawing.

4 is a block diagram of a processor 122 according to an embodiment of the present invention.

Referring to FIG. 4, the processor 122 may include a first video acquisition unit 400, a reaction video generation unit 420, a second video acquisition unit 440, and a video transmission/reception unit 460.

According to an embodiment, the components of the processor 122 may be made of separate modules, but in another embodiment, they may be included as components of software within one module.

The first moving picture acquisition unit 400 may generate a first moving picture using image information received through the camera device 130. In addition, the first video acquisition unit 400 may receive the first video from the server 10 through the video transmission/reception unit 460.

The first video acquisition unit 400 may receive a specific signal while generating the first video. Such a specific signal may include time information and location information at which the first video is photographed, but is not limited thereto. The first video acquisition unit 400 may store the first video together with a specific signal in the memory 110.

The reaction video generation unit 420 may generate one or more reaction videos indicating a user's reaction to the first video while playing the first video obtained by the first video acquisition unit 400. For example, the reaction video generation unit 420 may capture a user's face image according to a recording section of the reaction video using the camera device 130 installed in front of the electronic device 100.

The second video acquisition unit 440 may generate a second video combined with the first video by editing the response video provided from the response video generation unit 420. In addition, the second video acquisition unit 440 may receive the second video from the server 10 through the video transmission/reception unit 460.

The second moving picture acquisition unit 440 may provide the second moving picture acquired in the above-described manner to the input/output controller 180. The input/output controller 180 may display the provided second video on the display device 190.

The video transmission/reception unit 460 may receive a first video, a second video, and a reaction video from the server 10. Also, the video transmission/reception unit 460 may transmit a first video, a second video, and a response video generated by the electronic device 100 to the server 10.

In the present embodiment, the components of the processor 122 have been illustrated and described, but the present invention is not limited thereto. For example, the processor 122 may have a larger number of components or a smaller number of components than those shown in this drawing.

5 is a flowchart illustrating a method of operating the electronic device 100 according to an embodiment of the present invention.

Referring to FIG. 5, the electronic device 100 displays one or more second videos representing a user's reaction to the first video while playing the first video received or captured from the server 10 in operation 500. May be generated according to the viewpoint of the first video using an image sensor. Here, the server 10 may include, but is not limited to, a cloud service type cloud server that is connected to the electronic device 100 and the network 30 to provide various contents, or a streaming server that provides media files.

According to an embodiment, the electronic device 100 may play a first video received from the server 10 or a first video captured by the electronic device 100. In addition, as shown in FIG. 10, the electronic device 100 may reproduce the first video 1000 and simultaneously capture a face image 1020 of the user using the image sensor 1010 of the electronic device 100. will be.

The second video including the face image 1020 may be captured according to the viewpoint of the first video 1000, and a photographing section for the second video may be preset by the user.

As illustrated in FIG. 11, the electronic device 100 may determine a photographing section 1110 of the second video from among the entire section 1100 of the first video using a conventional media file editing method. There may be one or more capturing sections 1110 for the second video, and the setting information for the capturing section 1110 may be stored in attribute information of the second video file.

According to another embodiment, the recording section of the second video may be preset in the server 10. In this case, the electronic device 100 may display a photographing section of the second video on the first video screen.

As illustrated in FIG. 12, while the first video 1200 is played back, a recording section of the second video may be displayed together with the playback scroll bar. In addition, a guide phrase indicating recording of the second video or a voice may be further output. However, the present invention is not limited thereto, and the recording section of the second video may be displayed in various ways, and there may be various methods of notifying the recording of the second video.

In operation 510, the electronic device 100 may generate a third video in which some or all of the second video is combined with a partial region of the first video at a corresponding time point of the first video.

According to an embodiment, as described above, the electronic device 100 may edit the second video captured in the recording section of the second video and combine it with a partial region of the first video in an overlay manner. However, the present invention is not limited thereto, and a part of the second video may be combined with a partial region of the first video through various methods.

The electronic device 100 may play the third video combined in operation 520.

According to an embodiment, as illustrated in FIG. 13, a third video 1300 in which a first video 1310 and a second video 1320 are combined may be displayed on the screen of the electronic device 100. The second moving picture 1320 may be displayed on a partial area of the first moving picture 1310 in an overlay manner, and the size and position of the second moving picture 1320 may be set by a user.

According to another embodiment, as illustrated in FIG. 14, the electronic device 100 may notify a time when the first video 1400 is played and the second video 1410 is played. For example, the playback time of the second video 1410 may be displayed on the playback scroll bar, but is not limited thereto. The electronic device 100 may display the second video 1410 in a certain area of the first video 1400 by synchronizing the playback time of the second video 1410 and the first video 1400.

The instruction set for each of these operations may be stored as one or more modules in the above-described memory 110. In this case, the modules stored in the memory 110 may be executed by one or more processors 122.

6 is a flowchart illustrating a method of operating an electronic device 100 according to another embodiment of the present invention.

Referring to FIG. 6, the electronic device 100 may receive a first video from the server 10 in operation 600. Here, the server 10 may include, but is not limited to, a cloud service type cloud server that is connected to the electronic device 100 and the network 30 to provide various contents, or a streaming server that provides media files.

The electronic device 100 may receive first information related to the first video from the server 10 in operation 610.

According to an embodiment, the first information may include a reaction video indicating a user's reaction of the electronic device 100 to the first video. This first information may be displayed under the first moving picture 1500 as shown in FIG. 15A. For example, the first information 1510 may be displayed in a comment form or a layout form, but is not limited thereto. The first information 1510 may be provided from a counterpart electronic device through the server 10 or may be provided within the server 10.

The electronic device 100 may play a partial section of the first video according to the first information in operation 620.

According to an embodiment, when the first information 1510 is selected, as illustrated in FIG. 15B, the electronic device 100 may view a partial section of the first video 1500 corresponding to the selected first information 1510. Can play. In this case, a partial section of the first video 1500 may be played together with the execution of the first information 1510, and the first information 1510 may be displayed in an overlay manner on a partial region of the first video 1500. I can.

Accordingly, the electronic device 100 may reproduce a specific playback section such as a highlight section of the first video 1500 by using the first information 1510 related to the first video 1500.

The instruction set for each of these operations may be stored as one or more modules in the above-described memory 110. In this case, the modules stored in the memory 110 may be executed by one or more processors 122.

7 is a flowchart illustrating a method of operating the electronic device 100 according to another embodiment of the present invention.

Referring to FIG. 7, the electronic device 100 may play the first video received from the server 10 in operation 700. Here, the server 10 may include, but is not limited to, a cloud service type cloud server that is connected to the electronic device 100 and the network 30 to provide various contents, or a streaming server that provides media files.

The electronic device 100 may generate one or more reaction videos with respect to the first video in operation 710 according to the viewpoint of the first video.

According to an embodiment, the electronic device 100 may capture a reaction video representing a user's reaction through the camera device 130. The shooting section of the reaction video may be set by the user, but is not limited thereto.

The electronic device 100 may generate a second video in which the reaction video is combined with a corresponding time point of the first video in operation 720.

According to an embodiment, the electronic device 100 may edit the reaction video captured in the photographing section of the reaction video and combine it with a partial region of the first video in an overlay method. However, the present invention is not limited thereto, and a part of the reaction video may be combined with a partial region of the first video through various methods.

The electronic device 100 may transmit the second video combined in operation 730 to the server 10.

According to an embodiment, the electronic device 100 may upload the second video to the server 10 through the network 30. The server 10 may be implemented to provide the received second video to the second electronic device 20.

The instruction set for each of these operations may be stored as one or more modules in the above-described memory 110. In this case, the modules stored in the memory 110 may be executed by one or more processors 122.

8 is a flowchart illustrating a method of operating an electronic device 100 according to various embodiments of the present disclosure.

Referring to FIG. 8, in operation 800, the electronic device 100 may receive a plurality of reaction videos for the first video.

According to an embodiment, the electronic device 100 may receive a plurality of reaction videos for the first video through the server 10 and display them on a screen. Here, the reaction video may be a video representing a viewer's reaction to the first video. The server 10 may include, but is not limited to, a cloud service type cloud server that is connected to the electronic device 100 and the network 30 to provide various contents or a streaming server to provide media files.

In operation 810, the electronic device 100 may classify a plurality of reaction videos according to classification conditions.

According to an embodiment, the electronic device 100 may classify the reaction video according to a face shape (eg, a smile, a cry, a surprise, etc.) in the reaction video or the number of recommendations. Also, the electronic device 100 may adjust the number of reaction videos displayed on the screen or set the location thereof. However, the present disclosure is not limited thereto, and the electronic device 100 may classify the reaction video according to various classification conditions.

The instruction set for each of these operations may be stored as one or more modules in the above-described memory 110. In this case, the modules stored in the memory 110 may be executed by one or more processors 122.

9 is a flowchart illustrating an operation method between the electronic device 100 and the second electronic device 20 according to an embodiment of the present invention.

Referring to FIG. 9, in operation 900, the electronic device 100 may capture a first video of a target. For example, as illustrated in FIG. 16A, the electronic device 100 may capture a first video 1610 for one person 1600 in a specific place such as a concert hall. As shown in FIG. 16B, the second electronic device 20 may capture the second moving picture 1620 at different angles for the same person 1600 (operation 910).

In the present embodiment, a case in which the second video 1620 is captured after the first video 1610 is captured is described, but the present invention is not limited thereto. For example, the first moving picture 1610 and the second moving picture 1620 may be captured at the same time.

According to an embodiment, the electronic device 100 and the second electronic device 20 may receive a specific signal while capturing the first moving picture 1610 and the second moving picture 1620. Such a specific signal may be an ultrasonic signal or an infrared signal including time information and location information, but is not limited thereto. The electronic device 100 and the second electronic device 20 may store the corresponding videos 1610 and 1620 together with the above-described specific signal.

The second electronic device 20 may transmit the second video captured in operation 920 to the electronic device 100. The electronic device 100 may receive the second video in operation 930 and generate a third video in which the first video and the second video are combined in synchronization with the recording timing in operation 940.

According to an embodiment, the electronic device 100 may synchronize the first moving picture and the second moving picture by checking shooting times of the first moving picture and the second moving picture. Also, the electronic device 100 may synchronize using a specific signal received when the first moving picture and the second moving picture are captured. However, the present invention is not limited thereto, and there may be various methods for synchronizing the first video and the second video.

As shown in FIG. 17, the second video 1720 may be displayed in an overlay manner on a certain area of the first video 1710.

According to an embodiment, a third video 1700 in which the second video 1720 and the first video 1710 are combined may be displayed on one screen of the electronic device 100. In addition, when the third video 1700 is played, the first video 1710 included in the third video 1700 is displayed on the screen of the electronic device 100, and the second video 1720 is another electronic device. May be implemented to be displayed in

According to another embodiment, the electronic device 100 may search for the second video 1720 by using a specific signal included in the above-described first video 1710. For example, since a specific signal included in the first video 1710 has time information and location information when the corresponding video is captured, the second video 1720 can be searched by comparing it with a specific signal of the second video 1720. There will be.

The instruction set for each of these operations may be stored as one or more modules in the above-described memory 110. In this case, the modules stored in the memory 110 may be executed by one or more processors 122.

The methods according to the embodiments described in the claims and/or the specification of the present invention may be implemented in the form of hardware, software, or a combination of hardware and software.

When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. One or more programs stored in a computer-readable storage medium are configured to be executable by one or more processors in an electronic device (device). The one or more programs include instructions that cause the electronic device to execute methods according to the embodiments described in the claims and/or specification of the present invention.

These programs (software modules, software) include random access memory, non-volatile memory including flash memory, ROM (Read Only Memory), and electrically erasable programmable ROM. (EEPROM, Electrically Erasable Programmable Read Only Memory), magnetic disc storage device, Compact Disc-ROM (CD-ROM), Digital Versatile Discs (DVDs), or other types of It may be stored in an optical storage device or a magnetic cassette. Alternatively, it may be stored in a memory composed of a combination of some or all of them. In addition, a plurality of configuration memories may be included.

In addition, through a communication network composed of a communication network such as the Internet, an intranet, a local area network (LAN), a wide LAN (WLAN), or a storage area network (SAN), or a combination thereof It may be stored in an attachable storage device that can be accessed. Such a storage device can access the electronic device through an external port.

In addition, a separate storage device on the communication network may access the portable electronic device.

Obviously, there are various ways in which these embodiments can be modified while remaining within the scope of the claims. In other words, there will be various ways in which the present invention can be practiced without departing from the scope of the following claims.

10: server 20: second electronic device
30: network 100: electronic device

Claims (20)

In the method of operating an electronic device,
At least one second video indicating a response of the electronic device user to the first video while playing the first video received or captured from the server at the time point of the first video using an image sensor included in the electronic device. The operation to generate accordingly; And
And generating a third moving picture combined with a partial area of the first moving picture by synchronizing a playback time of some or all of the second moving picture with a corresponding point of the playing time of the first moving picture.
The method of claim 1,
The method further comprising reproducing the generated third video.
The method of claim 1,
The method of claim 1, wherein the viewpoint of the first video is set in advance.
The method of claim 1,
The method of claim 1, wherein the time point of the first video is determined by the user.
The method of claim 1,
The method further comprising displaying the second video according to a user input.
The method of claim 1,
The method further comprising transmitting the third video to the server.
The method of claim 6,
The method of claim 1, wherein the third video is played on a second electronic device through the server.
In the method of operating an electronic device,
Receiving a first video from a server;
Receiving, from the server, first information including one or more second videos indicating a response of a user of a second electronic device to the first video; And
And reproducing a partial section of the first video in which a partial or all playback time of the second video is synchronized to a corresponding time among playback times of the first video according to the first information.
delete The method of claim 8,
The method of claim 1, wherein the second video is displayed in an overlay manner on a partial area of the first video.
The method of claim 8,
In the operation of reproducing the partial section of the first video, the partial section of the first video is displayed on the screen of the electronic device, and the second video is displayed on the screen of the second electronic device.
The method of claim 8,
The first information is classified and displayed according to a reference condition.
In the method of operating an electronic device,
Capturing a first moving picture of the target;
Receiving, by a second electronic device, a second moving picture photographed on the target from the second electronic device; And
And generating a third moving picture combined with a partial region of the first moving picture by synchronizing the recording time of some or all of the second moving picture with a corresponding point of the recording time of the first moving picture.
The method of claim 13,
The method further comprising receiving a specific signal together with the operation of capturing the first video of the target.
The method of claim 14,
The method further comprising searching for the second video including the specific signal.
In the electronic device,
At least one image sensor;
Memory; And
Including at least one processor,
The processor,
While playing the first video received or photographed from the server, one or more second videos representing the response of the electronic device user to the first video are generated using the image sensor according to the viewpoint of the first video,
Synchronizing a playback time of some or all of the second video with a corresponding time of the playback time of the first video to generate a third video combined with a partial region of the first video,
An electronic device that plays the combined third video.
The method of claim 16,
The electronic device, wherein the processor sets a viewpoint of the first moving picture.
The method of claim 16,
The processor displays the second moving picture according to a user input.
The method of claim 16,
The processor is an electronic device that transmits the third moving picture to the server.
The method of claim 16,
The processor displays the first moving picture of the third moving picture on the screen of the electronic device, and displays the second moving picture of the third moving picture on the screen of the second electronic device.

Images