KR20210149549A - Electronic device for recording and method for operating thereof - Google Patents

Abstract

According to various embodiments, provided is an electronic device comprising a display, at least one communication circuit, and at least one processor. The electronic device is configured to: identify an event for recording; establish a communication connection with an external electronic device; transmit, based on the communication connection, audio data related to audio to the external electronic device using at least one communication circuit so that the audio can be output from the external electronic device while outputting at least one screen provided by at least one running application to the display, wherein output timing of the at least one screen is adjusted based on a latency associated with the communication connection; and provide, based on the event identification and the communication connection, a file using the at least one screen whose output timing has been adjusted and the audio data whose recording timing has been adjusted based on the latency. Various other embodiments are possible. When a recording operation is performed while communication with another external electronic device is established, a recording time of data for one content is adjusted as much as an output time of another content is adjusted. As a result, the contents in a file can be synchronized when the file is played back.

Description

Electronic device for recording and method of operation thereof

Various embodiments of the present disclosure relate to an electronic device for recording and an operating method thereof.

For many people living in modern times, portable digital communication devices have become an essential element. Consumers want to be provided with various high-quality services they want anytime, anywhere by using portable digital communication devices.

Various types of applications are installed in portable digital communication devices, and portable digital communication devices can provide various high-quality services based on data obtained according to the driving of the installed applications. A user may record data for various high-quality services by using a recording application to store various high-quality services provided from portable digital communication devices.

In recent years, when portable digital communication devices provide various high-quality services while communicating with each other, they may perform an operation of compensating for a delay in outputting data for providing high-quality services according to the established communication status. Therefore, when the recording operation is performed in a state in which communication is established, it is necessary to implement a technique for compensating for the effect generated on the recording operation by the operation of compensating for the delay of the output timing of the data.

The electronic device may output one content (eg, visual content) from the electronic device and provide another content (eg, auditory content) through the other external electronic device while communication is established with the other external electronic device. In this case, the electronic device may adjust the output timing of one content from the electronic device in consideration of the latency of the established communication. Accordingly, when a recording operation is performed in a state in which communication with another external electronic device is established in the electronic device, data (eg, video data) of one content to be recorded and the one content based on the adjustment of the output timing of the one content Recording times of data (eg, audio data) for other content related to the content may be different from each other. That is, when a file (eg, a moving picture file) generated according to a result of performing a recording operation is played, one output content and another content may not be synchronized.

According to various embodiments, an electronic device and a method of operating the same adjust the recording time of data for another content as much as the output time of one content is adjusted when a recording operation is performed in a state in which communication with another external electronic device is established. , it is possible to synchronize the contents output when the generated file (eg, a video file) is played.

According to various embodiments, an electronic device and an operating method thereof adjust different recording times of data for content according to different latencies of communications formed with an external electronic device, so that content output when a generated file is reproduced is can be synchronized.

The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. There will be.

According to various embodiments there is provided an electronic device comprising: a display, at least one communication circuitry, at least one processor operatively coupled to the display and the at least one communication circuitry, for identifying an event for recording; A communication connection is formed with an external electronic device using at least one communication circuit, and based on the communication connection, at least one screen provided by at least one application being executed is displayed on the display while audio is transmitted to the external device. Transmitting the audio data related to the audio to be output from the electronic device to the external electronic device using at least one communication circuit, wherein the output timing of the at least one screen is based on a latency associated with the communication connection Adjusted, based on the event identification and the communication connection, set to provide a file using at least one screen whose output time is adjusted and the audio data whose recording time is adjusted based on the latency, the electronic device may be provided.

According to various embodiments, the means for solving the problem are not limited to the above-described solutions, and the solutions not mentioned are to those of ordinary skill in the art to which the present invention belongs from the present specification and the accompanying drawings. can be clearly understood.

According to various embodiments, when a recording operation is performed in a state in which communication with another external electronic device is established, by adjusting the recording time of data for another content as much as the output time of one content is adjusted, a file (eg An electronic device that synchronizes contents output during playback of a moving picture file) and an operating method thereof may be provided.

According to various embodiments, an electronic device that synchronizes contents output when a generated file is reproduced by adjusting a recording time of content data differently according to different latencies of communications formed with an external electronic device, and the same A method of operation may be provided.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;
2A is a diagram illustrating an electronic device and an external electronic device according to various embodiments of the present disclosure;
2B is a diagram for explaining an example of the configuration of an electronic device and an external electronic device according to various embodiments of the present disclosure;
3 is a diagram for describing another example of a configuration of an electronic device according to various embodiments of the present disclosure;
4 is a flowchart illustrating an example of an operation of an electronic device according to various embodiments of the present disclosure;
FIG. 5 is a diagram for explaining an example of an operation of performing recording when a communication connection between an electronic device and an external electronic device is established, according to various embodiments of the present disclosure;
6 is a flowchart illustrating another example of an operation of an electronic device according to various embodiments of the present disclosure;
7 is a diagram for describing an example of an operation of adjusting an output time of at least one screen by using a latency when an electronic device is connected to an external electronic device for communication according to various embodiments of the present disclosure;
8 is a diagram for explaining an example of an operation for adjusting a recording time of audio data obtained for a recording operation of an electronic device using latency according to various embodiments of the present disclosure;
9 is a diagram for explaining examples of an operation of reproducing a file generated by a recording operation of an electronic device according to various embodiments of the present disclosure;
10 is a flowchart illustrating another example of an operation of an electronic device according to various embodiments of the present disclosure;
11 is a diagram for explaining different latencies for each external electronic device communicatively connected to an electronic device according to various embodiments of the present disclosure;
12 is a diagram for describing an example of an operation of identifying a latency according to whether a communication connection of an electronic device is identified, according to various embodiments of the present disclosure;
13 is a flowchart illustrating another example of an operation of an electronic device according to various embodiments of the present disclosure;
14 is a diagram for describing an example of an operation of performing a recording operation related to an empty time period when a communication connection is established after performing a recording operation of an electronic device according to various embodiments of the present disclosure;
15 is a flowchart illustrating another example of an operation of an electronic device according to various embodiments of the present disclosure;
16 is a diagram for explaining an example of an operation of processing video data acquired for a predetermined time period from a time point of starting a recording operation when a recording operation is started after a communication connection of an electronic device is established according to various embodiments of the present disclosure; It is a drawing.
17 is a flowchart illustrating another example of an operation of an electronic device according to various embodiments of the present disclosure;
18 is a diagram for describing an example of an operation of executing a recording application of an electronic device and providing an interface of the recording application according to various embodiments of the present disclosure;
19 is a flowchart illustrating another example of an operation of an electronic device according to various embodiments of the present disclosure;
20 illustrates an example of an operation of recording video data and audio data of an electronic device as well as audio data of a user voice acquired through an input device (eg, a microphone) of the electronic device according to various embodiments of the present disclosure; is a drawing for
21 is a flowchart illustrating another example of an operation of an electronic device according to various embodiments of the present disclosure;
22 is a diagram for describing an example of an operation performed when a call is received while an electronic device performs a recording operation according to various embodiments of the present disclosure;
23 is a diagram for describing an example of an operation that is performed when a notification is obtained while an electronic device performs a recording operation according to various embodiments of the present disclosure;
24 is a flowchart illustrating another example of an operation of an electronic device according to various embodiments of the present disclosure;
25 is a diagram for explaining an example of an operation of adjusting a recording time of at least one of video data or audio data based on latency when recording of an electronic device is completed, according to various embodiments of the present disclosure;
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the co-processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

Hereinafter, an example of the electronic device 210 and an example of the external electronic device 220 according to various embodiments will be described. Since the description of the electronic device 101 described in FIG. 1 may be applied mutatis mutandis to the electronic device 210 and the external electronic device 220 , a redundant description will be omitted.

2A is a diagram illustrating an electronic device and an external electronic device according to various embodiments of the present disclosure; Hereinafter, FIG. 2A will be described with reference to FIGS. 2B and 3 .

2B is a diagram for explaining an example of the configuration of an electronic device and an external electronic device according to various embodiments of the present disclosure; 3 is a diagram for describing another example of a configuration of an electronic device according to various embodiments of the present disclosure; According to various embodiments, it is not limited to the configurations shown in FIGS. 2B and 3 , and the electronic device 210 and the external electronic device 220 have more configurations than the illustrated configurations or more than the illustrated configurations. It may include few components. For example, the components of the electronic device 101 described in FIG. 1 may be included in the electronic device 210 and/or the external electronic device 220 described in FIGS. 2 and 3 . According to various embodiments, the electronic device 210 and/or modules (eg, the recording module 212 ) included in the processor of the external electronic device 220 include the processor 211 (eg, the processor 120 of FIG. 1 ). )) may be implemented in an electronic form such as instructions, computer code, or a program for performing at least one operation. In other words, when the module is executed, the module may cause the electronic device 210 (eg, the processor 211 , such as the processor 120 of FIG. 1 ) to perform at least one operation associated with the module.

According to various embodiments, the electronic device 210 and the external electronic device 220 may form a communication connection 230 with each other as shown in FIG. 2A . The type of the communication connection 230 is a wireless communication connection 230 using a D2D method such as Bluetooth (blue-tooth), Wi-Fi direct, Wi-Fi hot spot, and an AP (access point) such as Wi-Fi. ) and a wired communication connection 230 such as serial (USB). The electronic device 210 and the external electronic device 220 may transmit and/or receive data through established communication. Latency may occur when the electronic device 210 and the external electronic device 220 transmit and/or receive data. For example, when the electronic device 210 transmits data to the external electronic device 220 at a first time, the external electronic device 220 may receive the data at a second time. A difference between the first time point, which is the data transmission time, and the second time point, which is the data reception time, may be defined as latency. The electronic device 210 may perform at least one operation (eg, a screen output operation and a recording operation) based on the latency associated with the communication connection 230 , which will be described later.

According to various embodiments, the electronic device 210 may perform a cooperative operation with the external electronic device 220 based on the communication connection 230 formed with the external electronic device 220 . For example, while performing one operation, the electronic device 210 may transmit data to the external electronic device 220 through communication so that the external electronic device 220 performs another operation. As an example, the electronic device 210 performs an operation of outputting a screen (or displaying the screen on a display), and transmits audio data to the external electronic device 220 through which the communication connection 230 is connected to the external electronic device 220 . ) can perform an operation of outputting audio. When a collaborative operation is performed, the electronic device 210 sets the time point at which one operation performed by the electronic device 210 is performed and the time point at which another operation performed by the external electronic device 220 is performed to be the same (or, to be synchronized) and latency can be used. An operation of synchronizing an operation using the latency of the electronic device 210 (eg, synchronizing an output of a screen and an output of an audio) will be described later.

According to various embodiments, the electronic device 210 may perform a recording operation while performing a cooperative operation with the external electronic device 220 . The recording operation may include an operation of muxing various types of data in real time. The various types of data include video data or audio data, and each data may be encoded real-time stream data. For example, when an event for initiating a recording operation is identified, the electronic device 210 acquires video data related to a currently displayed screen and audio data related to output audio in real time, and muxes the video data and audio data. can do. As a result of the muxing, the electronic device 210 may generate a file including video data and audio data. When the generated file is reproduced, video data and audio data may be reproduced to output video and audio together. The type of the recording operation may include, in addition to the operation of recording the video data and the audio data, an operation of recording only video data, and an operation of recording video data, audio data, and audio data corresponding to a user's voice. . When performing a recording operation, the electronic device 210 may adjust a recording time of the muxed audio data 525 and/or a recording time of the video data 515 using latency. A detailed recording operation of the electronic device 210 will be described later.

Hereinafter, an example of the configuration of the electronic device 210 and an example of the configuration of the external electronic device 220 will be described.

According to various embodiments, the electronic device 210 includes a processor 211 including a recording module 212 , a video data acquisition module 213 , and an audio module 214 , and display control as shown in FIG. 2B . circuitry 215 , communication circuitry 216 , display 217 , and/or antenna 218 .

According to various embodiments, the recording module 212 of the processor 211 may perform a recording operation. The recording module 212 may provide an interface (eg, displayed on a display) for receiving an event related to the recording operation, and receive an event related to the recording operation from a user. When a recording operation is started, the recording module 212 may acquire various types of data (eg, audio data and/or video data) in real time and mux the obtained various types of data. For example, the recording module 212 may acquire the video data 515 for at least one screen displayed on the display of the electronic device 210 from the video data acquisition module 213 . When the recording operation is performed, the video data acquisition module 213 acquires the video data 515 from the configuration for displaying a screen on the display 217 of the display control circuit 215 from the time the recording operation is performed. may be transmitted to the recording module 212 . Also, for example, the recording module 212 may obtain audio data for audio output from the electronic device 210 or the external electronic device 220 from the audio module 214 . Various types of data obtained by the recording module 212 may be data encoded by a designated codec. Alternatively, the various types of data may be encoded using a designated codec before muxing by the recording module 212 . Alternatively, the various types of data may be muxed by a recording application in an unencoded state. In addition, according to various embodiments, without being limited thereto, the recording module 212 does not perform the recording operation in real time, but data ( For example, video data and/or audio data) may be muxed at the time the recording operation ends. Hereinafter, for convenience of description, the recording operation will be described as being performed in real time, but the described examples may be applied mutatis mutandis to a recording operation of muxing data when the recording operation is terminated.

According to various embodiments, the recording module 212 may perform a recording operation according to whether the communication connection 230 with the external electronic device 220 is established. For example, the recording module 212 may adjust the recording time of various types of data (eg, audio data and/or video data) to be recorded according to whether the communication connection 230 is established. The adjustment operation of the recording time by the recording module 212 will be described later.

According to various embodiments, the recording module 212 of the processor 211 may generate a file including video data 515 and audio data as a result of the muxing. When the generated file is reproduced, the electronic device 210 may split the video data 515 and audio data from the file using a media playback application and reproduce the video data and the audio data, respectively. As the video data and the audio data are respectively reproduced, the electronic device 210 may output video and audio together.

According to various embodiments, the audio module 214 may provide audio data to the communication circuit 216 and transmit the audio data to the external electronic device 220 through the antenna 218 using the communication circuit 216 . have. The external electronic device 220 may output audio through the speaker 225 based on the received audio data.

According to various embodiments, the display control circuit 215 may display at least one screen on the display 217 . For example, the electronic device 210 displays at least one screen on the display 217 using the display control circuit 215 based on video data obtained according to the execution and/or driving of at least one application. can do. In addition, when the communication connection 230 is formed between the electronic device 210 and the external electronic device 220 , the electronic device 210 (eg, the processor 211 ) operates as much as the latency associated with the communication connection 230 . The display control circuit 215 and the display 217 may be controlled to adjust an output timing of at least one screen. The operation of adjusting the output timing when the communication connection 230 of the electronic device 210 is formed will be described later.

According to various embodiments, the video data acquisition module 213 obtains video data 515 for at least one screen displayed on a display when a recording operation is performed, as described above in the description of the recording module 212 . It can be obtained and provided to the recording module 212 .

According to various embodiments, the electronic device 210 may store the information on the latency in a memory (not shown). For example, when the electronic device 210 forms a communication connection 230 with the external electronic device 220 , information on a communication connection received from the external electronic device 220 (eg, information on latency associated with a communication connection) ) can be received and stored in a memory (not shown). Also, for example, the electronic device 210 may store information on latency identified based on the received communication connection information in a memory (not shown).

Hereinafter, an example of the configuration of the external electronic device 220 will be described.

According to various embodiments, the external electronic device 220 includes a processor 221 including an audio module 222 , a communication circuit 223 , an antenna 224 , a speaker 225 , and/or a microphone 226 . can do.

According to various embodiments, the audio module 222 of the processor 221 may output audio through the speaker 225 based on the audio data 525 . The audio module 222 may receive a sound (eg, a user's voice) through the microphone 226 , and obtain the received user's voice as audio data 525 . The audio module 222 may transmit audio data 525 to the communication circuit 223 , and the audio data 525 may be transmitted to the electronic device 210 through the communication circuit 233 . Also, the audio module 222 may acquire the audio data 525 received from the electronic device 210 through the communication circuit 223 .

According to various embodiments, the external electronic device 220 receives the audio data 525 from the electronic device 210 through the antenna 224 using the communication circuit 223 and transmits the received audio data 525 . It may be provided by the audio module 222 . The external electronic device 220 obtains audio data 525 (eg, audio data 525 related to a user's voice) from the audio module 222 , and uses the communication circuit 223 through the antenna 224 . The acquired audio data 525 may be transmitted to the electronic device 210 .

According to various embodiments, the external electronic device 220 may store information on a communication connection used by the external electronic device 220 (eg, information on latency associated with the communication connection) in a memory (not shown). The external electronic device 220 may transmit information on the communication connection 230 to the electronic device 210 when the communication connection 230 is formed with the electronic device 210 .

Hereinafter, another example of the configuration of the electronic device 210 will be described. The configurations of the electronic device 210 described with reference to FIG. 2A may be implemented as illustrated in FIG. 2B .

According to various embodiments, the electronic device 210 includes a hardware layer (HW) including a sensor controller 311 and a display panel 312 , and a sensor driver 321 . , a BT AV sync module 322, a kernel layer including a DDI controller (diplay driver integrated circuit controller) 323, an event hub 331, an audio HAL (audio hal) 332, and a hardware abstraction layer (HAL) including a surface flinger (333), a sensor manager (335), a window manager (334), a virtual display (337) and a video record module 336 including a media projection 338 and an audio service including an audio record 340 and an audio framework 341 ( 339), a view system 342, a framework including an activity manager 343, and a screen recorder manager (hereinafter, recording application) 351 (SRM) 351, system UI (system) It may include an application layer (application) including a user interface) 355 and other applications 352 , 353 , or 354 . Here, the kernel layer (kernel), hardware abstraction layer (hardware abstraction layer, HAL), framework layer (framework), and the application layer (application) are the same as the modules included in the processor 211 of FIG. 2A described above. Instructions for causing the processor 211 to perform at least one operation may be implemented in an electronic form, such as instructions, computer code, or a program.

Hereinafter, the hardware layer (HW) will be described.

According to various embodiments, the sensor controller 311 may detect states of various types of electronic devices 210 . For example, when the electronic device 210 is the foldable electronic device 210 using a Hall sensor, the sensor controller 311 may detect whether the foldable electronic device 210 is folded.

According to various embodiments, the display panel 312 may output at least one screen.

Hereinafter, the kernel layer (kernel) will be described.

According to various embodiments, the kernel layer may include various drivers for controlling various hardware modules (eg, 311 or 312 ) included in the electronic device 210 .

According to various embodiments, the sensor driver 321 may include an interface module for controlling the sensor controller 311 .

According to various embodiments, the BT AV sync module 322 may control the output of data through a configuration such as the antenna 218 when the external electronic device 220 and the communication connection 230 (eg, Bluetooth) are formed. .

According to various embodiments, the DDI controller 323 may control the output of at least one screen through the display panel 312 .

Hereinafter, the hardware abstraction layer (HAL) will be described.

The hardware abstraction layer (HAL) may refer to an abstraction layer between a plurality of hardware modules included in the hardware layer (HW) and software of the electronic device 210 .

According to various embodiments, the event hub 331 may provide an interface for standardizing an event occurring in an input dispatcher or a sensor. The input dispatcher (not shown) may perform a function of determining to which application the generated event is provided. The event hub 331 may cause the collected events and data to be processed. For example, the event hub 331 may transmit the event and data collected from the sensor module (not shown) to a framework layer so that a service corresponding to the data may be provided.

According to various embodiments, the surface flanger 333 performs a function of providing an execution screen to be displayed on a display among execution screens generated by various applications, and changes the resolution and density according to the changed display configuration when the display configuration is changed. may request applications 352 , 353 , or 354 to process. According to various embodiments, the surface flinger 333 may combine a plurality of layers. The surface flinger 333 may provide data representing a plurality of synthesized layers to a display controller (eg, the DDI controller 323 ).

It is not limited to the above description, and since the hardware abstraction layer (HAL) may be implemented like a well-known technique, a redundant description will be omitted.

Hereinafter, a framework layer will be described.

According to various embodiments, a framework may provide various functions to an application so that a function or information provided from one or more resources of the electronic device 210 may be used by an application.

According to various embodiments, the window manager 334 may manage one or more graphic user interface (GUI) resources used in a screen.

According to various embodiments, the sensor manager 335 may obtain information sensed by a sensor (not shown) and allow the sensed information to be processed by an application.

According to various embodiments, the video record module 336 acquires video data for at least one screen displayed through the display panel 312 like the video data acquisition module 213 described in FIG. 2A , and SRM ( 351, hereinafter referred to as a recording application). For example, the video record module 336 may acquire the video data transmitted to the surface flanger 333 (or acquire the video data directly from the surface flanger 333 ) as shown in FIG. 3 . . The described operation of acquiring video data of the video record module 336 is only an example, and the description is not limited thereto. The video data module 336 receives video data for at least one screen displayed through the display panel 312 . Video data may be obtained from various obtainable configurations. The media projection 338 included in the video record module 336 generates a virtual display 337 , and video data for at least one screen may be transmitted and/or acquired in real time to the virtual display 337 . The video record module 336 may transmit and/or acquired video data in real time to the SRM 351 .

According to various embodiments, the audio service 339 processes to output audio or transmits the audio data to the external electronic device 220 based on the acquired audio data like the audio module 214 described in FIG. 2A . Alternatively, the audio data may be transmitted to the SRM 351 (recording application) to be recorded. The audio framework 341 included in the audio service 339 may process audio data. The audio record 340 may deliver audio data to the SRM 351 (recording application). For example, the audio record 340 transmits audio data transmitted from the BT AV sync module 322 and the Audio HAL 332 to the SRM 351 according to the establishment of a communication connection from an external electronic device (eg, 220 in FIG. 2B ). can be transmitted as

According to various embodiments, the view system 342 may be a set of extensible views used to create an application user interface.

According to various embodiments, the activity manager 343 may control an application lifecycle and an activity stack.

Since the framework is not limited to the above description and may be implemented as well-known techniques, a redundant description will be omitted.

Hereinafter, an application layer (application) will be described.

The application layer (application) is stored in a memory (eg, the memory 130 of FIG. 1 ) and at least one application executable by the processor (eg, the processor 120 of FIG. 1 , the processor 211 of FIG. 2B ). 351 , 352 , 353 , or 354 , and a system UI 355 .

According to various embodiments, the SRM (Screen Recorder Manager, recording application) 351 may perform a recording operation like the recording module 212 described above with reference to FIG. 2B . In other words, the recording module 212 described above in FIG. 2B may be implemented in the form of an application as shown in FIG. 3 . The recording application 351 may acquire and mux video data and/or audio data in real time. When the electronic device 210 performs the recording operation, the recording application 351 may perform the recording operation by adjusting a time stamp (hereinafter, a recording time point) of audio data to be recorded using latency. Since the recording application 351 may perform the same operation as the recording module 212 , a redundant description will be omitted.

According to various embodiments, the applications 352 , 353 , or 354 may include various types of applications such as an Internet browser, a video application, and a game. The application may provide various data (eg, audio data, video data, etc.) to be processed as it is executed and/or driven. Various data may be processed by the above-described components of the electronic device 210 and output through respective hardware (eg, a display, an antenna, a speaker, etc.). When a communication connection is established, the electronic device 210 may control an output timing of data provided by the application 352 , 353 , or 354 to be delayed by a latency.

According to various embodiments, the system UI 355 may mean an application constituting various GUI screens implemented on the system of the electronic device 210 , such as a notification bar and a quick view.

Hereinafter, diagrams are provided to explain an example of an operation of the electronic device 210 according to various embodiments of the present disclosure.

According to various embodiments, the electronic device 210 may perform recording while maintaining the communication connection 230 with the external electronic device 220 . Hereinafter, the operation of the electronic device 210 will be described.

4 is a flowchart 400 for explaining an example of an operation of an electronic device according to various embodiments of the present disclosure. According to various embodiments, the operations illustrated in FIG. 4 are not limited to the illustrated order and may be performed in various orders. In addition, according to various embodiments, more operations than those illustrated in FIG. 4 or at least one fewer operations may be performed. Hereinafter, FIG. 4 will be described with reference to FIG. 5 .

5 is a diagram for describing an example of an operation of performing recording when a communication connection with an external electronic device of an electronic device is established, according to various embodiments of the present disclosure;

According to various embodiments, the electronic device 210 may identify an event for recording in operation 401 . For example, the electronic device 210 may execute a recording application 351 and display an interface for controlling a recording operation using the executed recording application 351 on the display 217 . The electronic device 210 may identify an event for starting a recording operation on the displayed interface (eg, receive a user's input for starting recording), and start a recording operation based on the identification of the event. The above-described recording operation may be an operation for recording video data and audio data. An operation of displaying the interface using the recording application 351 of the electronic device 210 will be described later with reference to FIGS. 19 to 20 .

According to various embodiments, the electronic device 210 may establish a communication connection with the external electronic device 220 in operation 402 . For example, the electronic device 210 may establish a communication connection 230 with the external electronic device 220 as shown in FIG. 5 . The electronic device 210 may transmit data (eg, audio data 525 ) to the external electronic device 220 based on the established communication connection 230 . The communication connection 230 is the same as described above with reference to FIG. 2 , and thus a redundant description will be omitted.

According to various embodiments, in operation 403 , the electronic device 210 may output audio through the external electronic device 220 and perform a recording operation while displaying at least one screen on the display 217 . Hereinafter, operation 403 will be described.

According to various embodiments, the electronic device 210 may perform a cooperative operation with the external electronic device 220 based on the communication connection 230 formed with the external electronic device 220 . That is, the electronic device 210 transmits data to the external electronic device 220 while performing at least one operation (eg, displaying visual content), so that the external electronic device 220 performs at least one operation based on the received data. operation (eg, output auditory content). Meanwhile, in the following description, the electronic device 210 outputs visual content (screen) and the external electronic device 220 outputs auditory content (audio) as an example, but the present invention is not limited thereto. ) and the external electronic device 220 may output various contents according to a cooperative operation. That is, in the following descriptions, when the electronic device 210 and the external electronic device 220 output various contents according to a cooperative operation (eg, the electronic device 210 outputs auditory content, the external electronic device 220 ) can be applied mutatis mutandis to visual content output).

For example, the electronic device 210 may display at least one related screen 510 on the display according to the execution and/or driving of at least one application. The at least one screen is defined as screens including various types of visual content displayed (or output) in real time on the display 217 of the electronic device 210 as at least one application is executed and/or driven. can be For example, as shown in FIG. 5 , the visual content includes a video 511 , an image, a graphic user interface (GUI) element provided by at least one executed application, and a user input (eg, a user's It may include a GUI element 512 displayed according to an input by a touch or an input by an electronic pen). As an example, the electronic device 210 executes a specified application (eg, a web application or an application for video of conference (VOC)), and a multimedia file (eg, a multimedia file provided by the executed specified application) video files of various extensions) and/or multi-media channel data (eg, multi-channel streaming data) may be acquired. The electronic device 210 may display a screen 510 including video content 511 reproduced in real time based on video data 515 obtained as the multimedia file is reproduced. According to an embodiment, the electronic device 210 may display a screen 510 including video content 511 reproduced in real time based on video data 515 among the received multimedia data. According to an embodiment, as shown in FIG. 5 , the electronic device 210 receives a user input (eg, input by the electronic pen 550 ) while the video content 511 is displayed on the screen 510 . can receive and display the graphic object 512 on at least one screen based on the user's input (eg, display hand writing or stroke on the movement trajectory of the user's input). have. For example, the electronic device 210 displays an icon for receiving a pen input on an interface for controlling a recording operation provided by a recording application 351, which will be described later, and responds to the user's input when the displayed icon is selected. Based on the hand writing (hand writing) or the stroke (stroke) can be displayed.

According to an embodiment, the electronic device 210 may transmit data provided as at least one application is executed and/or driven to the external electronic device 220 . For example, as shown in FIG. 5 , the electronic device 210 transmits audio data 525 provided according to the execution of a specified application (eg, a web application or an application for video of conference (VOC)). The transmission may be performed to the external electronic device 220 based on the communication connection 230 formed with the external electronic device 220 . The external electronic device 220 may output audio 521 using the received audio data 525 .

According to various embodiments, the electronic device 210 may perform the recording operation while performing the aforementioned cooperative operation. For example, the electronic device 210 may perform an operation for recording at least one screen 510 displayed and output audio 525 according to the cooperative operation in real time. For example, as shown in FIG. 5 , the electronic device 210 transmits video data 515 for at least one screen 510 displayed on the display in real time and the electronic device 210 to the external electronic device 220 as shown in FIG. 5 . Transmitted audio data 525 may be acquired. The electronic device 210 may generate the file 540 by muxing the obtained video data 515 and audio data 525 using the recording application 351 . When the file 540 is reproduced, the electronic device 210 may split the video data 515 and the audio data 525 from the file 540 and reproduce them.

Hereinafter, another example of the operation of the electronic device 210 according to various embodiments will be described.

According to various embodiments, when the communication connection 230 with the external electronic device 220 is established, the electronic device 210 records the audio data 525 acquired for the recording operation (eg, at which recording is performed). timestamp) may be adjusted using a latency associated with the established communication connection 230 . For example, the electronic device 210 may adjust the recording time of the acquired audio data 525 using the recording application 351 . Hereinafter, the operation of the electronic device 210 will be described.

6 is a flowchart 600 for explaining another example of an operation of an electronic device according to various embodiments of the present disclosure. According to various embodiments, the operations illustrated in FIG. 6 are not limited to the illustrated order and may be performed in various orders. Also, according to various embodiments, more operations than those illustrated in FIG. 6 or at least one fewer operations may be performed. Hereinafter, FIG. 6 will be described with reference to FIGS. 7 to 9 .

7 is a diagram for describing an example of an operation of adjusting an output time of at least one screen by using a latency when an electronic device is connected to an external electronic device for communication according to various embodiments of the present disclosure; 8 is a diagram for explaining an example of an operation for adjusting a recording time of audio data obtained for a recording operation of an electronic device using latency according to various embodiments of the present disclosure; 9 is a diagram for explaining examples of an operation of reproducing a file generated by a recording operation of an electronic device according to various embodiments of the present disclosure;

According to various embodiments, the electronic device 210 may identify an event for recording in operation 601 . For example, the electronic device 210 may execute a recording application 351 and identify an event for starting a recording operation using the executed recording application 351 . Since operation 601 of the electronic device 210 may be performed like operation 401 of the electronic device 210 described above, a redundant description will be omitted.

According to various embodiments, the electronic device 210 may establish a communication connection 230 with the external electronic device 220 in operation 602 . For example, the electronic device 210 may establish a communication connection 230 with the external electronic device 220 as shown in 702 of FIG. 7 . Operation 602 of the electronic device 210 may be performed like operation 402 of the electronic device 210 , so a redundant description will be omitted.

According to various embodiments, the electronic device 210 transmits the audio data 525 to an external electronic device while displaying at least one screen provided by at least one running application based on the communication connection 230 in operation 603 . may be transmitted to device 220 . For example, as shown in 702 of FIG. 7 , the electronic device 210 displays content (eg, displayed by playback of a video) according to the execution of a specified application (eg, a web application, an application for VOC, etc.) At least one screen 510 including a video is displayed (or output) in real time, and audio data 525 provided according to execution of a specified application (eg, audio data 525 obtained by playing a video) )) may be transmitted to the external electronic device 220 . Since operation 603 of the electronic device 210 may be performed similarly to operation 403 of the electronic device 210 described above, a redundant description will be omitted. Hereinafter, an operation of adjusting the output time 710 of the at least one screen 510 output based on the latency tL in operation 603 of the electronic device 210 will be described. The output time 710 refers to a point in time when the electronic device provides data of the content as a component in order to provide content (eg, a screen (eg, 510) and audio (eg, “Important!”), etc.) to the user. can do. For example, the output timing 710 of the at least one screen 510 may include video data ( 515) may be a time point (or time stamp) provided as a component of the electronic device 210 (eg, the display control circuit 215 of FIG. 2B ).

According to various embodiments, the electronic device 210 displays at least one screen 510 according to the execution of a specified application according to whether the communication connection 230 between the electronic device 210 and the external electronic device 220 is established. It can display and output audio (eg “Important!”). For example, the electronic device 210 displays at least one screen 510 based on the presence or absence of latency tL according to whether the communication connection 230 is formed, and displays the audio (eg, “important!”). can be printed out.

For example, as shown in 701 of FIG. 7 , when the electronic device 210 and the external electronic device 220 and the communication connection 230 are formed before the communication connection 230 is established, the output timing 710 is identical (or synchronized). ) at least one set screen and audio can be output. For example, when a moving picture is played according to the execution of an application, the electronic device 210 may display at least one screen including video content related to the moving picture in real time and output audio related to the moving picture in real time. The output video content and audio may be recognized by the user as content from the same viewpoint.

Also, for example, when the electronic device 210 and the external electronic device 220 and the communication connection 230 are formed before the communication connection 230 is formed as shown in 702 of FIG. 7 , at least one output time point 710 is adjusted. Audio (eg, important!) in which the screen 510 and the output timing 710 are maintained may be output. When the communication connection 230 is formed with the external electronic device 220 , it takes time for data to be transmitted from the electronic device 210 to the external electronic device 220 , so that the latency is equivalent to the time for data transmission. (tL) can be generated. In other words, when the electronic device 210 transmits the audio data 525 to the external electronic device 220 at a first time point 711 , the external electronic device 220 has a latency ( tL), audio data 525 may be received at a second time point 712 , and audio (eg, important!) may be output from the second time point 712 from the external electronic device 220 . Accordingly, when the electronic device 210 outputs at least one screen 510 set to the same output time point 710 and audio (eg, important!), the at least one screen 510 displays the first time point 711 . ), and audio (eg, important!) may be provided to the user at a second time point 712 elapsed by latency tL from the first time point 711 in the external electronic device 220 . Accordingly, the electronic device 210 controls the audio (eg, important!) through the at least one screen 510 and the external electronic device 220 to be provided to the user at the same time, as shown in 702 of FIG. 7 . Output timing 710 of at least one screen 510 while maintaining the output timing 710 (eg, the timing of providing audio data 525 to the audio module (eg, the audio module 214 of FIG. 2B )) At least one screen 510 may be displayed by adjusting back by the latency tL. That is, the electronic device 210 adjusts the output time 710 of the at least one screen 510 by the latency tL, and when the communication connection 230 is formed, the latency associated with the communication connection 230 ( tL) can be identified. The operation of identifying the latency tL of the electronic device 210 will be described later with reference to FIGS. 13 to 14 .

According to various embodiments, in operation 604 , the electronic device 210 performs at least one screen 510 to which the output time 710 is adjusted based on the latency tL and a recording time based on the latency tL. 810 may provide a file using the adjusted audio data 525 . The recording time 810 is data (eg, video data for at least one screen 510 ) acquired in real time to generate a file 540 when a recording operation is performed using the recording application 351 . 515) or the real-time audio data 525) may be defined as a point in time (or a time stamp) at which the muxed. Since the video data 515 and/or audio data 525 recorded at the recording time 810 may be reproduced at a time (or time stamp) corresponding to the recording time 810 , the recording time 810 is performed. may correspond to a playback time (time stamp at which the playback is performed) of the video data 515 and/or the audio data 525 .

For example, as shown in 801 of FIG. 8 , the electronic device 210 displays at least one screen 510 in real time and transmits audio data 525 to the external electronic device 220 while performing a recording operation. can be done The electronic device 210 acquires video data 515 for at least one screen 510 displayed on the display in real time by using the recording application 351 and is transmitted to the external electronic device 220 in real time. Audio data 525 may be acquired. For example, the recording application 351 may convert the video data 515 from the video record 336 (or the video data acquisition module 213) to the video data 515 in real time as described above in FIGS. 2A and 3 . can be obtained Also for example, the recording application 351 may obtain the audio data 525 from the audio service 339 (or the audio module 214 ) in real time. The electronic device 210 may perform a recording operation by inputting the obtained video data 515 and the obtained audio data 525 to the recording application 351 . In this case, since the output timing 710 of the at least one screen 510 is adjusted when the communication connection 230 is formed as described above in operation 603 , the audio data 525 and the at least one screen 510 are displayed on the screen 510 . When the video data 515 for the video data 515 is recorded from the same time point, the sync between the video data 515 and the audio data 525 may not match. Accordingly, the electronic device 210 moves the recording time 810 of the acquired audio data 525 backward by the latency tL by using the recording application 351, and displays it on the acquired at least one screen 510. It is possible to maintain the recording time 810 of the video data 515 for the. The electronic device 210 may identify a latency tL for adjusting the recording time 810 of the audio data 525 . In this case, the latency tL identified by the electronic device 210 to adjust the recording time 810 is the latency (tL) identified for adjusting the output time 710 of the at least one screen 510 in operation 603 . tL). Alternatively, without being limited thereto, the latency tL identified to adjust the recording time 810 is identified by the electronic device 210 when the recording operation is performed separately from the operation 603 of the electronic device 210 . It may be a latency (tL).

According to various embodiments, the electronic device 210 provides audio data 525 for which the recording time point 810 is adjusted (eg, moved backward) and video data in which the recording time point 810 is maintained as the output time point 710 . A file 540 may be generated by muxing 515 , and the generated file 540 may be stored in the memory 130 ( 820 ). The file 540 may have various types of extensions such as mkv, avi, mp4, mpg, flv, wmv, asf, asx, ogm, ogv, and/or mov. When the generated file 540 is played back (eg, played by a media player application), the electronic device 210 splits the video data 515 and the audio data 525 from the file 540, and the video data Each of 515 and audio data 525 may be reproduced. Based on the adjustment of the recording time 810 of the audio data 525 , the time points (or time stamps) associated with the at least one screen 510 displayed according to the reproduction of the video data 515 are audio The time points (or time stamps) associated with the audio displayed according to the reproduction of the data 525 may be identical to each other (or may be synchronized). For example, as shown in 901 of FIG. 9 , when audio data 525 and video data 515 for which the recording time point 810 is not adjusted are recorded, video data obtained when the file 540 is reproduced ( The viewpoint (or time stamp) of 515 may be different from the viewpoint (or time stamp) of the audio data 525 obtained when the file 540 is reproduced. Accordingly, as shown in 901 of FIG. 9 , information (eg, displayed by a user input) included in the screen 510 displayed using the video data 515 at designated time points (or designated time stamps) GUI elements, "Medium", "Important!") and information (eg, voice information, "Medium", "Important") included in the audio output using the audio data 525 do not match (or do not correspond) may not be However, as shown in 902 of FIG. 9 , when the audio data 525 and the video data 515 at which the recording time point 810 is adjusted are recorded, the video data 515 obtained when the file 540 is reproduced. The viewpoint (or time stamp) of the audio data 525 obtained when the file 540 is reproduced may be the same as the viewpoint (or time stamp) of the file 540 . Accordingly, as shown in 902 of FIG. 9 , information (eg, displayed by a user input) included in the screen 510 displayed using the video data 515 at designated time points (or designated time stamps) GUI elements, “middle” and “important!”) and information included in audio output using the audio data 525 (eg, voice information, “middle”, and “important”) may correspond to each other.

According to various embodiments, the electronic device 210 may automatically set the file name 821 when the file 540 is created. For example, as shown in 802 of FIG. 8 , the electronic device 210 may include the file name 821 of the generated file 540 with the application name (eg, App A) of the specified application. It can be set to text. The electronic device 210 may identify at least one application that is executed while a recording operation is being performed. The electronic device 210 may identify a designated application that is most frequently controlled by a user (eg, user interaction) or most frequently executed in a foreground mode among the at least one identified application. . The electronic device 210 generates an application name of the identified specified application as a file name 821, or generates a file name 821 that further includes at least one text (eg, a recorded date, etc.) together with the application name. It may be created, and the generated file name 821 may be set in the file 540 . As the file name 821 includes the application name, a user can easily identify a designated application associated with the created file 540 . As a result, the user's convenience using the files 540 generated by the recording operation may be improved.

Hereinafter, another example of the operation of the electronic device 210 according to various embodiments will be described.

According to various embodiments, when performing a recording operation, the electronic device 210 may identify the latency as a specified value in response to the identification of the communication connection 230 . In addition, the electronic device 210 newly identifies the latency when the communication connection 230 is released while the recording operation is performed while the communication connection 230 is established (eg, 0 or a value similar to 0). can do. Hereinafter, the operation of the electronic device 210 will be described.

10 is a flowchart 1000 for explaining another example of an operation of an electronic device according to various embodiments of the present disclosure. According to various embodiments, the operations illustrated in FIG. 10 are not limited to the illustrated order and may be performed in various orders. In addition, according to various embodiments, more operations than those illustrated in FIG. 10 or at least one fewer operations may be performed. Hereinafter, FIG. 10 will be described with reference to FIGS. 11 to 12 .

11 is a diagram for explaining different latencies for each external electronic device communicatively connected to an electronic device according to various embodiments of the present disclosure; 12 is a diagram for describing an example of an operation of identifying a latency according to whether a communication connection of an electronic device is identified, according to various embodiments of the present disclosure;

According to various embodiments, the electronic device 210 may identify an event for recording in operation 1001 . For example, the electronic device 210 may execute a recording application (eg, SRM 351 of FIG. 3 ) and identify an event for starting a recording operation using the executed recording application. Since operation 1001 of the electronic device 210 may be performed like operation 401 of the electronic device 210 described above, a redundant description will be omitted.

According to various embodiments, the electronic device 210 may identify whether the communication connection 230 with the external electronic device 220 is established in operation 1002 . Hereinafter, an operation of identifying and storing the latency tL during the communication connection 230 of the electronic device 210 will be described.

According to various embodiments, when the communication connection 230 is formed with the external electronic device 220 , the electronic device 210 may identify and store the latency tL associated with the communication connection 230 . For example, the processor of the electronic device 210 (eg, the processor 211 of FIG. 2B ) communicates with a communication module (eg, the communication module 190 of FIG. 1 ) of the electronic device 210 (eg, a Bluetooth module). can be used to identify the formation of the communication connection 230 .

According to an embodiment, the electronic device 210 may identify the latency tL based on the identification of the communication connection 230 being formed. For example, the processor (eg, the processor 211 of FIG. 2B ) communicates with the communication connection 230 stored in the external electronic device 220 from the external electronic device 220 using a communication module (eg, 190 of FIG. 1 ) and Information on the related latency (tL) may be received. The external electronic device 220 stores information on latency (tL) associated with communication used by the external electronic device 220 , and transmits the stored information on latency tL when the communication connection 230 is formed to the electronic device. It can be transmitted to (210). As another example, the processor (eg, 211 of FIG. 2B ) may calculate the latency tL. The electronic device 210 identifies a first time point at which first data is transmitted to the external electronic device 220 and a second time point at which second data is received in response to the first data from the external electronic device 220 , , a difference between the first time point and the second time point may be calculated as latency tL. As another example, the processor (eg, 211 of FIG. 2B ) may identify the latency tL based on information on the communication connection 230 formed with the external electronic device 220 . The electronic device 210 stores information on the latency tL included in the information on the communication connection 230 in a memory (eg, the memory 130 of FIG. 1 ), and identifies when the communication connection 230 is formed. By comparing the information on the communication connection 230 to be stored and the stored information, the latency tL included in the information on the communication connection 230 may be identified. The information on the communication connection 230 may include information indicating a type of communication, a profile at the time of the communication connection 230 , and information on a codec of the profile. The type of communication is a wireless communication connection 230 and serial using a D2D method such as Bluetooth (blue-tooth), Wi-Fi direct, or Wi-Fi hot spot and an AP (access point) such as Wi-Fi. It may include a wired communication connection 230 such as (USB). The profile at the time of the communication connection 230 is an A2DP profile (advanced audio distribution profile) profile, HFP profile (hands-free profile), HSP profile (headset profile) VDP profile (video distribution profile), or VCP profile (video conferencing profile) ) may include a profile of Bluetooth (bluetooth) communication, such as. For example, information on the codec of the profile may include SBC and apt-X codecs in case of an A2dp profile. The processor (eg, 211 of FIG. 2B ) may store the identified latency tL in a memory (eg, 130 of FIG. 1 ) based on the identification of the latency tL associated with the formed communication connection 230 . have. The latency tL stored in the memory (eg, the memory 130 of FIG. 1 ) is for adjustment of the output time 710 of the screen or the adjustment of the recording time 810 of data (eg, audio data 525 ). can be used For example, when the electronic device 210 establishes a communication connection with the external electronic device 220 using Bluetooth and uses the A2dp profile and the SBC codec of the A2dp profile, the latency of the first value (eg, 180ms) can be identified. The value of the latency is as an example, and is not limited thereto. For example, the value of latency may vary according to the sensitivity of the communication connection 230 .

According to various embodiments, the electronic device 210 may identify different latencies tL for each external electronic device 220 . Referring to FIG. 11 , the electronic device 210 may form communication connections 1111 , 1112 , or 1113 with various types of external electronic devices 1101 , 1102 , or 1103 . The electronic device 210 and the external electronic device 220 may form a communication connection 230 by using different types of communication and/or profiles used for different types of communication and a codec of the profile. In this case, the latency (eg, tL1, tL2, or tL3) associated with the communication connections 1111 , 1112 , or 1113 formed for each electronic device 210 and the external electronic devices 220 is a communication type and/or It can be set differently depending on the profile used for communication. Accordingly, for example, when receiving the information on the latency from the external electronic devices 220 , the electronic device 210 sets a different communication type and/or communication profile for each external electronic device 220 . Based on usage, information on different latencies (eg, tL1, tL2, or tL3) may be received. As another example, when the electronic device 210 calculates the latency, data transmission time and reception time are different according to different types of communication and/or profiles used during communication for each external electronic device 220 . Based on , different latencies (eg, tL1, tL2, or tL3) can be calculated. As another example, the electronic device 210 provides different latencies (eg, tL1, tL2, or tL3) can be identified. For example, when the electronic device 210 establishes a communication connection with the first external electronic device using Bluetooth and uses the A2dp profile and the SBC codec of the A2dp profile, the latency of the first value (eg, 180ms) is identified In the case of forming a communication connection with the second external electronic device using Bluetooth and using the A2dp profile and the apt-X codec of the A2dp profile, the latency of the second value (eg, 400 ms) may be identified. The value of the latency is an example, and is not limited thereto. For example, the value of latency may vary according to the sensitivity of the communication connection 230 .

According to various embodiments, the electronic device 210 identifies the latency associated with the communication connection 230 as a specified value in operation 1003 . According to various embodiments, the electronic device 210 may perform a recording operation based on the identification of the latency as a specified value (eg, A) in operation 1004 . As shown in FIG. 12 , when performing a recording operation, the electronic device 210 may identify whether the communication connection 230 is formed using a recording application. The identification of whether the communication connection 230 is formed may be performed at the start time t1 of the recording operation. When it is identified that the communication connection 230 is established, the electronic device 210 identifies the stored latency in operation 1003 and adjusts the recording time 810 of the audio data 525 using the identified latency (eg, : as shown in Fig. 12) can be delayed.

According to various embodiments, in operation 1005 , the electronic device 210 may perform a recording operation without adjusting the recording time 810 of the audio data 525 . When the recording operation is started, the electronic device 210 may identify whether the communication connection 230 is formed by using the recording application. When the communication connection 230 formed between the electronic device 210 and the external electronic device 220 is released or the communication connection 230 is not formed between the electronic device 210 and the external electronic device 220 , the electronic The device 210 may identify that the communication connection 230 is not established. When it is identified that the communication connection 230 is not formed, the electronic device 210 identifies the value of the latency tL as a first value (eg, 0), and performs a recording operation using the identified first value. can be performed. Alternatively, when it is identified that the communication connection 230 is not formed, the electronic device 210 does not perform an operation of identifying the value of the latency tL, but at the recording time 810 of the audio data 525 . Recording operations can be performed without adjustment. The first value is not limited to the description, and may be identified as various values. For example, the first value may be identified as a value close to zero.

According to various embodiments, the electronic device 210 identifies whether the communication connection 230 is formed while performing a recording operation in operation 1006 , and sets the latency to 0 when the communication connection 230 is not identified in operation 1007 . is identified, and a recording operation may be performed based on the identification of latency as 0 in operation 1008 . When the communication connection 230 is released while the electronic device 210 is performing a recording operation, the video data 515 for which the output timing 710 is not adjusted and the audio data 525 for which the recording timing 810 is not adjusted. can be used to continuously perform the recording operation. For example, the electronic device 210 may release the communication connection 230 from the external electronic device 220 while performing a recording operation in a state in which the communication connection 230 is established as shown in FIG. 12 . . When the communication connection 230 with the external electronic device 220 is disconnected, the electronic device 210 performs an operation of adjusting an output time 710 of at least one screen and a recording time 810 of the audio data 525 . You can change the action to be adjusted. For example, from a time point t2 at which the communication connection 230 with the external electronic device 220 is released, the electronic device 210 may output at least one screen using the latency tL. Without adjustment, at least one screen may be output in real time. Also, the electronic device 210 may identify the latency tL as 0 based on the identification that the communication connection 230 is released while performing the recording operation. The electronic device 210 may continue to perform the recording operation without adjusting the recording time 810 of the audio data 525 when the recording operation is performed based on the latency tL being identified as 0 . Alternatively, the electronic device 210 performs audio data without the operation of re-identifying (eg, identifying as 0) the value of the latency tL based on the identification that the communication connection 230 is released while performing the recording operation. The operation of adjusting the recording time 810 of 525 may be stopped, and the recording operation may be continuously performed while the operation of adjusting the recording time 810 of the audio data 525 is stopped.

According to various embodiments, the electronic device 210 continues to perform the operation of identifying whether a communication connection is formed even while performing the recording operation in operation 1006, and the communication connection 230 is identified during the recording operation. In this case, as in operations 1003 to 1004 , the recording operation may be performed based on the latency associated with the identified communication connection 230 .

Hereinafter, another example of the operation of the electronic device 210 according to various embodiments will be described.

According to various embodiments, when the communication connection 230 is formed after the electronic device 210 performs a recording operation, for a predetermined time (eg, a time corresponding to latency) from the time the communication connection 230 is formed. During) (hereinafter, empty time interval) can process the data of the generated file. During the empty time period, video data 515 for a screen and audio data 525 for audio input to a recording application for recording may not exist. Accordingly, the electronic device 210 may perform a recording operation related to the empty time period. The operation of processing data will be described below.

13 is a flowchart 1300 for explaining another example of an operation of an electronic device according to various embodiments of the present disclosure. According to various embodiments, the operations illustrated in FIG. 13 are not limited to the illustrated order and may be performed in various orders. In addition, according to various embodiments, more operations than those illustrated in FIG. 13 or at least one fewer operations may be performed. Hereinafter, FIG. 13 will be described with reference to FIG. 14 .

14 is a diagram for describing an example of an operation of performing a recording operation related to an empty time period when a communication connection is established after performing a recording operation of an electronic device according to various embodiments of the present disclosure;

According to various embodiments, the electronic device 210 may identify an event for recording in operation 1301 and perform a recording operation. For example, the electronic device 210 may execute a recording application 351 and identify an event for starting a recording operation using the executed recording application 351 . Since operation 1301 of the electronic device 210 may be performed like operation 401 of the electronic device 210 described above, a redundant description will be omitted.

According to various embodiments, the electronic device 210 may establish a communication connection 230 with the external electronic device 220 while performing a recording operation in operation 1302 . As shown in FIG. 14 , the electronic device 210 starts a recording operation at a first time point t1 and communicates with the external electronic device 220 at a second time point t2 after the first time point t1. (230) can be formed.

According to various embodiments, the electronic device 210 may adjust the output timing 710 of at least one screen based on the latency tL in operation 1303. According to various embodiments, the electronic device ( The 210 may adjust the recording time 810 of the audio data 525 based on the latency tL in operation 1304 . According to various embodiments, in operation 1305 , the electronic device 210 may perform a recording operation based on at least one screen to which the output time 710 is adjusted and the audio data 525 to which the recording time 810 is adjusted. can As shown in FIG. 14 , the electronic device 210 may adjust the output time 710 of at least one screen by the latency tL from the time t2 at which the communication connection is established. The electronic device 210 may acquire the video data 515 for at least one screen to which the output viewpoint 710 is adjusted, and acquire the audio data 525 by using the recording application 351 . The electronic device 210 adjusts the recording time 810 of the audio data 525 acquired by the latency tL value (tL=A) backward, and the video data 515 at which the output time 710 is adjusted. And a recording operation may be performed using the audio data 525 of which the recording time point 810 has been adjusted. Since operations 1303 to 1305 of the electronic device 210 have been described in the drawings before FIG. 13 , a redundant description thereof will be omitted.

According to various embodiments, in operation 1306 , the electronic device 210 may perform an operation for an empty time period 1510 after a time t2 at which the communication connection 230 is formed. The electronic device 210 may perform a processing operation for a recording operation in a predetermined time period (eg, an empty time period 1410 ) from the time point t2 when the communication connection 230 is formed. Referring to FIG. 14 , the output time 710 of at least one screen is adjusted backward by the latency tL from the time t2 at which the communication connection 230 is formed, and the recording time 810 of the audio data 525 . ) is adjusted by the latency tL, video data muxed by the recording application 351 for a time period (empty time period 1410) equal to the latency tL from the time t2 when the communication connection is established 515 and audio data 525 may not be present. In other words, the video data 515 and the audio data 525 for recording may not be acquired during the empty time period 1410 by the recording application 351 . As the muxed video data 515 and audio data 525 are not acquired, at least one screen and/or audio during the empty time period 1410 when the file 540 generated by the recording operation is reproduced. An error in the output of Accordingly, as an example, when the communication connection 230 is formed while performing the recording operation, the electronic device 210 performs the recording operation during the empty time period 1410 (ie, the latency tL). while) can be paused. The electronic device 210 restarts the recording operation after the empty time period 1410, and video data 515 and recording time 810 for at least one screen to which the output time 710 obtained in real time is adjusted. Muxing may be performed by acquiring the adjusted audio data 525 . As another example, the electronic device 210 may remove data from the file 540 generated according to the performance of the recording operation for a time period from the first time point t1 at which communication is established to the latency tL. may be

Hereinafter, another example of the operation of the electronic device 210 according to various embodiments will be described.

According to various embodiments, when starting a recording operation after the communication connection 230 is established, the electronic device 210 may process the video data 515 acquired for a predetermined time period from the time the recording operation starts. have. Since the recording time of the audio data 525 is adjusted backward by the latency at the time of starting the recording operation, only the video data 515 may exist for muxing during a designated time period from the time of starting the recording operation. Accordingly, the electronic device 210 may process the video data 515 for muxing during a predetermined time period from the time the recording operation is started. Hereinafter, the operation of the electronic device 210 will be described.

15 is a flowchart 1500 for explaining another example of an operation of an electronic device according to various embodiments of the present disclosure. According to various embodiments, the operations illustrated in FIG. 15 are not limited to the illustrated order and may be performed in various orders. In addition, according to various embodiments, more operations than those illustrated in FIG. 15 or at least one fewer operations may be performed. Hereinafter, FIG. 15 will be described with reference to FIG. 16 .

16 is a diagram for explaining an example of an operation of processing video data acquired for a predetermined time period from a time point of starting a recording operation when a recording operation is started after a communication connection of an electronic device is established according to various embodiments of the present disclosure; It is a drawing.

According to various embodiments, the electronic device 210 may establish a communication connection 230 with the external electronic device 220 in operation 1501 . As shown in FIG. 16 , the electronic device 210 forms a communication connection 230 with the external electronic device 220 at a first time point t1, and outputs at least one screen by the latency tL ( 710) can be adjusted backwards.

According to various embodiments, the electronic device 210 may identify an event for recording after the communication connection 230 is established in operation 1502 . For example, the electronic device 210 may execute a recording application 351 and identify an event for starting a recording operation using the executed recording application 351 . Since operation 1502 of the electronic device 210 may be performed like operation 401 of the electronic device 210 described above, a redundant description will be omitted.

According to various embodiments, the electronic device 210 adjusts the recording time 810 of the audio data 525 based on the latency tL in operation 1503, and adjusts the output timing 710 at operation 1504. A recording operation may be performed based on at least one screen and the audio data 525 of which the recording time 810 is adjusted. As shown in FIG. 16 , the electronic device 210 acquires video data 515 for at least one screen whose output time 710 is adjusted at a start time t2 when a recording operation is started, and audio data (525) can be obtained. The electronic device 210 adjusts the recording time 810 of the acquired audio data 525 later by the latency tL, and adjusts the video data ( 515 ) and an operation for muxing the audio data 525 of which the recording time 810 has been adjusted may be performed.

According to various embodiments, the electronic device 210 may process at least a portion of the video data 515 obtained for recording based on the recording time 810 of the audio data 525 adjusted in operation 1505 . have. Referring to FIG. 16 , since the recording time 810 of the audio data 525 acquired at the start time t2 of the recording operation is adjusted backward by the latency tL, the latency from the start time t2 of the recording operation is Only the video data 1610 may be muxed during a time period of (tL). Therefore, as an example, the electronic device 210 pauses the recording operation for a time period equal to the latency tL from the start time t2 of the recording operation, and starts the recording operation after the latency tL. This may be performed to mux the video data 515 and the audio data 525 . As another example, the electronic device 210 may remove data (eg, 1610 ) for a time period from the initial time point of the file 540 generated by performing the recording operation by the latency tL.

Hereinafter, another example of the operation of the electronic device 210 according to various embodiments will be described.

According to various embodiments, the electronic device 210 may execute a recording application and perform a recording operation using the executed recording application. The electronic device 210 may provide an interface of a recording application for receiving information related to a recording operation. Hereinafter, the operation of the electronic device 210 will be described.

17 is a flowchart 1700 illustrating another example of an operation of an electronic device according to various embodiments of the present disclosure. According to various embodiments, the operations illustrated in FIG. 17 are not limited to the illustrated order and may be performed in various orders. In addition, according to various embodiments, more operations than those illustrated in FIG. 17 or at least one fewer operations may be performed. Hereinafter, FIG. 17 will be described with reference to FIG. 18 .

18 is a diagram for describing an example of an operation of executing a recording application of an electronic device and providing an interface of the recording application according to various embodiments of the present disclosure;

According to various embodiments, the electronic device 210 may execute a first application for recording in operation 1701 . For example, as shown in 1801 of FIG. 18 , the electronic device 210 displays a quick panel 1805 that displays items for executing a plurality of functions in response to a user input for calling the quick panel. can be displayed The quick panel may include an item 1810 for executing a recording application 351 (eg, SRM 351 of FIG. 3 ) for performing a recording operation. The electronic device 210 may receive a user input for selecting the item 1810 on the quick panel and execute a recording application 351 . Also, for example, without being limited thereto, the electronic device 210 may display an icon (not shown) for executing the recording application 351 , and execute the recording application 351 when the icon is selected. have.

According to various embodiments, the electronic device 210 may receive an event for recording in operation 1702 . According to various embodiments, the electronic device 210 may display an interface related to the first application on the display 217 in operation 1703 . Hereinafter, an operation of displaying an interface for receiving an event related to recording of the electronic device 210 and displaying an interface for controlling a recording operation according to operations 1702 and 1703 of the electronic device 210 will be described. .

According to various embodiments, the electronic device 210 may perform various settings (eg, 1811 and 1812 ) related to a recording operation. As shown in 1802 of FIG. 18 , the electronic device 210 calls an interface for various settings (eg, 1811, 1812) related to a recording operation (eg, execution of a recording application 351 or a quick panel 1805). In response to a long press input for the item 1810 ), an interface for various settings (eg, 1811 and 1812 ) may be displayed. The various settings may include a setting 1811 of a type of a recording operation and a setting 1812 of a quality (eg, video quality) of a file to be recorded. The type of recording operation 1811 includes an operation for recording only video data 515, an operation for recording video data 515 and audio data 525, and video data 515, audio data 525 and other audio data. It may include an action to record (eg, user voice). When various settings are performed in the interface 1802 of FIG. 18 and an input for starting a recording operation is received, the electronic device 210 may start a recording operation of a set type and quality.

According to various embodiments, the electronic device 210 may display an interface for controlling a recording operation. For example, when an input for starting a recording operation is received as illustrated in 1803 of FIG. 18 , the electronic device 210 may display an interface for pausing recording. The electronic device 210 may perform counting before starting the recording operation, and display an interface for temporarily stopping the recording operation while the counting is performed. When a user input is received on the icon 1830 for skip counting and start recording, the electronic device 210 may start a recording operation. Also, for example, as shown in 1804 of FIG. 18 , the electronic device 210 may display an interface 1840 for controlling the recording operation while the recording operation is being performed. According to an embodiment, the interface 1840 for controlling the recording operation may be provided in the form of a floating UI. For example, the interface 1840 includes an icon 1841 for displaying an interface indicating a recording (or recording) time, an icon 1842 for displaying a pen input corresponding to a user input, and an icon 1842 for photographing a user. an icon 1843 , and/or an icon 1844 for terminating the recording operation.

Hereinafter, another example of the operation of the electronic device 210 according to various embodiments will be described.

According to various embodiments, the electronic device 210 includes not only the video data 515 and audio data 525 obtained according to the execution and/or driving of at least one application, but also the input device (eg, the input device of the electronic device 210 ). : It is possible to record audio data 525 for a user's voice acquired through a microphone). When recording is performed while the communication connection 230 is in progress, the electronic device 210 determines a recording time point of the audio data 525 for the user's voice different from the audio data 525 obtained according to the reproduction of the media file. may not be adjusted. Hereinafter, the operation of the electronic device 210 will be described.

19 is a flowchart 1900 for explaining another example of an operation of an electronic device according to various embodiments of the present disclosure. According to various embodiments, the operations illustrated in FIG. 19 are not limited to the illustrated order and may be performed in various orders. In addition, according to various embodiments, more operations than those illustrated in FIG. 19 or at least one fewer operations may be performed. Hereinafter, FIG. 19 will be described with reference to FIG. 20 .

20 illustrates an example of an operation of recording video data and audio data of an electronic device as well as audio data of a user voice acquired through an input device (eg, a microphone) of the electronic device according to various embodiments of the present disclosure; is a drawing for

According to various embodiments, the electronic device 210 may identify an event for recording in operation 1901 . For example, the electronic device 210 may execute a recording application 351 and identify an event for starting a recording operation using the executed recording application 351 . Operation 1901 of the electronic device 210 may be performed in the same manner as operations 401 and 1701 of the electronic device 210 described above, and thus a redundant description will be omitted.

According to various embodiments, the electronic device 210 may establish a communication connection 230 with the external electronic device 220 in operation 1902 . For example, as shown in FIG. 20 , the electronic device 210 establishes a communication connection 230 with the external electronic device 220 , and transmits and/or receives data (eg, audio data 525 and 2005 ). can do.

According to various embodiments, the electronic device 210 transmits the audio data 525 to the external electronic device while displaying at least one screen provided by at least one running application based on the communication connection 230 in operation 1903 . It can be transmitted to 220 . For example, as shown in FIG. 20 , the electronic device 210 displays at least one screen on the display based on the video data 515 obtained according to the execution and/or driving of at least one application, and Audio data 525 may be transmitted through the external electronic device 220 . Since operation 1903 of the electronic device 210 may be performed like operation 403 of the above-described electronic device 210 , a redundant description will be omitted.

According to various embodiments, the electronic device 210 may receive voice data from the external electronic device 220 in operation 1904 . For example, as shown in 2001 of FIG. 20 , the electronic device 210 records video data 515 , audio data 525 , and audio data 2005 for user voice in setting windows 1811 and 1812 . A type of recording operation (Media sounds and mic) to be performed may be set, and the recording operation may be performed. As illustrated in 2002 of FIG. 20 , the electronic device 210 may receive audio data 2005 for a user voice acquired by the external electronic device 220 (eg, a microphone) while performing a recording operation. have.

According to various embodiments, in operation 1905 , the electronic device 210 performs at least one screen whose output time is adjusted based on latency tL and the audio data whose recording time is adjusted based on latency tL ( 525), and audio data 2005 for the user's voice may be used to provide the file. As shown in 2002 of FIG. 20 , the electronic device 210 includes video data 515 for at least one screen whose output time is adjusted, audio data 525 acquired according to reproduction of a multimedia file, and an external electronic device. Audio data 2005 for the user's voice received from the device 220 may be obtained. The electronic device 210 adjusts the recording time 810 of the audio data 525 acquired according to the reproduction of the multimedia file backward by the latency tL, and the recording time 810 of the audio data 2005 for the user's voice. ) can be maintained. When the electronic device 210 receives the audio data 2005 for the user's voice from the external electronic device 220, when the external electronic device 220 transmits the audio data 2005 (or the external electronic device ( The audio data 2005 may be received at a time delayed by the latency tL from the time point 220 when the audio data 2005 is generated by acquiring the user's voice. That is, when the audio data 2005 is transmitted from the external electronic device 220 to the electronic device 210 , the transmission of the audio data 2005 may be delayed by a latency. Accordingly, the electronic device 210 may maintain the recording time 810 for the audio data 2005 for the user's voice.

According to various embodiments, the electronic device 210 identifies a type of audio data (eg, 525, 2005) acquired in real time when a recording operation is performed, and according to the identified type, the audio data (eg, 525, 2005) Whether to adjust the recording time 810 may be determined for each. Each audio data (eg, 525, 2005) is executed and/or driven by a source from which the audio data (eg, 525, 2005) was obtained (eg, a multimedia file stored in the electronic device 210 , and the electronic device 210 ) It may include information for indicating an application to be used, the external electronic device 220, a user, etc.). When the type of audio data (eg, 525 and 2005) is determined (eg, 2005) to be received by the external electronic device 220 , the electronic device 210 maintains the recording time 810 of the audio data 2005 . can Also, when it is determined (eg, 525) that the type of audio data (eg, 525, 2005) is not received by the external electronic device 220, the electronic device 210 records the audio data 525 ( 810) can be adjusted. Accordingly, as shown in 2002 of FIG. 20 , the recording time 810 of the video data 515 and the audio data 525 and 2005 may be the same.

Hereinafter, another example of the operation of the electronic device 210 according to various embodiments will be described.

According to various embodiments, when a specified event is identified while performing a recording operation, the electronic device 210 may perform an operation corresponding to the identified event.

21 is a flowchart 2100 for explaining another example of an operation of an electronic device according to various embodiments of the present disclosure. According to various embodiments, the operations illustrated in FIG. 21 are not limited to the illustrated order and may be performed in various orders. In addition, according to various embodiments, more operations than those illustrated in FIG. 21 or at least one fewer operations may be performed. Hereinafter, FIG. 21 will be described with reference to FIGS. 22 to 23 .

22 is a diagram for describing an example of an operation performed when a call is received while an electronic device performs a recording operation according to various embodiments of the present disclosure; 23 is a diagram for describing an example of an operation performed when a notification is obtained while an electronic device performs a recording operation according to various embodiments of the present disclosure;

According to various embodiments, the electronic device 210 may identify an event for recording in operation 2101 . According to various embodiments, the electronic device 210 may perform a recording operation in operation 2102 . For example, the electronic device 210 may execute a recording application (eg, SRM 351 of FIG. 3 ) and identify an event for starting a recording operation using the executed recording application. The electronic device 210 may perform a recording operation when identifying an event for initiating a recording operation.

According to various embodiments, the electronic device 210 may identify a specified event in operation 2103 . According to various embodiments, the electronic device 210 may perform at least one of a recording-related operation or a recorded file 540-related operation in response to the specified event identified in operation 2104 . The specified event may be identified when a specified operation (eg, a call reception operation, a notification display operation, etc.) is performed by the electronic device 210 while the recording operation of the electronic device 210 is being performed. The electronic device 210 may be configured to store information related to an operation corresponding to a specified event for each specified event, and to perform an operation corresponding to the specified event when the specified event is identified. Hereinafter, operations of the electronic device 210 performed for each designated event will be described.

For example, as shown in FIG. 22 , when a call is received while performing a recording operation, the electronic device 210 receives audio data 525 during a time period 2210 for receiving a call. ) may not be recorded. As shown in 2201 to 2202 of FIG. 22 , the electronic device 210 may receive a call while performing recording. The electronic device displays at least one screen and obtains audio data 525 (eg: Audio data 525 of the user's voice received from the external electronic device 220 may be output. The electronic device 210 may not record the audio data 525 while recording the video data 515 for at least one screen from the time the call operation starts to the time it ends ( 2210 ). As shown in 2203 of FIG. 22 , the electronic device 210 stops the execution and/or operation of the call application from the point in time when the call is terminated, and the video data 515 and audio data 525 ) can be recorded. Accordingly, when the file 540 received by the recording operation is reproduced, a screen related to a call may be displayed during a time period for receiving a call ( 2210 ), but audio related to the call may not be output.

Also, for example, as shown in FIG. 23 , when a notification is generated while the electronic device 210 performs a recording operation, from the time when the operation of providing the notification is started to the time when the operation of providing the notification is finished. During the time period 2310 , video data 515 and audio data 525 may be processed. The notification may include a pop-up message based on a message received from the external electronic device 220 and a message generated by various types of notification applications (eg, an alarm application, a reservation application, etc.). As shown in 2301 to 2302 of FIG. 23 , the electronic device 210 may identify occurrence of a notification while performing a recording operation. As illustrated in 2302 of FIG. 23 , the electronic device 210 may display a screen related to the notification and output audio data 525 related to the notification from the time the notification is started. In this case, the electronic device 210 may process the recorded audio data 525 as silence from the time the notification is started to the time when the notification is ended ( 2310 ). In addition, the electronic device 210 provides a notification while recording video data 515 for at least one screen displayed according to the execution of an operation for providing a notification, from the time the notification is started to the time when the notification is ended ( 2310 ). The audio data 525 obtained according to the execution of the operation may not be recorded. As shown in 2303 of FIG. 23 , the electronic device 210 may stop providing a notification from a point in time when the notification is terminated, and record video data 515 and audio data 525 .

Hereinafter, another example of the operation of the electronic device 210 according to various embodiments will be described.

According to various embodiments, when the electronic device 210 performs a recording operation in a state in which the communication connection 230 is formed, video data 515 and/or audio data 525 recorded at the time the recording operation ends. You can adjust the recording time of

24 is a flowchart 2400 for explaining another example of an operation of an electronic device according to various embodiments of the present disclosure. According to various embodiments, the operations illustrated in FIG. 24 are not limited to the illustrated order and may be performed in various orders. In addition, according to various embodiments, more operations than those illustrated in FIG. 24 or at least one fewer operations may be performed. Hereinafter, FIG. 24 will be described with reference to FIG. 25 .

25 is a diagram for explaining an example of an operation of adjusting a recording time of at least one of video data or audio data based on latency when recording of an electronic device is completed, according to various embodiments of the present disclosure;

According to various embodiments, the electronic device 210 may identify an event for recording in operation 2401 . For example, the electronic device 210 may execute a recording application 351 and identify an event for starting a recording operation using the executed recording application 351 . Operation 2401 of the electronic device 210 may be performed in the same manner as operations 401 and 1701 of the electronic device 210 described above, and thus a redundant description will be omitted.

According to various embodiments, the electronic device 210 may establish a communication connection 230 with the external electronic device 220 in operation 2402 . For example, as shown in FIG. 25 , the electronic device 210 forms a communication connection 230 with the external electronic device 220 and transmits and/or receives data (eg, audio data 525 ). can

According to various embodiments, in operation 2403 , the electronic device 210 may output audio through the external electronic device 220 and display at least one screen while performing recording. When a recording operation is started as shown in FIG. 25 , the electronic device 210 acquires video data 515 and audio data 525 in real time, and the obtained video data 515 and audio data 525 . may be input to the recording application 351 . The recording application 351 may accumulate each of the video data 515 and the audio data 525 acquired in real time in real time until the time when the recording operation ends.

According to various embodiments, upon completion of recording in operation 2404 , the electronic device 210 adjusts a recording time of at least one of the video data 515 and the audio data 525 based on the latency tL, and the file ( 540) can be provided. As shown in FIG. 25 , the electronic device 210 adjusts the recording time of the video data 515 for at least one screen whose output time is adjusted to the previous time by the latency tL at the time when the recording operation is finished, as shown in FIG. 25 . In step 2510 , the file 540 may be generated by muxing the video data 515 and the audio data 525 of which the recording time is adjusted. Alternatively, when the recording operation is finished, the electronic device 210 adjusts the recording time of the audio data 525 for at least one screen whose output time is adjusted to an earlier time by the latency tL, or the video data ( 515) and the recording time of both the audio data 525 may be adjusted to be synchronized.

Meanwhile, although various embodiments have been described as an example in which the electronic device 210 outputs visual content (screen) and the external electronic device 220 outputs auditory content (audio), the present invention is not limited thereto. The 210 and the external electronic device 220 may output various contents according to a cooperative operation. That is, the descriptions of the various embodiments described above may be applied mutatis mutandis to a case in which various other contents are output according to a cooperative operation between the electronic device 210 and the external electronic device 220 .

According to various embodiments, as an electronic device (eg, 210 ), at least one display, at least one communication circuit (eg, 216 ), and at least one operatively connected to the display and the at least one communication circuit (eg, 216 ) of a processor (eg, 130, 211), identifying an event for recording, and using the at least one communication circuit (eg, 216) to communicate with an external electronic device (eg, 220) (eg, 230) ), and based on the communication connection (eg, 230), at least one screen (eg, 510) provided by at least one application being executed is displayed on the display, while audio is transmitted to the external electronic device ( For example: 220), the audio data (eg, 525) associated with the audio is transmitted to the external electronic device (eg, 220) using at least one communication circuit (eg, 216 of FIG. 2B ), wherein the at least The output timing of one screen (eg 510) is adjusted based on the latency (eg latency) associated with the communication connection (eg 230), and based on the event identification and the communication connection (eg 230) , providing a file using at least one screen to which the output time (eg, 710) is adjusted and the audio data (eg, 525) to which the recording time (eg, 810) is adjusted based on the latency (tL) An electronic device (eg, 210 ) configured to do so may be provided.

According to various embodiments, when it is identified that the communication connection (eg, 230) is formed, the at least one processor (eg, 130, 211) identifies the latency associated with the communication connection (eg, 230), , an electronic device (eg, 210 ) configured to adjust an output time of the at least one screen by the latency and display the at least one screen may be provided.

According to various embodiments, when the event for recording is identified, the at least one processor (eg, 130 , 211 ) provides information about at least one screen whose output time is adjusted using a first application for recording. Acquire video data (eg 515) and audio data (eg 525), and adjust the recording time of the acquired audio data (eg 525) by the latency by using the first application, The electronic device is set to generate the file by muxing (eg, muxing) video data (eg, 515) of at least one screen whose output time is adjusted and audio data (eg, 525) of which the recording time is adjusted, to generate the file. (eg 210) may be provided.

According to various embodiments, the at least one processor (eg, 130, 211) displays the at least one screen and transmits the audio data (eg, 525), while the output time is adjusted on the at least one screen. An electronic device (eg, 210 ) configured to mux video data (eg, 515 ) and audio data (eg, 525 ) of which the recording time is adjusted may be provided.

According to various embodiments, when the file is played back, the at least one processor (eg, 130 or 211) displays at least one first screen on the display based on the video data (eg, 515), and An electronic device (eg, 210) that is set to output first audio based on audio data (eg, 525), and that a viewpoint for the displayed at least one first screen and a viewpoint for the output audio are related to each other (eg, 210) may be provided.

According to various embodiments, when the communication connection (eg, 230 ) is established, the at least one processor (eg, 130 , 211 ) receives information from the external electronic device (eg, 220 ) using the at least one communication circuit. An electronic device (eg, 210 ) configured to receive the received information on the latency and identify the latency based on the received information may be provided.

According to various embodiments, when a first communication connection (eg, 230) is formed with a first external electronic device (eg, 220), the at least one processor (eg, 130 or 211) may connect the first communication connection (eg, 230). : Identifies the first latency associated with 230), and when a second communication connection (eg, 230) is formed with a second external electronic device (eg, 220), the second communication connection (eg, 230) is associated with the An electronic device (eg, 210 ) configured to identify a second latency different from the first latency may be provided.

According to various embodiments, the at least one processor (eg, 130 and 211 ) may include video data (eg, 515 ) of the at least one screen whose output time is adjusted and audio data (eg, the recording time of which is adjusted). 525), it is identified that the communication connection (eg, 230) is released, and based on identifying that the communication connection (eg, 230) is released, the muxed audio data (eg, 525) ), an electronic device (eg, 210 ) configured to stop adjusting the recording time may be provided.

According to various embodiments, the at least one processor (eg, 130, 211) performs the communication connection (eg, 230) while performing muxing of the video data (eg, 515) and the audio data (eg, 525) In this case, an electronic device (eg, 210 ) configured to pause the muxing for a time corresponding to the latency from the time when the communication connection (eg, 230 ) is formed may be provided.

According to various embodiments, the recording event is an event for starting the muxing using the first application, and the at least one processor performs the video data (eg: 515) and the audio data (eg, 525), an electronic device (eg, 210) that is set to pause the muxing for a time equal to the latency from the point in time when the event for recording is identified may be provided.

According to various embodiments, in a method of operating an electronic device (eg, 210 ), an operation of identifying an event for recording, an operation of forming a communication connection (eg, 230 ) with an external electronic device (eg, 220 ), and the Based on a communication connection (eg, 230 ), while displaying at least one screen provided by at least one application being executed on the display, audio associated with the audio is output from the external electronic device (eg, 220 ) Transmitting audio data (eg, 525) to the external electronic device (eg, 220) using at least one communication circuit - The output timing of the at least one screen is a latency associated with the communication connection (eg, 230) Adjusted based on time (eg latency) - and based on the event identification and the communication connection (eg 230 ), at least one screen for which the output timing is adjusted and the recording timing is adjusted based on the latency An operation method including an operation of providing a file using the obtained audio data (eg, 525 ) may be provided.

According to various embodiments, when it is identified that the communication connection (eg, 230) has been formed, an operation of identifying the latency associated with the communication connection (eg, 230) and outputting the at least one screen by the latency An operation method including adjusting a viewpoint and displaying the at least one screen may be provided.

According to various embodiments, when the event for recording is identified, the method includes obtaining video data (eg 515) and audio data (eg 525) for at least one screen whose output time is adjusted. A method of operation may be provided.

Adjusting the recording time of the acquired audio data (eg, 525) by the latency and video data (eg, 515) for at least one screen whose output timing is adjusted and the audio with the recording timing adjusted An operation method including an operation of generating the file by muxing (eg, muxing) data (eg, 525 ) may be provided.

According to various embodiments, while displaying the at least one screen and transmitting the audio data (eg, 525), the video data (eg, 515) and the recording time of the at least one screen whose output time is adjusted are An operation method including an operation of muxing the adjusted audio data (eg, 525 ) may be provided.

According to various embodiments, when the file is played, at least one first screen is displayed on the display based on the video data (eg, 515), and first audio is displayed based on the audio data (eg, 525). An operation method may be provided in which a viewpoint for the displayed at least one first screen and a viewpoint for the outputted audio are related to each other, including outputting a .

According to various embodiments, when the communication connection (eg, 230) is formed, the operation of receiving the information on the latency received from the external electronic device (eg, 220) using the at least one communication circuit; A method of operation may be provided, comprising identifying the latency based on the received information.

According to various embodiments, when a first communication connection (eg, 230) is formed with a first external electronic device (eg, 220), the operation of identifying a first latency associated with the first communication connection (eg, 230) and when a second communication connection (eg, 230) is formed with a second external electronic device (eg, 220), a second latency different from the first latency associated with the second communication connection (eg, 230) A method of operation may be provided, including the operation of identifying.

According to various embodiments, while muxing the video data (eg, 515) of the at least one screen whose output time is adjusted and the audio data (eg, 525) of which the recording time is adjusted, the communication connection (eg: 230) is released and based on identifying that the communication connection (eg, 230) is disconnected, the operation of stopping the adjustment of the recording time of the muxed audio data (eg, 525) A method of operation may be provided, comprising:

According to various embodiments, when the communication connection (eg, 230) is formed while performing muxing of the video data (eg, 515) and the audio data (eg, 525), the communication connection (eg, 230) An operation method may be provided, including the operation of temporarily stopping the muxing for a time corresponding to the latency from the time when this is formed.

According to various embodiments, as an electronic device (eg, 210), the display includes at least one communication circuit and at least one processor, forms a communication connection (eg, 230) with an external electronic device (eg, 220), and the Identifies a latency (eg, latency) associated with the communication connection (eg, 230) based on the establishment of a communication connection (eg, 230), identifies an event for recording, and responds to identification of the event for recording to obtain audio data (eg 525) and video data (eg 515), and based on the identified latency, at least one of the audio data (eg 525) or the video data (eg 515) An electronic device ( For example, 210) may be provided.

Claims (20)

An electronic device comprising:
display;
at least one communication circuit;
at least one processor operatively coupled to the display and the at least one communication circuit;
identify events for recording;
forming a communication connection with an external electronic device using the at least one communication circuit;
at least one communication circuit configured to transmit audio data related to the audio to be output from the external electronic device while displaying at least one screen provided by at least one running application on the display based on the communication connection and transmitted to the external electronic device using, but the output timing of the at least one screen is adjusted based on the latency associated with the communication connection,
based on the event identification and the communication connection, set to provide a file using at least one screen whose output time is adjusted and the audio data whose recording time is adjusted based on the latency,
electronic device.
The method of claim 1 , wherein the at least one processor comprises:
When identifying that the communication connection is established, identify the latency associated with the communication connection,
Set to adjust the output time of the at least one screen by the latency and display the at least one screen,
electronic device.
3. The method of claim 2, wherein the at least one processor comprises:
When the event for recording is identified, using a first application for recording to obtain video data and the audio data for at least one screen whose output time is adjusted,
adjusting the recording time of the acquired audio data by the latency by using the first application;
set to generate the file by muxing video data for at least one screen whose output time is adjusted and audio data whose recording time is adjusted,
electronic device.
4. The method of claim 3,
The at least one processor comprises:
set to display the at least one screen and transmit the audio data, and to mux the video data for the at least one screen whose output time is adjusted and the audio data for which the recording time is adjusted,
electronic device.
4. The method of claim 3,
The at least one processor comprises:
when the file is played, display at least one first screen on the display based on the video data and output first audio based on the audio data;
A viewpoint for the displayed at least one first screen and a viewpoint for the output audio are related to each other
electronic device.
The method of claim 1,
The at least one processor comprises:
When the communication connection is established, receiving the information on the latency received from the external electronic device using the at least one communication circuit,
configured to identify the latency based on the received information;
electronic device.
7. The method of claim 6,
The at least one processor comprises:
When a first communication connection is established with the first external electronic device, identifying a first latency associated with the first communication connection,
configured to identify a second latency different from the first latency associated with the second communication connection when a second communication connection is established with a second external electronic device;
electronic device.
4. The method of claim 3,
The at least one processor comprises:
Identifies that the communication connection is disconnected while muxing the video data for at least one screen whose output time is adjusted and the audio data whose recording time is adjusted,
Set to stop adjusting the recording time of the muxed audio data based on identifying that the communication connection is disconnected,
electronic device.
4. The method of claim 3,
The at least one processor comprises:
When the communication connection is formed while performing muxing of the video data and the audio data, the muxing is set to pause for a time equal to the latency from the time the communication connection is established,
electronic device.
The method of claim 3, wherein the recording event is an event for starting the muxing using the first application,
The at least one processor comprises:
When performing muxing of the video data and the audio data after the communication connection is established, the muxing is set to pause for a time equal to the latency from the time when the event for the recording is identified,
electronic device.
A method of operating an electronic device, comprising:
identifying an event for recording;
establishing a communication connection with an external electronic device;
Based on the communication connection, while displaying at least one screen provided by at least one application being executed on the display of the electronic device, the audio data associated with the audio is outputted from the external electronic device by at least one transmitting to the external electronic device using a communication circuit, wherein an output time of the at least one screen is adjusted based on a latency associated with the communication connection; and
Based on the event identification and the communication connection, the operation of providing a file using at least one screen whose output time is adjusted and the audio data whose recording time is adjusted based on the latency;
how it works.
12. The method of claim 11,
identifying the latency associated with the communication connection when it is identified that the communication connection is established; and
Including; adjusting an output time of the at least one screen by the latency and displaying the at least one screen;
how it works.
13. The method of claim 12,
obtaining video data and the audio data for at least one screen whose output time is adjusted when the event for the recording is identified;
adjusting the recording time of the acquired audio data by the latency; and
The operation of generating the file by muxing the video data of the at least one screen whose output time is adjusted and the audio data of which the recording time is adjusted;
how it works.
14. The method of claim 13,
Displaying the at least one screen and transmitting the audio data, muxing the video data of the at least one screen whose output time is adjusted and the audio data of which the recording time is adjusted;
how it works.
14. The method of claim 13,
When the file is reproduced, displaying at least one first screen on the display based on the video data and outputting a first audio based on the audio data;
A viewpoint for the displayed at least one first screen and a viewpoint for the output audio are related to each other
how it works.
12. The method of claim 11,
receiving information about the latency received from the external electronic device using the at least one communication circuit when the communication connection is established; and
Including; identifying the latency based on the received information
how it works.
17. The method of claim 16,
identifying a first latency associated with the first communication connection when a first communication connection is established with the first external electronic device; and
When a second communication connection is established with a second external electronic device, identifying a second latency different from the first latency associated with the second communication connection;
how it works.
14. The method of claim 13,
identifying that the communication connection is disconnected while muxing the video data for the at least one screen whose output time has been adjusted and the audio data whose recording time has been adjusted; and
On the basis of identifying that the communication connection is disconnected, the operation of stopping the adjustment of the recording time of the muxed audio data; including,
how it works.
14. The method of claim 13,
When the communication connection is formed while performing the muxing of the video data and the audio data, the operation of temporarily stopping the muxing for a time corresponding to the latency from the time the communication connection is established;
how it works.
An electronic device comprising:
display;
at least one communication circuit;
at least one processor;
establish a communication connection with an external electronic device;
identify a latency associated with the communication connection based on the establishment of the communication connection;
identify events for recording;
in response to identifying the event for recording, obtain audio data and video data;
Based on the identified latency, adjust the muxed timing of the audio data,
Set to provide a file by performing muxing of the audio data and the video data at which the muxing time is adjusted based on the adjustment of the muxing timing of the audio data,
electronic device.

Images