KR20240029485A - Method for displaying information in virtual space and apparatus thereof - Google Patents

Abstract

An electronic device related to a virtual space application is disclosed. A method of operating an electronic device performed by a processor according to an embodiment includes running an application that provides a conversation function with another user through an avatar in a virtual space; Generating an interruption event based on at least one of the state of the electronic device and the state of the user of the electronic device detected during execution of the application; changing the display of the avatar based on the interruption event; and controlling the operation of the electronic device based on a control signal received through the application in response to the display of the changed avatar.

Description

Method and device for displaying information in virtual space {METHOD FOR DISPLAYING INFORMATION IN VIRTUAL SPACE AND APPARATUS THEREOF}

Various embodiments of the present invention relate to a method and device for displaying information in virtual space.

A virtual world or virtual space is an alternative world that is similar to or completely different from reality constructed with digital data. Users can access the virtual world using electronic devices and can perform activities similar to economic and social activities in the real world in the virtual world through avatars implemented in the virtual world. As communication technology and computer vision technology have recently developed, demand for virtual world platforms that allow many actions performed through interaction in the real world to be performed in the virtual world is increasing. In accordance with this trend, in order to provide a user experience similar to the real world in the virtual world, technologies are being developed to digitally implement objects close to the real world and to implement interactions close to the real world by diversifying input and output interfaces. .

A server according to an embodiment may include a server that provides a conversation service through an avatar in a virtual space through an application.

As an example, a method of operating a server may include detecting an interruption event occurring in a first electronic device executing an application.

As an example, the operating method of the server may include controlling the electronic device executing the application to change the display of the avatar corresponding to the first electronic device based on the detected interruption event. The electronic device executing the application may include a first electronic device and a second electronic device.

As an example, the operating method of the server may include receiving an input requesting control of the operation of the first electronic device corresponding to the changed display of the avatar from the second electronic device executing the application.

As an example, a method of operating a server may include transmitting a control signal to a first electronic device based on a received input.

The operation of a server that provides a conversation service through an avatar in a virtual space through an application according to one embodiment may be performed by at least one processor.

As an example, the server may include at least one processor that detects an interruption event that occurs in a first electronic device executing an application.

As an example, the server may include at least one processor that controls the electronic device executing the application to change the display of the avatar corresponding to the first electronic device based on the detected interruption event.

As an example, the server may include at least one processor that receives an input requesting control of the operation of the first electronic device corresponding to the changed display of the avatar from the second electronic device executing the application.

As an example, the server may include at least one processor that transmits a control signal to the first electronic device based on the received input.

An electronic device according to an embodiment may include a memory storing computer-executable instructions.

An electronic device according to an embodiment may include a processor that accesses memory and executes instructions.

According to one embodiment, the electronic device may include a first electronic device.

As an example, commands stored in the memory of the first electronic device may be configured to execute an application that provides a conversation function with another user through an avatar in a virtual space.

As an example, the instructions stored in the memory of the first electronic device may be configured to generate an interruption event based on at least one of the state of the first electronic device and the state of the user of the first electronic device detected during execution of the application. You can.

As an example, commands stored in the memory of the first electronic device may be configured to change the display of the avatar based on an interruption event.

As an example, commands stored in the memory of the first electronic device may be configured to control the operation of the first electronic device based on a control signal received through an application in response to the display of a changed avatar.

According to one embodiment, the electronic device may include a second electronic device.

For example, commands stored in the memory of the second electronic device may be configured to execute an application that provides a conversation function with another user through an avatar in a virtual space.

As an example, commands stored in the memory of the second electronic device may be configured to change the display of the avatar corresponding to the first electronic device based on an interruption event that occurred in the first electronic device.

As an example, commands stored in the memory of the second electronic device may be configured to display an interface object corresponding to an interruption event.

As an example, commands stored in the memory of the second electronic device may be configured to request operation control of the first electronic device based on input received through an interface object.

1 is a block diagram of an electronic device in a network environment, according to one embodiment.
Figure 2 is a block diagram illustrating a program according to one embodiment.
3 is a flowchart of an operation of an electronic device according to an embodiment.
Figure 4 is a diagram illustrating an interface screen output through an electronic device running a virtual space application according to an embodiment.
FIG. 5A is a flowchart of an interruption event generation operation of an electronic device according to an embodiment.
FIG. 5B is a flowchart of an interruption event generation operation of an electronic device according to an embodiment.
Figure 6 is a diagram for explaining the operation of a virtual space conversation system according to an embodiment.
Figure 7 is a diagram for explaining the operation of a virtual space conversation system according to an embodiment.
Figure 8 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of an interruption event during a call, according to an embodiment.
FIG. 9 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of an interruption event in the execution of at least one application according to an embodiment.
Figure 10 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of an interruption event of a user's fall according to an embodiment.
Figure 11 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of a sleep interruption event according to an embodiment.
Figure 12 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of a sleep interruption event according to an embodiment.
Figure 13 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of a low battery interruption event according to an embodiment.
Figure 14 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of an interruption event of reaching bedtime, according to an embodiment.
Figure 15 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of an interruption event of app execution interruption according to an embodiment.
FIG. 16 is a diagram illustrating the operation of an electronic device according to the occurrence of an interruption event that stops execution of an app, according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the accompanying drawings, identical components will be assigned the same reference numerals regardless of the reference numerals, and overlapping descriptions thereof will be omitted.

FIG. 1 is a block diagram of an electronic device 101 in a network environment 100, according to one embodiment.

Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes the main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, coprocessor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected to the plurality of antennas by, for example, the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to one embodiment, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes: a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

Figure 2 is a block diagram 200 illustrating program 140 according to one embodiment.

According to one embodiment, the program 140 includes an operating system 142, middleware 144, or an application 146 executable on the operating system 142 for controlling one or more resources of the electronic device 101. It can be included. Operating system 142 may include, for example, AndroidTM, iOSTM, WindowsTM, SymbianTM, TizenTM, or BadaTM. At least some of the programs 140 are preloaded into the electronic device 101, for example, at the time of manufacture, or are stored in an external electronic device (e.g., the electronic device 102 or 104, or a server) when used by a user. It can be downloaded or updated from 108)).

The operating system 142 may control management (eg, allocation or retrieval) of one or more system resources (eg, process, memory, or power) of the electronic device 101 . Operating system 142 may additionally or alternatively operate on other hardware devices of electronic device 101, such as input module 150, audio output module 155, display module 160, and audio module 170. , sensor module 176, interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196, or It may include one or more driver programs for driving the antenna module 197.

The middleware 144 may provide various functions to the application 146 so that functions or information provided from one or more resources of the electronic device 101 can be used by the application 146. The middleware 144 includes, for example, an application manager 201, a window manager 203, a multimedia manager 205, a resource manager 207, a power manager 209, a database manager 211, and a package manager 213. ), connectivity manager (215), notification manager (217), location manager (219), graphics manager (221), security manager (223), call manager (225), or voice recognition manager (227). You can.

The application manager 201 may, for example, manage the life cycle of the application 146. The window manager 203 may, for example, manage one or more GUI resources used on the screen. For example, the multimedia manager 205 identifies one or more formats required for playing media files, and encodes or decodes the corresponding media file using a codec suitable for the selected format. It can be done. The resource manager 207 may, for example, manage the source code of the application 146 or the memory space of the memory 130. The power manager 209 manages, for example, the capacity, temperature, or power of the battery 189, and may use this information to determine or provide related information necessary for the operation of the electronic device 101. . According to one embodiment, the power manager 209 may interface with a basic input/output system (BIOS) (not shown) of the electronic device 101.

Database manager 211 may create, search, or change a database to be used by application 146, for example. The package manager 213 may, for example, manage the installation or update of applications distributed in the form of package files. The connectivity manager 215 may manage, for example, a wireless connection or direct connection between the electronic device 101 and an external electronic device. For example, the notification manager 217 may provide a function for notifying the user of the occurrence of a designated event (eg, an incoming call, message, or alarm). The location manager 219 may, for example, manage location information of the electronic device 101. The graphics manager 221 may, for example, manage one or more graphic effects to be provided to the user or a user interface related thereto.

Security manager 223 may provide, for example, system security or user authentication. The telephony manager 225 may manage, for example, a voice call function or a video call function provided by the electronic device 101. For example, the voice recognition manager 227 transmits the user's voice data to the server 108 and provides a command corresponding to a function to be performed in the electronic device 101 based at least in part on the voice data, Alternatively, text data converted based at least in part on the voice data may be received from the server 108. According to one embodiment, the middleware 244 may dynamically delete some existing components or add new components. According to one embodiment, at least a portion of the middleware 144 may be included as part of the operating system 142 or may be implemented as separate software different from the operating system 142.

The application 146 includes, for example, home 251, dialer 253, SMS/MMS (255), instant message (IM) 257, browser 259, camera 261, and alarm 263. , Contacts (265), Voice Recognition (267), Email (269), Calendar (271), Media Player (273), Album (275), Watch (277), Health (279) (such as exercise amount or blood sugar) It may include applications that measure biometric information) or environmental information 281 (e.g., measure atmospheric pressure, humidity, or temperature information). According to one embodiment, the application 146 may further include an information exchange application (not shown) that can support information exchange between the electronic device 101 and an external electronic device. The information exchange application may include, for example, a notification relay application configured to deliver designated information (e.g., calls, messages, or alarms) to an external electronic device, or a device management application configured to manage the external electronic device. there is. The notification relay application, for example, transmits notification information corresponding to a specified event (e.g., mail reception) generated in another application (e.g., email application 269) of the electronic device 101 to an external electronic device. You can. Additionally or alternatively, the notification relay application may receive notification information from an external electronic device and provide it to the user of the electronic device 101.

The device management application, for example, controls the power (e.g., turn-on or turn-off) of an external electronic device or some component thereof (e.g., a display module or camera module of the external electronic device) that communicates with the electronic device 101. ) or functions (such as brightness, resolution, or focus). A device management application may additionally or alternatively support installation, deletion, or update of applications running on external electronic devices.

3 is a flowchart of an operation of an electronic device according to an embodiment.

Referring to FIG. 3, a method of operating an electronic device (e.g., the electronic device 101 of FIG. 1) according to an embodiment includes an application that provides a conversation function with at least one user through an avatar in a virtual space (e.g., FIG. It may include an operation 310 of executing the application 146 in 1 or the application 146 in FIG. 2. Hereinafter, an application that provides a conversation function with at least one user through an avatar in a virtual space may be briefly referred to as an 'application' or a 'virtual space application'.

The virtual space displayed on the electronic device through the application according to one embodiment is a two-dimensional or three-dimensional space including two-dimensional or three-dimensional graphic objects, and at least one electronic device executes the application to access the virtual space. You can. For example, a projection of a two-dimensional or three-dimensional virtual space may be displayed through the display of an electronic device connected to the virtual space (e.g., the display module 160 of FIG. 1). As an example, projection of a two-dimensional or three-dimensional virtual space may be performed using an external device (e.g., AR glasses) linked to an electronic device connected to the virtual space (e.g., the electronic device 102 of FIG. 1 or the electronic device 104 of FIG. 1 )) can be displayed through the display.

According to one embodiment, the virtual space may include an avatar corresponding to the user of the electronic device executing the application. An avatar is a two-dimensional or three-dimensional graphic object displayed in a virtual space, and may correspond to a virtual object that operates in the virtual space under the user's control. For example, an avatar can take action or speak according to user instructions received through an electronic device. An avatar is a specific user's avatar and may include an identifier to distinguish it from other avatars. For example, the avatar's face, hairstyle, and clothes may be displayed to distinguish it from other avatars, and may further include an identifier to indicate the user, such as the user's ID or name.

According to one embodiment, a plurality of electronic devices (eg, the electronic device 101 of FIG. 1) may access the virtual space. An avatar corresponding to each user of a plurality of electronic devices may be displayed in a virtual space. Users can interact using avatars. For example, you can chat with another user by moving the avatar's location near the location of another avatar. Dialogue input in the form of text or sound entered by a user into an electronic device may be output through an avatar. As an example, a chat message entered by a user may be displayed in the form of a speech bubble indicating that the message is uttered by an avatar. For example, a chat message input by a user may be output in a way that reflects the conversation of real people and generates a speech signal along with the speech action of the avatar. Chat messages in visual or auditory form may be transmitted to all electronic devices connected to the virtual space, or may be transmitted only to some electronic devices.

For example, Figure 4 is a diagram illustrating an interface screen output through an electronic device running a virtual space application. The screen 400 of FIG. 4 may display a projection of a virtual space accessed through an application. Referring to the screen 400, the virtual space may include an avatar 401 corresponding to a user of the electronic device and avatars 402 and 403 corresponding to at least one user connected to the virtual space. For example, a projection of a virtual space output through an electronic device may correspond to a projection of the virtual space viewed from a direction corresponding to the viewpoint of the avatar 401 corresponding to the user of the electronic device. In other words, the projection screen of the virtual space output to the user's electronic device corresponding to the avatar 402 may correspond to a projection of the virtual space viewed from a different angle than the screen 400 shown in FIG. 4. A user can conduct a conversation in a virtual space using the avatar 401. For example, when a user enters a chat message through an electronic device, the avatar 401 corresponding to the user utters a speech corresponding to the chat message, or the chat message is displayed in the form of a speech bubble at the top of the avatar 401. A chat message can be transmitted to an external electronic device in this way.

A method of operating an electronic device according to an embodiment includes an operation 320 of generating an interruption event based on at least one of the state of the electronic device and the state of the user of the electronic device detected while executing an application. can do.

Operation 320 according to one embodiment may include generating an interruption event based on the state of the electronic device. The state of the electronic device for generating an interruption event may correspond to a state that is distinct from the default state of the electronic device. The default state of an electronic device may mean a state in which an application is running on the electronic device and a conversation is in progress in a virtual space.

According to one embodiment, the state of the electronic device for generating an interruption event may include a state in which at least one application is running on the electronic device. If the electronic device detects that the at least one application is running while execution of the virtual space application has not ended, an interruption event may be generated. For example, while the at least one application is running, a virtual space application may be executed in the background, and the at least one application may be executed in the foreground.

According to one embodiment, a virtual space application and at least one application may be executed simultaneously on an electronic device. The execution screen of the virtual space application and the execution screen of at least one application running simultaneously with the virtual space application may be output through the display of the electronic device. For example, multiple screens output through a display may be visualized in a split screen form (e.g., multi-window, pop-up, and widget).

According to one embodiment, the state of the electronic device for generating an interruption event may include the remaining state of the battery (eg, battery 189 in FIG. 1) of the electronic device. When a low battery condition in which the remaining battery capacity of the electronic device is less than a threshold value is detected, an interruption event may be generated. The threshold value of the remaining battery capacity may be determined as a specific predetermined value or as the minimum value required to run the virtual space application.

According to one embodiment, the state of the electronic device for generating an interruption event may include a call connection state of the electronic device. For example, when a call connection request is detected in an electronic device, an interruption event may be generated. For example, when a call connection establishment state is detected in an electronic device or a call session start state of the electronic device is detected, an interruption event may be generated.

According to one embodiment, the state of the electronic device for generating an interruption event may include the display state of the electronic device. When a state in which the display screen is turned off is detected in the electronic device, that is, when a screen-off state of the electronic device is detected, an interruption event may be generated.

According to one embodiment, the state of the electronic device for generating an interruption event may include a displacement state of the electronic device. When a state in which the displacement of the electronic device is greater than or equal to a threshold value is detected, an interruption event may be generated. Displacement of an electronic device is a change in the posture or position of an electronic device, and is measured by a sensor that measures the position or posture of the electronic device, such as a position sensor, gravity sensor, acceleration sensor, or gyro sensor (e.g., sensor module 176 in FIG. 1). It can be calculated as the amount of change in data received from . If the displacement of the electronic device measured for a certain period of time is outside the range of displacement that can occur due to human movement, it may be judged to be a special situation, such as a situation where the electronic device falls or the user falls. In this case, an interruption event may be generated.

According to one embodiment, the state of the electronic device for generating an interruption event may include the power state of the electronic device. If a state in which the electronic device is being turned off is detected, an interruption event may be generated.

According to one embodiment, the state of the electronic device for generating an interruption event may include the communication state of the electronic device. When a state in which the electronic device is disconnected from the network (eg, the first network 198 in FIG. 1 or the second network 199 in FIG. 1) is detected, an interruption event may be generated.

Operation 320 according to an embodiment may include generating an interruption event based on the duration of the state of the electronic device. For example, when the default state of the electronic device is changed to the state of the electronic device for generating an interruption event, and the changed state continues for more than a threshold time, an interruption event may be generated. As an example, if the changed state lasts for less than a threshold time and then changes back to the default state, an interruption event may not be generated.

Operation 320 according to one embodiment may include generating an interruption event based on the user's state. The user's state for generating an interruption event may correspond to a state that is distinct from the user's default state. The user's default state may refer to the user's general state of using the electronic device. As an example, the user's state for generating an interruption event may include a state determined based on the user's biosignal obtained from the electronic device.

According to one embodiment, the state determined based on the user's biosignals obtained from the electronic device is the range of biosignals measured in the user's general state, such as the user's heart rate and movement speed obtained from the electronic device. It may include out-of-state conditions. As an example, the electronic device may determine whether the user is asleep based on the user's acquired biosignals. If it is determined that the user is in a sleeping state as a result of bio-signal analysis, an interruption event may be generated.

According to one embodiment, the user's biosignal acquired from the electronic device may include the biosignal measured by a sensor included in the electronic device (eg, the sensor module 176 of FIG. 1). The electronic device may include a sensor for measuring biological signals, such as a photoplethysmography (PPG) sensor or an electrocardiogram (ECG) sensor.

According to one embodiment, the user's biosignal acquired from the electronic device is a biosignal received from an external device (e.g., the electronic device 102 of FIG. 1 or the electronic device 104 of FIG. 1) linked to the electronic device. It can be included. An external device linked to an electronic device is an electronic device that can exchange data with the electronic device, and may include, for example, a wearable device (eg, a smart watch) linked to the electronic device. The electronic device may receive the user's biometric signal measured from a biometric sensor of an external device linked to the electronic device.

According to one embodiment, the user's state for generating an interruption event may include a state determined based on the user's displacement obtained from the electronic device. As an example, the user's displacement obtained from the electronic device may include the displacement of the electronic device described above. As an example, the user's displacement obtained from the electronic device may include the displacement of an external device linked to the electronic device. For example, the displacement of the wearable device measured by the position sensor of the wearable device linked to the electronic device may be regarded as the user's displacement. If the displacement of an external device linked to an electronic device is greater than a threshold, it may be determined to be a special situation, such as a situation in which a user falls. In this case, an interruption event may be generated.

Operation 320 according to an embodiment may include generating an interruption event based on the duration of the state of the electronic device. For example, when the user's default state is changed to the user's state for generating an interruption event, and the changed state continues for more than a threshold time, an interruption event may be generated. As an example, if the changed state lasts for less than a threshold time and then changes back to the default state, an interruption event may not be generated.

According to one embodiment, the operation 320 of generating an interruption event may include generating an interruption event based on whether a response to the detected state is received. The operation of generating an interruption event based on whether a response to the detected state is received will be described in detail with reference to FIG. 5A below.

According to one embodiment, the operation 320 of generating an interruption event may include an operation of generating an interruption event based on settings of an application for reflection of a detected state. The operation of generating an interruption event based on the application's settings for reflection of the detected state will be described in detail with reference to FIG. 5B below.

A method of operating an electronic device according to an embodiment may include an operation 330 of changing the display of an avatar based on an interruption event.

According to one embodiment, the operation 330 of changing the display of the avatar may include an operation of changing the motion of the avatar. The motion of the avatar can be changed from the motion of the avatar having a conversation to a motion corresponding to the generated interruption event. For example, if an interruption event is generated due to the state of at least one application running on the electronic device, the avatar's motion may participate in the conversation, such as a motion of looking at the mobile phone or a motion of looking somewhere other than the conversation partner. It can be changed to a motion indicating that it is not there. For example, if an interruption event is generated due to a call connection being established in the electronic device, the avatar's motion may be changed to a calling motion.

According to one embodiment, the operation 330 of changing the display of the avatar may include adding a visual element corresponding to the avatar. Visual elements may include visual elements (e.g., icons, text messages, special effects) added around or adjacent to the avatar to convey information about an interruption event that occurred in an electronic device corresponding to the avatar. For example, a message to convey information about an interruption event may be displayed around the avatar, or an auxiliary icon to explain the avatar's motion may be added adjacent to the avatar.

According to one embodiment, the operation 330 of changing the display of the avatar may include changing the display method of the avatar. The avatar display method may mean changing the settings of the avatar's size, avatar's transparency, and avatar's color to convey information about an interruption event that occurred in an electronic device corresponding to the avatar. For example, when an interruption event is generated due to a state in which the application execution of the electronic device is interrupted, such as the screen of the electronic device is turned off, the electronic device is turned off, or the electronic device is disconnected from the network, the avatar The display method of the avatar may be changed to increase the transparency of the avatar to inform users of the difficulty in participating in conversations using .

A specific example in which the display of an avatar is changed due to the creation of an interruption event according to an embodiment will be described in detail with reference to FIGS. 8 to 16 below.

A method of operating an electronic device according to an embodiment may include an operation 340 of controlling the operation of the electronic device based on a control signal received using an application in response to the display of a changed avatar.

According to one embodiment, a control signal may be generated based on an input received from an external electronic device executing an application in response to a changed display of an avatar. As an example, an input received by the external electronic device in response to a changed display of the avatar from the external electronic device executing the application may include an input for selecting the avatar displayed on the external device. As an example, input received from an external electronic device executing an application to an external device in response to a changed display of the avatar may include input received using an interface object provided corresponding to the avatar. Generation of control signals of electronic devices will be described in detail below.

According to one embodiment, the operation 340 of controlling the operation of the electronic device may include executing at least one application installed on the electronic device. For example, an input requesting a call connection to the electronic device where an interruption event occurred may be received from an external electronic device. The electronic device may control the operation of the electronic device to execute a call application in response to a received call connection request input.

According to one embodiment, the operation 340 of controlling the operation of the electronic device may include transmitting a notification signal to the electronic device. For example, an input requesting transmission of a notification signal to the electronic device in which an interruption event occurred may be received from an external electronic device. In response to a received notification signal transmission request input, the electronic device vibrates, makes a notification sound, displays an alert message, sends a text message, or sends a chat message using an application. The operation of the device can be controlled.

A method of operating an electronic device according to an embodiment may include restoring the display of an avatar in response to the end of an interruption event. When the state of the electronic device that caused the generation of the interruption event or the state of the user changes back to the default state, the interruption event may be recognized as having ended. When the end of the interruption event is detected, the changed display of the avatar may be restored to the display before the change. For example, the avatar's motion can be changed back to a conversational motion. For example, visual elements added to convey information about an interruption event around the avatar may be removed. For example, the increased transparency of the avatar can be lowered back to the default value.

FIG. 5A is a flowchart of an interruption event generation operation of an electronic device according to an embodiment.

Referring to FIG. 5A, an electronic device (e.g., the electronic device 101 of FIG. 1) according to an embodiment determines whether a state for generating an interruption event is detected as a condition for generating an interruption event 513 ( 511) You can. The state for generating an interruption event may include the state of the electronic device for generating the interruption event described above with reference to FIG. 3 . The state for generating an interruption event may include the user's state for generating the interruption event described above with reference to FIG. 3 .

According to one embodiment, when the electronic device determines that a state for generating an interruption event has been detected, it may determine whether to receive a response to the state detected as a condition for generating an interruption event (512). The state for generating an interruption event may include a state requiring a user response. For example, a state in which a call connection request is received from an electronic device may correspond to a state for generating an interruption event. The state in which the call connection request is received may correspond to a state requiring a response to the call connection request.

According to one embodiment, when it is determined that a response to the detected state has been received, the electronic device may generate an interruption event (513). For example, when a state in which a call connection request has been received is detected by the electronic device and a response to the call connection request is received, the electronic device may generate an interruption event (513).

According to one embodiment, if it is determined that a response to the detected state has not been received, the electronic device may not generate an interruption event.

FIG. 5B is a flowchart of an interruption event generation operation of an electronic device according to an embodiment.

Referring to FIG. 5B, an electronic device (e.g., the electronic device 101 of FIG. 1) according to an embodiment determines whether a state for generating an interruption event is detected as a condition for generating an interruption event (523). 521) You can. The state for generating an interruption event may include the state of the electronic device for generating the interruption event described above with reference to FIG. 3 . The state for generating an interruption event may include the user's state for generating the interruption event described above with reference to FIG. 3 .

According to one embodiment, when the electronic device determines that a state for generating an interruption event has been detected, it may determine whether a setting reflecting the detected state as a condition for generating an interruption event exists (522). The virtual space application may include a setting for whether to change the display of the avatar to reflect the state detected by the electronic device. As an example, the first state among the states for generating an interruption event in the application may be set to reflect. As an example, the second state among the states for generating an interruption event in the application may be set not to be reflected.

According to one embodiment, if it is determined that there is a setting that reflects the detected state, the electronic device may generate an interruption event that changes the display of the avatar (523). For example, if a first state is detected and the application has settings that reflect the first state, the electronic device may generate (523) an interruption event that causes the display of the avatar to change as the first state is detected. You can.

According to one embodiment, if it is determined that there are no settings reflecting the detected state, the electronic device may not generate an interruption event that causes a display change of the avatar. For example, when a second state is detected, and the application does not have a setting to reflect the second state or is set not to reflect the second state, the electronic device changes the display of the avatar as the second state is detected. The command may not generate an interruption event.

Figure 6 is a diagram for explaining the operation of a virtual space conversation system according to an embodiment.

According to one embodiment, the virtual space conversation system may include a server 603 (eg, server 108 in FIG. 1) and an electronic device (eg, electronic device 101 in FIG. 1). The electronic device may include a first electronic device 601 and a second electronic device 602 on which a virtual space application is installed. The server 603 may provide a conversation service using a virtual space application installed on the electronic devices 601 and 602. The first electronic device 601 and the second electronic device 602 can run a virtual space application and access the virtual space provided by the server 603. The first electronic device 601 and the second electronic device 602 can transmit and receive data with the server 603 using an application.

According to one embodiment, the first electronic device 601 may correspond to an electronic device that operates according to the operation method described above with reference to FIG. 3. In other words, the first electronic device 601 may correspond to the electronic device that generated the interruption event or the electronic device in which the interruption event occurred. The second electronic device 602 is an electronic device that is distinct from the first electronic device 601, and the avatar corresponding to the second electronic device 602 interacts with the avatar corresponding to the first electronic device 601 in virtual space. It can work.

According to one embodiment, the first electronic device 601 may generate an interruption event (610). Operation 610 of generating an interruption event may correspond to operation 320 of FIG. 3 . The interruption event generated in the first electronic device 601 may be loaded 620 into the server 603. In other words, a signal indicating that an interruption event has occurred in the first electronic device 601 may be transmitted to the server 603.

According to one embodiment, the server 603 may detect (630) an interruption event. Detecting an interruption event 630 may mean recognizing that an interruption event has occurred in the first electronic device 601, based on a signal received from the first electronic device 601. The server 603 responds to the detection 630 of the interruption event, and sends the electronic device executing the application to change the display of the avatar corresponding to the first electronic device 601 where the interruption event occurred (e.g., 601, 602). ) can be controlled (640, 650). The electronic device executing the application may include a first electronic device 601 and a second electronic device 602.

According to one embodiment, the second electronic device 602 may display (660) an interface object corresponding to an interruption event. An interface object is an object included in an interface implemented to receive input from a user and output a corresponding action, and may include, for example, a button, an input window, and a display window. The interface displaying the projection surface of the virtual space output through the second electronic device 602 may include an interface object corresponding to an interruption event that occurred in the first electronic device 601. A request to control the operation of the electronic device in which the interruption event occurred may be made using the interface object corresponding to the interruption event. For example, the interface object corresponding to the interruption event may include a button for requesting execution of at least one application on the first electronic device 601, a button for transmitting a notification signal to the first electronic device 601, and a button for transmitting a notification signal to the first electronic device 601. 1 It may include a message input window for entering a message to be transmitted to the electronic device 601.

According to one embodiment, a request to control the operation of the first electronic device 601 may be transmitted (670) from the second electronic device 602 to the server 603 through an interface object. The server 603 may transmit (680) an operation control signal to the first electronic device 601 in response to the received operation control request.

According to one embodiment, the first electronic device 601 may control the operation of the first electronic device 601 in response to a received operation control signal.

Figure 7 is a diagram for explaining the operation of a virtual space conversation system according to an embodiment.

The server 603, the first electronic device 601, and the second electronic device 602 shown in FIG. 7 are the server 603, the first electronic device 601, and the second electronic device 602 described above in FIG. 6. ) can correspond to.

Referring to FIG. 7 , an interruption event generated in the first electronic device 601 according to an embodiment may be terminated (710). The end signal of the interruption event occurring in the first electronic device 601 may be loaded 720 into the server 603. In other words, a signal indicating that the interruption event has ended may be transmitted from the first electronic device 601 to the server 603.

According to one embodiment, the server 603 may detect the end of the interruption event (730). Detecting the end of the interruption event (730) may mean recognizing that the interruption event has ended in the first electronic device 601, based on a signal received from the first electronic device 601. The server 603 controls the electronic device (e.g., 601, 602) executing the application to change the display of the avatar corresponding to the first electronic device 601 in response to detection 730 of the end of the interruption event ( 740, 750) can be done. The electronic device executing the application may include a first electronic device 601 and a second electronic device 602. When the interruption event ends, the display of the avatar corresponding to the first electronic device 601 that has changed due to the generation of the interruption event may be restored to the display before the interruption event was generated.

According to one embodiment, the server 603 may include a server 603 that provides a conversation service through an avatar in a virtual space through an application.

As an example, the operating method of the server 603 may include detecting an interruption event that occurred in the first electronic device 601 executing the application.

As an example, the operating method of the server 603 may include controlling the electronic device executing the application to change the display of the avatar corresponding to the first electronic device 601 based on the detected interruption event. there is. The electronic device executing the application may include a first electronic device 601 and a second electronic device 602.

As an example, the operating method of the server 603 includes receiving an input requesting control of the operation of the first electronic device 601 corresponding to the changed display of the avatar from the second electronic device 602 executing the application. can do.

As an example, a method of operating the server 603 may include transmitting a control signal to the first electronic device 601 based on a received input.

The operation of controlling the electronic device running the application according to one embodiment may include controlling the electronic device running the application to change the motion of the avatar.

The operation of controlling the electronic device running the application according to one embodiment may include controlling the electronic device running the application to add a visual element corresponding to the avatar.

The operation of controlling the electronic device executing the application according to one embodiment may include controlling the electronic device executing the application to change the display method of the avatar.

An operation of transmitting a control signal to the first electronic device 601 according to an embodiment may include transmitting a signal that controls execution of another application installed on the first electronic device 601.

The operation of transmitting a control signal to the first electronic device 601 according to an embodiment may include transmitting a signal that controls transmission of a notification signal to the first electronic device 601.

An operation of receiving an input for controlling the first electronic device 601 according to an embodiment may include an operation of receiving an input of selecting an avatar.

The operation of receiving an input for controlling the first electronic device 601 according to an embodiment may include receiving an input for controlling the first electronic device 601 through an interface object provided corresponding to the avatar. You can.

A method of operating the server 603 according to an embodiment may include detecting the end of an interruption event.

A method of operating the server 603 according to an embodiment may include restoring the display of the avatar in response to the end of an interruption event.

The operation of the server 603, which provides a conversation service through an avatar in a virtual space through an application according to an embodiment, may be performed by at least one processor.

As an example, the server 603 may include at least one processor that detects an interruption event occurring in the first electronic device 601 executing the application.

As an example, the server 603 may include at least one processor that controls the electronic device executing the application to change the display of the avatar corresponding to the first electronic device 601 based on the detected interruption event. there is.

As an example, the server 603 includes at least one processor that receives an input requesting control of the operation of the first electronic device 601 corresponding to the changed display of the avatar from the second electronic device 602 executing the application. can do.

As an example, the server 603 may include at least one processor that transmits a control signal to the first electronic device 601 based on the received input.

An electronic device according to an embodiment may include a memory (eg, memory 130 of FIG. 1 ) in which computer-executable instructions are stored.

An electronic device according to an embodiment may include a processor (eg, processor 120 of FIG. 1) that accesses memory and executes instructions.

According to one embodiment, the electronic device may include a first electronic device 601.

As an example, commands stored in the memory of the first electronic device 601 may be configured to execute an application that provides a conversation function with another user through an avatar in a virtual space.

As an example, the commands stored in the memory of the first electronic device 601 are based on at least one of the state of the first electronic device 601 and the state of the user of the first electronic device 601 detected during execution of the application. , may be configured to generate an interruption event.

As an example, commands stored in the memory of the first electronic device 601 may be configured to change the display of the avatar based on an interruption event.

As an example, commands stored in the memory of the first electronic device 601 may be configured to control the operation of the first electronic device 601 based on a control signal received through an application in response to the display of the changed avatar. there is.

As an example, instructions stored in the memory of the first electronic device 601 may be configured to perform the operations 310, 320, 330, and 340 described above with reference to FIG. 3 in the first electronic device 601.

According to one embodiment, the electronic device may include a second electronic device 602.

As an example, commands stored in the memory of the second electronic device 602 may be configured to execute an application that provides a conversation function with at least one user using an avatar in a virtual space.

As an example, the commands stored in the memory of the second electronic device 602 are configured to change the display of the avatar corresponding to the first electronic device 601 based on an interruption event that occurred in the first electronic device 601. It can be.

As an example, commands stored in the memory of the second electronic device 602 may be configured to display an interface object corresponding to an interruption event.

As an example, commands stored in the memory of the second electronic device 602 may be configured to request operation control of the first electronic device 601 based on input received through an interface object.

Figure 8 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of an interruption event during a call, according to an embodiment.

Referring to FIG. 8, the interface screens 801, 802, and 803 are displayed on a second electronic device executing a virtual space application (e.g., the electronic device 101 in FIG. 1, the second electronic device 602 in FIG. 6, Alternatively, these are examples of screens output through the second electronic device 602 in FIG. 7. The screen 801 is an avatar corresponding to the user of the first electronic device (e.g., the electronic device 101 in FIG. 1, the first electronic device 601 in FIG. 6, or the first electronic device 601 in FIG. 7). and an example of a screen where three avatars, including an avatar corresponding to a user of the second electronic device, are having a conversation in a virtual space.

According to one embodiment, as shown in screen 801, during a conversation using an avatar in a virtual space, a call connection request is received and a response to the call connection request is received from the first electronic device, and a state in which a call connection is established is detected. (810) It can be. When a call connection establishment state is detected (810), an interruption event during a call may be generated in the first electronic device. In response to the occurrence of an interruption event during a call on the first electronic device, the motion of the avatar 821 corresponding to the first electronic device is changed to a calling motion, as shown in the screen 802 displayed on the second electronic device. It can be. The user of the second electronic device may recognize that the user of the first electronic device is on a call through the changed display of the avatar 821 on the screen 802.

According to one embodiment, in response to the occurrence of an interruption event during a call on the first electronic device, an interface object 831 corresponding to the interruption event during a call, such as a screen 803, is displayed through the second electronic device. can be printed. The interface object 831 may receive an input requesting operation control of the first electronic device. For example, an input for selecting the button 832 included in the interface object 831 may correspond to an input requesting a call connection to the first electronic device where an interruption event occurred. An input for selecting the button 833 included in the interface object 831 may correspond to an input requesting transmission of a message to the first electronic device where an interruption event occurred.

According to one embodiment, the first electronic device may receive an operation control signal corresponding to an operation control request of the first electronic device input to the second electronic device. For example, when an input for selecting the button 832 is received from the second electronic device, a call connection request signal may be transmitted to the first electronic device. The operation of the first electronic device that receives the call connection request signal may be controlled to execute a call application. For example, when an input for selecting the button 833 is received from the second electronic device, the message input from the second electronic device may be transmitted to the first electronic device. The operation of the first electronic device that has received the message may be controlled to display the received message. As an example, a message may be transmitted and received through a virtual space application, and the operation of the first electronic device may be controlled to display the received message by executing the virtual space application.

FIG. 9 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of an interruption event in the execution of at least one application according to an embodiment.

Referring to FIG. 9, the interface screens 901, 902, and 903 are displayed on a second electronic device executing a virtual space application (e.g., the electronic device 101 in FIG. 1, the second electronic device 602 in FIG. 6, Alternatively, these are examples of screens output through the second electronic device 602 in FIG. 7. The screen 901 is an avatar corresponding to the user of the first electronic device (e.g., the electronic device 101 in FIG. 1, the first electronic device 601 in FIG. 6, or the first electronic device 601 in FIG. 7). and an example of a screen where three avatars, including an avatar corresponding to a user of the second electronic device, are having a conversation in a virtual space.

According to one embodiment, as shown in the screen 901, a state in which at least one application is running on the first electronic device may be detected (910) while a conversation using an avatar is in progress in a virtual space. When the execution state of at least one application is detected (910), an interruption event of the execution of at least one application may be generated in the first electronic device. In response to the occurrence of an interruption event of execution of at least one application on the first electronic device, the motion of the avatar 921 corresponding to the first electronic device, such as the screen 902 output on the second electronic device, is displayed on the mobile phone. It can be changed to a viewing motion. The user of the second electronic device may recognize that the user of the first electronic device is not participating in the conversation through the changed display of the avatar 921 in the screen 902.

According to one embodiment, in response to the occurrence of an interruption event of execution of at least one application on the first electronic device, an interface object 931 corresponding to an interruption event of execution of at least one application, such as a screen 903, is displayed. ) may be output through the second electronic device. The interface object 931 may receive an input requesting operation control of the first electronic device. For example, a message can be input through the message input window 932 included in the interface object 931. An input for selecting the button 933 included in the interface object 931 may correspond to an input requesting transmission of a message entered in the message input window 932 to the first electronic device.

According to one embodiment, the first electronic device may receive an operation control signal corresponding to an operation control request of the first electronic device input to the second electronic device. For example, when an input for selecting the button 933 is received from the second electronic device, the message input through the message input window 932 from the second electronic device may be transmitted to the first electronic device. The operation of the first electronic device that has received the message may be controlled to display the received message. As an example, a message may be transmitted and received through a virtual space application, and the operation of the first electronic device may be controlled to display the received message by executing the virtual space application.

Figure 10 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of an interruption event of a user's fall according to an embodiment.

Referring to FIG. 10, the interface screens 1001, 1002, and 1003 are displayed on a second electronic device executing a virtual space application (e.g., the electronic device 101 in FIG. 1, the second electronic device 602 in FIG. 6, Alternatively, these are examples of screens output through the second electronic device 602 in FIG. 7. The screen 1001 is an avatar corresponding to the user of the first electronic device (e.g., the electronic device 101 in FIG. 1, the first electronic device 601 in FIG. 6, or the first electronic device 601 in FIG. 7). and an example of a screen where an avatar corresponding to a user of a second electronic device is having a conversation in a virtual space.

According to one embodiment, as shown in screen 1001, a state in which the user has fallen (or a fall state) may be detected (1010) by the first electronic device during a conversation using an avatar in a virtual space. When the user's fall condition is detected (1010), an interruption event of the user's fall may be generated in the first electronic device. In response to the occurrence of an interruption event of the user's fall on the first electronic device, the motion of the avatar 1021 corresponding to the first electronic device, such as the screen 1002 displayed on the second electronic device, is a falling motion. may be changed to The user of the second electronic device may recognize that the user of the first electronic device fell through the changed display of the avatar 1021 in the screen 1002.

According to one embodiment, in response to the occurrence of an interruption event of the user's fall on the first electronic device, the interface object 1031 corresponding to the interruption event of the user's fall, such as the screen 1003, is displayed on the second electronic device. Can be output through an electronic device. The interface object 1031 may receive an input requesting operation control of the first electronic device. For example, an input for selecting the button 1032 included in the interface object 1031 may correspond to an input requesting a call connection to the first electronic device where an interruption event occurred. An input for selecting the button 1033 included in the interface object 1031 may correspond to an input requesting emergency rescue corresponding to the first electronic device in which an interruption event occurred.

According to one embodiment, the first electronic device may receive an operation control signal corresponding to an operation control request of the first electronic device input to the second electronic device. For example, when an input for selecting the button 1032 is received from the second electronic device, a call connection request signal may be transmitted to the first electronic device. The operation of the first electronic device that receives the call connection request signal may be controlled to execute a call application. For example, when an input for selecting the button 1033 is received from the second electronic device, an emergency rescue request signal may be transmitted to the first electronic device. The first electronic device that receives the emergency rescue request signal may be controlled to execute the emergency rescue request function. For example, the operation of the first electronic device that has received an emergency rescue request signal may be controlled to request an emergency call to a contact number set as an emergency contact number. For example, the operation of the first electronic device that has received an emergency rescue request signal may be controlled to request emergency rescue from an emergency service phone number nearby the first electronic device.

Figure 11 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of a sleep interruption event according to an embodiment.

Referring to FIG. 11, the interface screens 1101, 1102, 1103, and 1104 are displayed on a second electronic device executing a virtual space application (e.g., the electronic device 101 in FIG. 1, the second electronic device 602 in FIG. 6). ), or the second electronic device 602 in FIG. 7) are examples of screens output. The screen 1101 is an avatar corresponding to the user of the first electronic device (e.g., the electronic device 101 in FIG. 1, the first electronic device 601 in FIG. 6, or the first electronic device 601 in FIG. 7). and an example of a screen where three avatars including an avatar corresponding to a user of the second electronic device are having a conversation in a virtual space.

According to one embodiment, as shown on the screen 1101, the user's sleeping state may be detected (1110) by the first electronic device during a conversation using an avatar in a virtual space. When the user's sleep state is detected (1110), a sleep interruption event may be generated in the first electronic device. In response to the occurrence of a sleep interruption event in the first electronic device, the motion of the avatar 1121 corresponding to the first electronic device may be changed to a sleeping motion, such as the screen 1102 displayed on the second electronic device. You can. Like the screen 1102, a visual element 1122 for conveying information about a sleep interruption event that occurred in the first electronic device may be added adjacent to the avatar 1121 corresponding to the first electronic device. The user of the second electronic device may recognize that the user of the first electronic device is in a sleeping state through the changed display of the avatar 1121 in the screen 1102.

According to one embodiment, in response to the occurrence of a sleep interruption event in the first electronic device, an interface object 1131 corresponding to the sleep interruption event, such as a screen 1103, is displayed through the second electronic device. can be printed. The interface object 1131 may receive an input requesting operation control of the first electronic device. For example, an input for selecting the button 1132 included in the interface object 1131 may correspond to an input requesting transmission of a vibration notification signal to the first electronic device in which an interruption event occurred.

According to one embodiment, in response to the occurrence of a sleep interruption event on the first electronic device, an interface object 1141 corresponding to the sleep interruption event, such as a screen 1104, is displayed through the second electronic device. can be printed. The interface object 1141 may receive an input requesting operation control of the first electronic device. For example, a message can be input through the message input window 1142 included in the interface object 1141. An input for selecting the button 1143 included in the interface object 1141 may correspond to an input requesting transmission of a message entered in the message input window 1142 to the first electronic device.

According to one embodiment, the first electronic device may receive an operation control signal corresponding to an operation control request of the first electronic device input to the second electronic device. For example, when an input for selecting the button 1132 is received from the second electronic device, a signal for generating a vibration notification may be transmitted to the first electronic device. The operation of the first electronic device that has received a signal for generating a vibration notification may be controlled to generate a vibration notification.

According to one embodiment, the first electronic device may receive an operation control signal corresponding to an operation control request of the first electronic device input to the second electronic device. For example, when an input for selecting the button 1143 is received from the second electronic device, the message input through the message input window 1142 from the second electronic device may be transmitted to the first electronic device. The operation of the first electronic device that has received the message may be controlled to display the received message. As an example, a message may be transmitted and received through a virtual space application, and the operation of the first electronic device may be controlled to display the received message by executing the virtual space application.

Figure 12 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of a sleep interruption event according to an embodiment.

Referring to FIG. 12, the interface screens 1201, 1202, 1203, and 1204 are displayed on a second electronic device executing a virtual space application (e.g., the electronic device 101 in FIG. 1, the second electronic device 602 in FIG. 6). ), or the second electronic device 602 in FIG. 7) are examples of screens output. Screen 1201 and screen 1202 may correspond to screen 1101 and screen 1102 shown in FIG. 11 . In other words, in the state of the screen 1201, the first electronic device (e.g., the electronic device 101 in FIG. 1, the first electronic device 601 in FIG. 6, or the first electronic device 601 in FIG. 7) When a sleep interruption event occurs in the first electronic device as the user's sleep state is detected, the display of the avatar 1221 corresponding to the first electronic device may be changed, as shown in the screen 1202.

According to one embodiment, when the end of the user's sleep state is detected in the first electronic device (1210), the sleep interruption event may end in the first electronic device. In response to the end of the sleep interruption event, the motion of the avatar 1231 corresponding to the first electronic device, such as the screen 1203, may be changed to a waking motion. Thereafter, as shown on the screen 1201, the motion of the avatar 1211 corresponding to the first electronic device may be changed to a motion during a conversation.

According to one embodiment, when the sleep interruption event ends, the interface objects 1131 and 1141 corresponding to the sleep interruption event shown in FIG. 11 may not be provided to the second electronic device.

According to one embodiment, when the duration of the sleep state of the user of the first electronic device reaches a threshold time (eg, N minutes), a logout event may be generated in the first electronic device. The logout event may mean that execution of the virtual space application on the first electronic device ends. When a logout event occurs in the first electronic device, the display of the avatar corresponding to the first electronic device may be removed, as shown in screen 1204. The user of the second electronic device can recognize that the user of the first electronic device is not connected to the virtual space through the screen 1204 in which the avatar corresponding to the first electronic device is removed.

Figure 13 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of a low battery interruption event according to an embodiment.

Referring to FIG. 13, the interface screens 1301 and 1302 are displayed on a second electronic device (e.g., the electronic device 101 of FIG. 1, the second electronic device 602 of FIG. 6, or the second electronic device 602 of FIG. 6) executing the virtual space application. These are examples of screens output through the second electronic device 602 in 7. The screen 1301 is an avatar corresponding to the user of the first electronic device (e.g., the electronic device 101 in FIG. 1, the first electronic device 601 in FIG. 6, or the first electronic device 601 in FIG. 7). and an example of a screen where three avatars, including an avatar corresponding to a user of the second electronic device, are having a conversation in a virtual space.

According to one embodiment, as shown in screen 1301, during a conversation using an avatar in a virtual space, a low battery state in which the remaining battery power is less than a threshold value may be detected (1310) in the first electronic device. When a low battery state is detected (1310), a low battery interruption event may be generated in the first electronic device. In response to the occurrence of a low-battery interruption event in the first electronic device, the motion of the avatar 1321 corresponding to the first electronic device, such as the screen 1302 displayed on the second electronic device, is a motion under consideration. may be changed to Like the screen 1302, a visual element 1322 for conveying information about a low-battery interruption event that occurred in the first electronic device may be added adjacent to the avatar 1321 corresponding to the first electronic device. . The user of the second electronic device may recognize that the first electronic device is in a low battery state through the changed display of the avatar 1321 in the screen 1302.

According to one embodiment, when the battery charging state is detected in the first electronic device (1310), the low-battery interruption event may be ended in the first electronic device. In response to the end of the low-battery interruption event, the motion of the avatar 1311 corresponding to the first electronic device, such as the screen 1301, may be restored to the motion during the conversation.

Figure 14 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of an interruption event of reaching bedtime, according to an embodiment.

Referring to FIG. 14, the interface screens 1401, 1402, 1403, and 1404 are displayed on a second electronic device executing a virtual space application (e.g., the electronic device 101 in FIG. 1, the second electronic device 602 in FIG. 6). ), or the second electronic device 602 in FIG. 7) are examples of screens output. The screen 1401 is an avatar corresponding to the user of the first electronic device (e.g., the electronic device 101 in FIG. 1, the first electronic device 601 in FIG. 6, or the first electronic device 601 in FIG. 7). and an example of a screen where three avatars, including an avatar corresponding to a user of the second electronic device, are having a conversation in a virtual space.

According to one embodiment, as shown in screen 1401, the bedtime arrival state may be detected (1410) in the first electronic device while a conversation using an avatar is in progress in a virtual space. For example, the bedtime arrival state may include a state in which the current time has reached the bedtime preset in the electronic device. When the bedtime arrival state is detected (1410), an interruption event of bedtime arrival may be generated in the first electronic device. In response to the occurrence of an interruption event of reaching bedtime on the first electronic device, the motion of the avatar 1421 corresponding to the first electronic device, such as the screen 1402 output on the second electronic device, is displayed to indicate a sleepy state. It can be changed to a motion of rubbing the eyes for indication. Alternatively, like the screen 1403, the motion of the avatar 1431 corresponding to the first electronic device may be changed to a yawning motion to indicate a sleepy state. The user of the second electronic device may recognize that the user of the first electronic device is sleepy through the changed display of the avatars 1421 and 1431 in the screens 1402 and 1403. Alternatively, the user of the second electronic device may recognize that the time in the area where the first electronic device is located is night through the changed display of the avatars 1421 and 1431 on the screens 1402 and 1403.

According to one embodiment, in response to the occurrence of an interruption event of bedtime arrival on the first electronic device, an interface object 1441 corresponding to the interruption event of bedtime arrival, such as screen 1404, is displayed on the second electronic device. Can be output through an electronic device. As an example, the interface object 1441 may be output in response to an input for selecting an avatar 1421 or 1431 displayed on the screen 1402 or 1403.

The interface object 1441 according to one embodiment may correspond to an object for conveying information about an interruption event of reaching bedtime. As an example, the interface object 1441 may indicate information about the bedtime set for the first electronic device. As an example, the interface object 1441 may indicate information about the current time in the area where the first electronic device is located. The user of the second electronic device can obtain additional information about the interruption event that occurred in the first electronic device through the interface object 1441 in the screen 1404.

Figure 15 is a diagram illustrating an interface screen of a virtual space application according to the occurrence of an interruption event of app execution interruption according to an embodiment.

Referring to FIG. 15, the interface screens 1501, 1502, 1503, and 1504 are displayed on a second electronic device executing a virtual space application (e.g., the electronic device 101 in FIG. 1, the second electronic device 602 in FIG. 6). ), or the second electronic device 602 in FIG. 7) are examples of screens output. The screen 1501 is an avatar corresponding to the user of the first electronic device (e.g., the electronic device 101 in FIG. 1, the first electronic device 601 in FIG. 6, or the first electronic device 601 in FIG. 7). and an example of a screen where three avatars, including an avatar corresponding to a user of the second electronic device, are having a conversation in a virtual space.

According to one embodiment, as shown in screen 1501, a state in which execution of a virtual space application is stopped on the first electronic device may be detected (1510) while a conversation using an avatar is in progress in a virtual space. For example, a state in which execution of a virtual space application is stopped may include a screen-off state in which the display screen of the electronic device is turned off. As an example, a state in which the execution of a virtual space application is stopped may include a state in which the network connection (e.g., Wi-Fi network connection, mobile communication network connection) of the electronic device is disconnected. For example, a state in which execution of a virtual space application is stopped may include a state in which the electronic device is turned off. For example, a state in which execution of a virtual space application is stopped may include a state in which no input is received from the electronic device for more than a threshold time (eg, N seconds).

According to one embodiment, when a state in which virtual space application execution is interrupted is detected (1510), an interruption event of virtual space application execution interruption may be generated in the first electronic device. 1 In response to the occurrence of an interruption event of stopping execution of a virtual space application in an electronic device, the transparency of the avatar 1521 corresponding to the first electronic device increases, such as the screen 1502 output to the second electronic device. The display method may change. The degree of increase in transparency may be determined by a predetermined value.

According to one embodiment, when the interruption event of stopping execution of the virtual space application continues for a threshold time (e.g., N seconds) after creation, the display method is such that the transparency of the avatar 1531 increases, as shown in the screen 1503. can be changed.

According to one embodiment, after the display method of the avatar 1531 is changed, as shown in the screen 1503, if the interruption event continues for more than a threshold time (e.g., N seconds), a logout event is generated on the first electronic device. can be created. When a logout event occurs in the first electronic device, the display of the avatar corresponding to the first electronic device may be removed, as shown in screen 1504. The user of the second electronic device can recognize that the user of the first electronic device is not connected to the virtual space through the screen 1504 in which the avatar corresponding to the first electronic device is removed.

FIG. 16 is a diagram illustrating the operation of an electronic device according to the occurrence of an interruption event that stops execution of an app, according to an embodiment.

Referring to FIG. 16, during a conversation using an avatar in a virtual space, a first electronic device (e.g., the electronic device 101 of FIG. 1, the first electronic device 601 of FIG. 6, or the first electronic device of FIG. 7) At (601)), a state in which virtual space application execution is stopped may be detected (1610). Detection 1610 of a state in which execution of a virtual space application is stopped may correspond to detection 1510 of a state in which execution of a virtual space-related application is stopped described above in FIG. 15 .

According to one embodiment, the state in which execution of the virtual space application is stopped in the first electronic device may be released (1620). As an example, when the screen-off state of the first electronic device is changed to the screen-on state in which the display screen is turned on again, the state in which execution of the virtual space application is stopped on the first electronic device will be released (1620). You can. For example, when the electronic device changes from being disconnected to the network to being connected to the network again, the state in which execution of the virtual space application is stopped in the first electronic device may be canceled (1620). For example, when the first electronic device is rebooted while the first electronic device is turned off, the state in which execution of the virtual space application is stopped on the first electronic device may be canceled (1620). In addition, when an operation to re-execute the virtual space application of the first electronic device occurs, the state in which execution of the virtual space application is suspended in the first electronic device may be released (1620).

According to one embodiment, when the state in which execution of the virtual space application is stopped in the first electronic device is canceled (1620), the first electronic device displays the virtual space application, as shown in the screen 1601 output through the first electronic device. An interface object 1611 for re-executing can be output.

As an example, the interface object 1611 may include a button 1612 for requesting execution of a virtual space application. When an input for selecting the button 1612 is received, an operation of executing a virtual space application may be performed on the first electronic device. When the virtual space application is normally executed in the first electronic device, the second electronic device (e.g., the electronic device 101 in FIG. 1, the second electronic device 602 in FIG. 6, or the second electronic device in FIG. 7 ( Like the screen 1602 output through 602)), a virtual space interface including a display of an avatar corresponding to the user of the first electronic device may be provided. The user of the second electronic device can recognize that the user of the first electronic device can reconnect to the virtual space and participate in the conversation through the screen 1602 on which the avatar corresponding to the first electronic device is displayed.

As an example, the interface object 1611 may include a button 1613 for requesting message transmission through a virtual space application. When an input for selecting the button 1613 is received, the first electronic device may output an interface object 1631 for message input and transmission, such as a screen 1603 output through the first electronic device. When transmission of a message input through the interface object 1631 is requested, the message may be transmitted through the application. When a message is transmitted, the message sent from the first electronic device will be displayed through a speech bubble indicating that the speech is from an avatar corresponding to the user of the first electronic device, such as screen 1604 output through the second electronic device. You can.

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to that component in other respects (e.g., importance or order) is not limited. One (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” When mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. can be used A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term refers to cases where data is semi-permanently stored in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play StoreTM) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to one embodiment, each component (e.g., module or program) of the above-described components may include a single or multiple entities, and some of the multiple entities may be separately placed in other components. . According to one embodiment, one or more of the above-described corresponding components or operations may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. . According to one embodiment, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or , or one or more other operations may be added.

Claims (20)

In the electronic device (101; 601),
A memory 130 storing computer-executable instructions; and
A processor 120 that accesses the memory and executes the instructions.
Including,
The above commands are:
Running an application 146 that provides a conversation function with at least one user using an avatar in a virtual space,
Generating an interruption event based on at least one of the state of the electronic device (101; 601) and the state of the user of the electronic device (101; 601) detected during execution of the application (146),
Based on the interruption event, change the display of the avatar,
Configured to control the operation of the electronic device (101; 601) based on a control signal received using the application (146) in response to the display of the changed avatar,
Electronic devices (101; 601).
In the server (108; 603) (108; 603) that provides a conversation service through an avatar in a virtual space using the application (146),
Detecting an interruption event occurring in the first electronic device (101; 601) executing the application (146),
Based on the detected interruption event, at least one electronic device (101; 601; 602) executing the application (146) changes the display of the avatar corresponding to the first electronic device (101; 601). control,
Receiving an input requesting operation control of the first electronic device (101; 601) corresponding to the changed display of the avatar from the second electronic device (101; 602) executing the application (146),
Based on the received input, transmitting a control signal to the first electronic device (101; 601),
At least one processor (120)
Including,
Server (108; 603).
In a method of operating an electronic device (101; 601) performed by a processor (120),
An operation of executing an application 146 that provides a conversation function with other users through an avatar in a virtual space;
generating an interruption event based on at least one of the state of the electronic device (101; 601) and the state of the user of the electronic device (101; 601) detected while the application (146) is running;
changing the display of the avatar based on the interruption event; and
An operation of controlling the operation of the electronic device (101; 601) based on a control signal received through the application (146) in response to the display of the changed avatar.
Including,
Method of operating the electronic device (101; 601).
According to paragraph 3,
The operation of generating the interruption event is
An operation of generating the interruption event based on the state of the electronic device (101; 601)
Including,
The state of the electronic device (101; 601) is
A state in which another application (146) is executed in the electronic device (101; 601);
The remaining battery power status of the battery 189 of the electronic device 101 (601);
call connection status of the electronic device (101; 601);
display status of the electronic device (101; 601);
displacement state of the electronic device (101; 601);
power state of the electronic device (101; 601); and
Communication status of the electronic device (101; 601)
Containing at least one of
Method of operating the electronic device (101; 601).
According to any one of paragraphs 3 and 4,
The operation of generating the interruption event is
An operation of generating the interruption event based on the state of the user
Including,
The user's status is
A state determined based on the user's biosignals obtained from the electronic device (101; 601); and
A state determined based on the user's displacement obtained from the electronic device (101; 601)
Containing at least one of
Method of operating the electronic device (101; 601).
According to clause 5,
The user's biosignals obtained from the electronic device (101; 601) are
Biological signals measured by a sensor included in the electronic device (101; 601); and
Biological signals received from an external device (102; 104) linked to the electronic device (101; 601)
Containing at least one of
Method of operating the electronic device (101; 601).
According to any one of claims 3 to 6,
The operation of generating the interruption event is
An operation of generating the interruption event further based on at least one of the duration of the state of the electronic device (101; 601) and the duration of the state of the user.
Including,
Method of operating the electronic device (101; 601).
According to any one of claims 3 to 7,
The operation of generating the interruption event is
An operation of generating the interruption event based on whether a response to the detected state is received.
Including,
Method of operating the electronic device (101; 601).
According to any one of claims 3 to 8,
The operation of generating the interruption event is
An operation of generating the interruption event based on settings of the application 146 for reflection of the detected state.
Including,
Method of operating the electronic device (101; 601).
According to any one of claims 3 to 9,
The operation of changing the display of the avatar is
An operation to change the motion of the avatar;
An operation of adding a visual element corresponding to the avatar; and
An operation to change the display method of the avatar
Containing at least one of
Method of operating the electronic device (101; 601).
According to any one of claims 3 to 10,
The operation of controlling the operation of the electronic device (101; 601) is
Executing another application (146) installed on the electronic device (101; 601); and
An operation of transmitting a notification signal to the electronic device (101; 601)
Containing at least one of
Method of operating the electronic device (101; 601).
According to any one of claims 3 to 11,
The control signal is generated based on an input received in response to the changed display of the avatar from another electronic device (101; 602) executing the application (146).
Method of operating the electronic device (101; 601).
According to clause 12,
The received input is
An input for selecting the avatar; and
Input received through an interface object provided in response to the avatar
Containing at least one of
Method of operating the electronic device (101; 601).
According to any one of claims 3 to 13,
In response to termination of the interruption event, restoring the display of the avatar
Containing more,
Method of operating the electronic device (101; 601).
In the method of operating the server (108; 603) that provides a conversation service through an avatar in a virtual space through the application (146),
detecting an interruption event occurring in a first electronic device (101; 601) executing the application (146);
An operation of controlling an electronic device (101; 601; 602) executing the application (146) to change the display of an avatar corresponding to the first electronic device (101; 601) based on the detected interruption event. ;
Receiving an input requesting operation control of the first electronic device (101; 601) corresponding to the changed display of the avatar from a second electronic device (101; 602) executing the application (146); and
An operation of transmitting a control signal to the first electronic device (101; 601) based on the received input.
Including,
How the server (108; 603) operates.
According to clause 15,
The operation of controlling the electronic device (101; 601; 602) executing the application (146) is
Controlling the electronic device (101; 601; 602) executing the application (146) to change the motion of the avatar;
Controlling the electronic device (101; 601; 602) executing the application (146) to add a visual element corresponding to the avatar; and
An operation of controlling the electronic device (101; 601; 602) executing the application (146) to change the display method of the avatar.
Containing at least one of
How the server (108; 603) operates.
According to any one of claims 15 and 16,
The operation of transmitting a control signal to the first electronic device (101; 601) is
transmitting a signal to control execution of another application (146) installed on the first electronic device (101; 601); and
An operation of transmitting a signal to control transmission of a notification signal to the first electronic device (101; 601)
Containing at least one of
How the server (108; 603) operates.
According to any one of claims 15 to 17,
The operation of receiving an input for controlling the first electronic device (101; 601)
An operation of receiving an input for selecting the avatar; and
An operation of receiving an input for controlling the first electronic device (101; 601) through an interface object provided corresponding to the avatar.
Containing at least one of
How the server (108; 603) operates.
According to any one of claims 15 to 18,
detecting the end of the interruption event;
In response to the termination, restoring the display of the avatar.
Including,
How the server (108; 603) operates.
A computer program combined with hardware and stored in a medium to execute the method of any one of claims 3 to 19.

Images