KR102575856B1 - Method and apparauts for compatibility of input devices - Google Patents

Abstract

Embodiments provide compatible methods of input means. A method of compatibility of input means according to an embodiment includes the operation of receiving console UI image information including a console UI image and controller interaction information through an input/output unit; The console UI image includes one or more console unit images, the controller interaction information includes a relationship between input and output of a controller for each of the one or more console unit images, and the computer UI image includes one or more computer unit images. and the keyboard-mouse interaction information includes a relationship between input and output of each keyboard and mouse for each of the one or more computer unit images, and porting, by a processor, the console UI image information into graphics; Converting the ported result into a script by the processor; generating, by the processor, a profile including interaction conversion information between a console and a computer based on the script and storing it in a memory; The interaction conversion information includes mapping information and responsiveness conversion information, the mapping information includes a correspondence relationship between a button or wheel of the controller and a key of the keyboard or a button of the mouse, and the responsiveness conversion information corresponds to each other. an operation of executing, by the processor, a computer version of the game program, including a corresponding relationship between the responsiveness of the buttons or wheels of the controller and the responsiveness of the keys of the keyboard or buttons of the mouse; identifying, by the processor, a type of input means in response to execution of the game program; loading the profile from the memory when the input means is identified by the processor as the controller; and applying the profile to the game program by the processor.

Description

{METHOD AND APPARAUTS FOR COMPATIBILITY OF INPUT DEVICES}

Embodiments of the present invention relate to a method and device for compatible input means, and to technology for compatible input means used depending on the hardware of a game program.

Even if it is the same game program, if the input means are different, the position, size, and arrangement of the image responding to the input may be different, so image conversion information is necessary. Additionally, because the controller and keyboard have different operation methods, interaction with the UI may be different, and conversion information between controller interaction information and keyboard-mouse interaction information may be required.

As a related prior art, there is Korean Patent Publication No. 10-1994-0009736 (title of the invention: Compatible device for mouse and keyboard).

The background technology described above is possessed or acquired by the inventor in the process of deriving the disclosure of the present application, and cannot necessarily be said to be known technology disclosed to the general public before this application.

A method of compatibility of input means according to an embodiment includes the operation of receiving console UI image information including a console UI image and controller interaction information through an input/output unit; The console UI image includes one or more console unit images, the controller interaction information includes a relationship between input and output of a controller for each of the one or more console unit images, and the computer UI image includes one or more computer unit images. and the keyboard-mouse interaction information includes a relationship between input and output of each keyboard and mouse for each of the one or more computer unit images, and porting, by a processor, the console UI image information into graphics; Converting the ported result into a script by the processor; generating, by the processor, a profile including interaction conversion information between a console and a computer based on the script and storing it in a memory; The interaction conversion information includes mapping information and responsiveness conversion information, the mapping information includes a correspondence relationship between a button or wheel of the controller and a key of the keyboard or a button of the mouse, and the responsiveness conversion information corresponds to each other. an operation of executing, by the processor, a computer version of the game program, including a corresponding relationship between the responsiveness of the buttons or wheels of the controller and the responsiveness of the keys of the keyboard or buttons of the mouse; identifying, by the processor, a type of input means in response to execution of the game program; loading the profile from the memory when the input means is identified by the processor as the controller; and applying the profile to the game program by the processor.

The operation of creating the profile and storing it in the memory includes calculating the responsiveness of the wheel of the controller and the responsiveness of the buttons of the controller based on the game log of the user account; and determining a correspondence between the responsiveness of the controller wheel and the responsiveness of the keyboard keys among the responsiveness conversion information based on the responsiveness of the wheel of the controller and the responsiveness of the buttons of the controller.

The operation of determining the correspondence relationship may include comparing the difference between the responsiveness of the wheel of the controller and the responsiveness of the buttons of the controller with a first threshold value; and when the difference is less than the first threshold, determining the responsiveness of the keys of the keyboard in correspondence to the responsiveness of the buttons of the controller.

The operation of determining the correspondence relationship includes, when the difference is greater than or equal to the first threshold and less than the second threshold, the difference in start times at which each of the up and right keys of the keyboard is contacted and the directional motion goal on the game program. determining the responsiveness of keys on the keyboard based on a game log of the user account including data on the number of successes; And the operation of storing the correspondence between the responsiveness of the control wheel and the responsiveness of the keys of the keyboard in the memory.

The operation of determining the responsiveness of the keys of the keyboard based on the game log of the user account includes the difference in start time when each of the up and right keys of the keyboard is contacted and the number of successes of the directional movement goal on the game program. An operation of mapping a plurality of data to spatial coordinates; determining one or more density areas for the plurality of data; and determining a correspondence relationship between the difference in start time and direction at which each of the up and right keys of the keyboard is contacted in correspondence to the core and boundary of the one or more density areas.

If the difference is greater than or equal to the second threshold, outputting interaction conversion information between the console and the computer using a neural network model based on the script, wherein the neural network model includes an input layer, one or more hidden layers, and Each training data including an output layer and consisting of a learning script and learning interaction conversion information is input to the input layer of the neural network model, passes through the one or more hidden layers and the output layer, and outputs an output vector, and the output A vector is input to a loss function layer connected to the output layer, and the loss function layer outputs a loss value using a loss function that compares the output vector with the correct answer vector for each training data, and the neural network model Parameters can be learned in a direction that reduces the loss value.

The computer program according to one embodiment may be combined with hardware and stored in a computer-readable recording medium to execute the method of claim 1.

A computer-readable recording medium according to one embodiment may be combined with hardware to store a computer program for executing the method of claim 1.

The accompanying drawings, which are included as part of the detailed description to aid understanding of the embodiments, provide various embodiments and together with the detailed description describe technical features of the various embodiments.
1 is a diagram showing the configuration of an electronic device according to an embodiment.
Figure 2 is a diagram showing the configuration of a program according to one embodiment.
FIG. 3 is a diagram illustrating the overall configuration of a system that provides compatible functions of input means according to an embodiment.
Figure 4 is a diagram illustrating the operation of a method for compatibility of input means according to an embodiment.
Figure 5 is an example of a graph showing the results of clustering game logs to personalize input means according to an embodiment.
FIG. 6 is a diagram illustrating an example screen of a compatibility process between a console UI image and a computer UI image according to an embodiment.
FIG. 7 is a diagram illustrating an example screen of a compatibility process between a console UI image and a computer UI image according to an embodiment.
FIG. 8 is a diagram illustrating the configuration of a computer in a system that provides compatible functions of input means according to an embodiment.

The following embodiments combine elements and features of the embodiments in a predetermined form. Each component or feature may be considered optional unless explicitly stated otherwise. Each component or feature may be implemented in a form that is not combined with other components or features. Additionally, various embodiments may be configured by combining some components and/or features. The order of operations described in various embodiments may change. Some features or features of one embodiment may be included in other embodiments or may be replaced with corresponding features or features of other embodiments.

In the description of the drawings, procedures or steps that may obscure the gist of the various embodiments are not described, and procedures or steps that can be understood at the level of a person with ordinary knowledge in the relevant technical field are not described. did.

Throughout the specification, when a part is said to “comprise or include” a certain element, this means that it does not exclude other elements but may further include other elements, unless specifically stated to the contrary. do. In addition, terms such as "... unit", "... unit", and "module" used in the specification refer to a unit that processes at least one function or operation, which refers to hardware, software, or a combination of hardware and software. It can be implemented as: Additionally, the terms “a or an,” “one,” “the,” and similar related terms are used herein in the context of describing various embodiments (particularly in the context of the claims below). Unless otherwise indicated or clearly contradicted by context, it may be used in both singular and plural terms.

Hereinafter, embodiments according to various embodiments will be described in detail with reference to the attached drawings. The detailed description set forth below in conjunction with the accompanying drawings is intended to illustrate exemplary embodiments of various embodiments and is not intended to represent the only embodiment.

In addition, specific terms used in various embodiments are provided to aid understanding of the various embodiments, and the use of such specific terms may be changed to other forms without departing from the technical spirit of the various embodiments. .

1 is a diagram showing the configuration of an electronic device according to an embodiment.

1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments. Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be. The electronic device 101 may also be referred to as a client, terminal, or peer.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes a main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, co-processor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected to the plurality of antennas by, for example, the communication module 190. can be selected Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes: a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

The server 108 is connected to the electronic device 101 and can provide services to the connected electronic device 101. In addition, the server 108 may perform a membership registration process, store and manage various information of users who have registered as members, and provide various purchase and payment functions related to the service. Additionally, the server 108 may share execution data of service applications running on each of the plurality of electronic devices 101 in real time so that services can be shared between users. This server 108 may have the same hardware configuration as a typical web server or WAP server. However, in terms of software, it may be implemented through any language such as C, C++, Java, Visual Basic, and Visual C, and may include program modules that perform various functions. In addition, the server 108 is generally connected to an unspecified number of clients and/or other servers through an open computer network such as the Internet, and receives work performance requests from clients or other servers and derives and provides work results in response. It refers to a computer system and the computer software (server program) installed for it. In addition, in addition to the server program described above, the server 108 includes a series of application programs running on the server 108 and, in some cases, various databases (DBs) built internally or externally, hereinafter " It should be understood as a broad concept including “DB”). Accordingly, the server 108 classifies membership registration information and various information and data about games, stores them in a DB, and manages this DB, which may be implemented inside or outside the server 108. In addition, the server 108 uses a variety of server programs provided depending on the operating system such as DOS, Windows, Linux, UNIX, and Macintosh on general server hardware. Representative examples include Website, IIS (Internet Information Server) used in a Windows environment, and CERN, NCSA, and APPACH used in a Unix environment. Additionally, the server 108 may be linked with an authentication system and payment system for user authentication of the service or payment for purchases related to the service.

The first network 198 and the second network 199 are a connection structure that allows information exchange between each node, such as terminals and servers, or a network connecting the server 108 and the electronic devices 101 and 104. It means (Network). The first network 198 and the second network 199 are the Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), and 3G. , 4G, LTE, 5G, Wi-Fi, etc., but are not limited to these. The first network 198 and the second network 199 may be closed, such as a LAN or WAN, but are preferably open, such as the Internet. The Internet uses the TCP/IP protocol and several services existing at its upper layer, namely HTTP (HyperText Transfer Protocol), Telnet, FTP (File Transfer Protocol), DNS (Domain Name System), SMTP (Simple Mail Transfer Protocol), and SNMP ( It refers to a worldwide open computer first network (198) and second network (199) structure that provides Simple Network Management Protocol (NFS), Network File Service (NFS), and Network Information Service (NIS).

A database can have a general data structure implemented in the storage space (hard disk or memory) of a computer system using a database management program (DBMS). A database may have a data storage format that allows for free search (extraction), deletion, editing, addition, etc. of data. Databases are relational database management systems (RDBMS) such as Oracle, Infomix, Sybase, and DB2, or object-oriented database management such as Gemston, Orion, and O2. It can be implemented according to the purpose of an embodiment of the present disclosure using a system (OODBMS) and an XML native database such as Excelon, Tamino, and Sekaiju, and has its own functions. To achieve this, you can have appropriate fields or elements.

Figure 2 is a diagram showing the configuration of a program according to one embodiment.

Figure 2 is a block diagram 200 illustrating program 140 according to various embodiments. According to one embodiment, the program 140 includes an operating system 142, middleware 144, or an application 146 executable on the operating system 142 for controlling one or more resources of the electronic device 101. It can be included. Operating system 142 may include, for example, AndroidTM, iOSTM, WindowsTM, SymbianTM, TizenTM, or BadaTM. At least some of the programs 140 are preloaded into the electronic device 101, for example, at the time of manufacture, or are stored in an external electronic device (e.g., the electronic device 102 or 104, or a server) when used by a user. It can be downloaded or updated from 108)). All or part of the program 140 may include a neural network.

The operating system 142 may control management (eg, allocation or retrieval) of one or more system resources (eg, process, memory, or power) of the electronic device 101 . Operating system 142 may additionally or alternatively operate on other hardware devices of electronic device 101, such as input module 150, audio output module 155, display module 160, and audio module 170. , sensor module 176, interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196, or It may include one or more driver programs for driving the antenna module 197.

The middleware 144 may provide various functions to the application 146 so that functions or information provided from one or more resources of the electronic device 101 can be used by the application 146. The middleware 144 includes, for example, an application manager 201, a window manager 203, a multimedia manager 205, a resource manager 207, a power manager 209, a database manager 211, and a package manager 213. ), connectivity manager (215), notification manager (217), location manager (219), graphics manager (221), security manager (223), call manager (225), or voice recognition manager (227). You can.

The application manager 201 may, for example, manage the life cycle of the application 146. The window manager 203 may, for example, manage one or more GUI resources used on the screen. For example, the multimedia manager 205 identifies one or more formats required for playing media files, and encodes or decodes the corresponding media file using a codec suitable for the selected format. It can be done. The resource manager 207 may, for example, manage the source code of the application 146 or the memory space of the memory 130. The power manager 209 manages, for example, the capacity, temperature, or power of the battery 189, and may use this information to determine or provide related information necessary for the operation of the electronic device 101. . According to one embodiment, the power manager 209 may interface with a basic input/output system (BIOS) (not shown) of the electronic device 101.

Database manager 211 may create, search, or change a database to be used by application 146, for example. The package manager 213 may, for example, manage the installation or update of applications distributed in the form of package files. The connectivity manager 215 may manage, for example, a wireless connection or direct connection between the electronic device 101 and an external electronic device. For example, the notification manager 217 may provide a function for notifying the user of the occurrence of a designated event (eg, an incoming call, message, or alarm). The location manager 219 may, for example, manage location information of the electronic device 101. The graphics manager 221 may, for example, manage one or more graphic effects to be provided to the user or a user interface related thereto.

Security manager 223 may provide, for example, system security or user authentication. The telephony manager 225 may manage, for example, a voice call function or a video call function provided by the electronic device 101. For example, the voice recognition manager 227 transmits the user's voice data to the server 108 and provides a command corresponding to a function to be performed in the electronic device 101 based at least in part on the voice data, Alternatively, text data converted based at least in part on the voice data may be received from the server 108. According to one embodiment, the middleware 244 may dynamically delete some existing components or add new components. According to one embodiment, at least a portion of the middleware 144 may be included as part of the operating system 142 or may be implemented as separate software different from the operating system 142.

The application 146 includes, for example, home 251, dialer 253, SMS/MMS (255), instant message (IM) 257, browser 259, camera 261, and alarm 263. , Contacts (265), Voice Recognition (267), Email (269), Calendar (271), Media Player (273), Album (275), Watch (277), Health (279) (such as exercise amount or blood sugar) It may include applications that measure biometric information) or environmental information 281 (e.g., measure atmospheric pressure, humidity, or temperature information). According to one embodiment, the application 146 may further include an information exchange application (not shown) that can support information exchange between the electronic device 101 and an external electronic device. The information exchange application may include, for example, a notification relay application configured to deliver designated information (e.g., calls, messages, or alarms) to an external electronic device, or a device management application configured to manage the external electronic device. there is. The notification relay application, for example, transmits notification information corresponding to a specified event (e.g., mail reception) generated in another application (e.g., email application 269) of the electronic device 101 to an external electronic device. You can. Additionally or alternatively, the notification relay application may receive notification information from an external electronic device and provide it to the user of the electronic device 101.

The device management application, for example, controls the power (e.g., turn-on or turn-off) of an external electronic device or some component thereof (e.g., a display module or camera module of the external electronic device) that communicates with the electronic device 101. ) or functions (such as brightness, resolution, or focus). A device management application may additionally or alternatively support installation, deletion, or update of applications running on external electronic devices.

Throughout this specification, neural network, neural network, and network function may be used with the same meaning. A neural network may consist of a set of interconnected computational units, which may generally be referred to as “nodes.” These “nodes” may also be referred to as “neurons.” A neural network is composed of at least two or more nodes. Nodes (or neurons) that make up neural networks may be interconnected by one or more “links.”

Within a neural network, two or more nodes connected through a link can relatively form a relationship as an input node and an output node. The concepts of input node and output node are relative, and any node in an output node relationship with one node may be in an input node relationship with another node, and vice versa. As described above, input node to output node relationships can be created around links. One or more output nodes can be connected to one input node through a link, and vice versa.

In a relationship between an input node and an output node connected through one link, the value of the output node may be determined based on data input to the input node. Here, nodes connecting the input node and the output node may have weights. Weights may be variable and may be varied by a user or algorithm in order for the neural network to perform a desired function. For example, when one or more input nodes are connected to one output node by respective links, the output node is set to the values input to the input nodes connected to the output node and the links corresponding to each input node. The output node value can be determined based on the weight.

As described above, in a neural network, two or more nodes are interconnected through one or more links to form an input node and output node relationship within the neural network. The characteristics of the neural network may be determined according to the number of nodes and links in the neural network, the correlation between the nodes and links, and the value of the weight assigned to each link. For example, if there are two neural networks with the same number of nodes and links and different weight values between the links, the two neural networks may be recognized as different from each other.

FIG. 3 is a diagram illustrating the overall configuration of a system that provides compatible functions of input means according to an embodiment.

In general, for the same game program, different versions of the game program may be provided depending on the hardware on which it is executed. Different versions of game programs generally have similar images and input/output information, but may have different output relationship information depending on different input means. For example, the input method mainly used for a computer may be a keyboard and mouse, but the input method mainly used for a console may be a console-specific controller.

Even if it is the same game program, if the input means are different, the position, size, and arrangement of the image responding to the input may be different, so image conversion information is necessary. Additionally, because the controller and keyboard have different operation methods, interaction with the UI may be different, and conversion information between controller interaction information and keyboard-mouse interaction information may be required.

According to one embodiment, the system may provide compatibility between input means of a computer and an input means of a console. The system may generate a script to identify the graphics unit of the console version of the game program and convert it to fit the computer version of the game program. The system may predetermine a profile for compatibility between the computer version of the game program and the console version of the game program and store it in memory. The system can create and save profiles for each controller. Then, once the controller is identified, the processor can apply the pre-stored profile to the computer version of the game program and automatically convert the controller's input.

To this end, according to one embodiment, the system may include a computer 300, a keyboard 311, a mouse 312, a console 320, a controller 321, a network, and a database 340. The keyboard 311 and mouse 312 may be used as input means for the computer 300. The controller 321 can be used as an input means for the console 320. The computer 300 can access the database 340 through a network. However, this is only an example, and the computer 300 may access the database 340 directly connected without going through a network.

The game program may include a computer version of the game program and a console version of the game program. A computer version of a game program may include one or more computer UI images. A console version of a game program may include one or more console UI images. The computer UI image and console UI image may correspond to each other.

The computer 300 may include an input/output unit, a processor, and memory.

The computer 300 may receive console UI image information including a console UI image and controller interaction information through an input/output unit.

Here, the console UI image may include one or more console unit images. Controller interaction information may include a relationship between the input and output of the controller for each of one or more console unit images. A computer UI image may include one or more computer unit images. Keyboard-mouse interaction information may include a relationship between input and output of each keyboard and mouse for each of one or more computer unit images.

Each console unit image may respectively correspond to a computer unit image. For mutually corresponding console unit images and computer unit images, mutually corresponding outputs may be output for mutually corresponding inputs. When a first output is output for a first input of a controller for any console unit image and a second output is output for a second input of a keyboard for a corresponding computer unit image, the first input and the second input are When they correspond to each other, the first output and the second output may correspond to each other.

For example, the game program may be a soccer game. If the contact input of the controller's wheel in the 45-degree direction is the first input, and the simultaneous input of the up and right keys of the keyboard's direction keys is the second input, the first input and the second input may correspond. In response to the first input, the first output may be an output in which the character advances in a 45-degree direction, and in response to the second input, the second output may be an output in which the character advances in a 45-degree direction.

The computer 300 can port console UI image information into graphics using a processor. The computer 300 can convert the results ported by the processor into a script. Console UI images and controller interaction information can be ported graphically. The processor can analyze console UI images and controller interaction information and output a script. The processor may match the computer UI image and the console UI image based on the analysis result. The processor may match controller interaction information and keyboard-mouse interaction information based on the correspondence result. Depending on the embodiment, the above operation may be omitted.

The computer 300 may use a processor to generate a profile containing interaction conversion information between the console and the computer based on a script and store it in memory. Interaction conversion information may include a correspondence relationship between a computer UI image and a console UI image and a correspondence relationship between controller interaction information and keyboard-mouse interaction information.

Here, the interaction conversion information may include a correspondence between controller interaction information and keyboard-mouse interaction information. The correspondence between controller interaction information and keyboard-mouse interaction information may include mapping information and responsiveness conversion information. Mapping information may include a correspondence relationship between a button or wheel on a controller and a key on a keyboard or button on a mouse. Responsiveness conversion information may include a correspondence relationship between the responsiveness of corresponding buttons or wheels of a controller and the responsiveness of keyboard keys or mouse buttons. Here, responsiveness means the degree of output output corresponding to the degree of input to the input means.

The computer 300 can execute a computer version of a game program using a processor.

The computer 300 can identify the type of input means in response to execution of the game program by the processor. Various input means including a keyboard 311, mouse 312, and controller 321 may be connected to the computer 300. A unique identification signal may be previously associated with each input means, and the computer 300 may identify the input means by analyzing the identification signal according to pre-arranged corresponding information.

The computer 300 may load a profile from memory when the input means is identified as a controller by the processor. The processor can load the controller's profile. The profile may include interaction conversion information including the correspondence between controller interaction information and keyboard-mouse interaction information.

The computer 300 may apply the profile to the game program by means of a processor. Accordingly, the correspondence between the buttons or wheels of the controller and the keys of the keyboard or buttons of the mouse can be applied to the computer version of the game program. The correspondence relationship between the responsiveness of a controller's buttons or wheel and the responsiveness of a keyboard key or mouse button can be applied to a computer version of a game program.

The processor can identify the input signal of the controller in the game program to which the profile is applied and correspond to a specific key on the keyboard or a specific input on the mouse. The processor may identify the input signal of the controller and determine the responsiveness of the computer version of the game program in response to the responsiveness of the controller.

In this way, when the same game program is released in a computer version and a console version, the system can increase compatibility between the console version's input means and the computer version's input means. Even when the controller used for a console is used on a computer, the system can increase user convenience by automatically converting the controller's input signal to suit the computer version of the game program.

Below, the process of creating a profile is described.

The processor may calculate the responsiveness of the controller's wheel and the responsiveness of the controller's buttons based on the game log of the user account.

The processor may determine the correspondence between the responsiveness of the controller wheel and the responsiveness of the keyboard keys among the responsiveness conversion information based on the responsiveness of the controller wheel and the responsiveness of the buttons of the controller.

The processor may determine the correspondence between reactivity in various ways depending on the case. According to one embodiment, the processor may estimate the responsiveness of the keyboard using the responsiveness of the controller's buttons based on game logs for the wheel and buttons of the controller. According to another embodiment, the processor may determine the responsiveness of the keyboard based on the game log separately from the responsiveness to the buttons of the controller. According to another embodiment, the processor may personalize keyboard responsiveness for each user by clustering input data and output data included in the game log.

For example, the probability of success in the game can be calculated for direction inputs classified as 45/1 degree, 45/2 degree, 45/4 degree, 45/8 degree, and 45/16 degree. For example, grade E if the probability of success for 45/2 degrees is less than the threshold, grade D if the probability of success for 45/2 degrees is greater than the threshold and probability of success for 45/4 degrees is less than the threshold. It can be determined by grade. In this way, responsivity to direction can be determined on a scale A - E.

For example, the responsiveness to direction may correspond to the responsiveness of the wheel in the case of a controller. For the wheel, the success probability of control is calculated in units of 45/2 degrees -> 45/4 degrees -> 45/8 degrees -> 45/16 degrees, and the responsiveness can be determined by grades A-E.

In the case of keyboards, this may be related to the difference in the start time when the two arrow keys are touched. For example, the responsiveness to the direction of the keyboard is graded from A to E based on the success probability corresponding to 0.05, 0.1, 0.15, 0.2, and 0.25 seconds based on the start or end time difference between the right key and the up key. can be decided.

The processor may compare the difference between the responsiveness of the wheel of the controller and the responsiveness of the buttons of the controller to a first threshold.

If the difference is less than the first threshold, the processor may determine the responsiveness of the keys on the keyboard corresponding to the responsiveness of the buttons on the controller. If the difference is less than the first threshold, the processor may determine the responsiveness of the keyboard to direction by referring to the responsiveness of the buttons on the controller. For example, if the responsiveness of the controller wheel is grade A and the responsiveness of the controller buttons is grade A, under the premise that the responsiveness of the buttons and keyboard keys are similar, the processor determines that the difference in responsiveness between the wheel and buttons is minimal and The responsiveness of the keyboard can be estimated to be Grade A based on the responsiveness of the wheel or buttons.

For example, the processor may compare the difference between the responsiveness of the wheel of the controller and the responsiveness of the buttons of the controller to a first threshold using Equation 1.

[Equation 1]

In equation 1, may mean the absolute value of the difference between the responsiveness of the wheel to the direction and the responsiveness of the button key. The responsiveness of the wheel to direction is It can be calculated as The responsiveness of the button to the direction is It can be calculated as

The denominator values for the direction wheel 45 degrees can be 1, 2, 4, 8, or 16. The responsiveness of the wheel to direction is It can be calculated as m may be the number of sample data for each class, and j may be the identification number of the sample data. xi,j = can be 0 (miss), 1 (valid), 2 (goal). n is the number of grades, n = 5 (i is the grade identification number, 5=A, 4=B ?? 1 =E), may be a set of sample data of the ith rank. is the maximum value of the set of sample data of the ith rank, represents the normalized value of each sample data, and cannot exceed a maximum of 1. is the average value of the standardized values of the sample data, and can represent the probability of success for each grade. In, n differs by 1 for each grade, Since cannot exceed a maximum of 1, the higher the success probability of a high grade, the greater the value. in other words, may mean the weight for the grade.

The contact time of the button on the controller can be 0.05, 0.1, 0.15, 0.2, 0.25, and the responsiveness of the button can be It can be calculated as q is the number of sample data in each class, l is the identification number of the sample data, xk,l = 0 (miss), 1 (valid), 2 (goal), p is the number of classes, p = 5 (k is Grade identification number, 5=A, 4=B ?? 1 =E), is the set of sample data of the kth class, represents the standardization of the value of each sample data as the maximum value of the set of sample data of the kth grade, and cannot exceed a maximum of 1. is the average value of the standardized values of the sample data and can represent the probability of success for each grade. In, p differs by 1 for each grade, Since cannot exceed a maximum of 1, the higher the success probability of a high grade, the greater the value. in other words, may mean the weight for the grade.

The functions of y and z can be shown in the graph below.

[graph]

Depending on the value of y, z is distributed between 0.5 and 1.5. Based on the threshold value of 1.0, if z is less than 1.0, the processor estimates that the control speed of the keyboard will also be proportional when switching keyboards, otherwise, button controls can be personalized with existing data and a wheel-button matching profile can be created.

If the difference is greater than or equal to the first threshold and less than the second threshold, the game for the user's account includes data about the difference in the starting time at which each of the up and right keys on the keyboard is contacted and the number of successes of the directional motion goal on the game program. Based on the log, you can determine the responsiveness of the keyboard keys. The processor can store the correspondence between the responsiveness of the control wheel and the responsiveness of the keyboard keys in memory.

For example, if the game program is a soccer game, the game log may include the number of effective shots relative to the direction input for the shot. For example, the direction of the computer version of the game program may be determined based on the difference in the contact times of the two arrow keys on the keyboard in response to the direction input of the controller's wheel. For example, if the responsiveness of the controller's wheel is grade A and the responsiveness of the buttons is grade E, the processor may determine that there is a large difference in responsiveness between the wheel and buttons and determine the responsiveness of the keyboard independently of the controller.

The responsiveness of the keyboard can be determined into multiple groups through a clustering technique using a neural network based on game logs. In order to determine the responsiveness of keys on the keyboard based on the game log of the user account, the processor includes a plurality of data about the difference in start time when each of the up and right keys on the keyboard is touched and the number of successes of the directional movement goal on the game program. can be mapped to spatial coordinates. The processor may determine one or more density areas for a plurality of data. The processor may determine a correspondence relationship between the differences in start times and directions at which each of the up and right keys of the keyboard are contacted in response to the core and boundary of one or more density areas.

If the difference is greater than or equal to the second threshold, the processor may output interaction conversion information between the console and the computer using a neural network model based on the script. Here, the neural network model may include an input layer, one or more hidden layers, and an output layer.

The neural network model can be learned as follows. Each learning data consisting of a learning script and learning interaction transformation information is input to the input layer of the neural network model, passes through one or more hidden layers and an output layer to output an output vector, and the output vector is sent to the loss function layer connected to the output layer. input, the loss function layer outputs a loss value using a loss function that compares the output vector with the correct answer vector for each training data, and the parameters of the neural network model can be learned in a direction that reduces the loss value.

[Equation 2]

The loss function may follow Equation 2. In Equation 2, n is the number of learning data for each class, y and j are identifiers representing the classes, C is a constant value, M is the number of classes, x_y is the probability that the learning data belongs to class y, and x_j is the learning data The probability value of belonging to class j, L, may mean the loss value. Since Equation 2 reflects the number of learning data for each class, a class with a small number of learning data may have a small impact on learning, and a class with a large number of learning data may have a large impact on learning.

Figure 4 is a diagram illustrating the operation of a method for compatibility of input means according to an embodiment.

According to one embodiment, the input/output unit of the computer 300 may receive console UI image information including a console UI image and controller interaction information.

Here, the console UI image includes one or more console unit images, the controller interaction information includes a relationship between input and output of the controller for each of the one or more console unit images, and the computer UI image includes one or more computer unit images. It includes, and the keyboard-mouse interaction information may include a relationship between input and output of each keyboard and mouse for each of the one or more computer unit images.

The processor of the computer 300 can port the console UI image information into graphics.

The processor of the computer 300 may convert the ported result into a script.

The processor of the computer 300 may create a profile containing interaction conversion information between the console and the computer based on the script and store it in memory.

Here, the interaction conversion information includes mapping information and responsiveness conversion information, the mapping information includes a correspondence relationship between a button or wheel of the controller and a key of the keyboard or a button of the mouse, and the responsiveness conversion information includes mutual It may include a correspondence relationship between the responsiveness of the corresponding buttons or wheels of the controller and the responsiveness of the corresponding keys of the keyboard or buttons of the mouse.

The processor of the computer 300 can execute a computer version of a game program.

The processor of the computer 300 may identify the type of input means in response to execution of the game program.

The processor of the computer 300 may load the profile from the memory when the input means is identified as the controller.

The processor of the computer 300 may apply the profile to the game program.

Figure 5 is an example of a graph showing the results of clustering game logs to personalize input means according to an embodiment.

The responsiveness of the keyboard can be determined into multiple groups through a clustering technique using a neural network based on game logs. The responsiveness of the keyboard can be determined into multiple groups through a clustering technique using a neural network based on game logs. Here, the game log may include information about the difference in start time between the direction keys on the keyboard and the number of successes of the direction movement goal in the game program. Clustering may refer to unsupervised learning that groups data with similar properties into a certain number of clusters. The group can be determined into n types through DBSCAN (Density-Based Spatial Clustering of Applications with Noise) technique. DBSCAN assumes that if a specific element (point) belongs to a cluster, it must be close to many other elements in the cluster, and the radius and minimum points can be used for this calculation. Additionally, the element is the difference in start time between the direction keys on the keyboard and the number of successes of the direction movement goal in the game program converted into two-dimensional coordinates. The two-dimensional coordinates may be [the difference in start time between the direction keys on the keyboard, the number of successes in the direction movement goal in the game program]. For example, the diameter may be a radius based on a specific data element, which may be referred to as a dense area. The minimum element can indicate how many elements are needed around the core point to specify it. Additionally, each element in the data set can be divided into core, border, and outlier points. Through a neural network, the processor can check the size of the diameter of each element and explore how many surrounding elements there are. Afterwards, if there are m or more elements within the diameter range, the processor may determine that element to be a key element. Additionally, the processor may determine an element included within a diameter range from the core element as a boundary element. Additionally, the processor may determine elements that are not included within the diameter range from the core element as outlier elements, and the outlier element may be excluded from the corresponding cluster. Additionally, the processor can classify key elements into the same cluster if the distance between them is less than the diameter. Because of this, the responsiveness is not determined by fixed types, but can be changed dynamically according to the game log currently collected by the processor to determine the responsiveness differentiated into a section more suitable for the user.

Referring to FIG. 5, the two-dimensional coordinates may be [difference in start time between direction keys on the keyboard, number of successes of the direction movement goal in the game program]. The difference in start time between the direction keys on the keyboard may be distributed between 0.1, 0.2, 0.3, 0.4, and 0.5 seconds, and the number of successes of the direction movement goal in the game program may be distributed between 1 and 7. On the graph of FIG. 5, [difference in start time between direction keys on the keyboard, number of successes in direction movement goals on the game program] can be clustered into a total of four groups.

FIG. 6 is a diagram illustrating an example screen of a compatibility process between a console UI image and a computer UI image according to an embodiment. FIG. 7 is a diagram illustrating an example screen of a compatibility process between a console UI image and a computer UI image according to an embodiment.

Even if it is the same game program, if the input means are different, the position, size, and arrangement of the image responding to the input may be different, so image conversion information is necessary. Additionally, because the controller and keyboard have different operation methods, interaction with the UI may be different, and conversion information between controller interaction information and keyboard-mouse interaction information is required.

The system may generate a script to identify the graphics unit of the console version of the game program and convert it to fit the computer version of the game program. The console UI image may include one or more console unit images. Controller interaction information may include a relationship between the input and output of the controller for each of one or more console unit images. A computer UI image may include one or more computer unit images. Keyboard-mouse interaction information may include a relationship between input and output of each keyboard and mouse for each of one or more computer unit images.

The computer 300 can port console UI image information into graphics using a processor. Figures 6 and 7 exemplarily show the results of porting console UI image information into graphics.

FIG. 8 is a diagram illustrating the configuration of a computer in a system that provides compatible functions of input means according to an embodiment.

According to one embodiment, the computer 300 may include an input/output unit 830, a processor 820, and a memory 810.

According to one embodiment, the input/output unit 830 may receive console UI image information including a console UI image and controller interaction information.

Here, the console UI image includes one or more console unit images, the controller interaction information includes a relationship between input and output of the controller for each of the one or more console unit images, and the computer UI image includes one or more computer unit images. It includes, and the keyboard-mouse interaction information may include a relationship between input and output of each keyboard and mouse for each of the one or more computer unit images.

The processor 820 of the computer 300 can port the console UI image information into graphics.

The processor 820 of the computer 300 may convert the ported result into a script.

The processor 820 of the computer 300 may create a profile containing interaction conversion information between the console and the computer based on the script and store it in the memory 810.

Here, the interaction conversion information includes mapping information and responsiveness conversion information, the mapping information includes a correspondence relationship between a button or wheel of the controller and a key of the keyboard or a button of the mouse, and the responsiveness conversion information includes mutual It may include a correspondence relationship between the responsiveness of the corresponding buttons or wheels of the controller and the responsiveness of the corresponding keys of the keyboard or buttons of the mouse.

The processor 820 of the computer 300 may execute a computer version of a game program.

The processor 820 of the computer 300 may identify the type of input means in response to execution of the game program.

The processor 820 of the computer 300 may load the profile from the memory when the input means is identified as the controller.

The processor 820 of the computer 300 may apply the profile to the game program.

The embodiments described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, and a field programmable gate (FPGA). It may be implemented using one or more general-purpose or special-purpose computers, such as an array, programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may perform an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include a plurality of processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used on any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. Computer-readable media may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Although the embodiments have been described with limited drawings as described above, those skilled in the art can apply various technical modifications and variations based on the above. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the claims described below.

Claims (8)

An operation of receiving console UI image information including a console UI image and controller interaction information by an input/output unit;
The console UI image includes one or more console unit images, the controller interaction information includes a relationship between input and output of a controller for each of the one or more console unit images, and the computer UI image includes one or more computer unit images. and the keyboard-mouse interaction information includes a relationship between input and output of each keyboard and mouse for each of the one or more computer unit images,
An operation of porting the console UI image information into graphics by a processor;
Converting the ported result into a script by the processor;
generating, by the processor, a profile including interaction conversion information between a console and a computer based on the script and storing it in a memory;
The interaction conversion information includes mapping information and responsiveness conversion information, the mapping information includes a correspondence relationship between a button or wheel of the controller and a key of the keyboard or a button of the mouse, and the responsiveness conversion information corresponds to each other. Contains a correspondence relationship between the responsiveness of the buttons or wheels of the controller and the responsiveness of the keys of the keyboard or buttons of the mouse,
executing, by the processor, a computer version of the game program;
identifying, by the processor, a type of input means in response to execution of the game program;
loading the profile from the memory when the input means is identified by the processor as the controller; and
An operation of applying the profile to the game program, by the processor
Including,
The operation of creating the profile and saving it in memory is,
calculating the responsiveness of the wheel of the controller and the responsiveness of the buttons of the controller based on the game log of the user account; and
An operation of determining a correspondence between the responsiveness of the wheel of the controller and the responsiveness of the keys of the keyboard among the responsiveness conversion information based on the responsiveness of the wheel of the controller and the responsiveness of the buttons of the controller
A compatible method of input means, including. delete According to paragraph 1,
The operation of determining the correspondence relationship is,
comparing the difference between the responsiveness of the wheel of the controller and the responsiveness of the buttons of the controller with a first threshold; and
If the difference is less than the first threshold, determining the responsiveness of the keys of the keyboard corresponding to the responsiveness of the buttons of the controller
A compatible method of input means, including. According to paragraph 3,
The operation of determining the correspondence relationship is,
When the difference is greater than or equal to the first threshold and less than the second threshold, data on the difference in start time at which each of the up and right keys of the keyboard is contacted and the number of successes of the directional motion goal on the game program are included. determining the responsiveness of keys on the keyboard based on the game log of the user account; and
An operation of storing the correspondence between the responsiveness of the control wheel and the responsiveness of the keys of the keyboard in the memory.
A compatible method of input means, further comprising: According to paragraph 4,
The operation of determining the responsiveness of keys on the keyboard based on the game log of the user account,
An operation of mapping a plurality of data about the difference in start time when each of the up and right keys of the keyboard is touched and the number of successes of the directional movement goal on the game program to spatial coordinates;
determining one or more density areas for the plurality of data; and
An operation of determining a correspondence relationship between the difference in start time and direction at which each of the up and right keys of the keyboard is contacted in response to the core and boundary of the one or more density areas.
A compatible method of input means, including. According to paragraph 4,
If the difference is greater than or equal to the second threshold, outputting interaction conversion information between the console and the computer using a neural network model based on the script,
The neural network model includes an input layer, one or more hidden layers, and an output layer,
Each learning data consisting of a learning script and learning interaction conversion information is input to the input layer of the neural network model and passes through the one or more hidden layers and the output layer to output an output vector, and the output vector is sent to the output layer. It is input to a connected loss function layer, and the loss function layer outputs a loss value using a loss function that compares the output vector with the correct answer vector for each training data, and the parameters of the neural network model are the loss value. Learned in the direction of becoming smaller,
Compatible method of input method.
A computer program combined with hardware and stored on a computer-readable recording medium to execute the method of claim 1.
A computer-readable recording medium storing a computer program combined with hardware to execute the method of claim 1.

Images