KR20210051065A - Method and system for verifying information received through an instant messaging application for providing a video call service - Google Patents

Abstract

The present disclosure relates to a method for verifying information received through an instant messaging application which operates in a user terminal and provides a video call service. The information verification method comprises the steps of: receiving a gender associated with a first user account; receiving an image including a face captured through an image sensor while the application is running; inputting the received image to an artificial neural network model, and outputting the gender associated with the face included in the received image; and verifying the received gender based on the output gender.

Description

[METHOD AND SYSTEM FOR VERIFYING INFORMATION RECEIVED THROUGH AN INSTANT MESSAGING APPLICATION FOR PROVIDING A VIDEO CALL SERVICE}

The present disclosure relates to a method and system for verifying information received through an instant messaging application providing a video call service, and more particularly, to a method and system for verifying the gender information of a user received through an instant messaging application. .

The spread of user terminals such as smartphones with cameras, tablet PCs, laptop computers, desktop computers, etc. is expanding widely. In addition, due to the recent development of communication technology, a user can easily transmit an image or video captured using his or her own terminal to another person. Furthermore, since a user can transmit or broadcast an image captured using his or her own terminal in real time to another person, a video call service and a personal broadcasting service are widely used. In such an environment, in using the blind chat service, the demand of users who want to use not only text chat but also video call service is increasing.

Meanwhile, some users of the blind chat service may use the blind chat service through a video call after inputting a gender different from their own. When a counterpart of the blind chatting service is matched based on such a false gender, not only discomfort may be transmitted to the matched counterpart, but also the reliability of the blind chatting service may be negatively affected. In order to detect such false gender, a method was used in which a monitoring agent directly detects a user who is active with a fake gender while using the app or directly inspects and detects an image reported from the user. However, since such inspection is performed manually, the size of users that can be inspected may be limited depending on the number of monitoring personnel. In addition, since the monitoring agent verifies whether the user's false gender is based on an arbitrary judgment, an error may occur in the inspection result by the monitoring agent.

The present disclosure provides an information verification method, a recording medium, and a system for solving the above problems.

A method and system are provided for receiving a gender associated with a user account, and verifying a gender associated with the received user account based on an image including a user's face captured through an image sensor during application operation.

A method and system are provided for collecting information and/or data associated with a user account received or processed through an instant messaging application, and for verifying the gender associated with a user account based on the information and/or data associated with the collected user account. .

Methods and systems are provided for using information and/or data associated with a user account received or processed through an instant messaging application, as well as an image containing a user's face, to verify the gender associated with a user account.

The present disclosure may be implemented in a variety of ways, including a method, system, apparatus, or computer-readable storage medium storing instructions.

A method of verifying information received through an instant messaging application operating in a user terminal and providing a video call service according to an embodiment of the present disclosure includes the steps of receiving a gender associated with a first user account, while the application is being operated. Receiving an image including a face captured through an image sensor, inputting the received image to an artificial neural network model, and outputting a gender associated with the face included in the received image, and based on the output gender And verifying the received gender.

According to an embodiment, the artificial neural network model is generated by performing machine learning based on data representing a plurality of training images and data representing a gender for a person in the plurality of training images.

According to an embodiment, the received image includes clothing, and the outputting of a gender associated with a face included in the received image includes: extracting an image feature from the received image, and the extracted image feature. And outputting the gender by inputting it into the artificial neural network model.

According to an embodiment, verifying the received gender based on the output gender includes providing a received image to a separate monitoring system when the output gender is different from the received gender.

According to an embodiment, the step of verifying the received gender based on the output gender is a separate monitoring system for the received image if the output gender is the same as the received gender and the reliability of the output gender is less than or equal to a predetermined reliability. It includes the step of providing to.

According to an embodiment, when it is determined that the gender received in a separate monitoring system is different from the gender associated with the first user account, a penalty is given to the first user account.

According to an embodiment, the information verification method further comprises receiving evaluation information for the first user account from the second user account, and verifying the received gender based on the output gender includes the received evaluation information And verifying the received gender based on the output gender.

According to an embodiment, the information verification method further comprises receiving interest information associated with the first user account, and verifying the received gender based on the output gender is based on the interest information and the output gender. And verifying the received gender.

According to an embodiment, the information verification method further comprises receiving evaluation information for one or more second user accounts provided by the first user account, and verifying the received gender based on the output gender. Includes verifying the received gender based on the output gender and evaluation information for one or more second user accounts provided by the received first user account.

According to an embodiment, the information verification method further comprises receiving at least one second user account that is a partner previously matched with the first user account, and verifying the received gender based on the output gender And verifying the received gender based on the received information on one or more second user accounts and the output gender.

According to an embodiment, the information verification method further includes receiving report information for the first user account, and verifying the received gender based on the output gender includes the received report information and the output gender. It includes the step of verifying the received gender based on.

According to an embodiment, the information verification method further comprises receiving information on a plurality of user accounts associated with the first user account in the application, and verifying the received gender based on the output gender is first 1 and verifying the received gender based on the output gender and information on a plurality of user accounts associated with the user account.

According to an embodiment, the information verification method further includes collecting user activity information for the first user account, and verifying the received gender based on the output gender, the collected user activity information and output And verifying the received gender based on the determined gender.

According to an embodiment, the user activity information for the first user account is a blur item, a facial effect item, and a lock-in that the first user account uses during a video call with the second user account. -in) Includes information on an item about at least one of an item, a shake item, or a sticker item.

According to an embodiment, the receiving of the gender associated with the first user account includes at least one of the input gender or the gender extracted from information on the account associated with the first user account while the first user account is subscribed to the application. And receiving the gender of.

According to an embodiment, the receiving of the image containing the face includes an image containing the detected face when a face is detected in image data captured through an image sensor operated after the first user account is subscribed to the application. And receiving.

According to an embodiment, the information verification method further comprises receiving text input during text chat between the first user account and one or more second user accounts, and verifying the received gender based on the output gender. The step includes verifying the received gender based on the received text and the output gender.

A computer-readable recording medium in which a computer program for executing a method of verifying information received through an instant messaging application that operates on a user terminal and provides a video call service described above in an embodiment of the present disclosure on a computer is recorded. Is provided.

A system for verifying information received through an instant messaging application providing a video call service of the present disclosure receives a gender associated with a first user account from a user terminal, and a face photographed through an image sensor while the application is operating ( face) and input the received image to the artificial neural network model, output the gender associated with the face included in the received image, and verify the received gender based on the output gender. It includes a configured processor.

According to an embodiment, the communication module is further configured to receive evaluation information for the first user account from the second user account, and the processor is further configured to verify the received gender based on the received evaluation information and the output gender. do.

According to some embodiments of the present disclosure, by verifying the gender information of the user received through the instant messaging application, the user who uses the blind video chat service may have distrust of the other party's gender, and furthermore, distrust of the blind video chat service. Can be minimized or eliminated.

In some implementations of the present disclosure, the information processing system analyzes the gender associated with the user account based on information about the user account collected through the instant messaging application, thereby minimizing the cost for the inspection personnel for the user gender.

According to some embodiments of the present disclosure, since the verification of the user's gender is performed through an information processing system and a separate monitoring system, that is, a two-stage system, the error rate of the verification result for the user's gender may be reduced or minimized. have.

Embodiments of the present disclosure will be described with reference to the accompanying drawings described below, in which like reference numerals denote like elements, but are not limited thereto.
1 is a schematic diagram illustrating a configuration in which an information processing system is connected to enable communication with a plurality of user terminals in order to provide an instant messaging service according to an embodiment of the present disclosure.
2 is a block diagram illustrating an internal configuration of a user terminal and an information processing system according to an embodiment of the present disclosure.
3 is a block diagram illustrating a configuration of an information processing system configured to provide a video call service and verify a user's gender according to an embodiment of the present disclosure.
4 is a schematic diagram illustrating an artificial neural network model configured to output a gender associated with a person or a face in an input image from an input image according to an embodiment of the present disclosure.
5 is a flowchart illustrating a method of verifying information received through an instant messaging application operating in a user terminal and providing a video call service according to an embodiment of the present disclosure.
6 is a flowchart illustrating a detailed step of verifying a received gender based on an output gender according to an embodiment of the present disclosure.
7 is a diagram illustrating an example of receiving a gender associated with a user account while a user account is subscribed to an instant messaging application according to an embodiment of the present disclosure.
FIG. 8 is a diagram illustrating an example of detecting a facial image from an image captured through an image sensor while an instant messaging application according to an embodiment of the present disclosure is operated, and inputting a condition for a counterpart of a video call service.
9 is a diagram illustrating an example of applying a blur process to an image including at least a part of a user in an instant messaging application according to an embodiment of the present disclosure.
10 is a diagram illustrating an example of applying a facial effect process and a sticker item to an image including a user's face in an instant messaging application according to an embodiment of the present disclosure.
11 is a diagram illustrating an example of initiating a video call session according to an embodiment of the present disclosure, adding a video call partner during a video call session, and performing text chat.
12 is a diagram illustrating an example of transmitting evaluation information for evaluating a counterpart and receiving evaluation information from a counterpart during a video call session with a counterpart according to an embodiment of the present disclosure.
FIG. 13 is a diagram illustrating an example of using a lock-in item to prevent leaving the other party during a video call session with the other party according to an embodiment of the present disclosure.
14 is a diagram illustrating an example of using a shake item of a user terminal during a video call with a counterpart according to an embodiment of the present disclosure.
15 is a diagram illustrating an example of transmitting a report item during a video call session with a counterpart according to an embodiment of the present disclosure.
16 is a diagram illustrating an example of inquiring a message and a friend list associated with a user account according to an embodiment of the present disclosure.
17 is a diagram illustrating an example of outputting profile information associated with a user account according to an embodiment of the present disclosure.
18 is a diagram illustrating an example of outputting one or more user accounts that have made a video call with a user account according to an embodiment of the present disclosure.

Hereinafter, with reference to the accompanying drawings, specific details for implementing the present disclosure will be described in detail. However, in the following description, when there is a concern that the subject matter of the present disclosure may be unnecessarily obscure, detailed descriptions of widely known functions or configurations will be omitted.

In the accompanying drawings, the same or corresponding elements are denoted with the same reference numerals. In addition, in the description of the following embodiments, overlapping descriptions of the same or corresponding components may be omitted. However, even if description of a component is omitted, it is not intended that such component is not included in any embodiment.

Advantages and features of the disclosed embodiments, and a method of achieving them will be apparent with reference to the embodiments described below together with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms. It is only provided to inform the person of the scope of the invention completely.

The terms used in the present specification will be briefly described, and the disclosed embodiments will be described in detail.

The terms used in the present specification have selected general terms that are currently widely used as possible while considering functions in the present disclosure, but this may vary according to the intention or precedent of a technician engaged in a related field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present disclosure should be defined based on the meaning of the term and the overall contents of the present disclosure, not a simple name of the term.

In the present specification, expressions in the singular include plural expressions unless the context clearly specifies that they are in the singular. In addition, plural expressions include expressions in the singular, unless the context clearly specifies that they are plural.

When a part of the specification is said to "include" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

In addition, the terms "module" or "unit" used in the specification mean software or hardware components, and "module" or "unit" performs certain roles. However,'module' or'unit' is not meant to be limited to software or hardware. The'module' or'unit' may be configured to be in an addressable storage medium, or may be configured to reproduce one or more processors. Thus, as an example, the'module' or'unit' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, It may include at least one of procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, or variables. Components and functions provided within the'module' or'unit' may be combined into a smaller number of components and'module' or'unit', or additional components and'module' or'unit'. Can be further separated.

According to an embodiment of the present disclosure, a'module' or'unit' may be implemented with a processor and a memory. 'Processor' should be interpreted broadly to include general purpose processors, central processing units (CPUs), microprocessors, digital signal processors (DSPs), controllers, microcontrollers, state machines, etc. In some circumstances, a'processor' may refer to an application specific semiconductor (ASIC), programmable logic device (PLD), field programmable gate array (FPGA), and the like. 'Processor' refers to a combination of processing devices such as, for example, a combination of a DSP and a microprocessor, a combination of a plurality of microprocessors, a combination of one or more microprocessors in combination with a DSP core, or any other such combination You may. In addition, the'memory' should be broadly interpreted to include any electronic component capable of storing electronic information. 'Memory' refers to random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erase-programmable read-only memory (EPROM), It may refer to various types of processor-readable media such as electrically erasable PROM (EEPROM), flash memory, magnetic or optical data storage, registers, and the like. The memory is said to be in electronic communication with the processor if the processor can read information from and/or write information to the memory. The memory integrated in the processor is in electronic communication with the processor.

In the present disclosure, a'user account' may represent an account created and used by a user in an instant messaging application or data related thereto. Also, the user account of the instant messaging application may refer to a user who uses the instant messaging application. Similarly, a user using a video call service provided by an instant messaging application may refer to a user account of the instant messaging application.

In the present disclosure, the'image' may include one or more images or images. In addition, the image may include an image captured through an image sensor attached to the user terminal, and an image captured by an image sensor configured to communicate with the user terminal. Also, the image may include some images extracted from the captured video image.

In the present disclosure,'while a user account is subscribed to an application' or'when a user account is subscribed to an application' may refer to a period in which information and/or data required for a user account to subscribe to the application is obtained or received .

In the present disclosure, the'user activity information' may include information or data indicating an activity of a user or a user terminal using a user account of an instant messaging application. According to an embodiment, the user activity information of the user account may refer to information or data used by the user account while an instant application is running. For example, the user activity information may include a blur item, a face effect item, a sticker item, etc. applied to an image including the user's face, but is not limited thereto. According to another embodiment, the user activity information of the user account may refer to information or data used by the user account during a video call provided by an instant messaging application. For example, the user activity information may include, but is not limited to, a lock-in item, a shake item, and the like used during a video call with the other party.

1 is a schematic diagram illustrating a configuration in which an information processing system 130 is connected to enable communication with a plurality of user terminals 112, 114, and 116 in order to provide an instant messaging service according to an embodiment of the present disclosure. The information processing system 130 can store, process, and verify information received through an instant messaging service in a plurality of user terminals 112, 114, and 116 through the network 120. , It may include a system for providing information through an instant messaging service (instant messaging service). According to an embodiment, the information processing system 130 may store, provide, and execute a computer-executable program (for example, a downloadable application) and data related to an instant messaging service and/or a database, Alternatively, it may include one or more distributed computing devices and/or distributed databases based on cloud computing services. The instant messaging service provided by the information processing system 130 may be provided to a user through an instant messaging application installed in the plurality of user terminals 112, 114, and 116. For example, the instant messaging service may include a video call service and/or a text messaging service between the user terminals 112, 114, and 116. In FIG. 1, it has been described that the information processing system 130 may be configured to verify information received through an instant messaging application, but is not limited thereto, and an instant messaging application is provided through a system separate from the information processing system 130 It may be configured to verify information received through.

In FIG. 1, a mobile phone terminal 112, a tablet terminal 114, and a PC terminal 116 are illustrated as examples of user terminals, but the present invention is not limited thereto, and the user terminal is capable of wired and/or wireless communication, and an image sensor (eg For example, a camera) may be attached or may be any computing device capable of communicating with an image sensor and having an instant messaging application installed and running. For example, user terminals include smart phones, mobile phones, navigation systems, computers, notebook computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablet PCs, and game consoles. , A wearable device, an internet of things (IoT) device, a virtual reality (VR) device, an augmented reality (AR) device, and the like. In addition, although FIG. 1 shows that three user terminals 112, 114, and 116 communicate with the information processing system 130 through the network 120, the present invention is not limited thereto. 120 may be configured to communicate with the information processing system 130.

The communication method is not limited, and not only a communication method using a communication network (for example, a mobile communication network, wired Internet, wireless Internet, broadcasting network, satellite network, etc.) that the network 120 may include, but also short-range wireless communication between user terminals. Can be included. For example, the network 120 is a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), and a broadband network (BBN). And any one or more of networks such as the Internet. In addition, the network 120 may include any one or more of a network topology including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, etc. Not limited.

The information processing system 130 may provide a video call service between the user terminals 112, 114, and 116 on which the instant messaging application is operated. According to an embodiment, the information processing system 130 matches the first user of the first user terminal and the second user of the second user terminal according to a specified condition, and allows a video call to proceed between the two users. The user terminal and the second user terminal can be connected to each other. Such a specified condition may include a condition for a counterpart that the user himself wants to make a video call, and may include a condition input by at least one of the first user and the second user. For example, the designated condition may include the other person's gender, region, age, occupation, annual salary, physical condition, etc., but is not limited thereto. According to another embodiment, the information processing system 130 may randomly match the first user of the first user terminal with the second user of the second user terminal and connect the two users to each other so that a video call can be conducted .

The information processing system 130 may be configured to collect information through an instant messaging application. According to an embodiment, the information processing system 130 may be configured to receive an image including a face of a user captured through an image sensor attached to a user terminal during an instant messaging application operation. For example, an image including the user's face may be detected or selected from an image (eg, video image) taken after the user subscribes to an instant messaging application, and the detected image is provided to the information processing system 130 Can be. In addition, the detected image may include not only the user's face but also the user's clothing. According to another embodiment, the information processing system 130 may collect any information and/or data associated with a user for an instant messaging application. For example, the information processing system 130 may include information entered by a user into an instant messaging application, a history of using an instant messaging application by a user, a user's friend list, other users' input information to the user, text entered during text chat And the like may be collected, but are not limited thereto.

The information processing system 130 may be configured to verify information received through an instant messaging application. According to an embodiment, when a user subscribes to an instant messaging application, it may be configured to verify information received from the user terminal. Here, the information received from the user terminal may include information about the user, information indicating the user, and the like, and may include, for example, the user's gender, age, or birth year, but is not limited thereto.

The information processing system 130 may be configured to verify received information about the gender of a user based on information collected through an instant messaging application. According to an embodiment, the information processing system 130 may verify the received information on the gender of the user by analyzing an image including the user's face. For example, an image including a user's face or image feature information extracted therefrom may be input to a learned artificial neural network model to output the user's gender. According to another embodiment, the information processing system 130 may analyze the received user's gender based on information related to the user collected through an instant messaging application as well as an analysis result of the image including the user's face. . For example, in addition to the user's gender results analyzed from images including the user's face, information entered by the user through an instant messaging application, history information by the user using an instant messaging application, information on the user's friend list, and information about the user. The gender of the user may be verified based on at least one of input information of other users or text information input during text chat. As another example, the information processing system 130 can verify the gender of the received user using only the information related to the user collected through the instant messaging application without considering the analysis result of the image including the user's face. have. When the received user's gender is different from the actual user's gender, the information processing system may be provided to a separate verification system (eg, inspection by a monitoring agent, different algorithms for gender verification, etc.). In addition, a user account whose gender is falsely entered may be subject to a penalty (eg, suspension of use, withdrawal from subscription, etc.) when using an instant messaging application. In FIG. 1, the information processing system 130 is disclosed to verify information received through an instant messaging application, but is not limited thereto, and a user terminal on which the instant messaging application is operated may be configured to verify the received information.

2 is a block diagram showing the internal configuration of the user terminal 112 and the information processing system 130 according to an embodiment of the present invention. The user terminal 112 may include a memory 216, a processor 218, a communication module 220, and an input/output interface 214. Similarly, the information processing system 130 may include a memory 234, a processor 236, a communication module 238, and an input/output interface 232. As shown in FIG. 2, the user terminal 112 and the information processing system 130 are configured to communicate information and/or data through the network 120 using respective communication modules 220 and 238. Can be. In addition, the input/output device 212 may be configured to input information and/or data to the user terminal 112 through the input/output interface 214 or to output information and/or data generated from the user terminal 112. In FIG. 2, the memory 234, the processor 236, the communication module 238, and the input/output interface 232 are shown as internal configurations of the user terminal 112, but other user terminals (eg, 114, 116)) may also include the same or similar internal configuration as the internal configuration of the user terminal 112.

The memories 216 and 234 may include any non-transitory computer-readable recording medium. According to an embodiment, the memories 216 and 234 are non-destructive mass storage devices such as random access memory (RAM), read only memory (ROM), disk drive, solid state drive (SSD), flash memory, etc. (Permanent mass storage device) may be included. As another example, a non-destructive mass storage device such as ROM, SSD, flash memory, disk drive, etc. is a separate permanent storage device that is separate from the memories 216 and 234 and is included in the user terminal 112 or the information processing system 130. I can. In addition, the memories 216 and 234 contain an operating system and at least one program code (for example, a browser installed and driven on the user terminal 112 or an instant messaging application installed on the user terminal 112 to provide an instant messaging service). Code) can be stored. These software components may be loaded from a computer-readable recording medium separate from the memories 216 and 234. Such a separate computer-readable recording medium may include a recording medium that can be directly connected to such a user terminal and an information verification system. For example, a floppy drive, a disk, a tape, a DVD/CD-ROM drive, a memory card, etc. It may include a computer-readable recording medium. As another example, software components may be loaded into the memories 216 and 234 through communication modules 220 and 238 other than a computer-readable recording medium. For example, at least one program is based on a computer program (for example, the instant messaging application described above) installed by files provided by the file distribution system for distributing the installation files of the developers or applications through the network 120 Thus, it can be loaded into the memories 216 and 234.

The processors 218 and 236 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Instructions may be provided to the processors 218 and 236 by the memories 216 and 234 or the communication modules 220 and 238. For example, processors 218 and 236 may be configured to execute instructions received according to program code stored in a recording device such as memories 216 and 234.

The communication modules 220 and 238 may provide a configuration or function for the user terminal 112 and the information verification system 130 to communicate with each other through the network 120, and the user terminal 112 and/or information processing The system 130 may provide a configuration or function for communicating with another user terminal or another system (for example, a separate monitoring system). For example, the request generated by the processor 218 of the user terminal 112 according to the program code stored in the recording device such as the memory 216 is the information processing system through the network 120 under the control of the communication module 220 Can be delivered to 130. Conversely, control signals, commands, contents, files, etc. provided under the control of the processor 236 of the information processing system 130 are transmitted through the communication module 238 and the network 120 to the communication module of the user terminal 112 It may be received by the user terminal 112 through 220. For example, control signals, commands, contents, files, etc. of the information processing system 130 received through the communication module 220 may be transmitted to the processor 218 or the memory 216, and the contents or files The user terminal 112 may be stored in a storage medium (permanent storage device described above) that may further include.

The input/output interface 214 may be a means for an interface with the input/output device 212. As an example, the input device may include a device such as a camera, a keyboard, a microphone, and a mouse, and the output device may include a device such as a display, a speaker, and a haptic feedback device. As another example, the input/output interface 214 may be a means for an interface with a device in which a configuration or function for performing input and output is integrated into one, such as a touch screen. For example, the processor 218 of the user terminal 112 uses information and/or data provided by the information processing system 130 or other user terminals in processing instructions of a computer program loaded into the memory 216. The configured service screen or content may be displayed on the display through the input/output interface 214. The input/output device 212 may be configured with the user terminal 112 and one device. In addition, the input/output interface 232 of the information processing system 130 is a means for interface with a device (not shown) for input or output that is connected to the information processing system 130 or that the information processing system 130 may include. Can be In FIG. 2, the input/output interfaces 214 and 232 are illustrated as elements configured separately from the processors 218 and 236, but are not limited thereto, and the input/output interfaces 214 and 232 may be configured to be included in the processors 218 and 236. have.

The user terminal 112 and the information processing system 130 may include more components than those of FIG. 2. However, there is no need to clearly show most of the prior art components. According to an embodiment, the user terminal 112 may be implemented to include at least some of the above-described input/output devices. In addition, the user terminal 112 may further include other components such as a transceiver, a Global Positioning System (GPS) module, a camera, various sensors, and a database. For example, when the user terminal 112 is a smartphone, it may include components generally included in the smartphone, for example, an acceleration sensor, a gyro sensor, a camera module, various physical buttons, and Various components such as a button using a panel, an input/output port, and a vibrator for vibration may be implemented to be further included in the user terminal 112.

According to one embodiment, the processor 218 of the user terminal 112 may be configured to operate an instant messaging application that provides a video call service. In this case, the program code associated with the instant messaging application may be loaded into the memory 216 of the user terminal 112. While the instant messaging application is running, the processor 218 of the user terminal 112 receives information and/or data provided from the input/output device 212 through the input/output interface 214 or processes information through the communication module 220. Information and/or data may be received from system 130, and the received information and/or data may be processed and stored in memory 216. In addition, such information and/or data may be provided to the information processing system 130 through the communication module 220.

While the instant messaging application is being operated, a camera, which is an input device connected to an input/output interface to the user terminal 112, may be configured to be operated. For example, the camera may be arranged to capture an image including the user's face of the user terminal 112, and may be installed on the front and/or rear portions of the user terminal 112, video captured through the camera. Alternatively, the image may be transferred to the processor 218. According to an embodiment, the processor 218 may be configured to detect whether there is an image including a face from a video image or image captured while the application is running (eg, while the user is running after signing up for the application). The processor 218 may be configured to detect an image including a face from the received image by applying any facial recognition or detection algorithm, technique, and/or artificial intelligence technology known in the field of object recognition or detection. For example, the processor 218 may be configured to extract one or more feature points from the received image and determine whether a face is included in the received image based on the extracted feature points. When a face is detected from a moving picture or image received from the camera, the processor 218 may provide the image including the face to the information processing system 130 through the communication module 220 and the network 120. According to another embodiment, during a video call service with another person provided by an instant messaging application, one or more images captured through a camera are provided to the information processing system 130 through the communication module 220 and the network 120 In addition, the processor 236 of the information processing system 130 may provide the user terminal 112 with one or more images received from the user terminal of the other party in the communication with the user terminal 112. During this video call service, the user's voice received through the microphone connected to the input/output interface together with the image captured through the camera may be provided through the information processing system 130 and may be provided to the other user terminal.

According to an embodiment, while the instant messaging application is running, the processor 218 may receive input or selected text, images, etc. through an input device such as a touch screen or a keyboard connected to the input/output interface. / Or the image may be stored in the memory 216 or provided to the information processing system 130 through the communication module 220 and the network 120. For example, the processor 218 may receive text information such as user information such as gender and age of the user, text message input during an instant messaging service, interest information, report information, etc. through input devices such as a touch screen and a keyboard. I can. In addition, the processor 218 may be configured to receive evaluation information for the counterpart and item information such as blur items, facial effect items, lock-in items, shake items, and sticker items through the input device. Accordingly, the received text and/or image may be provided to the information processing system 130 through the communication module 220 and the network 120.

While the instant messaging application is running, the processor 218 is processed through an output device such as a display output capable device (eg, a touch screen, a display, etc.) of the user terminal 112, and a voice output capable device (eg, a speaker). It may be configured to output information and/or data. According to an embodiment, information and/or data provided by the instant messaging application may be displayed through a display-outputable device or the like. For example, during a video call service provided by an instant messaging application, the processor 218 may be configured to display not only the user's image but also the other party's image through the displayable output device. As another example, the processor 218 is an output device capable of displaying various functions or configurations (eg, profile, user information input interface, evaluation information, image processing item, chat window, friend list, etc.) provided by the instant messaging application. Can be configured to display on. According to another embodiment, information and/or data provided by the instant messaging application may be output through an audio output capable device or the like. For example, during a video call service, the processor 218 may be configured to output the voice of the other party received from the information processing system 130.

According to an embodiment, the processor 236 of the information processing system 130 may be configured to manage, process, and/or store information and/or data received from a plurality of user terminals including the user terminal 112. . For example, the processor 236 may provide a video call service and/or a text chat service provided by an instant messaging application to a plurality of user terminals based on information and/or data received from a plurality of user terminals. For example, while two user terminals are performing a video call, it may be configured to provide video, audio, and/or text data received from each user terminal to the other user terminal.

Processor 236 of information processing system 130 may be configured to verify information and/or data received from user terminal 112 while an instant messaging application is running. According to an embodiment, the processor 236 of the information processing system 130 may receive information about the user's gender from the user terminal 112 and may be configured to verify the received gender. Specifically, the processor 236 of the information processing system 130 may be configured to verify the gender of the user based on the received information and/or data associated with the user terminal 112. Hereinafter, a detailed description will be given of a specific method in which the processor 236 of the information processing system 130 verifies information on the user's gender.

3 is a block diagram showing the configuration of an information processing system 130 configured to provide a video call service and verify a user's gender according to an embodiment of the present disclosure. The processor 236 of the information processing system 130 may be configured to include a data collection module 310, a data learning module 320, a data recognition module 330, and a gender verification module 340. In addition, the processor 236 may transmit and receive information and/or data to and from an external device through the communication module 238. In addition, the processor 236 may store information and/or data in the memory 234 or obtain information and/or data from the memory 234.

The data collection module 310 may be configured to receive an image including a face of the user from each of the plurality of user terminals through the communication module 238 while the instant messaging application is running. According to an embodiment, the data collection module 310 may receive an image including a user's face from a user terminal in which the user account is active after the user account subscribes to the instant messaging application. For example, the received image may include at least one of not only the user's face but also other body parts (eg, neck, shoulders, arms, etc.) or clothes of the user. The image received from the user terminal may be stored in the memory 234 or provided to the data recognition module 330.

The data collection module 310 may be configured to receive information associated with a user account from a user terminal through the communication module 238 while the instant messaging application is running. According to an embodiment, the data collection module 310 may be configured to receive a gender associated with a user account from a user terminal. According to another embodiment, the data collection module 310 may be configured to receive interest information associated with a user account from a user terminal. According to another embodiment, the data collection module 310 may receive information on a plurality of user accounts associated with the user account. For example, such a plurality of user accounts may be stored as a friend list of the user account.

The data collection module 310 may receive information on one or more user accounts in which the user account has been matched in the instant messaging application through the communication module 238. According to an embodiment, the list of one or more user accounts that have been matched may be stored in the usage history of the user account. The matched one or more user accounts may be stored in the usage history of the user account regardless of whether a video call or text chat service is performed with the user account.

The data collection module 310 transmits information and/or data generated during a video call between a user account (eg, a first user account) and another user account (eg, a second user account). ) Can be configured to receive. According to an embodiment, while the first user account is in a video call session with the second user account, the data collection module 310 may receive evaluation information on the first user account of the second user account. Evaluation information for the first user account of the second user account may be stored in association with the first user account. According to another embodiment, during a video call session with the first user account and the second user account, the data collection module 310 receives evaluation information for the second user account of the first user account, and the evaluation information is It may be stored in association with the first user account. Here, the evaluation information may include evaluation items including icons representing each user account or user's characteristics, and a number for each evaluation item. According to another embodiment, while the first user account is in a video call session with the second user account, the data collection module 310 may receive report information on the first user account of the second user account. For example, the report information may be information different from the information of the first user account during a video call (e.g., when the known gender and the gender of the person in the actual image are different), report items regarding inappropriate matters made by the user of the first user account, etc. May include, and may also include the number of times for each report item. According to another embodiment, while the first user account is performing a video call service with the second user account, the data collection module 310 may receive a text message between the first user account and the second user account. .

The data collection module 310 may be configured to receive user activity information used during a video call between a user account (eg, a first user account) and another user account (eg, a second user account). . According to an embodiment, this user activity information is not only information received from the first user account during a video call session with the second user account by the first user account, but also from the first user account before the video call is performed. May contain information. For example, the user activity information is a blur item, a face effect item, a lock-in item, a shake item, which the first user account used during a video call session with the second user account. Alternatively, information on at least one of the sticker items may be included. Here, the facial effect item is at least one of a face filter applicable to the face of the first user account, an item for reducing the face of the first user account, or a beauty item applicable to the face of the first user account. It may include. The information and/or data received by the data collection module 310 may be associated with a user account and stored in the memory 234 or provided to the data recognition module 330 and/or the gender verification module 340.

The data learning module 320 may receive data representing a plurality of training images through the memory 234 or the communication module 238. For example, the plurality of learning images may include an arbitrary set of images that can be learned so that the distinction points between men and women are clearly revealed. In addition, data representing a plurality of training images may be data representing images including a plurality of people or faces, data representing image features extracted from such images, and the like. Data representing an image feature may include any information and data capable of representing or characterizing an image, for example, information representing or characterizing an object (e.g., a face, clothing, etc.) within an image, and May contain data. As an example, information and data representing or characterizing an object (for example, a face, clothing, etc.) in an image is for at least one of a feature point for an object, a segmentation mask for an object, or a depth for an object. May contain information and data. In addition, the data learning module 320 may also receive data indicating gender for a person or face in a plurality of learning images. For example, data representing gender may include data representing male or female.

The data learning module 320 may generate an artificial neural network model by performing machine learning to output a gender by inputting a plurality of training images. According to an embodiment, the data learning module 320 may be configured to input a plurality of training images and/or image features extracted therefrom into an artificial neural network model and output gender through unsupervised leanring. . In addition, the data learning module 320, when it is determined that the gender output for the learning image is wrong based on data representing the gender associated with the person or face in the learning image, labeling the learning image, that is, guidance It may be configured to perform supervised learning to generate or update an artificial neural network model. Accordingly, the data learning module 320 may generate or update an artificial neural network model through semi-supervised learning by using a plurality of training images and data representing a person or gender associated with a face in the training image. have. According to another embodiment, the data learning module 320 may generate an artificial neural network model by performing machine learning to output gender by inputting learning information associated with a user account. Here, the learning information associated with the user account may include information associated with the user account that can be received or processed through an instant messaging application. For example, the learning information associated with the user account may include at least one of evaluation information, interest information, history information, report information, friend list, user activity information, or text message associated with the user account, but is not limited thereto. At this time, the data learning module 320 may generate or update the artificial neural network model by machine learning to output gender by inputting the learning image as well as the learning information associated with the user account into the artificial neural network model.

The data recognition module 330 may be configured to receive an image including a face received from a user account, input the received image to an artificial neural network model, and output a face in the received image or a gender associated with a person. Here, the artificial neural network model may include an artificial neural network model learned by the data learning module 320. According to an embodiment, the data recognition module 330 may be configured to input an image feature extracted from an image including a face into the learned artificial neural network model, and output a person in the image or a gender associated with the face. In addition, when it is determined that the output gender is different from the actual gender, the received image and the actual gender may be provided to the data learning module 320 so that the artificial neural network model may be retrained. According to another embodiment, the data recognition module 330 receives information corresponding to the learning information associated with the user account used in the training of the artificial neural network model in the data learning module 320, and transmits the received information to the artificial neural network model. You can type and print the gender. In this case, not only this information but also the received image may be input to the learned artificial neural network model and the gender may be output. In order to verify the gender of the user account, the gender output from the artificial neural network model may be provided to the gender verification module 340.

The gender verification module 340 may verify the gender of the user account received when the user account subscribes to the instant messaging application based on the gender information provided by the data recognition module 330. According to an embodiment, when the output gender is different from the gender of the received user account, the gender verification module 340 may impose a penalty such as suspension of use or withdrawal from subscription to the user account. According to another embodiment, when the output gender is different from the gender of the received user account, the gender verification module 340 may transmit an image including a face associated with the user account to a separate monitoring system. Here, the separate monitoring system may include a system for verifying the gender of the user account in a manner or algorithm different from the verification method or algorithm performed by the gender verification module 340, for example, It can be configured to directly inspect the image. Alternatively, the gender verification module 340 may be configured to complete verification of the gender of the user account when the output gender is the same as the gender of the received user account.

The gender verification module 340 may be configured to receive not only the gender information output from the data recognition module 330 but also information related to the user account, and verify the gender of the user account based on the output gender information and the received information. have. According to an embodiment, the information associated with the user account may include information received from the user account through an instant messaging application or generated or processed when the user account is active on the instant messaging application. For example, the information related to the user account may include at least one of evaluation information, interest information, history information, report information, friend list, user activity information, or text message related to the user account, but is not limited thereto. Here, the user activity information may include information on at least one of a blur item, a face effect item, a lock-in item, a shake item, or a sticker item, which the user account uses while making a video call with another user account.

According to an embodiment, the gender verification module 340 is a user received through rule-based learning and prediction based on information associated with the received user account and the gender output from the data recognition module 330. For example, the gender verification module 340 may generate a table matching the gender of the user account based on at least one of the output gender information or information related to the user account. Accordingly, the gender verification module 340 extracts information related to the received user account and a gender corresponding to the output gender received from the data recognition module 330 based on the generated table, and receives the extracted gender. In another embodiment, the gender verification module 340 uses the information associated with the received user account and the gender output from the data recognition module 330 through a known machine learning technique. The gender information of the received user account can be verified For example, the machine learning technique may include, but is not limited to, a Find-S algorithm, a Version Space algorithm, and a Candidate Elimination algorithm. According to another embodiment, the gender verification module 340 may change a weight used for the output of the gender of the user account or change a score associated with the output of the user's gender using information associated with the received user account. The gender verification module 340 includes the face of the user account in a separate monitoring system when the received user account is different from the actual one based on the information associated with the received user account and the gender output from the data recognition module 330 It can be configured to provide an image.

In FIG. 3, in order to verify the user's gender, the processor 236 of the information processing system 130 includes a data collection module 310, a data learning module 320, a data recognition module 330, and a gender verification module 340. It is configured to include, but is not limited thereto, and the processor 218 of the user terminal is the same as the data collection module 310, the data learning module 320, the data recognition module 330, and the gender verification module 340, or It may be configured to include a similar configuration to verify the gender of the user. In addition, in FIG. 3, the data collection module 310, the data learning module 320, the data recognition module 330, and the gender verification module 340 are illustrated as separate modules, but are not limited thereto, and such a module 310 Each of -340) may be combined and implemented as one or more modules.

4 is a schematic diagram illustrating an artificial neural network model 400 configured to output a gender associated with a person or a face in an input image from an input image according to an embodiment of the present disclosure. The artificial neural network model 400 is a statistical learning algorithm implemented based on the structure of a biological neural network or a structure that executes the algorithm in machine learning technology and cognitive science. According to an embodiment, the artificial neural network model 400 is, as in a biological neural network, nodes, which are artificial neurons that form a network by combining synapses, repeatedly adjust the weight of the synapse, By learning to reduce the error between the output and the inferred output, it is possible to represent a machine learning model having problem solving ability. For example, the artificial neural network model 400 may include an arbitrary probability model, a neural network model, and the like used in artificial intelligence learning methods such as machine learning and deep learning.

According to an embodiment, the artificial neural network model 400 may include an artificial neural network model configured to output a gender by inputting a training image including a face or a person and/or an image feature extracted from the training image. In another embodiment, the artificial neural network model 400 may include an artificial neural network model configured to output gender by inputting learning information received or processed through an instant messaging application. In another embodiment, the artificial neural network model 400 inputs training information received or processed through an instant messaging application and a training image (or an image feature extracted from the training image) including a face or person to output gender It may include a constructed artificial neural network model.

The artificial neural network model 400 is implemented as a multilayer perceptron (MLP) composed of multilayer nodes and connections between them. The artificial neural network model 400 according to the present embodiment may be implemented using one of various artificial neural network model structures including MLP. As shown in FIG. 4, the artificial neural network model 400 includes an input layer 420 that receives an input signal or data 410 from the outside, and an output layer that outputs an output signal or data 450 corresponding to the input data. (440), which is located between the input layer 420 and the output layer 440, receives a signal from the input layer 420, extracts characteristics, and transmits it to the output layer 440 (where n is a positive integer). It consists of hidden layers 430_1 to 430_n. Here, the output layer 440 receives signals from the hidden layers 430_1 to 430_n and outputs them to the outside.

In the learning method of the artificial neural network model 400, a supervised learning method that learns to be optimized to solve a problem by inputting a teacher signal (correct answer), and an unsupervised learning method that does not require a teacher signal. ) There is a way. The data learning module 320 analyzes the input image using supervised learning in order to provide gender information related to the face or person in the learning image, and artificially extracts the gender corresponding to the image. The neural network model 400 may be trained. The artificial neural network model 400 learned in this way may be provided or accessed to the data recognition module 330, and may output a gender associated with the user account in response to an input of an image including a face received from the user account.

According to an embodiment, as shown in FIG. 4, the input variable of the artificial neural network model 400 from which sex information can be extracted may be a face or a learning image including a person. For example, the input variable input to the input layer 420 of the artificial neural network model 400 may be an image vector 410 in which a training image is composed of one vector data element. In response to an input of a learning image including a face or a person, an output variable output from the output layer 440 of the artificial neural network model 400 may be a vector 450 representing gender. In addition, the output layer 440 of the artificial neural network model 400 may be configured to output a vector indicating reliability or accuracy of the output gender. For example, a vector representing confidence or accuracy for this output can be interpreted or displayed as a score. In the present disclosure, the output variable of the artificial neural network model 400 is not limited to the types described above, and may be expressed in various forms related to gender information and reliability of the gender information.

In this way, a plurality of output variables corresponding to a plurality of input variables are matched to the input layer 420 and the output layer 440 of the artificial neural network model 400, respectively, and the input layer 420, the hidden layers 430_1 to 430_n, and the output layer By adjusting synaptic values between nodes included in 440, it may be learned so that a correct output corresponding to a specific input can be extracted. Through this learning process, it is possible to grasp the characteristics hidden in the input variable of the artificial neural network model 400, and the nodes of the artificial neural network model 400 can reduce the error between the output variable calculated based on the input variable and the target output. You can adjust the synaptic values (or weights) between them. Using the artificial neural network model 400 learned in this way, in response to the input image, gender information for a person or face in the input image may be output.

According to another embodiment, the input variable of the artificial neural network model 400 from which sex information can be extracted may include learning information received or processed through an instant messaging application. For example, the learning information received or processed through the instant messaging application may include at least one of evaluation information, interest information, history information, report information, friend list, user activity information, or text message, but is not limited thereto. . In response to such learning information, the output layer 440 of the artificial neural network model 400 may be a vector representing gender and a vector representing reliability or accuracy for gender. According to another embodiment, the input variable of the artificial neural network model 400 from which sex information can be extracted may include such training information and a training image including a face, and the output layer 440 of the artificial neural network model 400 May be a vector representing gender and a vector representing reliability or accuracy for gender. Here, a weight value between nodes included in the input layer 420, the hidden layers 430_1 to 430_n, and the output layer 440 may be adjusted so that a correct output corresponding to a specific input may be extracted. The artificial neural network model 400 capable of extracting such gender information may be provided or accessed to the data recognition module 330, and the image associated with the user account and including a face or person, and/or information associated with the user account. It is input to the artificial neural network model 400 to output the gender of the user account, and further, a score indicating the reliability or accuracy of the gender.

5 is a flowchart illustrating a method 500 of verifying information received through an instant messaging application operating in a user terminal and providing a video call service according to an embodiment of the present disclosure. This method may be executed by the information processing system 130 or the user terminals 112, 114, 116, and may be initiated with a step (S510) of receiving a gender (eg, the user's gender) associated with the first user account have. According to an embodiment, when a user account subscribes to an application, a gender associated with the user account may be directly input. In another embodiment, the gender associated with the user account may be extracted from information about the account associated with the first user account.

Then, in step S520, an image including a face captured through an image sensor may be received while the application is being operated. For example, the image sensor may be attached to the front and/or rear of the user terminal to generate an image including the user's face. According to an embodiment, the image sensor may be configured to automatically operate after a user account is subscribed to generate an image. When an image including the face of the user account is detected in the generated image, the image including the face of the detected face may be provided to the data recognition module to verify the gender of the user account.

Next, a step S530 of outputting a gender associated with a face included in the received image by inputting the received image into the artificial neural network model may be performed by the data recognition module. Here, the artificial neural network model may be generated by performing machine learning on the basis of data representing a plurality of training images and data representing a gender for a person in the plurality of training images by the data learning module. In addition, the received image may include not only the user's face but also the user's clothing. An image feature may be extracted from such an image, and the extracted image feature may be input into an artificial neural network model to output a gender.

In addition, in step S540, the gender verification module may be configured to verify the received gender based on the output gender. According to an embodiment, evaluation information for the first user account may be received from the second user account, and the gender verification module may verify the received gender based on the received evaluation information and the output gender. In another embodiment, interest information associated with the first user account may be received, and the gender verification module may verify the received gender based on the received interest information and the output gender. According to another embodiment, evaluation information on one or more second user accounts provided by the first user account may be received, and the gender verification module may be provided with the one or more second user accounts provided by the received first user account. It may be configured to verify the received gender based on the evaluation information and the output gender information. In another embodiment, at least one second user account, which is a partner that has previously been matched with the first user account, is received, and the gender verification module receives information on the received one or more second user accounts and the output gender. You can verify the gender. According to another embodiment, report information for the first user account may be received, and the gender verification module may be configured to verify the received gender based on the received report information and the output gender. According to another embodiment, information on a plurality of user accounts (eg, a friend list) associated with a first user account in the application is received, and the gender verification module is provided in the plurality of user accounts associated with the first user account. The received gender may be verified based on the information (eg, the sex and number of friends) and the output gender. In another embodiment, user activity information for the first user account may be collected, and the gender verification module may verify the received gender based on the collected user activity information and the output gender. For example, the user activity information for the first user account is a blur item, a facial effect item, and a lock-in that the first user account used during a video call with the second user account. ) It may include information on at least one of an item, a shake item, or a sticker item. In another embodiment, text entered during a text chat between a user account and one or more second user accounts may be received, and the gender verification module is configured to verify the received gender based on the received text and the output gender. Can be.

6 is a flowchart illustrating a detailed step of verifying the received gender based on the output gender according to an embodiment of the present disclosure (S540). First, the gender verification module may be initiated by determining whether the output gender is the same as the received gender (S610). When the output gender is different from the received gender, the received image may be provided to a separate monitoring system (S630). In contrast, when the output gender is the same as the received gender, the gender verification module may determine whether the reliability (eg, score) for the output gender received from the data recognition module is equal to or greater than a predetermined reliability level. For example, if the score for the gender output from the artificial neural network model is 89 points or less, it can be analyzed that there is a recognition failure rate of about 30% of the output gender, and in this case, the predetermined reliability (score) is set to 90 points. Can be. If the reliability of the output gender is greater than or equal to the predetermined reliability, verification of the received gender may be completed (S640). Alternatively, when the reliability of the output gender is less than the predetermined reliability, the received image may be provided to a separate verification system (S630).

A separate verification system may analyze the received image and determine whether the received gender is the same as the gender associated with the user's account (S650). If it is determined that the received gender is different from the gender associated with the user's account, a penalty may be given to the user account (S660). Alternatively, if it is determined that the received gender is the same as the gender associated with the user account, verification of the received gender may be completed (S640).

7 is a diagram illustrating an example of receiving a gender associated with a user account while a user account is subscribed to an instant messaging application according to an embodiment of the present disclosure. Subscription of an instant messaging application may be performed in the user terminal through the first operation 710 and the second operation 720. In one embodiment, the instant messaging application may be one of several applications installed and executed on the user terminal.

When the instant messaging application is operated, the user may be provided with an interface for subscribing to the instant messaging application. As shown in the first operation 710, a list 712 of other sites or applications may be displayed on the screen. The user may join the instant messaging application by selecting one of the displayed list of other websites or applications 712 and logging in with the user account of the selected website or application. Here, other websites may include websites that a random user has already signed up for, and the user selects a website to which he or she has already signed up, and when signing up for linkage with an instant messaging application, account information of the selected website Can be used. The user's gender information may be extracted from the account information of the selected website, and the information processing system may be configured to verify the extracted gender information. As shown in the second operation 720, the user may be provided with an interface for inputting the user's gender 722 and birth year 724 when subscribing to or while subscribing to the instant messaging application. The received user gender 722 and birth year 724 may be provided to the information processing system, and the received user gender 722 may be verified by the information processing system.

8 illustrates an example of detecting an image including a face from a plurality of images captured through an image sensor while an instant messaging application according to an embodiment of the present disclosure is operating, and inputting a condition for a counterpart of a video call service. It is a drawing showing. After the user subscribes to the instant messaging application, as shown in the first operation 810, input image data is generated through the image sensor disposed on the front of the user terminal operated by the instant messaging application, and the screen Can be displayed on.

The user terminal may determine whether there is an image including the user's face from the input image data. As shown in the first operation 810, for example, while detecting the user's face from image data, a smiling emoticon and a text 812 of "Finding a face" may be displayed. When the user's face is detected from the image data, the image including the user's face may be used to verify the gender associated with the user. According to an embodiment, one image including the user's face may be used to verify the user's gender. According to another embodiment, a plurality of images including the user's face may be used to verify the user's gender. In this case, a plurality of images including a face may be used to determine the depth of an object including the user's face, and the information on the depth of the object may be used to verify the user's gender. In contrast, the information processing system inputs each of a plurality of images including the user's face to the data recognition module 330 to output a plurality of genders and reliability, and analyzes the outputted plurality of genders and reliability to determine the user's gender. Can be verified.

As shown in the first operation 810, after the user subscribes to the instant messaging application, a plurality of icons 814, 816, 818, and 820 may be displayed on the screen. For example, when the icon 814 is selected, information related to a user's profile may be displayed. As another example, when the icon 816 is selected, information related to a shop provided by an instant messaging application may be displayed. As another example, when the icon 818 is selected, information on a plurality of user accounts associated with the user account (eg, a friend list) and information on messages previously exchanged with the plurality of user accounts may be displayed. As another example, when the icon 820 is selected, information on the usage history of the user account (eg, a list of users previously matched with the user account, etc.) may be displayed. In addition, as shown in the first operation 810, a text 822 of “I am searching for anyone in everywhere” may be displayed in which the user account may designate information on a person who desires a video call service. When the text 822 is selected (for example, when it is touched), as shown in the second operation 830, the user selects a desired condition, for example, gender and region, as a counterpart of the video call service. An interface for input is provided.

9 is a diagram illustrating an example of applying a blur process to an image including at least a part of a user in an instant messaging application according to an embodiment of the present disclosure. The first operation 910 represents an operation of displaying image data including a user's face and clothes through an image sensor before the user matches a counterpart for a video call service. As illustrated, a swipe area 914 for starting to search for a counterpart for a video call may be displayed. When the swipe is executed after the specific point of the swipe area 914 is touched, the other party of the video call may be searched according to a previously set condition.

The user may apply the blur item to one or more images including a part of the user by clicking the icon 912 for blurring the image. According to an embodiment, when the user selects the second area 912, an interface through which the degree of blurring to be applied to the displayed image can be selected, that is, the second operation 920 may be displayed. Then, the user may determine the degree of the blur effect by adjusting the point on the line after touching the point of the bar 922 disposed at the bottom of the screen. The information on the blur item may be stored as user activity information of the user account, and may be used to determine the gender of the user account. For example, a blur item can be provided only to women. If a specific user account uses the blur item more than a predetermined number of times, it is interpreted as an action to deceive their gender, and the gender of the specific user account is false The likelihood of being judged may be higher.

10 is a diagram illustrating an example of applying a facial effect process and a sticker item to an image including a user's face in an instant messaging application according to an embodiment of the present disclosure. The user may select an item to be applied to the displayed image through the first operation 1010, the second operation 1020, and the third operation 1030 in the user terminal. For example, the item may include a face effect item and a sticker item including a face filter effect item and a face reduction item. The selected item may be used by the user during a video call with another user.

In one embodiment, as shown in the first operation 1010, the user may select the first icon 1012 for applying the face filter item, and when the first region 1012 is selected, the applicable face filter A list of fields 1014 may be displayed in a horizontal direction. The user may perform a swipe operation within the list 1014 to further display face filters that are not currently displayed. The user can select one of the applicable face filters and apply it to a part (eg, a face) or all of the displayed image. These facial filters may include filters capable of applying cosmetic effects to the face.

According to an embodiment, as shown in the second operation 1020, the user may select the second icon 1022 for applying the face reduction item, and when the second icon 1022 is selected, the face A bar (1024) for selecting the degree of reduction may be displayed. The user may determine the degree of reduction of the face included in the image by adjusting the point of the bar 1024 on the line. The degree of face reduction may be expressed as a numerical value (eg, 8 in FIG. 10).

In one embodiment, as shown in the third operation 1030, the user may select a third icon 1032 for selecting a sticker that can be worn on the face, and when the third icon 1032 is selected, A list of applicable stickers 1034 may be displayed in a horizontal direction. The user may perform a swipe operation within the list 1034 to further display stickers that are not currently displayed. One of the displayed stickers may be selected, and the selected sticker may be used in a video call session with another user.

Information on a face effect item and a sticker item that a user intends to use or uses during a video call session with another user may be stored as user activity information. Such user activity information may include information on the type and number of used items. User activity information can be used to verify the user's gender. Information on facial effect items and sticker items that are frequently used depending on men and women may be collected, and the collected information may be used to verify the user's gender. According to an embodiment, the information processing system determines the gender of the first user account based on the gender information output from the data recognition module 330 for the first user account and user activity information including facial effect items and sticker items. It can be configured to verify.

11 is a diagram illustrating an example of initiating a video call session according to an embodiment of the present disclosure, adding a video call partner during a video call session, and performing text chat. According to an embodiment, the information processing system may collect information on a second user account that is a counterpart of a video call in order to verify the gender of the first user account. In another embodiment, text entered during text chat with the second user account may be collected to verify the gender of the first user account. Here, the text may include text input from at least one of the first user account and the second user account.

The user of the first user account may determine a counterpart to perform the video call of the first user account through a first operation 1110. As shown in the first operation 1110, when the information processing system matches the second user account, which is the counterpart of the video call of the first user account, profile information 1114 for the second user account is displayed on the screen. Can be. For example, the profile information may include a face image of the second user account, residence area, interest information, and evaluation information on the second user account. Then, if the skip icon 1112 is touched when profile information for the second user account is displayed, a video call with the second user account may not be performed. In contrast, if the skip icon 1112 is not touched, a video call with the second user account may be performed.

During a video call session between the first user account and the second user account, the second user account may be added as a friend of the first user account. According to an embodiment, the user of the first user account selects the icon 1122 for adding a friend displayed on the screen through the second operation 1120 to add the second user account as a friend of the first user account. I can. In this case, the added second user account may be stored in association with the first user account.

During a video call session between the first user account and the second user account, the user of the first user account may perform text chat with the user of the second user account. The user of the first user account may input text through the text input area 1132 displayed on the screen through the third operation 1130, and the text input from the first user account and/or the second user account is text. It may be displayed on the display window 1134. Such text may be stored in association with the first user account. The information processing system may be configured to collect text associated with the first user account, analyze the content of the text, and verify the gender of the first user based on the content of the analyzed text. As an example, the information processing system may extract a keyword of the collected text, assign a weight to the extracted keyword, and verify the gender of the first user based on the keyword and the weight. As another example, the information processing system may be configured to verify the gender of the first user by performing natural language processing on the collected text.

12 is a diagram illustrating an example of transmitting evaluation information for evaluating a counterpart and receiving evaluation information from a counterpart during a video call session with a counterpart according to an embodiment of the present disclosure. The user of the first user account may transmit evaluation information for the second user account and may receive evaluation information for himself/herself from the second user account. Here, the evaluation information may include an evaluation item selected for the user account. The first operation 1210 represents an operation required when the user of the first user account transmits evaluation information for the second user account, and the second operation 1220 indicates that the user of the first user account is assigned to the second user account. It may represent an operation in which evaluation information on the first user account is received from.

According to an embodiment, an icon 1212 for showing evaluation information displayed by the first operation 1210 may be selected. When the icon 1212 is selected, a list 1214 of evaluation items may be displayed. As shown, evaluation items may be displayed as Swaggs, for example, Swagg may include a Handsome icon, a Pretty icon, a Cute icon, a Stylish icon, a Lovely icon, a Humorous icon, etc., but limited to this It doesn't work. For example, if the user of the first user account selects the Handsome icon for the second user account, the Handsome icon may be displayed on the screen of the user terminal on which the second user account is operated, and the selected icon is the first user. It can be stored in association with the account.

According to another embodiment, the first user account may receive evaluation information on the first user account from the second user account. As shown in the second operation 1220, a Pretty icon may be received. The received Pretty icon may be stored in association with the first user account.

The information processing system may collect evaluation information for the first user account from one or more second user accounts. The information processing system may store the type and number of swag icons for the first user account collected from one or more second user accounts as evaluation information of the first user account. In addition, the information processing system may be configured to analyze a swag icon used by a plurality of users, and determine what the gender of the user who used the item and number of swag icons is. For example, when relatively many Handsome icons, Stylish icons and/or Humorous icons are given, the gender corresponding to these icons is likely to be determined as male. As another example, when relatively many Pretty icons, Cute icons and/or Lovely icons are given, the gender corresponding to these icons is likely to be determined to be female. Accordingly, the information processing system may be configured to verify the gender of the first user account based on the collected evaluation information (ie, the type and number of icons in the swag) of the first user account. According to an embodiment, the evaluation information of the first user account may be used to adjust a weight used when the gender associated with the first user account is output by the data recognition module, or to adjust the reliability of the output gender. In FIG. 12, it is shown that the swag includes six icons, but the present invention is not limited thereto, and the swag may include more icons than six icons.

13 is a diagram illustrating an example of using a lock-in item to prevent the other party from leaving during a video call session with the other party according to an embodiment of the present disclosure. According to an embodiment, the information processing system may collect a lock-in item used during a video call session to verify the gender of the first user account. Here, the collected lock-in item may include an item and number of lock-in items. For example, information on a lock-in item used by the first user account for one or more second user accounts that are counterparts of a video call may be collected as user activity information of the first user account. As another example, information on a lock-in item used by one or more second user accounts for the first user account may be stored in association with the first user account.

In an embodiment, as shown in the first operation 1310, the first user account may be provided with a list 1312 of selectable lock-in items during a video session with the second user account. Here, the list of lock-in items 1312 may include a plurality of lock-in items that provide a function that prevents the other party from leaving the video call session for a certain period of time. For example, as shown, the list 1312 of lock-in items may include a 10-second lock-in item, a 20-second lock-in item, and a 30-second lock-in item. These lock-in items can be purchased with coins that the first user account can use in instant messaging applications. The lock-in item used in this way may be stored as user activity information of the first user account, and may be used to verify the gender of the first user account. The information processing system may be configured to analyze information on a plurality of lock-in items used by a plurality of users, and determine what gender of the user who used the type and number of lock-in items.

According to an embodiment, as shown in the second operation 1320, the first user account may receive a lock-in item from the second user account during a video call session of the second user account and display it on the screen. For example, the received item may be a 10-second lock-in item 1322, and the received 10-second lock-in item 1322 may be displayed on the screen of the first user account. In this case, the first user account cannot exit the video call session of the second user account. The information processing system may collect lock-in items received by a first user account from a counterpart of a plurality of video calls, and store the collected lock-in items in association with the first user account. The collected lock-in item may be used to verify the gender associated with the first user account.

14 is a diagram illustrating an example of using a shake item of a user terminal during a video call with a counterpart according to an embodiment of the present disclosure. Here, the shake item may be used when the other party has a good feeling during the video call session. For example, during a video call session between a first user account and a second user account, when the first user account uses the shake item for the second user account, the first operation 1410 may be performed. As another example, when the second user account uses the shake item for the first user account during a video call session between the first user account and the second user account, the second operation 1420 may be performed.

According to an embodiment, the user of the first user account may shake the user terminal on which the first user account is operated during a video call session with the second user account to use the shake item. As shown in the first operation 1410, when a shake item is used, a first special effect expressing a good feeling may be displayed on the screen. Then, during a video call session between the first user account and the second user account, when the second user account uses the shake item, a second special effect indicating that there is a mutual goodwill may be displayed. As shown in the second operation 1420, the second special effect may include a larger amount of the effect than the first special effect. When the first user account uses the shake item for the second user account during a video call session between the first user account and the second user account, the used shake item may be stored as user activity information of the first user account. . The information processing system may collect, as user activity information of the first user account, information on the shake item used for one or more user accounts that the first user account was a counterpart of the video call. The user activity information of the first user account may be used to verify the gender of the first user account. Further, the shake items used by one or more second user accounts for the first user account may be stored as information associated with the first user account, and may be used to verify the gender of the first user account.

15 is a diagram illustrating an example of transmitting a report item during a video call with a counterpart according to an embodiment of the present disclosure. According to an embodiment, when a user of the first user account shows inappropriate behavior or information different from the profile information of the first user account is found during a video call session with the first user account, the second user account The user account may report the first user account. When reporting the first user account, the second user account may select or fill in a report item for the first user account.

As illustrated in FIG. 15, the second user account may select an icon 1510 for reporting the first user account during a video call session with the first user account. When the icon 1510 is selected, a report item list 1520 may be displayed on the screen. For example, the list of reported items 1520 may include “Violence or harmful behavior”, “Sexual harassment”, and “Other” items. It can contain any item. According to an embodiment, when the gender of the first user account identified on a video call is male and the profile of the first user account is displayed as female, the user of the second user account may report the first user account. As shown in Fig. 15, it is possible to report by selecting the "Other" item and stating that the gender of the first user account is different from the actual one. These report items may be provided to the information processing system and may be used to verify the gender of the first user account.

16 is a diagram illustrating an example of inquiring a message and a friend list associated with a user account according to an embodiment of the present disclosure. In the user terminal, through the first operation 1610 and the second operation 1620, the user may receive information related to a user account, that is, a message exchanged by the user with other users, and a plurality of user accounts registered in association with the user account ( In other words, you can search for a friend list). The text and friend list entered during the text chat with other users are provided to the information processing system and can be used to verify the gender of the user account.

As shown in the first operation 1610, when the user touches the "Message" text 1612 displayed on the screen, a list 1614 of a plurality of user accounts that had text chat with his user account is displayed. Can be. When any one of the list 1614 of a plurality of user accounts is selected, text input during text chat may be displayed. Here, the text input during the text chat may include all text input from a user account and/or text input from another user account in the chat chat window. The text input during the text chat may be provided to an information processing system and analyzed, and the gender of the user account may be verified based on the analyzed text. For example, as the text analysis algorithm or technique, any analysis algorithm or technique known in the related field may be used. For example, a keyword-based analysis, a natural language processing analysis technique, or the like may be used.

As shown in the second operation 1620. When the user touches the “Friends” text 1622 displayed on the screen, a plurality of user accounts associated with his user account, that is, a friend list 1624 may be displayed on the screen. Information on a plurality of user accounts included in the friend list 1624 (eg, gender, age, etc.) may be provided to the information processing system, and based on information on a plurality of user accounts included in the friend list, the user The gender of the account can be verified. According to an embodiment, when a male ratio among a plurality of user accounts included in a friend list is higher than a predetermined ratio, the gender of the user account may be more likely to be female than male. In this case, in performing an algorithm to determine the gender of the user account by synthesizing other information related to the user account, the information processing system gives a higher weight and/or reliability in determining that the gender of the user account is female. You can execute the operation of.

17 is a diagram illustrating an example of outputting profile information associated with a user account according to an embodiment of the present disclosure. In one embodiment, to verify the gender of the user account, the information processing system may collect profile information of the user account as associated information of the user account. Here, the profile information of the user account may include arbitrary information indicating characteristics of the user account, and may include information input from a user account and/or information on a user account input from another user account. For example, the profile information of the user account may include information on a profile image, ratings, interests, language, region, and the like. The information processing system can use this profile information to verify the gender of the user account.

According to an embodiment, the information processing system may collect information on icons of Swaggs received by the user account as evaluation information of the user account. As shown, for example, the list of swags 1710 may include the type and number of swag icons received by the user account. Accordingly, in verifying the gender of the user account, the information processing system may assign a high weight to the upper icons that the user account receives a lot from among the swag icons stored in the profile information. For example, when the user account receives more of the Handsome icon, Stylish icon, and/or Humorous icon than other icons, the information processing system combines with other information related to the user account to determine the gender of the user account, Any action can be performed that may give higher weight and/or confidence in determining that the gender of the user account is male. On the other hand, if a user account receives more of the Pretty icon, Cute icon, and/or Lovely icon than other icons, then a higher weight and/or credibility may be given in determining that the gender of the user account is female. The operation of can be executed.

In an embodiment, the information processing system may receive a list 1720 of interest items received by the user account as interest information of the user account. As shown, for example, interest information may be displayed by placing a tag in front of the interest item. In addition, the information processing system may store weight information indicating gender corresponding to each of the reference keywords indicating interest. Accordingly, the information processing system may determine a weight representing the gender of interest items included in the received interest item list 1720 and use it to verify the gender of the user account.

18 is a diagram illustrating an example of outputting one or more user accounts that have made a video call with a user account according to an embodiment of the present disclosure. The user account (eg, the first user account) may store one or more other user accounts (second user account) that have previously matched itself. These one or more second user accounts may be displayed through a history in the instant messaging application. For example, as illustrated in FIG. 18, a list 1810 of a plurality of user accounts may be displayed in the history of the first user account as user accounts that have previously been matched with the first user account.

The information processing system may be configured to receive one or more second user accounts that have previously been matched with the first user account. The information processing system may verify the gender of the first user account based on the received information on the one or more second user accounts. According to an embodiment, the received gender of one or more second user accounts may be used to verify the gender of the first user account. For example, when the gender of the second user account is more male than female, more weight may be given in determining that the gender of the second user account is male.

The method of verifying information received through the instant messaging application providing the video call service described above may be implemented as a computer-readable code on a computer-readable recording medium. The computer-readable recording medium includes all types of recording devices that store data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, and optical data storage devices. Further, the computer-readable recording medium is distributed over a computer system connected through a network, so that computer-readable codes can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the above-described embodiments can be easily inferred by programmers in the technical field to which the present invention belongs.

The method, operation, or techniques of this disclosure may be implemented by various means. For example, these techniques may be implemented in hardware, firmware, software, or a combination thereof. Those of skill in the art will appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented in electronic hardware, computer software, or combinations of both. To clearly illustrate this interchange of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the particular application and design requirements imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementations should not be interpreted as causing a departure from the scope of the present disclosure.

In a hardware implementation, the processing units used to perform the techniques include one or more ASICs, DSPs, digital signal processing devices (DSPDs), programmable logic devices (PLDs). ), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units designed to perform the functions described in this disclosure. , Computer, or a combination thereof.

Accordingly, various exemplary logic blocks, modules, and circuits described in connection with the present disclosure may include general purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or It may be implemented or performed in any combination of those designed to perform the functions described in. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, eg, a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in connection with the DSP core, or any other configuration.

In firmware and/or software implementation, the techniques include random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), PROM ( on a computer-readable medium such as programmable read-only memory), erasable programmable read-only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, compact disc (CD), magnetic or optical data storage device, etc. It can also be implemented as stored instructions. The instructions may be executable by one or more processors, and may cause the processor(s) to perform certain aspects of the functionality described in this disclosure.

When implemented in software, the techniques may be stored on a computer-readable medium as one or more instructions or code or transmitted through a computer-readable medium. Computer-readable media includes both computer storage media and communication media, including any medium that facilitates transfer of a computer program from one place to another. Storage media may be any available media that can be accessed by a computer. By way of non-limiting example, such computer readable medium may contain RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or desired program code in the form of instructions or data structures. It may include any other media that may be used for transfer or storage to and accessible by a computer. Also, any connection is properly termed a computer-readable medium.

For example, if the software is transmitted from a website, server, or other remote source using wireless technologies such as coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or infrared, wireless, and microwave, coaxial cable , Fiber optic cable, twisted pair, digital subscriber line, or wireless technologies such as infrared, wireless, and microwave are included within the definition of the medium. Disks and discs as used herein include CDs, laser disks, optical disks, digital versatile discs (DVDs), floppy disks, and Blu-ray disks, where disks are usually magnetic It reproduces data optically, while discs reproduce data optically using a laser. Combinations of the above should also be included within the scope of computer-readable media.

The software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other known type of storage medium. An exemplary storage medium may be coupled to a processor such that the processor can read information from or write information to the storage medium. Alternatively, the storage medium may be integrated into the processor. The processor and storage medium may also reside within the ASIC. The ASIC may exist in the user terminal. Alternatively, the processor and storage medium may exist as separate components in the user terminal.

Although the above-described embodiments have been described as utilizing aspects of the presently disclosed subject matter in one or more standalone computer systems, the present disclosure is not limited thereto, and may be implemented in connection with any computing environment such as a network or a distributed computing environment. . Furthermore, aspects of the subject matter in this disclosure may be implemented in multiple processing chips or devices, and storage may be similarly affected across multiple devices. Such devices may include PCs, network servers, and portable devices.

In the present specification, the present disclosure has been described with reference to some embodiments, but various modifications and changes may be made without departing from the scope of the present disclosure that can be understood by those of ordinary skill in the art to which the present disclosure belongs. In addition, such modifications and changes should be considered to fall within the scope of the claims appended hereto.

112, 114, 116: user terminal
120: network
130: information processing system
212: I/O device
214, 232: I/O interface
216, 234: memory
218, 236: processor
220, 238: communication module
310: data acquisition module
320: data learning module
330: data recognition module
340: gender verification module

Claims (20)

In a method for verifying information received through an instant messaging application operating on a user terminal and providing a video call service,
Receiving a gender associated with the first user account;
Receiving an image including a face captured through an image sensor while the application is being operated;
Inputting the received image to an artificial neural network model and outputting a gender associated with a face included in the received image; And
Verifying the received gender based on the output gender
Including, a method of verifying information.
The method of claim 1,
The artificial neural network model is generated by performing machine learning based on data representing a plurality of training images and data representing a gender for a person in the plurality of training images.
The method of claim 1,
The received image includes a garment,
Outputting the gender associated with the face included in the received image,
Extracting an image feature from the received image; And
And outputting the gender by inputting the extracted image feature into the artificial neural network model.
The method of claim 1,
The step of verifying the received gender based on the output gender comprises the step of providing the received image to a separate monitoring system when the output gender is different from the received gender, the method of verifying information .
The method of claim 4,
The step of verifying the received gender based on the output gender is the separate monitoring of the received image when the output gender is the same as the received gender and the reliability of the output gender is less than a predetermined reliability level. A method of verifying information comprising providing to a system.
The method of claim 5,
When the separate monitoring system determines that the received gender is different from the gender associated with the first user account, a penalty is granted for the first user account.
The method of claim 1,
Further comprising the step of receiving evaluation information for the first user account from a second user account,
The step of verifying the received gender based on the output gender includes verifying the received gender based on the received evaluation information and the output gender.
The method of claim 1,
Further comprising the step of receiving interest information associated with the first user account,
The step of verifying the received gender based on the output gender comprises verifying the received gender based on the interest information and the output gender.
The method of claim 1,
Receiving evaluation information for one or more second user accounts provided by the first user account,
The step of verifying the received gender based on the output gender may include evaluation information for one or more second user accounts provided by the received first user account and the received gender based on the output gender. A method of verifying information comprising the step of verifying.
The method of claim 1,
Further comprising the step of receiving at least one second user account that is a partner that has previously been matched with the first user account,
The step of verifying the received gender based on the output gender comprises the step of verifying the received gender based on the received information on the one or more second user accounts and the output gender. How to verify it.
The method of claim 1,
Further comprising the step of receiving report information for the first user account,
The step of verifying the received gender based on the output gender includes verifying the received gender based on the received report information and the output gender.
The method of claim 1,
Further comprising the step of receiving information on a plurality of user accounts associated with the first user account in the application,
Verifying the received gender based on the output gender comprises verifying the received gender based on the output gender and information on a plurality of user accounts associated with the first user account, How to verify the information.
The method of claim 1,
Further comprising the step of collecting user activity information for the first user account,
The step of verifying the received gender based on the output gender includes verifying the received gender based on the collected user activity information and the output gender.
The method of claim 12,
The user activity information for the first user account includes a blur item, a face effect item, and a lock-in item used during a video call by the first user account with a second user account. , A method of verifying information, including information on an item for at least one of a shake item or a sticker item.
The method of claim 1,
The receiving of the gender associated with the first user account may include at least one of a gender input or a gender extracted from information on an account associated with the first user account while the first user account is subscribed to the application. A method of verifying information, comprising the step of receiving a.
The method of claim 1,
Receiving the image including the face may include an image including the detected face when the face is detected in image data captured through the image sensor operated after the first user account is subscribed to the application. A method of verifying information comprising the step of receiving a.
The method of claim 1,
Receiving text input during text chat between the first user account and one or more second user accounts,
The step of verifying the received gender based on the output gender comprises verifying the received gender based on the received text and the output gender.
A computer program in which a computer program for executing a method of verifying information received through an instant messaging application that operates on a user terminal according to any one of claims 1 to 17 and provides a video call service on a computer is recorded. Readable recording medium.
A system for verifying information received through an instant messaging application providing a video call service,
A communication module configured to receive a gender associated with the first user account from a user terminal, and to receive an image including a face captured through an image sensor while the application is running; And
Processor configured to input the received image into an artificial neural network model, output a gender associated with a face included in the received image, and verify the received gender based on the output gender
A system comprising a.
The method of claim 19,
The communication module is further configured to receive evaluation information for the first user account from a second user account,
And the processor is further configured to verify the received gender based on the received evaluation information and the outputted gender.

Images