KR102485811B1 - Method, system, and non-transitory computer readable record medium for filtering image using keyword extracted form image - Google Patents

Abstract

Receiving an image transmitted from a user's electronic device included in the chat room through a chat room of a messenger, analyzing the image using a modeled learning model, classifying the image based on the analysis result of the image, A method of filtering the image for the chat room based on the classification result of the image is provided.

Description

Method and system for filtering an image using a keyword extracted from the image, and a non-transitory computer readable recording medium

The description below relates to techniques for filtering images.

An instant messenger, which is a general communication tool, is software capable of transmitting and receiving messages or data in real time, and allows a user to register a contact on the messenger and send and receive messages with the other person in the contact list in real time.

As for the messenger function, the use of the messenger is becoming common not only in a PC but also in a mobile environment of a mobile communication terminal.

For example, Korean Patent Publication No. 10-2002-0074304 (published on September 30, 2002) discloses a mobile messenger service system for a mobile terminal using a wireless communication network that enables a messenger service to be provided between mobile messengers installed in the mobile terminal, and A method is disclosed.

In general, a messenger supports a function of sharing various information such as photos, videos, files, contacts, locations, and schedules among users through a chat room, and a function of searching for chat messages or shared information.

Images can be filtered using keywords extracted from images to be shared through the chat room.

An image filtering method executed in a server, wherein the server includes at least one processor configured to execute computer readable instructions included in a memory, and the image filtering method is performed by the at least one processor in a chat room of a messenger. Receiving an image transmitted from a user's electronic device included in the chat room through the; analyzing, by the at least one processor, the image using a modeled learning model; Classifying, by the at least one processor, the image based on an analysis result of the image; and filtering, by the at least one processor, the image for the chat room based on a classification result of the image.

According to one aspect, the analyzing may include detecting at least one object from the image through the learning model modeled based on attributes including a color, texture, and category capable of object classification. .

According to another aspect, the receiving of the image may include receiving a video from the electronic device of the user, and the analyzing may include detecting at least one object from the video. .

According to another aspect, the analyzing may include analyzing the image using a database capable of interworking with the server.

According to another aspect, the classifying may include classifying the image into a specific type based on a result of analyzing the image, and the filtering may include, when the image is classified into the specific type, Filtering the image may be included.

According to another aspect, the filtering may include limiting exposure of the image in the chat room based on a result of classifying the image.

According to another aspect, the filtering may include transmitting a message including information about the image to an electronic device of another user included in the chat room through the chat room based on a result of analyzing the image. can do.

It provides a computer program stored in a computer readable recording medium to execute the image filtering method on the computer system.

A computer-implemented server comprising at least one processor implemented to execute computer-readable instructions contained in a memory, wherein the at least one processor is a user's electronic device included in the chat room through a chat room of a messenger. receiving an image transmitted from; analyzing the image using a modeled learning model; classifying the image based on an analysis result of the image; and a server processing a process of filtering the image for the chat room based on a result of classifying the image.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention.
Figure 2 is a block diagram for explaining the internal configuration of the electronic device and the server in one embodiment of the present invention.
3 illustrates an example of a basic technical scenario for image transmission in a messenger according to an embodiment of the present invention.
4 is a block diagram illustrating an example of components that may be included in a processor of a server according to an embodiment of the present invention.
5 is a flowchart illustrating an example of a method performed by a server according to an embodiment of the present invention.
6 is a block diagram illustrating an example of components that may be included in a processor of an electronic device according to an embodiment of the present invention.
7 is a flowchart illustrating an example of a method performed by an electronic device according to an embodiment of the present invention.
8 to 10 are flowcharts illustrating an image filtering process according to an embodiment of the present invention.
11 and 12 illustrate examples of chat room screens for limiting image exposure according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Embodiments of the present invention relate to techniques for filtering images.

Embodiments including those specifically disclosed in this specification can automatically filter images using keywords extracted from images, and through this, significant advantages in terms of image regulation, image management, convenience, efficiency, cost reduction, etc. can achieve them.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention. The network environment of FIG. 1 shows an example including a plurality of electronic devices 110 , 120 , 130 , and 140 , a plurality of servers 150 and 160 , and a network 170 . 1 is an example for explanation of the invention, and the number of electronic devices or servers is not limited as shown in FIG. 1 .

The plurality of electronic devices 110, 120, 130, and 140 may be fixed terminals implemented as computer systems or mobile terminals. Examples of the plurality of electronic devices 110, 120, 130, and 140 include a smart phone, a mobile phone, a navigation device, a computer, a laptop computer, a digital broadcast terminal, a personal digital assistant (PDA), and a portable multimedia player (PMP). ), tablet PC, game console, wearable device, internet of things (IoT) device, virtual reality (VR) device, augmented reality (AR) device, and the like. As an example, FIG. 1 shows the shape of a smartphone as an example of the electronic device 110, but in the embodiments of the present invention, the electronic device 110 substantially uses a wireless or wired communication method to transmit other information via the network 170. It may refer to one of various physical computer systems capable of communicating with the electronic devices 120 , 130 , and 140 and/or the servers 150 and 160 .

The communication method is not limited, and includes not only a communication method utilizing a communication network (eg, mobile communication network, wired Internet, wireless Internet, broadcasting network, satellite network, etc.) that the network 170 may include, but also short-range wireless communication between devices. can For example, the network 170 may include a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), and a broadband network (BBN). , one or more arbitrary networks such as the Internet. In addition, the network 170 may include any one or more of network topologies including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, and the like. Not limited.

Each of the servers 150 and 160 communicates with the plurality of electronic devices 110, 120, 130, and 140 through the network 170 to provide commands, codes, files, contents, services, and the like, or a computer device or a plurality of computers. Can be implemented in devices. For example, the server 150 may be a system that provides a first service to a plurality of electronic devices 110, 120, 130, and 140 accessed through the network 170, and the server 160 may also include a network ( It may be a system that provides a second service to a plurality of electronic devices 110, 120, 130, and 140 accessed through 170). As a more specific example, the server 150 provides a service (for example, a messenger service, etc.) for which the application is intended through an application as a computer program that is installed and driven in the plurality of electronic devices 110, 120, 130, and 140. As the first service, it may be provided to a plurality of electronic devices 110, 120, 130, and 140. As another example, the server 160 may provide a service for distributing files for installing and running the above-described application to the plurality of electronic devices 110, 120, 130, and 140 as a second service.

Figure 2 is a block diagram for explaining the internal configuration of the electronic device and the server in one embodiment of the present invention. In FIG. 2 , internal configurations of the electronic device 110 and the server 150 will be described as examples of electronic devices. In addition, the other electronic devices 120 , 130 , and 140 or the server 160 may also have the same or similar internal structure as the above-described electronic device 110 or server 150 .

The electronic device 110 and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223, and input/output interfaces 214 and 224. The memories 211 and 221 are non-transitory computer readable recording media, such as RAM (random access memory), ROM (read only memory), disk drive, SSD (solid state drive), flash memory, and the like. It may include a permanent mass storage device. Here, a non-perishable mass storage device such as a ROM, SSD, flash memory, or disk drive may be included in the electronic device 110 or the server 150 as a separate permanent storage device from the memories 211 and 221. In addition, the memories 211 and 221 include an operating system and at least one program code (for example, a browser installed and driven in the electronic device 110 or a code for an application installed in the electronic device 110 to provide a specific service). can be stored. These software components may be loaded from a computer-readable recording medium separate from the memories 211 and 221 . The separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD/CD-ROM drive, and a memory card. In another embodiment, software components may be loaded into the memories 211 and 221 through the communication modules 213 and 223 rather than computer-readable recording media. For example, at least one program is a computer program installed by files provided by developers or a file distribution system (for example, the above-described server 160) that distributes installation files of applications through the network 170. It may be loaded into the memories 211 and 221 based on (for example, the above-described application).

The processors 212 and 222 may be configured to process commands of a computer program by performing basic arithmetic, logic, and input/output operations. Instructions may be provided to processors 212 and 222 by memories 211 and 221 or communication modules 213 and 223 . For example, the processors 212 and 222 may be configured to execute instructions received according to program codes stored in a recording device such as the memories 211 and 221 .

The communication modules 213 and 223 may provide a function for the electronic device 110 and the server 150 to communicate with each other through the network 170, and the electronic device 110 and/or the server 150 may communicate with each other. A function for communicating with an electronic device (eg, the electronic device 120) or another server (eg, the server 160) may be provided. For example, a request generated according to a program code stored in a recording device such as the memory 211 by the processor 212 of the electronic device 110 is sent to the server 150 through the network 170 under the control of the communication module 213. ) can be transmitted. Conversely, control signals, commands, contents, files, etc. provided under the control of the processor 222 of the server 150 pass through the communication module 223 and the network 170 to the communication module 213 of the electronic device 110. ) through which it can be received by the electronic device 110 . For example, control signals, commands, contents, files, etc. of the server 150 received through the communication module 213 may be transmitted to the processor 212 or the memory 211, and the contents or files may be transferred to the electronic device ( 110) may be stored in a storage medium (the permanent storage device described above) that may be further included.

The input/output interface 214 may be a means for interface with the input/output device 215 . For example, the input device may include devices such as a keyboard, mouse, microphone, and camera, and the output device may include devices such as a display, a speaker, and a haptic feedback device. As another example, the input/output interface 214 may be a means for interface with a device in which functions for input and output are integrated into one, such as a touch screen. The input/output device 215 and the electronic device 110 may be configured as one device. Also, the input/output interface 224 of the server 150 may be connected to the server 150 or may be a means for interface with a device (not shown) for input or output that may be included in the server 150 . As a more specific example, a service configured using data provided by the server 150 or the electronic device 120 when the processor 212 of the electronic device 110 processes a command of a computer program loaded into the memory 211. A screen or content may be displayed on the display through the input/output interface 214 .

Also, in other embodiments, the electronic device 110 and the server 150 may include more components than those shown in FIG. 2 . However, there is no need to clearly show most of the prior art components. For example, the electronic device 110 is implemented to include at least some of the aforementioned input/output devices 215 or other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, and a database. may further include. As a more specific example, when the electronic device 110 is a smartphone, an acceleration sensor or gyro sensor, a camera module, various physical buttons, a button using a touch panel, an input/output port, and a vibrator for vibration, which are generally included in the smartphone. Various components such as may be implemented to be further included in the electronic device 110.

3 illustrates an example of a basic technical scenario for image transmission in a messenger according to an embodiment of the present invention.

3 illustrates an example of a process of exchanging images between users through a messenger.

1. The user (user A) of the electronic device 110 executes the messenger installed on the electronic device 110, and then sends an image to be shared with user B in a chat room with the user (user B) of the electronic device 120. choose The chat room is a messenger conversation screen corresponding to a communication session established between user A's account and user B's account.

2. The electronic device 110 transmits the image selected by user A to the server 150 according to the messenger's file transmission request.

3. The server 150 receives an image to be transmitted to user B from the electronic device 110 and stores it in a file DB (eg, memory 221).

4. The electronic device 120 downloads the image sent by user A from the server 150 at the request of user B through a chat room with user A on the messenger.

5. The server 150 stores the image sent by user A to user B, and deletes the image from the file DB after a certain period of time when user B downloads it.

The server 150 does not immediately transmit the image file sent by user A to user B, but first transmits an image type message including a thumbnail of the image as a conversation message about the image, and when user B's request is When there is, the corresponding image file can be downloaded to the electronic device 120 .

Hereinafter, specific embodiments of a method and system for filtering an image will be described.

In this specification, an image may include all image-based content such as a moving picture as well as a still image such as a photograph.

4 is a block diagram illustrating an example of components that may be included in a processor of a server according to an embodiment of the present invention, and FIG. 5 is an example of a method that the server may perform according to an embodiment of the present invention. It is a flow chart showing

The server 150 according to the present embodiment serves as a platform for providing a messenger service to a plurality of electronic devices 110, 120, 130, and 140 serving as clients. The server 150 may provide a messenger service in conjunction with applications installed on the electronic devices 110, 120, 130, and 140.

The server 150 may perform the image filtering method according to FIG. 5 , and for this purpose, the processor 222 of the server 150 includes an image receiver 410 and a keyword extractor as shown in FIG. 4 as components. 420, and a message transfer unit 430. Depending on embodiments, components of the processor 222 may be selectively included in or excluded from the processor 222 . Also, components of the processor 222 may be separated or merged to express functions of the processor 222 according to embodiments.

The processor 222 and components of the processor 222 may control the server 150 to perform steps S510 to S540 included in the image filtering method of FIG. 5 . For example, the processor 222 and components of the processor 222 may be implemented to execute instructions according to an operating system code and at least one program code included in the memory 221 .

Here, components of the processor 222 may be representations of different functions of the processor 222 performed by the processor 222 according to instructions provided by program codes stored in the server 150. . For example, the image receiving unit 410 may be used as a functional expression of the processor 222 that controls the server 150 according to the above-described commands to receive an image to be shared by the server 150 through a chat room.

In step S510, the processor 222 may read necessary commands from the memory 221 loaded with commands related to the control of the server 150. In this case, the read command may include a command for controlling the processor 222 to execute steps S520 to S540 to be described later.

In step S520, the image receiving unit 410 may receive an image to be shared from the electronic device 110 through a chat room in which a user of the electronic device 110 is included. A user of the electronic device 110 uploads an image to be shared with other users to the server 150 through a chat room.

In step S530, the keyword extraction unit 420 may extract keywords related to the image from the image received from the electronic device 110. For example, the keyword extraction unit 420 may extract a keyword related to the image by recognizing an object included in an image through object detecting and obtaining a name of the corresponding object. The keyword extractor 420 includes a machine learning engine (eg, TensorFlow, etc.), and an object detection algorithm based on a pre-trained deep learning model can be applied to a set of training images. there is. When the image received from the electronic device 110 is entered as an input, the keyword extractor 420 finds an object included in the image based on a deep learning model-based object detection algorithm and extracts features of the object. In this case, the keyword extractor 420 may extract features of objects detected in the image by applying a learning model modeled based on various attributes capable of object classification (eg, color, texture, category, etc.). In addition to the above method, at least one of known techniques, for example, image recognition algorithms such as scale invariant feature transform (SIFT), speeded up robust features (SURF), histogram of oriented gradient (HOG), and modified census transform (MCT) The features included in the image are extracted using an algorithm of and the extracted features are registered in advance in a database on the server 150 (for example, the memory 221) or another database that can be linked with the server 150. Keywords can be extracted from an image by calculating the similarity with the image. In addition to extracting keywords, it is possible to classify specific types of content, such as pornography based on image analysis results.

In step S540, the message delivery unit 430 transmits a conversation message including the keyword extracted in step S530 with respect to the image received from the electronic device 110 to the electronic device 120 of another user through the chat room. can When a user of the electronic device 110 uploads an image through a chat room, the server 150 may store the image as data related to the chat room, and may also store keywords extracted from the image. At this time, the message delivery unit 430 may deliver a chat message including information about the image uploaded by the user of the electronic device 110 to the other party. In other words, the message delivery unit 430 may first deliver an image type message including information about an image instead of directly delivering an image file. In particular, when delivering an image type message, the message delivery unit 430 may also deliver a keyword extracted from a corresponding image. In this case, in the case of an image type message, a keyword extracted from an image may be included, or a thumbnail of a corresponding image may be included together with a keyword extracted from an image.

Accordingly, the server 150 may extract a keyword from the image to be shared through the chat room and transmit a chat message including the extracted keyword to the chat room.

6 is a block diagram illustrating an example of components that may be included in a processor of an electronic device according to an embodiment of the present invention, and FIG. 7 is a method that the electronic device according to an embodiment of the present invention may perform. It is a flow chart showing an example of

An image filtering system implemented by a computer may be configured in the electronic device 110 according to the present embodiment. For example, the image filtering system may be implemented in the form of a program that operates independently, or may be configured in the form of an in-app of a specific application to enable operation on the specific application, Image filtering can be performed through linkage.

An image filtering system implemented in the electronic device 110 may perform an image filtering method based on a command provided by an application installed in the electronic device 110 . To perform the image filtering method according to FIG. 7 , the processor 212 of the electronic device 110 includes a filtering setting unit 610, a message receiving unit 620, and image filtering as shown in FIG. 6 as components. A portion 630 may be included. Depending on embodiments, components of the processor 212 may be selectively included in or excluded from the processor 212 . Also, components of the processor 212 may be separated or merged to express functions of the processor 212 according to embodiments.

The processor 212 and components of the processor 212 may control the electronic device 110 to perform steps S710 to S740 included in the image filtering method of FIG. 7 . For example, the processor 212 and components of the processor 212 may be implemented to execute instructions according to an operating system code and at least one program code included in the memory 211 .

Here, components of the processor 212 are performed by the processor 212 according to commands provided by program codes stored in the electronic device 110 (for example, commands provided by applications running in the electronic device 110). may be representations of different functions of the processor 212 being For example, the filtering setting unit 610 may be used as a functional representation of the processor 212 that controls the electronic device 110 according to the above-described command so that the electronic device 110 sets conditions for image filtering. .

In step S710, the processor 212 may read necessary commands from the memory 211 loaded with commands related to control of the electronic device 110. In this case, the read command may include a command for controlling the processor 212 to execute steps S720 to S740 to be described later.

In step S720, the filtering setting unit 610 may set a keyword list including at least one keyword as a condition for image filtering. The keyword list for image filtering may be determined by the user's setting of the electronic device 110, and keywords determined as default values based on information (eg, age, etc.) related to the user of the electronic device 110 may be further selected. can include In addition, the keyword list may be collectively set for all chat rooms of the messenger installed in the electronic device 110, or may be set for each chat room as an individual condition.

In step S730, the message receiving unit 620 may receive a conversation message transmitted by another user through a chat room including a user of the electronic device 110. At this time, the received message contains information about an image sent by another user. In the case of an included image type message, keywords extracted from the corresponding image may be received together. In other words, the message receiver 620 may receive a chat message including a keyword extracted from the image from the server 150 about the image transmitted to the user of the electronic device 110 through the chat room. In this case, the conversation message may further include a thumbnail of an image transmitted to the user of the electronic device 110 .

In step S740, the image filtering unit 630, in the process of displaying the conversation messages exchanged by the user of the electronic device 110 in the chat room, in the case of an image type message, if the keyword received with the message is included in the keyword list You can restrict image exposure in chat rooms. The image filtering unit 630 stores keywords extracted from corresponding images for each image type message in a local storage space (eg, memory 211), and then filters images when the stored keywords match keywords set as conditions for image filtering. can be performed. For example, the image filtering unit 630 may indicate that the image received through the chat room belongs to the filtering target by displaying only keywords included in the image type message, that is, keywords extracted from images, in the chat room. As another example, the image filtering unit 630 applies a filtering effect (eg, blur processing, etc.) to limit image exposure to thumbnails when displaying a thumbnail of a corresponding image when displaying an image type message in a chat room. It may indicate that the received image is an image belonging to the filtering target. As another example, when displaying an image type message in a chat room, the image filtering unit 630 may request separate authentication (eg, adult authentication, password authentication, etc.) to indicate that an image received through the chat room belongs to a filtering target. there is. When a user request is input for an image to be filtered or authentication is completed, the image filtering unit 630 requests the server 150 to download the corresponding image and store the image locally. At this time, the image filtering unit 630 may also store keywords extracted from the image for each downloaded image.

Furthermore, if the image transmitted to the user of the electronic device 110 corresponds to pornographic content, the image filtering unit 630 may automatically hide or delete the corresponding image regardless of filtering conditions. On the other hand, the image filtering unit 630, contrary to limiting the image exposure, if the image transmitted to the user of the electronic device 110 matches a specific keyword set in advance by the user, immediately without a separate user request. You can download it and save it locally automatically. In addition, the image filtering unit 630 may output a keyword extracted from a corresponding image as voice through text to speech (TTS) when an image type message is received in a chat room for accessibility of the visually impaired. In addition, the image filtering unit 630 may automatically recommend an image that matches the entered keyword among images downloaded and stored through the chat room when a keyword is input into the message input window or search window of the chat room.

Accordingly, the client side in which the messenger is installed may perform image filtering on images exchanged through the chat room of the messenger using keywords extracted from images.

As described above, the subject for extracting keywords related to the image may be the server 150, and in some cases, the originating client or the receiving client may be the keyword extracting subject.

8 to 10 are flowcharts illustrating an image filtering process according to an embodiment of the present invention. A situation in which user A of the electronic device 110 sends an image to user B of the electronic device 120 is assumed.

8 illustrates an image filtering process when the server 150 is a subject of keyword extraction.

The electronic device 110 may upload the selected image to the server 150 when user A selects an image to be shared through the chat room with user B (S81).

When an image is received from the electronic device 110, the server 150 may extract keywords related to the image from the received image (S82).

The server 150 may store the image received from the electronic device 110 together with a keyword extracted from the corresponding image (S83).

The server 150 may deliver an image type message as a chat message for an image received from the electronic device 110, that is, an image sent by user A, to the electronic device 120 of user B through the corresponding chat room (S84).

The image type message delivered to the electronic device 120 may include a keyword extracted from the image or a thumbnail of the corresponding image together with the keyword extracted from the image.

In the process of displaying chat messages exchanged with user A in the chat room with user A, the electronic device 120 may perform image filtering in the chat room by using a keyword extracted from an image in the case of an image type message (S85).

9 illustrates an image filtering process when the electronic device 110, which is the originating client, is the subject of keyword extraction.

When an image to be shared with user B is selected by user A through a chat room, the electronic device 110 may extract a keyword related to the image from the selected image (S91).

The electronic device 110 may provide a keyword extracted from the image to user A through an editing screen before uploading the image to the server 150, and at this time, user A may check the keyword extracted from the image through the editing screen. You can edit, edit, add, or delete keywords as needed.

The electronic device 110 may locally store the image selected by user A and related keywords (extracted keywords or edited keywords) and then upload them to the server 150 (S92).

The server 150 may store the image and keywords received from the electronic device 110 together (S93).

The server 150 may deliver an image type message as a chat message for an image received from the electronic device 110, that is, an image sent by user A, to the electronic device 120 of user B through the corresponding chat room (S94).

The image type message delivered to the electronic device 120 may include a keyword extracted from the image or a thumbnail of the corresponding image together with the keyword extracted from the image.

In the process of displaying chat messages exchanged with user A in the chat room with user A, the electronic device 120 may perform image filtering in the chat room by using a keyword extracted from an image in the case of an image type message (S95).

10 illustrates an image filtering process when the electronic device 120, which is a receiving client, is a subject of keyword extraction.

When an image to be shared by user A through a chat room with user B is selected, the electronic device 110 may upload the selected image to the server 150 (S101).

When an image is received from the electronic device 110, the server 150 may store the received image (S102).

The server 150 may deliver an image type message as a chat message for an image received from the electronic device 110, that is, an image sent by user A, to the electronic device 120 of user B through the corresponding chat room (S103).

The image type message transmitted to the electronic device 120 may include a thumbnail of an image.

In the process of displaying conversation messages exchanged with user A in the chat room with user A, the electronic device 120 may extract a keyword related to the image from the thumbnail image in the case of an image type message (S104).

The electronic device 120 may locally store the thumbnail image and keywords of the image sent by user A, and then perform image filtering in the corresponding chat room using the keywords extracted from the thumbnail image (S105).

An entity that extracts a keyword related to an image can be used as a keyword extraction entity when a learning model for keyword extraction is included in the server 150 as well as the originating client or the receiving client.

The receiving client may limit image exposure in the chat room when a keyword extracted from an image is included in a keyword list set as a filtering condition.

Referring to FIG. 11, the electronic device 120 displays a conversation message exchanged with user A in a chat room 1100 with user A. At this time, when user A transmits an image, the thumbnail is not displayed and extracted from the image Image exposure can be limited by displaying the image type message 1110 only with keywords.

Referring to FIG. 12 , when displaying an image type message 1220 using a thumbnail image in a chat room 1200 with user A, the electronic device 120 may limit image exposure by blurring the thumbnail. In this case, it is possible to display the image of an object together with a keyword extracted from the image.

Even if the image is subject to filtering with limited image exposure, when user B inputs the download menu 1111 (1221) associated with the image type message 1110 (1220), the electronic device 120 requests the server 150 to send the image Images corresponding to the type messages 1110 and 1220 may be downloaded and stored locally.

As such, according to embodiments of the present invention, images to be shared through a chat room may be automatically filtered using keywords extracted from images.

The devices described above may be implemented as hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in the embodiments include a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), and a programmable PLU (programmable logic unit). logic unit), microprocessor, or any other device capable of executing and responding to instructions. The processing device may run an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of software. For convenience of understanding, there are cases in which one processing device is used, but those skilled in the art will understand that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it can include. For example, a processing device may include a plurality of processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

Software may include a computer program, code, instructions, or a combination of one or more of the foregoing, which configures a processing device to operate as desired or processes independently or collectively. The device can be commanded. The software and/or data may be embodied in any tangible machine, component, physical device, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. there is. Software may be distributed on networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. In this case, the medium may continuously store a program executable by a computer or temporarily store the program for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or combined hardware, but is not limited to a medium directly connected to a certain computer system, and may be distributed on a network. Examples of the medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROM and DVD, magneto-optical media such as floptical disks, and ROM, RAM, flash memory, etc. configured to store program instructions. In addition, examples of other media include recording media or storage media managed by an app store that distributes applications, a site that supplies or distributes various other software, and a server.

As described above, although the embodiments have been described with limited examples and drawings, those skilled in the art can make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from the method described, and/or components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

Claims (18)

In the image filtering method executed on a server implemented by a computer,
The server includes at least one processor configured to execute computer readable instructions contained in memory;
The image filtering method,
receiving, by the at least one processor, an image transmitted from a user's electronic device included in the chat room through a chat room of a messenger;
analyzing, by the at least one processor, the image;
Classifying, by the at least one processor, the image based on an analysis result of the image; and
Limiting, by the at least one processor, display of the image on electronic devices of other users included in the chat room based on a classification result of the image.
including,
The limiting step is
Limiting display of the image based on information about the image
including,
The image filtering method of claim 1 , wherein the information about the image includes information indicating that the image belongs to a filtering target. In the image filtering method executed on a server implemented by a computer,
The server includes at least one processor configured to execute computer readable instructions contained in memory;
The image filtering method,
receiving, by the at least one processor, an image transmitted from a user's electronic device included in the chat room through a chat room of a messenger;
analyzing, by the at least one processor, the image;
Classifying, by the at least one processor, the image based on an analysis result of the image; and
Storing, by the at least one processor, information about the image based on a classification result of the image
including,
The image filtering method of claim 1 , wherein the information about the image includes information indicating that the image belongs to a filtering target. According to claim 1 or 2,
The analysis step is
Analyzing the image using a modeled learning model
Image filtering method comprising a. According to claim 1 or 2,
The analysis step is
Analyzing the image using a database capable of interworking with the server
Image filtering method comprising a. According to claim 1 or 2,
The image includes a video
Image filtering method characterized by. According to claim 5,
The analysis step is
Detecting at least one object from the video
Image filtering method comprising a. According to claim 2,
The storing step is
Storing information about the image in association with the chat room
Image filtering method comprising a. According to claim 2,
The storing step is
Storing the image as data related to the chat room
Image filtering method comprising a. According to claim 2,
The storing step is
Storing keywords extracted from the image in association with the image
Image filtering method comprising a. According to claim 2,
The image filtering method,
Managing, by the at least one processor, the image based on information about the image.
Image filtering method further comprising a. According to claim 2,
The image filtering method,
Transmitting, by the at least one processor, a message including information about the image to another user's electronic device included in the chat room.
Image filtering method further comprising a. A computer program stored in a computer readable recording medium to cause the computer system to execute the image filtering method according to any one of claims 1, 2, or 7 to 11. In a server implemented by a computer,
at least one processor implemented to execute computer readable instructions contained in memory;
including,
The at least one processor,
receiving an image transmitted from a user's electronic device included in the chat room through a chat room of a messenger;
analyzing the image;
classifying the image based on an analysis result of the image; and
Limiting display of the image on electronic devices of other users included in the chat room based on a classification result of the image
processing,
The limiting process is
Limiting the display of the image based on information about the image
including,
The server, wherein the information on the image includes information indicating that the image belongs to a filtering target. In a server implemented by a computer,
at least one processor implemented to execute computer readable instructions contained in memory;
including,
The at least one processor,
receiving an image transmitted from a user's electronic device included in the chat room through a chat room of a messenger;
analyzing the image;
classifying the image based on an analysis result of the image; and
Storing information about the image based on a classification result of the image
processing,
The server, wherein the information on the image includes information indicating that the image belongs to a filtering target. According to claim 13 or 14,
The image includes a video
A server characterized by According to claim 15,
The analysis process is
Process of detecting at least one object from the video
Server containing . According to claim 14,
The saving process is
Process of saving the image as data related to the chat room
Server containing . According to claim 14,
The saving process is
A process of storing keywords extracted from the image in association with the image
Server containing .

Images