KR102482924B1 - non-face-to-face communication system through repulsive force - Google Patents

Abstract

The present invention relates to a face-centered non-face-to-face communication system through repulsive force, which includes: a user terminal unit which selectively obtains and transmits image information of a user or predetermined information of a user from a user terminal; a consultant terminal unit which selectively obtains image information of a consultant from a consultant terminal and selectively provides predetermined information through networking with the user; a mediating unit which mutually mediates communication between the user and the consultant; and a layout unit which selectively arranges a communication space output from a user terminal unit during communication between the user and the consultant.

Description

Face-centric non-face-to-face communication system through repulsive force {non-face-to-face communication system through repulsive force}

The present invention relates to a face-centered non-face-to-face communication system through repulsive force. More specifically, in communication between a user and a consultant, it is a technical field related to a system that provides non-face-to-face communication centering on the face of a user or consultant by selectively controlling the arrangement of a communication space output to a user's terminal.

According to a recent online media report (Medical Communications 2020.11.18.), Amazon, the world's largest e-commerce company, has entered the pharmacy business, making the US pharmacy market, which is estimated to be worth up to $500 billion, approximately 553 trillion won in Korean currency, excited. is said to be

On November 18, 2020, based on Korean time, according to reports such as Reuters and CNBC in the United States, Amazon, the world's largest online mall company, is based on the Pill Pack system, an online pharmacy acquired two years ago, (Amazon Pharmacy) is said to have launched a new online pharmacy service.

In the case of the new service that will be conducted through Amazon Pharmacy, all prescription drugs, except for 　controlled drugs such as opioids, which are synthetic anesthetics, can be ordered 　online　, and 　free shipping is also possible.

Amazon's "online pharmacy service" can be used by any Amazon customer over the age of 18 in 45 states, excluding five states, including Hawaii, Illinois, and Minnesota, and Prime customers can enjoy the benefit of free shipping. In addition, doctors who are not patients themselves can send prescriptions directly to Amazon Pharmacy.

The background that made this service possible is because Amazon acquired the online pharmacy ‘PillPack’ for $753 million in 2018 and equipped it with related systems, the US media reported.

There are many technical attempts in relation to this online business model, and some prior technologies for this also exist.

As an example of prior patent documents related to this, there exists a “image communication system (Registration No. 10-2177691, hereinafter referred to as Patent Document 1)”.

In the case of the invention according to Patent Document 1, it includes a webcam, a user terminal, a monitor unit, a microphone, and a speaker installed and operated in a place where each user participating in a meeting or education using video communication is located, and each user terminal Through image communication application programs installed in each user terminal in conjunction with, image information linked to each user terminal is input together with a unique authentication number of each user terminal, and user image information for each user terminal is generated, and user image information After collecting them by a preset program to create shared image information, the shared image information is output through the image communication application program of the user terminal, so that each user using the user terminal shares the shared image information. Image streaming communication server; And, in conjunction with each user terminal, through the video communication application programs installed in each user terminal, a voice electrical signal interworking with each user terminal is input together with a unique authentication number of each user terminal, and user voice signal information for each user terminal is received. A voice communication server that generates and outputs the audio signal information through the video communication application program of the user terminal so that each user using the user terminal outputs the audio signal information to share; includes, the video communication server is a shared video When transmitting information to each user terminal, a traffic measurement unit for measuring traffic transmitted to each user terminal in real time; And, when the traffic capacity measured by the traffic measurement unit increases above the first level level set in advance, the frame per second of the shared video information transmitted by each user terminal in the video communication server is lowered to less than the first level level It may be configured to further include a; frame control unit.

As another example of a patent document, there is “a method and server for providing real-time counseling (Publication No. 10-2018-0060872, hereinafter referred to as Patent Document 2)”.

In the case of the invention according to Patent Document 2, providing a counseling inducing interface including a counseling start screen for triggering counseling to the first user terminal—the counseling start screen is associated with online content accessed by the first user terminal— ; providing a first consultation interface for providing a real-time chatting window between the first user terminal and the second user terminal to the first user terminal when a selection input for a consultation start screen is received from the first user terminal; And when receiving a selection input for viewing together the content related to the first content from at least one of the first user terminal and the second user terminal, the first user terminal can output the real-time chat window and the first content together. providing a second counseling interface composed of a plurality of layers to one user terminal; A method for providing real-time non-face-to-face counseling by a server, wherein a first layer of the plurality of layers includes a consultation chatting layer, and a second layer of the plurality of layers includes a first content output layer. this is provided

As another example of a patent document, “a service system and method for implementing an overlay writing function on video and video screens during a video conference (Registration No. 10-2174290, hereinafter referred to as Patent Document 3)” exists.

In the case of the invention according to Patent Document 3, the step of receiving the service consultation request of the first terminal to the call center system or server; Sending a message including a video conference access address to a first terminal by a call center system or server; When the first terminal connects to the video conference and transmits the customer image to the server, the server connects the video conference with the second terminal of the counselor; allowing the server to share the manual guide video uploaded by the second terminal with the first terminal; and transmitting, by the server, the writing data of the second terminal to the first terminal and displaying the writing data.

As another example of a patent document, “image-based expert matching platform providing system (Registration No. 10-2075506, hereinafter referred to as Patent Document 4)” exists.

In the case of an invention according to Patent Document 4, a member sign-up module including an expert subscription unit receiving expert information including specialized field information from an expert and a user joining unit receiving client information including interest field information from a user; A matching module for creating a counseling group by designating one of the experts as a counselor for the user according to the match between the user's field of interest information and the field of expertise; A mediation module including a page creation unit for generating a consultation page for online video consultation and a consultation progress unit for conducting video consultation as all members of the consultation group are connected to the consultation page; It is characterized by including a counselor evaluation module including a numerical input unit receiving an evaluation result of the counselor from the user as the video consultation is completed, and a result providing unit providing the evaluation result to the counselor.

Registration No. 10-2177691 Publication No. 10-2018-0060872 Registration No. 10-2174290 Registration No. 10-2075506

The face-centered non-face-to-face communication system through repulsive force according to the present invention was devised to solve the conventional problems as described above, and presents the following problems to be solved.

First, the user's image information is acquired to enable online non-face-to-face communication.

Second, the communication space displayed on the user's terminal is centered on the user's face area.

Third, predetermined information output to the communication space can be arranged so as not to invade the user's face area.

The problems to be solved in the present invention are not limited to those mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

The face-centered non-face-to-face communication system through the repulsive force according to the present invention has the following problem solving means for the above problem to be solved.

A face-centered non-face-to-face communication system through repulsive force according to the present invention includes a user terminal unit that selectively obtains and transmits video information of a user or predetermined information of a user from a user terminal; a consultant terminal unit that selectively obtains image information of a consultant from a consultant terminal and selectively provides predetermined information through networking with the user; The user terminal unit receives image information of the user or predetermined information information of the user from the user terminal unit and transmits the received image information of the consultant to the consultant terminal unit and receives the video information of the consultant or predetermined information from the consultant terminal unit. a mediating unit for mutually mediating communication between the user and the consultant by transmitting the data to the unit; and a layout unit selectively arranging a communication space output from the user terminal unit during the communication between the user and the consultant.

The mediating unit of the face-centered non-face-to-face communication system through repulsive force according to the present invention includes: a networking unit that connects the user terminal and the consultant terminal to achieve networking; and a transmitter for receiving the image information of the consultant or the predetermined information information from the consultant terminal unit and transmitting the received image information to the user terminal unit.

The layout unit of the face-centered non-face-to-face communication system through repulsive force according to the present invention includes: an image locating unit in which the image information is allocated and disposed in a predetermined area of the communication space; and an information locating unit selectively allocating and disposing the predetermined information in a preset area other than the predetermined area of the communication space.

In the information locating unit of the face-centered non-face-to-face communication system through the repulsive force according to the present invention, the predetermined information is selectively floated in the communication space according to an arbitrary condition and is selectively in the preset area It can be characterized by being arranged as.

In the layout unit of the face-centered non-face-to-face communication system through repulsive force according to the present invention, a repulsive force interacts between the predetermined area and the preset area, and the repulsive force As a result, the image information and the predetermined information may be selectively disposed without overlapping each other.

The image locating unit of the face-centered non-face-to-face communication system through the repulsive force according to the present invention, the image information allocated to the predetermined area is selectively shifted by the repulsive force. It may be characterized in that it includes a tingbu.

The image locating unit of the face-centered non-face-to-face communication system through the repulsive force according to the present invention, in the case of the image information allocated to the predetermined area, the predetermined shifted by the repulsive force in the communication space It may further include an image resizing unit for selectively resizing the image information by calculating information of an area other than an area to which information of is allocated.

The image locating unit of the face-centered non-face-to-face communication system through the repulsive force according to the present invention detects the position of the face or hand of the user or the consultant in real time from the image information Image detecting It may be characterized in that it further includes a part.

The information locating unit of the face-centered non-face-to-face communication system through repulsive force according to the present invention, the predetermined information does not interfere with the position of the face or hand detected from the image information and is selectively floated can be characterized.

The information locating unit of the face-centered non-face-to-face communication system through repulsive force according to the present invention selectively adjusts the opacity value of the predetermined information, and among the image information, the face or hand It may be characterized in that the predetermined information is selectively overlapped and floated in an area except for .

The face-centered non-face-to-face communication system through the repulsive force according to the present invention configured as described above provides the following effects.

First, online non-face-to-face communication can be achieved by selectively acquiring user information and consultant information.

Second, during communication between the user and the consultant, image information and info information can be selectively arranged in the communication space output on the user's terminal.

Third, predetermined information information output to the communication space can be arranged so as not to invade the area to which the image information of the user or the image information of the consultant is allocated.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

1 is a conceptual diagram of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention.
2 is a conceptual diagram of a mediating unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention.
3 is a conceptual diagram of a layout unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention.
4 is a conceptual diagram of an image shifting unit and an image resizing unit of an image rotating unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention.
5 is a conceptual diagram of an image shifting unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention.
6 is a conceptual diagram of an image detecting unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention.
7 is a block diagram of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention.
8 is a block diagram of a mediating unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention.
9 is a block diagram of a layout unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention.

Since the face-centered non-face-to-face communication system through repulsive force according to the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, or substitutes included in the technical spirit and scope of the present invention.

1 is a conceptual diagram of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention. 2 is a conceptual diagram of a mediating unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention. 3 is a conceptual diagram of a layout unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention. 4 is a conceptual diagram of an image shifting unit and an image resizing unit of an image rotating unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention. 5 is a conceptual diagram of an image shifting unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention. 6 is a conceptual diagram of an image detecting unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention. 7 is a block diagram of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention. 8 is a block diagram of a mediating unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention. 9 is a block diagram of a layout unit of a face-centered non-face-to-face communication system through repulsive force according to an embodiment of the present invention.

As shown in FIGS. 1 and 7, the face-centered non-face-to-face communication system through repulsive force according to the present invention includes a user terminal unit 100, a consultant terminal unit 200, a mediating unit, 300) and a layout unit (400).

First, the meaning of the unit mentioned in these components does not refer to a specific product, part, or other tangible unit, but to a conceptual unit of a technical idea in which the technical idea that describes these units is implemented.

Therefore, these units should be understood as concepts of technical functions implemented on products, parts, or other tangible objects, not specific products, parts, or other tangible objects themselves.

In the case of the user terminal unit 100, it is a configuration that selectively obtains and transmits image information of a user or predetermined information of a user from a user terminal.

Although reference numeral 100 indicates the mobile terminal or smartphone in FIG. 1, the user terminal unit 100 is a terminal possessed by these users, such as a smartphone, a laptop PC, a desktop PC, and a tablet. It should be understood as a concept in which the technical functions described by the user terminal unit 100 in the form of a PC and the technical functions expressed by sub-components thereof are implemented.

That is, the user terminal unit 100 should be accessed as a conceptual unit of a technical function implemented on an application installed on a user's mobile smartphone, a program installed on a PC, or a web page accessed from the smartphone or PC. .

In addition, in the user terminal unit 100, the acquired image information of the user is an image captured through a camera or cam of the user terminal or a real-time video, and the user's face is preferably included. In addition, the user's predetermined info information preferably includes all information such as the user's personal information and symptom information, or the user's information or opinions related to communication.

In the case of the consultant terminal unit 200, it is a configuration that selectively obtains video information of the consultant from the consultant terminal and selectively provides predetermined information through networking with the user.

As shown in FIG. 2, the consultant terminal unit 200 also has the technical functions and functions of the consultant terminal unit 200 in the form of a terminal possessed by a consultant, such as a smartphone, laptop PC, desktop PC, tablet PC, and the like. It should be understood as a concept in which the technical functions expressed by the subcomponents are implemented.

That is, the consultant terminal unit 200 should be accessed as a conceptual unit of technical functions implemented on an application installed on a consultant's mobile smartphone, a program installed on a PC, or a web page accessed from the smartphone or PC. .

The image information of the consultant obtained from the consultant terminal unit 200 is an image or video of the consultant captured through a camera or cam installed in the consultant terminal, and preferably includes the consultant's face or upper body.

In addition, it is preferable to define all information that can be answered as a consultant, such as information, suggestions, prescriptions, etc. provided by a consultant through communication with users as predetermined information provided through networking with users. .

In the case of the mediating unit 300, as shown in FIGS. 1 and 2, the user's image information or the user's predetermined information information is received from the user terminal unit 100 and sent to the consultant terminal unit 200. send. In addition, the mediating unit 300 is a component that mediates communication between the user and the consultant by receiving image information or predetermined information of the consultant from the consultant terminal unit 200 and transmitting the received information to the user terminal unit 100 .

The mediating unit 300 connects the matched user and the consultant when the user and the consultant meet a predetermined criterion to mediate communication with each other.

At this time, according to a predetermined criterion for matching a user and a consultant, a user accessing a consulting URL is required to designate at least one or more consultants among an unspecified number of consultants, or a consultant is assigned to at least one or more consultants based on information of an unspecified number of users. Select users to be matched.

In the case of the mediating unit 300 of the face-centered non-face-to-face communication system through repulsive force according to the present invention, as shown in FIG. 8, a networking unit 310 and a transmitting unit (320) will be included.

In the case of the networking unit 310, the user terminal and the consultant terminal are connected to each other to achieve networking.

In the case of the transmitter 320, the consultant terminal unit 200 receives video information or predetermined information information of the consultant and transmits the received information to the user terminal unit 100.

Also, the transmitter 320 may receive image information of a user or predetermined information information of a user from the user terminal unit 100 and transmit the received image information to the consultant terminal unit 200 .

In the case of the layout unit 400, as shown in FIG. 3, it is a configuration that selectively arranges a communication space output from the user terminal unit 100 during communication between the user and the consultant.

The layout unit 400 enables the mediation unit 300 to selectively arrange the components of the communication space output to the user terminal when networking between the user and the consultant is made and communication is provided through mutual mediation of the mediating unit 300. .

For example, the components of the communication space can be composed of user's image information, user's predetermined information, consultant's image information, consultant's predetermined information, and the like.

In addition, the communication space is preferably defined as a communication screen displayed on a display of a user terminal, such as a smart phone, a laptop PC, a desktop PC, and a tablet PC.

In the case of the layout unit 400 of the face-centered non-face-to-face communication system through repulsive force according to the present invention, as shown in FIG. 9, an image locating unit 410 and an information locating unit 420 are included. .

First, in the case of the image locating unit 410, as shown in FIGS. 3 and 4, image information is allocated and arranged in a predetermined area of the communication space.

The image locating unit 410 enables the user's image information or the consultant's image information to be allocated to a predetermined area in the communication space among components arranged in the communication space.

At this time, in the case of the predetermined area, as shown in (b) of FIG. 3, it becomes the area of the central part and the upper part of the communication space, and the video information of the consultant and the video information of the user can be selectively arranged in the predetermined area. In the case of a predetermined area, it is preferable not to limit it to a fixed area.

For example, as shown in FIG. 3, it is preferable to arrange the consultant's video information in the center of the user terminal, and the user's video information is preferably arranged in the upper part.

In the case of the information locating unit 420, as shown in FIG. 3, predetermined information is selectively allocated and disposed in a preset area other than a predetermined area of the communication space.

The information locating unit 420 arranges predetermined information of a user or predetermined information of a consultant among components arranged in the communication space in the communication space. At this time, it is preferable that the predetermined information disposed in an area other than a predetermined area in which the image information is disposed.

In addition, through the information locating unit 420, predetermined information is selectively floated in the communication space according to an arbitrary condition and placed in a preset area.

During the communication between the user and the consultant, predetermined information is selectively floated in order to notify the user of the user's predetermined information or the consultant's counseling information or answer information, guide information, and the like as text. At this time, it is preferable that an arbitrary condition is floated when a user or consultant takes a predetermined action.

In addition, as shown in FIG. 4, a repulsive force (R) interacts between a predetermined area set through the image locating unit 410 and the information locating unit 420 and a preset area, By means of the repulsive force R, image information and predetermined information may be selectively arranged without overlapping each other. When a repulsive force (R) is formed between a predetermined area and a preset area, a force that pushes each other, that is, a repulsive force, is generated between the image information and the predetermined information by the repulsive force (R). As a result, regions of image information and predetermined information can be partitioned.

That is, since the repulsive force R is applied between the image information and the predetermined area, the image information and the predetermined information can be arranged without overlapping.

In the case of the image locating unit 410 of the face-centered non-face-to-face communication system through the repulsive force according to the present invention, as shown in FIG. 9, the image shifting unit 411, the image resizing unit 412, and the image detecting unit (413) will be included.

In the case of the image shifter 411, as shown in FIG. 4, image information allocated to a predetermined area is selectively shifted by a repulsive force (R).

The image shifting unit 411 shifts image information and predetermined information by the action of the repulsive force R so that they do not overlap.

Also, as shown in FIG. 5, the image shifting unit 411 may shift according to the center of the area of image information and predetermined information. It is shifted only when a predetermined criterion is satisfied based on the center point (G1) of the consultant's image information and the center point (G2) of the predetermined information.

For example, as shown in FIG. 5, when the center point G2 of predetermined information exceeds the center point G1 of consultant image information, shifting of consultant image information and predetermined information occurs. At this time, when the positions of the video information of the consultant and the predetermined information are shifted, a predetermined area and a preset area are switched. Therefore, it is preferable to apply a delay of 0.5 seconds for a natural transition of the area.

In the case of image resizing 412, as shown in FIG. 4, in the case of image information allocated to a predetermined area, excluding the area to which predetermined information shifted by repulsive force R is allocated in the communication space. This is a configuration in which information of an area is calculated and image information is selectively resized according to the calculated area.

Image resizing 412 calculates area information other than the space occupied by predetermined information so that the image information and predetermined information do not overlap, and selectively adjusts the size and ratio of the video information according to the area information.

At this time, the image resizing 412 may perform resizing regardless of the ratio of image information or resizing according to an initially set ratio of image information, which is preferably resized selectively by a user or consultant.

In the case of the image detector 413, as shown in FIG. 6, it is a component that detects the position of the user's or consultant's face or hand from image information in real time.

The reason for detecting the position of the user's or consultant's face or hand through the image detector 413 is that the eyes and hand gestures are important in communication, and when the face and hand parts including the eyes are covered by predetermined information, etc. , Since the reliability of the user or consultant may be reduced during communication, it is desirable to detect the position of the face or hand in real time so that the corresponding part is not covered.

In addition, the image detecting unit 413 detects the location of the user's or consultant's face and hands from image information by applying a physics engine or a modularized function that distinguishes and identifies faces that have already been commercialized, and detailed mechanisms are omitted.

In the information locating unit 420, predetermined information may be selectively plotted without interfering with the position of the face or hand detected from the image information.

In addition, by selectively adjusting the opacity value of predetermined information, if predetermined information selectively overlaps an area other than the face or hand among image information, it can be floated.

The scope of the rights of the present invention is determined by the matters described in the claims, and parentheses used in the claims are not written for selective limitation, but are used for clear components, and descriptions in parentheses are also interpreted as essential components. It should be.

100: user terminal unit
200: consultant terminal unit
300: mediating unit
310: networking unit
320: transmission unit
400: layout unit
410: image locating unit
411: video shifting unit
412: image resizing unit
413: image detecting unit
420: information locating unit
G: center point
R: Repulsive Force

Claims (10)

a user terminal unit that selectively obtains and transmits video information of a user or predetermined information of a user from a user terminal;
a consultant terminal unit that selectively obtains image information of a consultant from a consultant terminal and selectively provides predetermined information through networking with the user;
The user terminal unit receives video information of the user or predetermined information information of the user from the user terminal unit and transmits the video information of the consultant to the consultant terminal unit. a mediating unit for mutually mediating communication between the user and the consultant by transmitting the data to the unit; and
A layout unit for selectively arranging a communication space output from the user terminal unit during the communication between the user and the consultant;
The layout unit,
an image locating unit that allocates and arranges the image information to a predetermined area of the communication space; and
The predetermined information is selectively allocated and disposed in a preset area other than the predetermined area of the communication space;
The predetermined information includes an information locating unit selectively floating in the communication space according to an arbitrary condition and selectively disposed in the preset area;
A repulsive force interacts between the predetermined area and the preset area, so that the image information and the predetermined information are not overlapped by the repulsive force and are selectively disposed,
The image locating unit,
an image shifting unit for selectively shifting the image information allocated to the predetermined area by the repulsive force; and
In the case of the image information allocated to the predetermined area, the image information is selectively resized by calculating information of an area excluding the area to which the predetermined information shifted by the repulsive force is allocated in the communication space ( resizing) includes an image resizing unit,
The image shifting unit,
It is selectively shifted according to the area center of the image information and the predetermined information, and the center point (G1) of the image information and the center point (G2) of the predetermined information are selectively shifted when a predetermined criterion is satisfied. Characterized by a face-centered non-face-to-face communication system through repulsive force.
The method of claim 1, wherein the mediating unit,
a networking unit that interconnects the user terminal and the consultant terminal to perform networking; and
A face-centered non-face-to-face communication system through repulsive force, characterized in that it comprises a transmitting unit for receiving the video information or the predetermined information information of the consultant from the consultant terminal unit and transmitting it to the user terminal unit.
delete delete delete delete delete The method of claim 1, wherein the image locating unit,
A face-centered non-face-to-face communication system through repulsive force, characterized in that it further comprises an image detecting unit for detecting the position of the face or hand of the user or the consultant in real time from the image information.
The method of claim 8, wherein the information locating unit,
The predetermined information does not interfere with the position of the face or hand detected from the image information and is selectively floated.
The method of claim 8, wherein the information locating unit,
By selectively adjusting the opacity value of the predetermined information, the predetermined information is selectively overlapped and floated in an area other than the face or hand among the image information, repulsive force A face-oriented non-face-to-face communication system through

Images