KR102174290B1 - Overlay boarding function service system and method on video and image screen during video conference - Google Patents

Abstract

The present invention relates to a service system and method for implementing an overlay writing function on a video and video screen during a video conference, wherein a service consultation request from the first terminal 310 is sent to the call center system 200 or the server 110 Receiving as; Transmitting, by the call center system 200 or the server 110, a message including a video conference access address to the first terminal 310; When the first terminal 310 accesses the video conference and transmits the customer video to the server 110, the server 110 connects the video conference with the second terminal 320 of the counselor; Allowing the server 110 to share the manual guide video uploaded by the second terminal 320 with the first terminal 310; The server 110 transmits and displays the writing data of the second terminal 320 to the first terminal 310, and provides a function of simply writing on the video of the video conference during a video conference. It provides the ability to write on the video provided for sharing among video conference participants during video conference.

Description

Overlay boarding function service system and method on video and image screen during video conference}

The present invention relates to a service system and method for implementing an overlay writing function on a video and video screen during a video conference, providing a function to write on a video conference person's video during a video conference, and video conference during a video conference. Provides the ability to write on the video provided for sharing between parties, and saves and provides the overlaid written video in the form of writing or in the form of a video from which the overlay written content has been removed. It relates to a service system and method for implementing an overlay writing function.

The content described below merely provides background information related to the present invention and does not constitute the prior art.

There are various technologies related to video conferencing due to the development of current information and communication technologies.

In general, when a conference is conducted using a plurality of information terminals such as a video conference, a mobile device equipped with a touch screen or a pen is used to transmit and display the own screen on a large display.

At this time, a plurality of information terminals are divided into a server 110 and a client, and in this case, since the server 110 can be used only as one, it is necessary to conduct a meeting interactively or to exchange between instructors and trainees. There were many difficulties in using it in the educational field.

For example, when conducting a meeting at a company, the meeting was usually held while sharing the screen by displaying the screen of a specific PC on a large display. This is effective in unilaterally transmitting the speaker's information to a large number of people, but when a question or detailed additional explanation is needed, there is a problem in that it is necessary to refer to the screen or directly operate the speaker's device.

As described above, when someone in the conference participant asks a question or needs specific additional explanation, the input device of the PC connected to the large display has to be used.

Therefore, there is an inconvenience of having to move to the PC or move the wireless mouse to the questioner during the meeting.

In the case of academy, the screen of the instructor's information terminal, such as a tablet, is connected to a TV so that a large number of students can see the screen of the terminal, but only the contents written by the instructor's information terminal are displayed on a large TV. Because of this, there is a problem that students cannot conduct interactive classes.

In order to solve this problem, “a method and apparatus for sharing writing between terminals connected to a network” is disclosed in Korean Patent No. 1,687,901.

In this prior art, not only information written by the server 110 but also information written by an information terminal designated as each client can be displayed on a large display or an entire information terminal through the server 110, enabling interactive conferences. .

However, such a conventional technique displays a screen of one user on a display device and writes, but there is a cumbersome problem since each user must write while changing the authority of the server 110.

In addition, the prior art has an inconvenient problem because there is no function of freely adding or removing writing information or recording.

The technical problem to be achieved by the present invention is to solve the conventional problem, providing a function to simply write on the video of the video conferee during a video conference, and writing on the video provided for sharing between video conference parties during a video conference. It provides the function to perform and implements an overlay writing function on the video and video screens during video conferences that can store and provide the image that has been overlaid in the form of writing or in the form of an image from which the content of the overlay writing has been removed. It is to provide a service system and method.

In addition, the technical problem to be achieved by the present invention is to solve the conventional problem, a function that allows one user or a plurality of users to write simultaneously or sequentially on a video provided for sharing between video conference parties during a video conference. Provides, and overlays images and video screens during video conferences that can store and provide images that have been written by various users in the form of multiple writings, single writings, or images from which the overlay writing contents have been removed. (Overlay) To provide a service system and method that implements the writing function.

In addition, the technical problem to be achieved by the present invention is to solve the conventional problem, and provides a function of simply writing on the video of the video conference by linking with the call center system 200 to write on the video of the video conference. Provides a function to write on the video provided for sharing among conference participants, and video and video screens during video conferences that allow saving and provision of the overlaid written video in the form of writing or in the form of the overlay writing content removed It is to provide a service system and method that implements the overlay writing function.

A service system that implements an overlay writing function on video and video screens during video conference according to a feature of the present invention for solving these problems,

As a service system that implements an overlay writing function on images and video screens during video conferences, which services video conferences between a first terminal 310 and a second terminal 320 of a plurality of users,

A first image data transmission unit 132 for transmitting data of the image of the first terminal 310;

A first overlay writing data transmission unit 133 for transmitting the overlay writing data of the first terminal 310;

A first image data receiving unit 134 for receiving image data;

A first overlay writing data receiving unit 135 for receiving overlay writing data;

A first synthesis processing unit 131 that combines the image data received by the first image data receiving unit 134 and the overlay writing data received by the first overlay writing data receiving unit 135 and displays them on the first terminal 310 ;

A second image data transmission unit 142 for transmitting data of the image of the second terminal 320;

A second overlay writing data transmission unit 143 for transmitting the overlay writing data of the second terminal 320;

A second image data receiving unit 144 for receiving image data;

A second overlay writing data receiving unit 145 for receiving overlay writing data;

A second synthesis processing unit 141 that combines the image data received by the second image data receiving unit 144 and the overlay writing data received by the second overlay writing data receiving unit 145 and displays them on the second terminal 320 ;

Receives the output data of the first image data transmission unit 132 and the first overlay writing data transmission unit 133 and transmits it to the second image data receiving unit 144 and the second overlay writing data receiving unit 145,

A server 110 that receives output data from the second image data transmission unit 142 and the second overlay writing data transmission unit 143 and transmits the data to the first image data reception unit 134 and the first overlay writing data reception unit 135 ).

The server 110,

Further comprising a database for storing image data and writing data,

The image data and writing data received from the first terminal 310 and the second terminal 320 are recorded in the database unit 120.

Further comprising a call center system 200 for conducting consultation by connecting calls between the first terminal 310 or the second terminal 320, and requesting the first terminal 310 or the second terminal 320 Accordingly, the call center system 200 is characterized in that it requests a video conference from the server 110.

A service method for implementing an overlay writing function on a video and video screen during a video conference according to a feature of the present invention for solving these problems,

As a service method of a service system that provides a video conference service between a first terminal 310 and a second terminal 320 of a plurality of users, and implements an overlay writing function on images and video screens during a video conference,

Allowing the call center system 200 to make a call with the second terminal 320 according to the request of the first terminal 310;

Connecting, by the server 110, a video conference between the first terminal 310 and the second terminal 320 at the request of the first terminal 310 or the second terminal 320;

Transmitting, by the server 110, an image of a customer received from the first terminal 310 to a second terminal 320;

And transmitting, by the server 110, the image selected by the counselor received from the second terminal 320 and the overlay writing data written by the counselor to the first terminal 310.

A service method for implementing an overlay writing function on a video and video screen during a video conference according to another feature of the present invention for solving these problems,

As a service method of a service system that provides a video conference service between a first terminal 310 and a second terminal 320 of a plurality of users, and implements an overlay writing function on images and video screens during a video conference,

Receiving a service consultation request from the first terminal 310 to the call center system 200 or the server 110

Transmitting, by the call center system 200 or the server 110, a message including a video conference access address to the first terminal 310;

When the first terminal 310 accesses the video conference and transmits the customer video to the server 110, the server 110 connects the video conference with the second terminal 320 of the counselor;

Allowing the server 110 to share the manual guide video uploaded by the second terminal 320 with the first terminal 310;

The server 110 transmits and displays the writing data of the second terminal 320 to the first terminal 310.

The server 110,

The image data and writing data received from the first terminal 310 and the second terminal 320 are recorded in the database unit 120.

The server 110 is characterized by storing image data, writing data of the first terminal 310, and writing data of the second terminal 320, respectively.

The server 110,

The image data,

Data obtained by combining the image data and writing data of the first terminal 310,

Data obtained by combining the image data and writing data of the second terminal 320,

The image data, the writing data of the first terminal 310 and the writing data of the second terminal 320 are all combined and stored, respectively.

In an embodiment of the present invention, a function to write on the video of a video conferee is provided at the time of a video conference, and a function to write on a video provided for sharing between video conference participants is provided during a video conference, and an overlay writing It is possible to provide a service system and method that implements an overlay writing function on images and video screens during video conferences that can store and provide images in the form of writing or in the form of images from which the content of the overlay writing has been removed.

In addition, the embodiment of the present invention provides a function that allows one user or a plurality of users to simultaneously or sequentially write on a video provided for sharing between video conference parties during a video conference, and an overlay writing of various users is provided. A service system that implements an overlay writing function on video and video screens during video conferences that can store and provide images in the form of multiple writings, one writing form, or image form from which the overlay writing content has been removed. And a method.

In addition, in the embodiment of the present invention, in connection with the call center system 200, it provides a function of simply writing on the video of the video conferee during a video conference, and writing on the video provided for sharing between video conference parties during a video conference. It provides the function to perform and implements an overlay writing function on the video and video screens during video conferences that can store and provide the image that has been overlaid in the form of writing or in the form of an image from which the content of the overlay writing has been removed. Service systems and methods can be provided.

1 is a block diagram of a service system that implements an overlay writing function on an image and a video screen during a video conference according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a service method for implementing an overlay writing function on a video and video screen during a video conference according to an embodiment of the present invention.
FIG. 3 is a diagram illustrating another example of a service method for implementing an overlay writing function on a video and video screen during a video conference according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating an example of writing an overlay when sharing an image in a service system that implements an overlay writing function on an image and a video screen during a video conference according to an embodiment of the present invention.
5 is a diagram illustrating an example of writing an overlay on an image screen in a service system that implements an overlay writing function on an image and a video screen during a video conference according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present invention. However, the present invention may be implemented in various different forms, and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are assigned to similar parts throughout the specification.

Throughout the specification, when a part "includes" a certain component, it means that other components may be further included rather than excluding other components unless otherwise stated. In addition, terms such as “……unit”, “……group”, and “module” described in the specification mean units that process at least one function or operation, which is implemented by hardware or software or a combination of hardware and software. Can be.

In addition, the server 110 described below may be implemented by a processor and a memory.

In the following, the first terminal 310 or the second terminal 320 may be a smart phone or a tablet computer equipped with a touch function, and a separate installation program is not required.

1 is a block diagram of a service system that implements an overlay writing function on an image and a video screen during a video conference according to an embodiment of the present invention.

Referring to FIG. 1, a service system for implementing an overlay writing function on a video and video screen during a video conference according to an embodiment of the present invention,

As a service system that implements an overlay writing function on images and video screens during video conferences, which services video conferences between a first terminal 310 and a second terminal 320 of a plurality of users,

A first image data transmission unit 132 for transmitting data of the image of the first terminal 310;

A first overlay writing data transmission unit 133 for transmitting the overlay writing data of the first terminal 310;

A first image data receiving unit 134 for receiving image data;

A first overlay writing data receiving unit 135 for receiving overlay writing data;

A first synthesis processing unit 131 that combines the image data received by the first image data receiving unit 134 and the overlay writing data received by the first overlay writing data receiving unit 135 and displays them on the first terminal 310 ;

A second image data transmission unit 142 for transmitting data of the image of the second terminal 320;

A second overlay writing data transmission unit 143 for transmitting the overlay writing data of the second terminal 320;

A second image data receiving unit 144 for receiving image data;

A second overlay writing data receiving unit 145 for receiving overlay writing data;

A second synthesis processing unit 141 that combines the image data received by the second image data receiving unit 144 and the overlay writing data received by the second overlay writing data receiving unit 145 and displays them on the second terminal 320 ;

Receives the output data of the first image data transmission unit 132 and the first overlay writing data transmission unit 133 and transmits it to the second image data receiving unit 144 and the second overlay writing data receiving unit 145,

A server 110 that receives output data from the second image data transmission unit 142 and the second overlay writing data transmission unit 143 and transmits the data to the first image data reception unit 134 and the first overlay writing data reception unit 135 ).

The first terminal 310 and the second terminal 320 may be terminals such as a customer, a counselor, or a video conference person, and may be plural.

The server 110,

Further comprising a database for storing image data and writing data,

The image data and writing data received from the first terminal 310 and the second terminal 320 are recorded in the database unit 120.

Further comprising a call center system 200 for conducting consultation by connecting calls between the first terminal 310 or the second terminal 320, and requesting the first terminal 310 or the second terminal 320 Accordingly, the call center system 200 is characterized in that it requests a video conference from the server 110.

The server 110 is characterized by storing image data, writing data of the first terminal 310, and writing data of the second terminal 320, respectively.

If necessary, the server 110,

The image data,

Data obtained by combining the image data and writing data of the first terminal 310,

Data obtained by combining the image data and writing data of the second terminal 320,

The image data, the writing data of the first terminal 310 and the writing data of the second terminal 320 are all combined and stored, respectively.

The server 110,

Receives the output data of the first image data transmission unit 132 and the first overlay writing data transmission unit 133 and transmits it to the second image data receiving unit 144 and the second overlay writing data receiving unit 145,

A data transmission/reception unit that receives output data from the second image data transmission unit 142 and the second overlay writing data transmission unit 143 and transmits it to the first image data reception unit 134 and the first overlay writing data reception unit 135 (111);

An image processing unit 112 that processes the image data;

An audio processing unit 113 processing an audio signal from the image data;

And a recording processing unit 114 for storing the image data.

An operation of a service system that implements an overlay writing function on video and video screens during a video conference according to an embodiment of the present invention having such a configuration will be described as follows.

An embodiment of interworking with the call center system 200 to provide an A/S related service from a customer will be described.

FIG. 2 is a diagram illustrating a service method for implementing an overlay writing function on a video and video screen during a video conference according to an embodiment of the present invention.

Referring to FIG. 2, first, a problem occurs such as that a customer does not display a TV, and the first terminal 310 connects to the call center system 200 and connects to the A/S service phone number.

Then, according to the request of the first terminal 310, the call center system 200 makes a call with the second terminal 320 (S210). At this time, the customer makes a request related to the service he wants to the counselor.

Then, you need to have the agent adjust or manipulate the customer's product, etc. However, there are cases where the customer does not understand the agent's explanation. For example, it is necessary to reset the connection line or power supply of the modem, but there are cases where the modem is not known.

Then, a customer or a counselor requests an explanation using a video conference. Then, at the request of the first terminal 310 or the second terminal 320, the server 110 connects the video conference between the first terminal 310 and the second terminal 320 (S220).

And the counselor uploads a picture or video of the modem.

Then, the server 110 transmits the image of the customer received from the second terminal 320 to the first terminal 310 (S230).

Then, an image such as a modem is displayed on the first terminal 310 of the customer, and the counselor explains while writing on the shared image displayed with the modem on the second terminal 320 of the customer.

Then, the server 110 transmits the image selected by the counselor received from the second terminal 320 and the overlay writing data written by the counselor to the first terminal 310 (S240). At this time, the customer can understand the consultation content more conveniently and quickly because the customer can understand while simultaneously viewing the video and writing data sent by the consultant through his or her terminal-1 terminal.

On the other hand, this embodiment can be variously modified, and another example will be described as follows.

FIG. 3 is a diagram illustrating another example of a service method for implementing an overlay writing function on a video and video screen during a video conference according to an embodiment of the present invention.

Referring to FIG. 3, first, a service consultation request from a customer's first terminal 310 is received by the call center system 200 or the server 110 (S310),

The call center system 200 or the server 110 transmits a message including a video conference access address to the first terminal 310 (S320).

In addition, when the first terminal 310 accesses the video conference and transmits the customer video to the server 110, the server 110 connects the second terminal 320 of the counselor to the video conference (S330).

In this state, the counselor uploads a manual guide video necessary for explanation to the second terminal 320 to the server 110, and the server 110 first uploads the manual guide video uploaded by the second terminal 320. Process to be shared with the terminal 310 (S340).

Then, when writing on a screen such as a touch screen while looking at the screen of the second terminal 320 of the counselor, the server 110 transmits the writing data of the second terminal 320 to the first terminal 310 (S350)

Therefore, the customer can easily understand the agent's explanation.

If necessary, the server 110 records image data and writing data received from the first terminal 310 and the second terminal 320 in the database unit 120.

In particular, the server 110 is characterized by storing image data, writing data of the first terminal 310, and writing data of the second terminal 320, respectively.

In addition, the server 110,

The image data,

Data obtained by combining the image data and writing data of the first terminal 310,

Data obtained by combining the image data and writing data of the second terminal 320,

Data obtained by combining the image data, the writing data of the first terminal 310 and the writing data of the second terminal 320, respectively, are stored and requested from the first terminal 310 or the second terminal 320. It can be provided in various forms.

An example of image data and overlay writing data displayed on the screen of the first terminal 310 or the second terminal 320 will be described as follows.

FIG. 4 is a diagram illustrating an example of writing an overlay when sharing an image in a service system that implements an overlay writing function on an image and a video screen during a video conference according to an embodiment of the present invention.

Referring to FIG. 4, an example of an overlay writing when sharing an image is shown, and the writing of a customer or a counselor may be selectively displayed on an image of shared information, or both may be displayed as needed.

5 is a diagram illustrating an example of writing an overlay on an image screen in a service system that implements an overlay writing function on an image and a video screen during a video conference according to an embodiment of the present invention.

Referring to FIG. 5, an example of writing an overlay on an image screen is shown, and writing can be performed at any time during a video conference.

In an embodiment of the present invention, a function to write on the video of a video conferee is provided at the time of a video conference, and a function to write on a video provided for sharing between video conference participants is provided during a video conference, and an overlay writing It is possible to save and provide an image that has been written in a form that has been written or in an image form from which the content of the overlay writing has been removed.

In addition, the embodiment of the present invention provides a function that allows one user or a plurality of users to simultaneously or sequentially write on a video provided for sharing between video conference parties during a video conference, and an overlay writing of various users is provided. It is possible to store and provide images in the form of multiple writings, one writing form, or image form from which the content of the overlay writing has been removed.

In addition, in the embodiment of the present invention, in connection with the call center system 200, it provides a function of simply writing on the video of the video conferee during a video conference, and writing on the video provided for sharing between video conference parties during a video conference. It provides a function that can be done, and it is possible to save and provide the image that has been overwritten in the form of the image that has been written or the content of the overlay writing has been removed.

The embodiments of the present invention described above are not implemented only through an apparatus and a method, but may be implemented through a program that realizes a function corresponding to the configuration of the embodiment of the present invention or a recording medium in which the program is recorded. Implementation can be easily implemented by an expert in the technical field to which the present invention belongs from the description of the above-described embodiment.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

Claims (7)

As a service system that implements an overlay writing function on images and video screens during video conferences, which services video conferences between a first terminal 310 and a second terminal 320 of a plurality of users,
A first image data transmission unit 132 for transmitting image data of the first terminal 310;
A first overlay writing data transmission unit 133 for transmitting the overlay writing data of the first terminal 310;
A first image data receiving unit 134 for receiving image data of the second terminal 320;
A first overlay writing data receiving unit 135 for receiving the overlay writing data of the second terminal 320;
A first synthesis processing unit 131 that combines the image data received by the first image data receiving unit 134 and the overlay writing data received by the first overlay writing data receiving unit 135 and displays them on the first terminal 310 ;
A second image data transmission unit 142 for transmitting image data of the second terminal 320;
A second overlay writing data transmission unit 143 for transmitting the overlay writing data of the second terminal 320;
A second image data receiving unit 144 for receiving image data of the first terminal 310;
A second overlay writing data receiving unit 145 for receiving the overlay writing data of the first terminal 310;
A second synthesis processing unit 141 that combines the image data received by the second image data receiving unit 144 and the overlay writing data received by the second overlay writing data receiving unit 145 and displays them on the second terminal 320 ;
Receives the output data of the first image data transmission unit 132 and the first overlay writing data transmission unit 133 and transmits it to the second image data receiving unit 144 and the second overlay writing data receiving unit 145,
A server 110 that receives output data from the second image data transmission unit 142 and the second overlay writing data transmission unit 143 and transmits the data to the first image data reception unit 134 and the first overlay writing data reception unit 135 ), and
The server 110,
Further comprising a database unit 120 for storing image data and writing data,
The image data and writing data received from the first terminal 310 and the second terminal 320 are recorded in the database unit 120, and
Further comprising a call center system 200 for conducting consultation by connecting calls between the first terminal 310 or the second terminal 320, and requesting the first terminal 310 or the second terminal 320 According to the call center system 200 is characterized in that it requests a video conference to the server 110,

The first terminal 310 and the second terminal 320 are terminals of a customer, a counselor, or a video conference,
The server 110 is characterized by storing image data, writing data of the first terminal 310, and writing data of the second terminal 320, respectively,

The server 110,
Data obtained by combining the image data and writing data of the first terminal 310,
Data obtained by combining the image data and writing data of the second terminal 320,
Data obtained by combining all of the image data, the writing data of the first terminal 310 and the writing data of the second terminal 320 are additionally stored, respectively,
The server 110,
Receives the output data of the first image data transmission unit 132 and the first overlay writing data transmission unit 133 and transmits it to the second image data receiving unit 144 and the second overlay writing data receiving unit 145,
A data transmission/reception unit that receives output data from the second image data transmission unit 142 and the second overlay writing data transmission unit 143 and transmits it to the first image data reception unit 134 and the first overlay writing data reception unit 135 (111);
An image processing unit 112 that processes the image data;
An audio processing unit 113 processing an audio signal from the image data;
A service system that implements an overlay writing function on images and video screens during a video conference including a recording processing unit 114 for storing the image data.
delete delete As a service method of a service system that provides a video conference service between a first terminal 310 and a second terminal 320 of a plurality of users, and implements an overlay writing function on images and video screens during a video conference,
Allowing the call center system 200 to make a call with the second terminal 320 according to the request of the first terminal 310;
Connecting, by the server 110, a video conference between the first terminal 310 and the second terminal 320 at the request of the first terminal 310 or the second terminal 320;
Transmitting, by the server 110, an image of a customer received from the first terminal 310 to a second terminal 320;
And transmitting, by the server 110, an image selected by a counselor received from the second terminal 320 and overlay writing data written by the counselor to the first terminal 310,
The server 110,
It characterized in that the image data and writing data received from the first terminal 310 and the second terminal 320 are recorded in the database unit 120, and
The server 110 is characterized by storing image data, writing data of the first terminal 310, and writing data of the second terminal 320, respectively,

The first terminal 310 and the second terminal 320 are terminals of a customer, a counselor, or a video conference,
The server 110,
Data obtained by combining the image data and writing data of the first terminal 310,
Data obtained by combining the image data and writing data of the second terminal 320,
The image data, the writing data of the first terminal 310 and the writing data of the second terminal 320 are each additionally stored. ) Service method to implement the writing function.
As a service method of a service system that provides a video conference service between a first terminal 310 and a second terminal 320 of a plurality of users, and implements an overlay writing function on images and video screens during a video conference,
Receiving a service consultation request from the first terminal 310 to the call center system 200 or the server 110
Transmitting, by the call center system 200 or the server 110, a message including a video conference access address to the first terminal 310;
When the first terminal 310 accesses the video conference and transmits the customer video to the server 110, the server 110 connects the video conference with the second terminal 320 of the counselor;
Allowing the server 110 to share the manual guide video uploaded by the second terminal 320 with the first terminal 310;
The server 110 transmits and displays the writing data of the second terminal 320 to the first terminal 310,
The server 110,
It characterized in that the image data and writing data received from the first terminal 310 and the second terminal 320 are recorded in the database unit 120, and
The server 110 is characterized by storing image data, writing data of the first terminal 310, and writing data of the second terminal 320, respectively,

The first terminal 310 and the second terminal 320 are terminals of a customer, a counselor, or a video conference,
The server 110,
Data obtained by combining the image data and writing data of the first terminal 310,
Data obtained by combining the image data and writing data of the second terminal 320,
The image data, the writing data of the first terminal 310 and the writing data of the second terminal 320 are each additionally stored. ) Service method to implement the writing function. delete delete

Images