KR102615305B1 - Method And Apparatus for Sharing Virtual Mobile Infrastructure Screen - Google Patents

Abstract

Disclosed is a VMI screen sharing method and device.
This embodiment applies VMI to a mobile environment and allows the user's own VMI screen to be shared in real time with multiple other users when the VMI client mounted in the device is run, thereby providing broadcasting services, video sharing services, disaster broadcasting services, etc. Provides a VMI screen sharing method and device that allows to provide.

Description

VMI screen sharing method and device {Method And Apparatus for Sharing Virtual Mobile Infrastructure Screen}

This embodiment relates to a VMI screen sharing method and device.

The content described below simply provides background information related to this embodiment and does not constitute prior art.

Recently, many people are using smartphones due to the popularity of smartphones. Since smartphones enable web surfing, games, shopping, and video watching using various applications, various mobile-based eco-systems are growing explosively. As many applications are installed on a smartphone, insufficient capacity, memory, and processor performance deteriorate, differences in user experience due to smartphone hardware (HW) and software (SW) performance limitations, data security, application reinstallation when replacing the device, etc. discomfort occurs.

Recently, as smartphone applications have become larger in capacity and videos have become higher quality, data consumption for application updates, video watching, etc. is increasing. In particular, in the case of mobile game applications, the amount of data for updating the initial installation file and application internal data is quite large.

In order to solve the problems of general devices, a virtual smartphone environment is built on a cloud server and then using the server's hardware (HW) and software (SW) resources to provide a virtual mobile environment to users (VMI) There is a Virtual Mobile Infrastructure (Virtual Mobile Infrastructure) technology.

However, when applying VMI to a mobile environment, unlike a general PC environment, there are smartphone hardware (HW) limitations, differences between the OS (Operating System) environment and the cloud server environment (architecture, etc.), ultra-high speed using a real-time wireless network, There are technical issues such as low-latency communication, and due to the lack of convergence technology capabilities according to the use case, VMI technology has not yet been officially commercialized in the B2B (Business to Business) and B2C (Business to Customer) markets. .

This embodiment applies VMI to a mobile environment and allows the user's own VMI screen to be shared in real time with multiple other users when the VMI client mounted in the device is run, thereby providing broadcasting services, video sharing services, disaster broadcasting services, etc. The purpose is to provide a VMI screen sharing method and device that can provide.

According to one aspect of the present embodiment, a list generator for generating a video sharing room list by receiving a video sharing room setting message for creating a video sharing room from a VMI client; And if there is another VMI client requesting participation in the video sharing room included in the video sharing room list, a video sharing unit that converts the VMI screen provided to the VMI client into a video at a preset bit rate value and transmits it to the other VMI client. Provides a VMI screen sharing device characterized by:

According to another aspect of the present embodiment, in combination with hardware, a process of receiving a video sharing room setting message for creating a video sharing room from a VMI client and generating a video sharing room list; And if there is another VMI client requesting participation in the video sharing room included in the video sharing room list, executing a process of converting the VMI screen provided to the VMI client into a video at a preset bit rate value and transmitting it to the other VMI client. For this purpose, computer programs stored on computer-readable recording media are provided.

According to another aspect of the present embodiment, a process of receiving a video sharing room setting message for creating a video sharing room from a VMI client and generating a video sharing room list; And if there is another VMI client requesting participation in the video sharing room included in the video sharing room list, converting the VMI screen provided to the VMI client into a video at a preset bit rate value and transmitting it to the other VMI client. Provides a VMI screen sharing method characterized by:

As described above, according to this embodiment, when VMI is applied to a mobile environment and the VMI client mounted in the device is run, the user's own VMI screen is shared in real time with a plurality of other users to provide broadcast services and video. It has the effect of providing shared services, disaster broadcasting services, etc.

According to this embodiment, the delay for encoding the screen of a general device is reduced, the uplink network traffic for transmitting the encoded screen is reduced, and the uplink network traffic for transmitting the encoded screen is reduced, as well as for video sharing. There is no need for separate storage space, and the user's shared VM storage space can be utilized as is.

Figure 1 is a block diagram schematically showing the basic system for VMI screen sharing according to this embodiment.
Figure 2 is a diagram for specifically explaining the VMI screen sharing system according to this embodiment.
Figure 3 is a block diagram schematically showing the VMI screen sharing device according to this embodiment.
Figure 4 is a flowchart for explaining the VMI screen sharing method according to this embodiment.

Hereinafter, this embodiment will be described in detail with reference to the attached drawings.

VMI (Virtual Mobile Infrastructure) refers to a technology that provides a virtual mobile environment from servers to devices. VMI is a technology that exposes a VM (Virtual Machine) created and managed on a server to individual users' mobile devices. Because VMI uses the high-performance CPU (Central Processing Unit)/GPU (Graphics Processing Unit) mounted on the server, it solves the limitations caused by the hardware (HW) and software (SW) of existing devices and provides various technologies. By converging with , differentiated services can be provided in the B2B and B2C markets.

This embodiment describes various performance improvement methods and convergence methods with other technologies to provide differentiated VMI services based on high-speed/low-latency networks on various mobile devices in the 5G era.

Figure 1 is a block diagram schematically showing the basic system for VMI screen sharing according to this embodiment.

The VMI screen sharing system according to this embodiment includes a VMI client 110, a network 120, a VMI gateway 130, and a VMI server 140. Components included in the VMI screen sharing system are not necessarily limited to this.

The VMI client 110 serves as an application to display a VM (Virtual Machine) on the device. Here, the device refers to an electronic device that performs voice or data communication via the network 120 according to the user's key operations. The device includes a memory for storing a program or protocol for communicating with the VMI server 140 via the network 120, and a microprocessor for executing the program to operate and control the program.

Devices include smart phones, tablets, laptops, personal computers (PCs), portable multimedia players (PMPs), wireless communication terminals, and media players. It may be an electronic device such as the like.

The device includes (i) a communication device such as a communication modem for communicating with various devices or the network 120, (ii) a memory for storing various programs and data, (iii) a device for calculating and controlling by executing the program. It is a variety of devices equipped with a microprocessor, etc. According to at least one embodiment, the memory is computer memory such as random access memory (RAM), read only memory (ROM), flash memory, optical disk, magnetic disk, and solid state disk (SSD). It may be a readable recording/storage medium. According to at least one embodiment, a microprocessor may be programmed to selectively perform one or more of the operations and functions described in the specification. According to at least one embodiment, a microprocessor may be implemented in whole or in part as hardware such as an application specific integrated circuit (ASIC) of a specific configuration.

The VMI client 110 is connected to the VMI gateway 130 to authenticate users, determine the VMI service provision level (network bandwidth, resolution, etc.), and perform secure data communication. The VMI client 110 transmits user basic information, device local information (hardware (HW), software (SW), etc.), user action information (touch, scroll, etc.) to the VMI server 140 via the VMI gateway 130. ) is transmitted. The VMI client 110 uses the environment setting function to set various setting options for each user. The VMI client 110 receives real-time encoded images of the actual screen from the VMI server 140 and outputs them to the display on the device.

The VMI client 110 uses the VMI server 140 to share its VMI screen with other VMI clients in real time. The VMI client 110 can be used as a type of media broadcasting application by using a function to share its VMI screen with other VMI clients. The VMI client 110 can be used to share videos from disaster situations, statistics screens from the central control center, and videos shot on site, as well as to broadcast BJ's application games. Except when the VMI client 110 uses a camera locally, the actual process takes place on the VMI server 140, so uplink data is transmitted on the network 120 except for touch or input. does not occur.

The network 120 is preferably a 5G network to be applied in the future, but is not necessarily limited to this, and is not limited to the Internet network, but also WCDMA (Wideband Code Division Multiple Access), GSM (Global System for Mobile Communications), LTE (Long Term Evolution), EPC (Evolved Packet Core), etc. may be applied.

The VMI gateway 130 refers to a device that acts as a relay between the VMI client 110 and the VMI server 140 to provide VMI services. The VMI gateway 130 performs authentication for the VMI client 110 and relays data with the VMI server 140 to provide VMI service according to the authentication result.

The VMI gateway 130 transmits user input information related to the VMI service from the VMI client 110 to the VMI server 140, and delivers the response received from the VMI server 140 to the VMI client 110. . For example, the VMI gateway 130 transmits user action information (touch, scroll, etc.) received from the VMI client 110 to the VMI server 140, and encodes an image corresponding to the user action information from the VMI server 140. is received and delivered to the VMI client 110.

The VMI gateway 130 refers to a gateway node that unifies device connections to respond to security compliance and network separation. The VMI gateway 130 connects to the VMI server 140 to authenticate VMI users and provide VMI services to the VMI client 110. VMI gateway 130 exchanges encrypted data with VMI client 110.

The VMI server 140 refers to a device that creates and manages VMs to be used by the VMI client 110. The VMI server 140 sets storage space/memory, etc. for each user's VM, manages application installation and updates, and stores user settings, etc.

The VMI server 140 performs real-time encoding processing on the VMI screen that is actually running, and transmits the encoded image to the VMI client 110 via the VMI gateway 130. When the VMI server 140 receives a user operation from the VMI client 110, it processes data corresponding to the user operation and transmits it to the VMI client 110. The VMI server 140 is equipped with a high-performance CPU and GPU, enabling high-quality video and faster calculation processing compared to devices.

The VMI server 140 according to this embodiment encodes one VMI screen provided by the VMI client 110, the video sharing room creator, into a video so that multiple users can view it at the same time. send. The VMI server 140 creates and manages various video sharing rooms using the VMI gateway 130 and DB 132.

The VMI server 140 does not need to generate additional data or increase storage space when changing the VMI video running in the VMI client 110, which is the creator of the video sharing room, from one to multiple, and performs the video encoding process. Minimize.

Even though the VMI server 140 encodes the VMI screen provided by the VMI client 110, the video sharing room creator, into video and provides it to multiple users, it uses the high-performance CPU/GPU mounted on the server, so the device receiving the VMI video It is not affected by the hardware (HW) or software (SW) they have, and no uplink traffic occurs when sharing video.

Figure 2 is a diagram for specifically explaining the VMI screen sharing system according to this embodiment.

Hereinafter, the environment setting process of the VMI client 110 will be described. The VMI client 110 can share its VMI screen in real time with other VMI clients (other devices) by a user's operation or command. The VMI client 110 provides a real-time video sharing function on the configuration menu.

The VMI client 110 configures the environment settings to include 'Video sharing On/Off (Room_OnOff)', 'Video sharing room name (Room_Name)', 'Maximum number of users who can participate in the video sharing room (Room_Max_Count)', and 'Whether the video sharing room is made public (Public/ Private selection) (Room_Policy)' and 'Video sharing room password (if Room Policy (Room_Policy) is Private) (Room_Password)' are provided as options.

The VMI client 110 transmits a message including the items in [Table 1] when communicating with the VMI gateway 130 based on the above-described option information.

The VMI client 110 immediately transmits option change information to the VMI gateway 130 when the ‘Room_OnOff’ value in [Table 1] or other item values are changed among the items in the message.

Hereinafter, the video sharing room setting process of the VMI gateway 130 will be described. The VMI gateway 130 periodically synchronizes the video sharing room information with the VMI client 110 and manages the video sharing room DB 132 with a simple structure for quick response to video sharing room searches by other VMI clients. Here, the video sharing room DB 132 is built as a separate video sharing room DB server (Room DB Server) and can communicate with the VMI gateway 130.

DB information managed for each video sharing room is shown in [Table 2]. The VMI client 110 provides a list of video sharing rooms in the form of a UI so that other VMI clients can search information on video sharing rooms.

When the VMI gateway 130 receives an update message changing video sharing room information from the VMI client 110 that has opened a video sharing room, it updates information in the video sharing room DB based on the update message and updates the video sharing room list.

Hereinafter, the operation of the VMI server 140 will be described. After completing the video sharing room setup, the VMI gateway 130 forwards a setup completion message to the VMI server 140 using ‘User_ID’ and ‘VM_ID’ information. The VMI gateway 130 pre-manages ‘VM_ID’ matching ‘User_ID’ for VMI service. Whenever information related to the video sharing room is changed, the VMI gateway 130 transmits a setup completion message to the VMI server 140, adding the number of participants, participant information, etc.

The VMI server 140 manages the VM Profile Set as shown in [Table 3].

When the VMI server 140 receives a video sharing room-related message from the VMI gateway 130, it transmits ‘VM_Pointer’ and ‘VM_User_Array_Blacklist’ corresponding to the video sharing room-related message to the VMI gateway 130. If the VMI server 140 receives updated blacklist information from the VMI gateway 130, it updates the ‘VM_User_Array_Blacklist’ item in the VM profile set in [Table 3] and synchronizes it with the external device.

The VMI server 140 transmits response information corresponding to the blacklist information to the VMI gateway 130. The VMI gateway 130 updates the ‘VM_Pointer’ and ‘Viewer_Blacklist’ items in the DB 132 based on the response information received from the VMI server 140.

Figure 3 is a block diagram schematically showing the VMI screen sharing device according to this embodiment.

The VMI screen sharing device 300 according to this embodiment may be implemented as one device including the VMI gateway 130 and the VMI server 140.

The VMI screen sharing device 300 according to this embodiment includes a list creation unit 310, a participant confirmation unit 320, and a video sharing unit 330. Components included in the VMI screen sharing device 300 are not necessarily limited to this.

Each component included in the VMI screen sharing device 300 is connected to a communication path connecting software modules or hardware modules within the device and can operate organically with each other. These components communicate using one or more communication buses or signal lines.

Each component of the VMI screen sharing device 300 shown in FIG. 3 refers to a unit that processes at least one function or operation, and may be implemented as a software module, a hardware module, or a combination of software and hardware.

The list generator 310 receives a video sharing room setting message for creating a video sharing room from the VMI client 110 and generates a video sharing room list. The video sharing room setting message includes the following items: ‘User_ID’, ‘Room_OnOff’, ‘Room_Name’, ‘Room_Max_Count’, ‘Room_Policy’, ‘Room_Password’, ‘Device_Info’, ‘Display_Info’, and ‘User_VM_Quality’.

The participant confirmation unit 320 checks whether another VMI client requests participation in a video sharing room included in the video sharing room list.

The participant confirmation unit 320 receives participation information including at least one of video sharing room identification information (Room_Name), participant identification information (User_ID), video sharing room password (Room_Password), and participant bitrate value from other VMI clients participating in the video sharing room. Receive a request message.

If the participant identification information (User_ID) included in the participation request message received from another VMI client is included in the previously stored blacklist (Viewer_Blacklist), the participant confirmation unit 320 sends a participation rejection message to the other VMI client. Send (Reject Message).

If the participant identification information (User_ID) is not included in the blacklist (Viewer_Blacklist), the participant confirmation unit 320 sends a participation acceptance message (Accept Message) to the other VMI client and then causes the other VMI client to join the video sharing room. .

If the video sharing room password (Room_Password) included in the participation request message received from another VMI client does not match the password (Room_Password) preset in the video sharing room, the participant confirmation unit 320 participates as another VMI client. Send a reject message.

If the video sharing room password matches the password (Room_Password) previously set for the video sharing room, the participant confirmation unit 320 sends a participation acceptance message (Accept Message) to the other VMI client and then causes the other VMI client to join the video sharing room. .

The participant confirmation unit 320 transmits a conditional participation acceptance message (Accept Message) containing only VM ID information (VM_ID), VM address information (VM_Pointer), and gate (Guest) permission to other VMI clients. The participant confirmation unit 320 allows other VMI clients that have received a conditional participation acceptance message to participate in the video sharing room, and sets the environment of the video sharing room so that it does not respond or does not respond to the input of the VMI client with guest authority in the video sharing room. do.

The video sharing unit 330 determines whether to allow other VMI clients to participate in the video sharing room. The video sharing unit 330 converts the VMI screen provided to the VMI client 110 into a video at a preset bit rate value and transmits it to other VMI clients participating in the video sharing room.

The video sharing unit 330 encodes the VMI screen corresponding to the user identification information (User_ID) held by the VMI client 110 into an image. When encoding the VMI screen into a video, the video sharing unit 330 encodes the VMI screen into a video using the bitrate value (VM_Quality) set by the VMI client 110 opened in the video sharing room and transmits it to the VMI client 110. do. When encoding the VMI screen into a video, the video sharing unit 330 encodes the VMI screen into a video using the participant bitrate value set by each other VMI client participating in the video sharing room and transmits it to each other VMI client through multicast. .

When transmitting a VMI screen to the VMI client 110 and other VMI clients, the video sharing unit 330 variably changes the bit rate value according to network conditions. The video sharing unit 330 recognizes the network status, refers to the RSSI (Received Signal Strength Indication) value included in the radio wave environment information of the network, and lowers the bit rate when the network status is below a preset threshold. If it is above a preset threshold, the bit rate can be maintained or increased.

The video sharing unit 330 collects the participant bitrate values set by the newly participating VMI clients whenever the other VMI clients participating in the video sharing room change. The video sharing unit 330 calculates the overall bitrate average value (VM_Avg_Quality) for all participants in the video sharing room. The video sharing unit 330 can transmit a video converted to the total bitrate average value (VM_Avg_Quality) based on the bitrate value (VM_Quality) and the total bitrate average value (VM_Avg_Quality) set by the VMI client 110 when opening the video sharing room. Determine the allowable range (x). In other words, the video sharing unit 330 may determine the allowable range (x) by subtracting the overall bitrate average value (VM_Avg_Quality) from the bitrate value (VM_Quality) set by the VMI client 110 when opening the video sharing room. .

The video sharing unit 330 sets the maximum number of encodings to the bitrate average value for other VMI clients with a value between the overall bitrate average value (VM_Avg_Quality) and the allowable range (x) or the minimum bitrate value among other VMI clients for computing. Minimize computing power. In other words, the video sharing unit 330 may set the average bitrate of other VMI clients with a value between the overall bitrate average value (VM_Avg_Quality) ± the allowable range (x) as the maximum number of encodings. The video sharing unit 330 may set the minimum bitrate value among other VMI clients with a value smaller than the total bitrate average value (VM_Avg_Quality) - allowable range (x) as the maximum number of encodings.

Figure 4 is a flowchart for explaining the VMI screen sharing method according to this embodiment.

The VMI client 110 sets video sharing options in the environment settings in order to share its VMI screen with others in real time by a user's operation or command (S410). In step S410, the VMI client 110 sets ‘Room_OnOff’ to On among various options in the environment settings. When an option in the environment settings is changed, the VMI client 110 transmits a video sharing room setting message to the VMI gateway 130.

When the VMI gateway 130 receives the video sharing room setting message from the VMI client 110, the VMI gateway 130 creates video sharing room information corresponding to the video sharing room setting message in the video sharing room DB 132 and updates the video sharing room list (S412). In step S412, when the VMI gateway 130 receives a video sharing room setup message from the VMI client 110, it updates the DB 132 so that other VMI clients who want to participate in the video sharing room can check the updated video sharing room information. .

The VMI server 140 synchronizes the information stored in the video sharing room DB 132 updated by the VMI gateway 130 and the video sharing room list with the VMI gateway 130 (S414). The VMI gateway 130 and the VMI server 140 complete the creation of the video sharing room (S416) and run the video sharing room (S418). The VMI gateway 130 and the VMI server 140 check whether other VMI clients have participated in the video sharing room included in the video sharing room list (S420).

If another VMI client participates in one of the shared rooms in the video shared room list, the VMI gateway 130 updates the video shared room DB 132 and the video shared room list (S422). The VMI server 140 synchronizes the video sharing room DB 132 and the video sharing room list updated by the VMI gateway 130 (S424). Other VMI clients can access the VMI gateway 130 to check the video sharing room list.

Other VMI clients, who are video sharing participants, check the list of video sharing rooms registered by the VMI client 110 by another user's operation or command while connected to the VMI gateway 130 and then select a video sharing room to join (S430). .

Other VMI clients participate with the VMI gateway 130, including 'Room_Name', 'User_ID', and 'Room_Password (if a password is set)' information and the bitrate value that is currently set in advance for the VMI service. A request message is transmitted (S432).

The VMI gateway 130 checks whether the video sharing room participation requester included in the participation request message received from another VMI client is included in the ‘Viewer_Blacklist’ (S434).

As a result of checking in step S434, if the video sharing room participation requester included in the participation request message is not included in the 'Viewer_Blacklist', the VMI gateway 130 determines that the password information included in the participation request message received from another VMI client is 'Room_Password' and Check whether they match (S436).

As a result of step S434, if the requester to participate in the video sharing room included in the participation request message is included in the 'Viewer_Blacklist', or as a result of step S436, if the password information included in the participation request message does not match 'Room_Password', VMI The gateway 130 transmits a participation rejection message (Reject Message) to other VMI clients (S438).

As a result of step S434, if the video sharing room participation requester included in the participation request message is not included in the 'Viewer_Blacklist', or as a result of step S436, if the password information included in the participation request message matches 'Room_Password', the VMI gateway ( 130) sends a participation acceptance message to other VMI clients and causes the other VMI clients to participate in the video sharing room (S440).

In cases other than step S440, the VMI gateway 130 may transmit 'VM_ID' and 'VM_Pointer' information and a conditional participation acceptance message (Accept Message) set with gate (Guest) permissions (can only view the screen) to other VMI clients. there is. When other VMI clients receive a conditional participation acceptance message, they can participate in the video sharing room, and the VMI gateway 130 updates the DB 132.

Other VMI clients 110 access the video sharing room by referring to the ‘VM_ID’ and ‘VM_Pointer’ values received from the VMI gateway 130. When the VMI client 110, which has opened a video sharing room, confirms guest permissions, it sets the environment so that no response/reaction is made when the VMI screen is touched except for the environment setting menu portion.

In order to share the VMI screen, the VMI server 140 basically converts the VMI screen into a video using ‘VM_Quality’, which is the bitrate value requested by the video sharing room creator, and transmits it to the VMI client 110, the video sharing room creator. The VMI server 140 encodes each screen with the user bitrate value set by other VMI clients participating in the VMI screen video sharing room and then transmits it to other VMI clients participating in the video sharing room.

After recognizing the network status, the VMI server 140 compares the network status and the threshold and, if it determines that the network status is poor, variably adjusts the bit rate of the video transmitted to other VMI clients participating in the video sharing room.

The VMI gateway 130 collects the current video bitrate values of the participants whenever the information of the participants in the video sharing room is changed, and stores the average bitrate value of the total number of participants in the ‘VM_Avg_Quality’ item in the video sharing room DB.

The VMI gateway 130 determines the allowable range (x) to determine to which users the video set to the ‘VM_Avg_Quality’ value can be sent to which bitrate value. The allowable range (x) value is calculated as ‘VM_Quality’ - ‘VM_Avg_Quality’.

The VMI gateway 130 determines the video bitrate level in the case shown in [Table 4].

The reason why the VMI gateway 130 defines the cases as shown in [Table 4] is to minimize the number of encodings according to the bit rate in the VMI server 140. In other words, the VMI server 140 allows the number of encodings to be up to 2 based on the standards shown in Table 4, thereby minimizing the computing power used by the VMI server 140.

The VMI gateway 130 transmits the bitrate values set in the above-described manner to the VMI server 140, and also transmits each set bitrate information to other VMI clients participating in the video sharing room.

The VMI server 140 encodes the VMI screen corresponding to the existing User_ID into an image and transmits it to the VMI gateway 130.

The VMI gateway 130 checks the video sharing room information and simultaneously multicasts the video corresponding to the VIM screen received from the VMI server 140 to other VMI clients participating in the video sharing room. At this time, the VMI server 140 transmits the video encoded by bit rate to other VMI clients that are authenticated participants.

The VMI client 110, the video sharing room creator, and other VMI clients who are video sharing room participants decode the video corresponding to the VMI screen received from the VMI gateway 130 and display it on the device.

In Figure 4, steps S410 to S440 are described as being sequentially executed, but this is not necessarily limited. In other words, the steps shown in FIG. 4 may be applied by modifying them or executing one or more steps in parallel, so FIG. 4 is not limited to a time-series order.

As described above, the VMI screen sharing method according to this embodiment shown in FIG. 4 can be implemented as a program and recorded on a computer-readable recording medium. The computer-readable recording medium on which the program for implementing the VMI screen sharing method according to this embodiment is recorded includes all types of recording devices that store data that can be read by a computer system.

The above description is merely an illustrative explanation of the technical idea of the present embodiment, and those skilled in the art will be able to make various modifications and variations without departing from the essential characteristics of the present embodiment. Accordingly, the present embodiments are not intended to limit the technical idea of the present embodiment, but rather to explain it, and the scope of the technical idea of the present embodiment is not limited by these examples. The scope of protection of this embodiment should be interpreted in accordance with the claims below, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of rights of this embodiment.

As described above, this embodiment is applied to the field of providing a virtual smartphone environment to users, sharing the user's own VMI screen with a plurality of other users in real time, such as smartphone broadcasting service, video sharing service, disaster It is a useful invention that produces effects applicable to broadcasting services.

110: VMI Client 120: Network
130: VMI gateway 140: VMI server
310: List creation unit 320: Participant confirmation unit
330: Video sharing unit

Claims (11)

a list creation unit that receives a video sharing room setting message for creating a video sharing room from a VMI client and generates a video sharing room list; and
If there is another VMI client requesting participation in the video sharing room included in the video sharing room list, the VMI screen provided to the VMI client with a preset bitrate value is converted to a video of the participant bitrate set by the other VMI client, Video sharing unit for transmitting to other VMI clients
Including,
The video sharing department,
The participant bitrate is variably changed depending on the network condition, but if the network condition is judged to be poor, the participant bitrate is based on the preset bitrate value and the average value of the participant bitrates of all other VMI clients participating in the video sharing room. Determine the allowable range (x),
A VMI screen sharing device characterized in that the bit rate of another VMI client having a participant bit rate whose difference from the average value is within the allowable range (x) is changed to the average value for the participant bit rate. According to claim 1,
The video sharing department,
When encoding the VMI screen corresponding to the user identification information (User_ID) held by the VMI client into an image,
Encoding the VMI screen into an image with a bitrate value (VM_Quality) set by the VMI client and transmitting it to the VMI client,
A VMI screen sharing device characterized in that the VMI screen is encoded into a video using the participant bitrate value set by each of the other VMI clients and transmitted to each of the other VMI clients in a multicast manner. delete According to claim 1,
The video sharing department,
Whenever the other VMI clients participating in the video sharing room change, the participant bitrate values set by the newly participating other VMI clients are collected,
A VMI screen sharing device characterized in that it calculates a new overall bitrate average value (VM_Avg_Quality) for all participants, including other newly joined VMI clients, in the video sharing room. According to claim 4,
The video sharing department,
Computing Power (Computing Power) by setting the maximum number of encodings to the bitrate average value for other VMI clients with a value between the overall bitrate average value (VM_Avg_Quality) and the allowable range (x) or the minimum bitrate value among other VMI clients. A VMI screen sharing device characterized by minimizing. According to claim 1,
A VMI screen sharing device further comprising a participant confirmation unit that checks whether another VMI client requests participation in a video sharing room included in the video sharing room list. According to claim 6,
If the participant identification information (User_ID) included in the participation request message (Request Message) received from the other VMI client is included in the pre-stored blacklist (Viewer_Blacklist), the participant confirmation unit sends a participation rejection message to the other VMI client ( Sends a Reject Message,
If the participant identification information (User_ID) is not included in the blacklist (Viewer_Blacklist), an Accept Message is sent to the other VMI client and then the other VMI client participates in the video sharing room. VMI screen sharing device. According to claim 6,
The participant confirmation department,
If the video sharing room password (Room_Password) included in the participation request message (Request Message) received from the other VMI client does not match the password (Room_Password) preset in the video sharing room, a participation rejection message (Reject Message) is sent to the other VMI client. ), and if the video sharing room password matches the password (Room_Password) preset in the video sharing room, an Accept Message is sent to the other VMI client, and then the other VMI client participates in the video sharing room. A VMI screen sharing device characterized by allowing According to claim 6,
The participant confirmation department,
After sending a conditional participation acceptance message containing only gate (Guest) permission to the other VMI client, the other VMI client who received the conditional participation acceptance message is made to participate in the video sharing room, and the guest in the video sharing room is allowed to participate in the video sharing room. A VMI screen sharing device that sets the environment of the video sharing room so that it does not respond or does not respond to input from a VMI client with authority. Combined with hardware,
A process of receiving a video sharing room setup message for creating a video sharing room from a VMI client and creating a video sharing room list; and
If there is another VMI client requesting participation in the video sharing room included in the video sharing room list, the VMI screen provided to the VMI client with a preset bitrate value is converted to a video of the participant bitrate set by the other VMI client, Including the process of transferring to another VMI client,
The process of converting the VMI screen into an image of the participant bitrate set by the other VMI client and transmitting it to the other VMI client,
The participant bitrate is variably changed depending on the network condition, but if the network condition is judged to be poor, the participant bitrate is based on the preset bitrate value and the average value of the participant bitrates of all other VMI clients participating in the video sharing room. The process of determining the acceptable range (x); and
A VMI screen sharing method comprising changing the bit rate of another VMI client having a participant bit rate whose difference from the average value is within the allowable range (x) to the average value for the participant bit rate.
A computer program stored on a computer-readable recording medium for execution. A process of receiving a video sharing room setup message for creating a video sharing room from a VMI client and creating a video sharing room list; and
If there is another VMI client requesting participation in the video sharing room included in the video sharing room list, the VMI screen provided to the VMI client with a preset bitrate value is converted to a video of the participant bitrate set by the other VMI client, Including the process of transferring to another VMI client,
The process of converting the VMI screen into an image of the participant bitrate set by the other VMI client and transmitting it to the other VMI client,
The participant bitrate is variably changed depending on the network condition, but if the network condition is judged to be poor, the participant bitrate is based on the preset bitrate value and the average value of the participant bitrates of all other VMI clients participating in the video sharing room. The process of determining the acceptable range (x); and
A process of changing the bit rate of another VMI client whose participant bit rate whose difference from the average value is within the allowable range (x) to the average value for the participant bit rate
A VMI screen sharing method comprising:

Images