CN115119003A - Application method and system of virtual camera in live broadcast room - Google Patents
Application method and system of virtual camera in live broadcast room Download PDFInfo
- Publication number
- CN115119003A CN115119003A CN202210525474.2A CN202210525474A CN115119003A CN 115119003 A CN115119003 A CN 115119003A CN 202210525474 A CN202210525474 A CN 202210525474A CN 115119003 A CN115119003 A CN 115119003A
- Authority
- CN
- China
- Prior art keywords
- camera
- module
- virtual camera
- virtual
- live broadcast
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000004891 communication Methods 0.000 claims abstract description 8
- 238000003780 insertion Methods 0.000 claims abstract description 7
- 230000037431 insertion Effects 0.000 claims abstract description 7
- 230000005540 biological transmission Effects 0.000 claims description 6
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 238000012544 monitoring process Methods 0.000 abstract description 4
- 238000013461 design Methods 0.000 abstract description 3
- 238000012545 processing Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23406—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving management of server-side video buffer
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to an application method and an application system of a virtual camera in a live broadcast room, wherein after a virtual camera acquires a preview interface call request, a communication connection is established with a camera management module, a cache queue capable of transmitting data in a cross-process mode is initialized, a server side detects whether a USB camera device is connected with the server side, and when the USB camera device is detected to be connected, insertion information of the camera device and attribute information of the camera device are sent to a client side. Has the advantages that: the method comprises the steps of acquiring information of a live broadcast room in real time, comprehensively analyzing the information to obtain a public opinion monitoring result, carrying out decision and behavior intervention according to the result, improving user experience, constructing a virtual camera from a camera driving layer, and having strong expansibility, namely, a plurality of virtual cameras can be arranged, so that the requirement of simultaneously previewing camera data by a plurality of applications or platforms can be met, and the camera management module is an upper application, has great expansibility and space for processing images, and is reasonable in design.
Description
Technical Field
The invention relates to the technical field of virtual cameras, in particular to an application method and system of a virtual camera in a live broadcast room.
Background
At present, the process of generally using a camera on a mobile terminal is to call a camera open interface and establish connection with a bottom layer camera drive. Examples of the bottom layer camera include a front camera, a rear camera, a USB camera, etc., also called a real camera. Setting preview parameters of a real camera, and binding a preview image to a display window of the Android device. The preview parameters include the width, height, frame rate and the like of the preview image, and the display window is called Surface. And calling a startpreview interface of the camera, informing the bottom layer camera to drive to start outputting the video image stream, namely starting previewing, and displaying the image of the camera on a screen of the mobile terminal. After the preview is finished, the camera is closed, and the underlying driving object is released, in a general case, when the application uses the camera, only one camera instance can be obtained at a time, the data stream (and the image data content) of one camera is previewed, if the camera needs to be switched, the previous camera needs to be closed and the next camera needs to be opened, a plurality of applications cannot use the camera at the same time, and only one application can use the camera service at the same time.
With the development of the network live broadcast industry, a user can receive the virtual prize in the modes of watching, doing activities and the like on a network live broadcast platform, and the obtained virtual prize is given to a favorite anchor for interaction, so that the watching habit and platform viscosity of the user are developed. However, the public opinion monitoring technology of the existing live webcasting platform is still imperfect, and the experience brought to the user is not good, so that the improvement of the intelligence of the live webcasting platform is an important technical problem which needs to be solved urgently, and for this reason, an application method and an application system of a virtual camera in a live webcasting room are provided.
Disclosure of Invention
The invention aims to provide an application method and an application system of a virtual camera in a live broadcast room, so as to solve the problems in the background technology.
In order to achieve the purpose, the invention provides the following technical scheme: an application method and a system of a virtual camera in a live broadcast room are provided, the application method of the virtual camera in the live broadcast room comprises the following steps:
s1, after the deficiency-type simulation camera acquires a preview interface calling request, establishing communication connection with a camera management module, initializing a cache queue capable of transmitting data in a cross-process mode, detecting whether a USB camera device is connected with the server side or not by the server side, and sending insertion information of the camera device and attribute information of the camera device to the client side when the USB camera device is detected to be connected;
s2, the camera management module acquires a plurality of same or different image data sources, target image data are obtained from the image data sources, the target image data are output to at least one virtual camera through the cache queue, and after receiving insertion information and attribute information of camera equipment sent by the server, the client adds a video conversion formula supported by the server to the attribute information and combines and stores the video conversion formula as equipment description information;
s3, the virtual camera sends the target image data to at least one data demand main body for image preview, the data demand main body comprises other windows of a single application and/or third-party applications, and the USB virtual bus module creates an imaginary camera device corresponding to the camera device according to the device description information;
s4, the camera application module uses the corresponding USB camera equipment through the virtual camera equipment;
and S5, when the USB camera equipment is removed, the server side informs the client side and the USB virtual bus module to automatically delete the corresponding defect-type simulation camera equipment according to the attribute information corresponding to the camera equipment.
Furthermore, the system of the virtual camera in the live broadcast room comprises an image data acquisition module, a camera management module, a server module, a virtual camera and a client module.
Furthermore, the virtual camera and the image data source are bound according to a preset corresponding relation, and the camera management module acquires a plurality of same or different image data sources, wherein the camera management module determines and acquires the image data source bound with the virtual camera according to the preset corresponding relation.
Further, when the USB camera equipment is removed, the server side informs the client side and the USB virtual bus module to automatically delete the corresponding virtual camera equipment according to the attribute information corresponding to the camera equipment.
Further, the camera application module sends a request message for requesting video data to the client module through the USB virtual bus module, where the request message includes attribute information of the camera device and a requested video format, the client module sends the request message to the server module, and the server module obtains video data of the corresponding USB camera device after receiving the request message.
Furthermore, the image data acquisition module is used for acquiring a plurality of same or different image data sources, and the camera management module outputs target image data obtained from the image data sources to at least one virtual camera through the cache queue.
Further, after the virtual camera acquires the preview interface call request, the virtual camera establishes communication connection with the camera management module and initializes a cache queue capable of transmitting data across processes.
Further, the client module transmits the transmitted information to the client display screen.
Furthermore, the server module converts the information, and the digital signal is converted into an electric signal for transmission and transmission.
Compared with the prior art, the invention has the following beneficial effects: the method comprises the steps of acquiring information of a live broadcast room in real time, comprehensively analyzing the information of the live broadcast room to obtain a public opinion monitoring result, carrying out decision and behavior intervention according to the result, improving user experience, constructing a virtual camera from a camera driving layer, and having strong expansibility, namely, a plurality of virtual cameras can be arranged, so that the requirement of simultaneously previewing the data of the camera by a plurality of applications or platforms can be met, and the camera management module is an upper application and has great expansibility and space for processing images, so that the camera can be better applied to the live broadcast room, and the design is reasonable.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an application method and system method of a virtual camera in a live broadcast room implemented according to the present invention,
fig. 2 is a schematic structural diagram of an application method and system of a virtual camera in a live broadcast room according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments, and all other embodiments obtained by a person of ordinary skill in the art without creative efforts based on the embodiments of the present invention belong to the protection scope of the present invention.
In the description of the present invention, it is to be noted that the terms "top", "bottom", "one side", "the other side", "front", "rear", "middle part", "inside", "top", "bottom", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus are not to be construed as limiting the present invention, the terms "first", "second", "third" are only used for descriptive purposes and are not to be construed as indicating or implying relative importance, and furthermore, unless explicitly stated or limited otherwise, the terms "mounted", "connected", and "connected" are to be construed broadly, e.g., as being fixedly connected, or may be detachably connected, or integrally connected, or may be mechanically connected, or may be electrically connected, or may be directly connected, or may be indirectly connected through an intermediate medium, or may be a communication between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
Referring to fig. 1-2, according to the application method and system of the virtual camera in the live broadcast room implemented by the present invention, the application method of the virtual camera in the live broadcast room includes:
s1, after the defect-type camera acquires the preview interface call request, establishing communication connection with the camera management module, initializing a cache queue capable of transmitting data in a cross-process manner, detecting whether a USB camera device is connected with the server side or not by the server side, and sending insertion information of the camera device and attribute information of the camera device to the client side when detecting that the USB camera device is connected with the server side;
s2, the camera management module acquires a plurality of same or different image data sources, target image data are obtained from the image data sources, the target image data are output to at least one virtual camera through the cache queue, and after receiving insertion information and attribute information of camera equipment sent by the server, the client adds a video conversion formula supported by the server to the attribute information and combines and stores the video conversion formula as equipment description information;
s3, the virtual camera sends the target image data to at least one data demand main body for image preview, the data demand main body comprises other windows of a single application and/or third-party applications, and the USB virtual bus module creates an imaginary camera device corresponding to the camera device according to the device description information;
s4, the camera application module uses the corresponding USB camera equipment through the virtual camera equipment;
and S5, when the USB camera equipment is removed, the server side informs the client side and the USB virtual bus module to automatically delete the corresponding deficiency-type virtual camera equipment according to the attribute information corresponding to the camera equipment.
The system of the virtual camera in the live broadcast room comprises an image data acquisition module 1, a camera management module 2, a server module 3, a virtual camera module 4 and a client module 5.
The virtual camera and the image data source are bound according to a preset corresponding relation, the camera management module 2 obtains a plurality of same or different image data sources, and the method comprises the step that the camera management module 2 determines and obtains the image data source bound with the virtual camera according to the preset corresponding relation.
When the USB camera equipment is removed, the server side informs the client side and the USB virtual bus module to automatically delete the corresponding virtual camera equipment according to the attribute information corresponding to the camera equipment.
The camera application module sends a request message for requesting video data to the client module 5 through the USB virtual bus module, where the request message includes attribute information of the camera device and a requested video format, the client module 5 sends the request message to the server module 3, and the server module 3 obtains video data of the corresponding USB camera device after receiving the request message.
The image data acquisition module 1 is used for acquiring a plurality of same or different image data sources, and the camera management module 2 is used for outputting target image data obtained from the image data sources to at least one virtual camera through the cache queue.
After acquiring the preview interface call request, the virtual camera module 4 establishes communication connection with the camera management module 2, and initializes a cache queue capable of transmitting data across processes.
Wherein the client module 5 delivers the delivered information to the client display screen.
The server module 3 converts the information, and the digital signal is converted into an electric signal for transmission and transmission.
Principle of operation
By the scheme, when the application method and the system of the virtual camera in the live broadcast room are used, public opinion monitoring results are acquired by real-time acquisition and comprehensive analysis of information of the live broadcast room, decision and behavior intervention are performed according to the results, user experience is improved, the virtual camera is constructed from the camera driving layer, the expansibility is strong, namely a plurality of virtual cameras can be provided, the requirement of simultaneously previewing the data of the camera by a plurality of applications or platforms can be met, the camera management module is an upper application, and the processing of images has great expansibility and space, so that the camera can be better applied to the live broadcast room, and the design is reasonable.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.
Claims (9)
1. An application method and a system of a virtual camera in a live broadcast room are characterized in that the application method of the virtual camera in the live broadcast room comprises the following steps:
s1, after the defect-type camera acquires the preview interface call request, establishing communication connection with the camera management module, initializing a cache queue capable of transmitting data in a cross-process manner, detecting whether a USB camera device is connected with the server side or not by the server side, and sending insertion information of the camera device and attribute information of the camera device to the client side when detecting that the USB camera device is connected with the server side;
s2, the camera management module acquires a plurality of same or different image data sources, target image data are obtained from the image data sources, the target image data are output to at least one virtual camera through the cache queue, and after receiving insertion information and attribute information of camera equipment sent by the server, the client adds a video conversion formula supported by the server to the attribute information and combines and stores the video conversion formula as equipment description information;
s3, the virtual camera sends the target image data to at least one data demand main body for image preview, the data demand main body comprises other windows of a single application and/or third-party applications, and the USB virtual bus module creates an imaginary camera device corresponding to the camera device according to the device description information;
s4, the camera application module uses the corresponding USB camera equipment through the virtual camera equipment;
and S5, when the USB camera equipment is removed, the server side informs the client side and the USB virtual bus module to automatically delete the corresponding deficiency-type virtual camera equipment according to the attribute information corresponding to the camera equipment.
2. The method and system for applying the virtual camera to the live broadcast room as claimed in claim 1, wherein the system for applying the virtual camera to the live broadcast room comprises an image data acquisition module (1), a camera management module (2), a server module (3), a virtual camera module (4) and a client module (5).
3. The method and system for applying the virtual camera to the live broadcast room as claimed in claim 1, wherein the virtual camera and the image data source are bound according to a preset corresponding relationship, and the camera management module (2) acquires a plurality of identical or different image data sources, including the camera management module (2) determining and acquiring the image data source bound with the virtual camera according to the preset corresponding relationship.
4. The method and system for applying the virtual camera to the live broadcast room as claimed in claim 1, wherein when the USB camera device is removed, the server notifies the client and the USB virtual bus module to automatically delete the corresponding virtual camera device according to the attribute information corresponding to the camera device.
5. The method and system for applying the virtual camera to the live broadcast room according to claim 1, wherein the camera application module sends a request message for requesting video data to the client module (5) through the USB virtual bus module, the request message includes attribute information of the camera device and a requested video format, the client module (5) sends the request message to the server module (3), and the server module (3) obtains the video data of the corresponding USB camera device after receiving the request message.
6. The method and system for applying the virtual camera to the live broadcast room as claimed in claim 1, wherein the image data acquisition module (1) is configured to acquire a plurality of identical or different image data sources, and the camera management module (2) is configured to output target image data obtained from the image data sources to the at least one virtual camera through the cache queue.
7. The method and system for applying the virtual camera to the live broadcast room as claimed in claim 1, wherein after the virtual camera module (4) obtains the preview interface call request, the virtual camera module establishes a communication connection with the camera management module (2), and initializes a cache queue capable of transmitting data across processes.
8. The method and system for applying the virtual camera to the live broadcast room as claimed in claim 1, wherein the client module (5) transmits the transmitted information to the client display screen.
9. The method and system for applying the virtual camera to the live broadcast room as claimed in claim 1, wherein the server module (3) converts information, and the digital signal can be converted into an electric signal for transmission and transmission.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210525474.2A CN115119003A (en) | 2022-05-16 | 2022-05-16 | Application method and system of virtual camera in live broadcast room |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210525474.2A CN115119003A (en) | 2022-05-16 | 2022-05-16 | Application method and system of virtual camera in live broadcast room |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115119003A true CN115119003A (en) | 2022-09-27 |
Family
ID=83326761
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210525474.2A Pending CN115119003A (en) | 2022-05-16 | 2022-05-16 | Application method and system of virtual camera in live broadcast room |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115119003A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116347015A (en) * | 2023-05-26 | 2023-06-27 | 深圳市拔超科技股份有限公司 | System and method for smooth switching based on multiple USB cameras |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106790612A (en) * | 2016-12-30 | 2017-05-31 | 深圳市杰云科技有限公司 | A kind of dynamic virtual camera mapping method and system |
| CN112804459A (en) * | 2021-01-12 | 2021-05-14 | 杭州星犀科技有限公司 | Image display method and device based on virtual camera, storage medium and electronic equipment |
-
2022
- 2022-05-16 CN CN202210525474.2A patent/CN115119003A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106790612A (en) * | 2016-12-30 | 2017-05-31 | 深圳市杰云科技有限公司 | A kind of dynamic virtual camera mapping method and system |
| CN112804459A (en) * | 2021-01-12 | 2021-05-14 | 杭州星犀科技有限公司 | Image display method and device based on virtual camera, storage medium and electronic equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116347015A (en) * | 2023-05-26 | 2023-06-27 | 深圳市拔超科技股份有限公司 | System and method for smooth switching based on multiple USB cameras |
| CN116347015B (en) * | 2023-05-26 | 2023-10-20 | 深圳市拔超科技股份有限公司 | System and method for smooth switching based on multiple USB cameras |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2572504A1 (en) | Multiple-site drawn-image sharing apparatus, multiple-site drawn-image sharing system, method executed by multiple-site drawn-image sharing apparatus, program, and recording medium | |
| CN107911710B (en) | Live broadcast resource sharing management platform and method | |
| EP2892205B1 (en) | Method and device for determining a sharing terminal | |
| CN1451149A (en) | Method for providing traffic information to radiotelephones | |
| CN104918137A (en) | Method enabling spliced screen system to play videos | |
| CN110267093B (en) | Live video pushing method and device, storage medium, terminal and live mirror | |
| CN106998485A (en) | Net cast method and device | |
| CN115119003A (en) | Application method and system of virtual camera in live broadcast room | |
| CN113259764A (en) | Video playing method, video playing device, electronic equipment and video playing system | |
| CN114584737A (en) | Method and system for customizing multiple persons in same scene in real time in cloud conference | |
| CN103945165A (en) | Method and device for processing remote video transmission of terminal device | |
| CN110727485A (en) | Screen interface selectable sharing method and system | |
| CN106664432B (en) | Multimedia information playing method and system, acquisition equipment and standardized server | |
| JP2010263326A (en) | Communication system | |
| CN116527852A (en) | Real-time video monitoring system | |
| KR100940176B1 (en) | System and method for restructuring web cam based-images, and apparatus applied to the same | |
| US9485458B2 (en) | Data processing method and device | |
| CN113691815B (en) | Video data processing method, device and computer readable storage medium | |
| KR20130122117A (en) | Method and apparatus for transmitting a moving image in a real time | |
| CN113473059A (en) | Data processing method, intelligent device and intelligent processing system | |
| CN110990109A (en) | Spliced screen redisplay method, terminal, system and storage medium | |
| CN105809660A (en) | Information processing method and electronic device | |
| CN113160342B (en) | Encoding method and device based on feedback, storage medium and electronic equipment | |
| CN116170425A (en) | Data pushing method, device, equipment and medium | |
| CN113938457B (en) | Method, system and equipment for cloud mobile phone to apply remote camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221129 Address after: No. 606, Global Digital Building, No. 9, Gaoxin Middle 3rd Road, Maling Community, Yuehai Street, Nanshan District, Shenzhen, Guangdong 518000 Applicant after: SHENZHEN YAXIA TECHNOLOGY Co.,Ltd. Address before: 518000 401, building B, No. 2, lanshui Industrial Zone, Longxin community, Baolong street, Longgang District, Shenzhen, Guangdong Province Applicant before: Ocdop Ltd. |
|
| TA01 | Transfer of patent application right |