CN116366890A

CN116366890A - Method for providing data monitoring service and integrated machine equipment

Info

Publication number: CN116366890A
Application number: CN202310215331.6A
Authority: CN
Inventors: 张胜利; 刘超; 王岩; 赵明; 汪波
Original assignee: Beijing Youku Technology Co Ltd
Current assignee: Beijing Youku Technology Co Ltd
Priority date: 2023-02-28
Filing date: 2023-02-28
Publication date: 2023-06-30
Anticipated expiration: 2043-02-28
Also published as: CN116366890B

Abstract

The embodiment of the application discloses a method for providing data monitoring service and integrated machine equipment, wherein the method comprises the following steps: the method comprises the steps of (1) aggregating various data collected in a film and television dramatic shooting field; converting the aggregated data into a coding format suitable for wireless network transmission; and transmitting the converted aggregate data to network equipment in a wired transmission mode, wherein the network equipment is used for externally transmitting the data in a wireless network transmission mode so as to distribute the converted aggregate data to at least one terminal equipment with monitoring requirements. Through this application embodiment, can be when promoting shooting efficiency, reduce the cable quantity of shooting scene, the cost is lower, also more is favorable to expanding.

Description

Method for providing data monitoring service and integrated machine equipment

Technical Field

The present invention relates to the field of video and movie capturing data monitoring technologies, and in particular, to a method and an integrated device for providing data monitoring services.

Background

The personnel in the shooting site of the movie and television play needs a large amount of site data to quickly make decisions so as to reduce rework and lower the occurrence of low-quality shots in shooting. However, these data typically exist separately, e.g., audio data is managed by an audio engineer, video data is managed by a photographer, and metadata (including parameters of the camera, lens parameters, body parameters, aperture, white balance, and also some control parameters such as start, end marks, etc.) is managed by a stadium. Therefore, when the creator wants to see the data in real time, the creator needs to find different people, and can see the data through a relatively complex method, so that the efficiency is very low, and the shooting efficiency and the shooting quality on site are seriously affected.

In the prior art, a tool capable of providing video monitoring and playback functions exists, however, the tool usually adopts a traditional matrix mode to aggregate multiple signals (video signals collected by cameras corresponding to a plurality of different sites), but because a film and television theatre shooting site can be in a netless environment, the matrix mode relies on wired transmission of SDI (Serial Digital Interface, digital component serial interface) signals, and has the problems of multiple site wiring, high cost, unfavorable expansion and the like. For example, assuming that a certain shooting lens has four positions to shoot simultaneously, four paths of video signals need to be transmitted to a computer of a general director, at this time, a cable needs to be pulled out from each camera and connected to the computer; however, the main creator participating in the movie and television series shooting usually has a plurality of persons, each of which is different in division, but may have a need to monitor the shooting data, for example, if the shooting instruction also needs to be monitored, a cable needs to be pulled out from each camera separately and connected to the computer of the shooting instruction. That is, if a signal needs to be transmitted to M computer devices, at least m×n (N is the number of units) cables are required, otherwise, only multiple people with monitoring requirements can squeeze to the same computer for monitoring.

Disclosure of Invention

The application provides a method for providing data monitoring service and integrated machine equipment, which can reduce the number of cables on a shooting site while improving shooting efficiency, and are lower in cost and more beneficial to expansion.

The application provides the following scheme:

a method of providing a data monitoring service, comprising:

the method comprises the steps of (1) aggregating various data collected in a film and television dramatic shooting field;

converting the aggregated data into a coding format suitable for wireless network transmission;

and transmitting the converted aggregate data to network equipment in a wired transmission mode, wherein the network equipment is used for externally transmitting the data in a wireless network transmission mode so as to distribute the converted aggregate data to at least one terminal equipment with monitoring requirements.

A all-in-one device, comprising:

the data aggregation and encoding and decoding module is used for aggregating various data acquired in the film and television theatre shooting field and converting the aggregated data into a coding format suitable for network transmission;

the exchanger module is used for providing the aggregated data after format conversion to the service module;

the service module is used for processing the aggregated data after format conversion into a format suitable for wireless network transmission and returning the format to the switch module;

The switch module is further configured to transmit, by using a wired transmission manner, data returned by the service module to a network device, where the network device performs data transmission to the outside by using a wireless network transmission manner, so as to distribute the received data to at least one terminal device.

Wherein, the multiple data that the scene gathered of shooting includes: and the multiple paths of video data corresponding to the camera positions.

The shooting site is further provided with a plurality of image transmission devices which correspond to the camera devices of the plurality of sites respectively, and the image transmission devices are used for receiving video data acquired by the corresponding camera devices in a wireless receiving mode;

the image transmission equipment is connected with the data aggregation and encoding and decoding module in a wired mode;

the data aggregation and encoding and decoding module is specifically used for receiving the multipath video data collected on the shooting site through the image transmission equipment.

Wherein, the multiple data that the scene gathered of shooting still includes: audio data;

the integrated machine equipment also comprises an audio signal distribution module which is used for copying the audio data into a plurality of copies and providing the copies for the data aggregation and encoding and decoding module;

The data aggregation and encoding and decoding module is specifically configured to synthesize the multiple audio data with the multiple video data, and then convert the multiple audio data into an encoding format suitable for network transmission.

The shooting site is further provided with a wireless audio receiver device, and the wireless audio receiver device is used for receiving audio data acquired by the recording table device in a wireless mode and is connected with the audio signal distribution module in a wired mode so as to transmit the audio data to the audio signal distribution module.

Wherein, the multiple data that the scene gathered of shooting still includes: metadata including parameter data related to video data acquisition and/or data acquisition start and end flag data;

the data aggregation and encoding/decoding module is specifically configured to extract the metadata from the received video data, so as to convert the metadata into the encoding format suitable for network transmission.

The service module is also used for recording and storing the data received from the switch module so as to provide review service;

when recording is carried out, the start and the end of the recording process are automatically triggered according to the acquisition start and end mark information contained in the metadata.

Wherein, the all-in-one equipment also comprises a display module;

the service module is also used for generating a control interface and outputting and displaying through the display module so as to manually trigger the start and the end of the recording process through the control interface when the metadata does not comprise the acquisition start and end mark information.

A data processing system, comprising:

the integrated machine device, the plurality of image transmission devices corresponding to the camera devices of the plurality of stations, the wireless audio receiver device corresponding to the recording table device and the network device;

the image transmission equipment, the wireless audio receiver equipment and the network equipment are respectively connected with the all-in-one equipment in a wired mode;

the image transmission equipment is used for receiving video data acquired by the corresponding camera equipment in a wireless receiving mode and transmitting the video data to the all-in-one equipment in a wired mode;

the wireless audio receiver device is used for receiving the audio data acquired by the recording table device in a wireless receiving mode and transmitting the audio data to the all-in-one device in a wired mode.

The network equipment comprises local area network access equipment deployed on the shooting site, and the data after aggregation and conversion are distributed to at least one terminal equipment accessed to the local area network access equipment through the local area network access equipment.

The network device comprises a gateway device of a mobile communication network, the data after aggregation and conversion are transmitted to a network server on a public network through the mobile communication network, and the network server distributes the data to at least one terminal device with remote monitoring requirements when receiving an access request.

A method of providing data monitoring services, comprising:

responding to a data monitoring request, receiving related data provided by local area network access point equipment deployed in a film and television theatre shooting site, wherein the related data are distributed in a wireless network transmission mode through the local area network access point equipment after the related data are aggregated on various data acquired in the film and television theatre shooting site and converted into a coding format suitable for wireless network transmission;

decoding the received related data, and organizing according to a preset interface structure to generate a target interface;

and displaying the target interface so as to provide a service for monitoring various data collected in the film and television theatrical shooting scene through the target interface.

Wherein the plurality of data comprises a plurality of paths of video data corresponding to a plurality of camera positions;

the organizing according to a preset interface structure to generate a target interface includes:

And synchronously displaying the pictures of the multipath video data in the target interface in a multi-grid mode.

The related data also comprises data for recording various data collected in the film and television dramatic shooting scene;

the target interface further comprises: a list of recorded files, and operational options for selecting the recorded files and initiating a review request for playback of the recorded files.

Wherein the related data further includes metadata, the metadata including: parameter data related to video data acquisition and/or data acquisition start and end mark data;

the target interface further comprises: an operation option for processing the diary information;

the method further comprises the steps of:

and after receiving the request through the operation options, providing a script information processing interface, organizing the metadata, and automatically filling the metadata into fields corresponding to the script information.

A method of providing a script service, comprising:

responding to a request for generating the script information, receiving related data provided by local area network access point equipment deployed in a film and television theatre shooting site, wherein the related data are obtained by aggregating various data acquired in the film and television theatre shooting site, and distributing the data in a wireless network transmission mode through the local area network access point equipment after the data are converted into a coding format suitable for wireless network transmission; wherein the related data comprises metadata in the video acquisition process; the metadata includes: parameter data related to video data acquisition and/or data acquisition start and end mark data;

Decoding the metadata, and filling the metadata into corresponding input controls in a target interface according to a preset interface structure;

and displaying the target interface so as to generate the script information on the basis that the information is filled in the target interface.

A remote data monitoring service method, comprising:

responding to a remote data monitoring request, and acquiring information of a target interface and related data thereof from a server; the related data are collected in a film and television theatre shooting scene, are aggregated and converted into a coding format suitable for wireless network transmission, and are transmitted to the server through gateway equipment of a mobile communication network; the target page is generated after the related data are organized according to a preset interface structure;

and displaying the target interface so as to provide a service for remotely monitoring various data collected in the film and television theatre shooting scene through the target interface.

Wherein, still include:

providing operation options for annotating the data displayed in the target interface;

after the marking information is received through the operation options, marking information is added at the position corresponding to the marking time on the playing progress bar, and the marking information comprises the identification information of the marking adder.

A device for providing data monitoring services, comprising:

the data receiving unit is used for responding to the data monitoring request, receiving related data provided by local area network access point equipment deployed in the film and television dramatic shooting scene, wherein the related data are distributed in a wireless network transmission mode through the local area network access point equipment after the data are collected in the film and television dramatic shooting scene are aggregated and converted into a coding format suitable for wireless network transmission;

the interface generating unit is used for decoding the received related data and organizing according to a preset interface structure to generate a target interface;

and the monitoring service data display unit is used for displaying the target interface so as to provide a service for monitoring various data acquired in the film and television theatrical shooting scene through the target interface.

A provision of a diary service device, comprising:

the data receiving unit is used for responding to the request for generating the script information, receiving related data provided by local area network access point equipment deployed in the film and television theatre shooting site, wherein the related data are distributed in a wireless network transmission mode through the local area network access point equipment after the data acquired in the film and television theatre shooting site are aggregated and converted into a coding format suitable for wireless network transmission; wherein the related data comprises metadata in the video acquisition process; the metadata includes: parameter data related to video data acquisition and/or data acquisition start and end mark data;

The metadata automatic input unit is used for decoding the metadata and filling the metadata into the corresponding input control in the target interface according to a preset interface structure;

and the interface display unit is used for displaying the target interface so as to generate the script information on the basis that the information is filled in the target interface.

A remote data monitoring service apparatus comprising:

the data acquisition unit is used for responding to the remote data monitoring request and acquiring information of the target interface and related data thereof from the server; the related data are collected in a film and television theatre shooting scene, are aggregated and converted into a coding format suitable for wireless network transmission, and are transmitted to the server through gateway equipment of a mobile communication network; the target page is generated after the related data are organized according to a preset interface structure;

and the interface display unit is used for displaying the target interface so as to provide a service for remotely monitoring various data acquired in the film and television theatrical shooting scene through the target interface.

A computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of the method of any of the preceding claims.

An electronic device, comprising:

one or more processors; and

a memory associated with the one or more processors, the memory for storing program instructions that, when read for execution by the one or more processors, perform the steps of the method of any of the preceding claims.

According to a specific embodiment provided by the application, the application discloses the following technical effects:

according to the scheme provided by the embodiment of the application, various data acquired in the film and television theatrical shooting scene can be aggregated, the aggregated data is converted into a coding format suitable for wireless network transmission, then the converted aggregated data can be transmitted to network equipment in a wired transmission mode, and the network equipment is used for externally transmitting the data in a wireless network transmission mode so as to distribute the converted aggregated data to at least one terminal equipment with monitoring requirements. By the method, various data acquired on the shooting site can be aggregated together, so that the monitoring of the various data can be finished from one terminal device, and the shooting efficiency is improved; meanwhile, in the process of providing the data monitoring service, the wired connection of matrix modes between the data acquisition equipment such as a camera and the plurality of terminal equipment is not relied on, so that the number of cables in a shooting field can be reduced, the cost is lower, and the expansion is facilitated.

Of course, not all of the above-described advantages need be achieved at the same time in practicing any one of the products of the present application.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic diagram of a system architecture provided by an embodiment of the present application;

FIG. 2 is a flow chart of a first method provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of an all-in-one device provided in an embodiment of the present application;

FIG. 4 is a schematic diagram of an interface presented in a piece of all-in-one equipment provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of a system provided by an embodiment of the present application;

FIG. 6 is a flow chart of a second method provided by an embodiment of the present application;

FIGS. 7-1 through 7-5 are diagrams of application interfaces for data monitoring services provided in embodiments of the present application;

FIG. 8 is a flow chart of a third method provided by an embodiment of the present application;

FIG. 9 is a flow chart of a fourth method provided by an embodiment of the present application;

FIG. 10 is a schematic diagram of a web page of a remote monitoring service provided by an embodiment of the present application;

FIG. 11 is a schematic diagram of a first apparatus provided in an embodiment of the present application;

FIG. 12 is a schematic diagram of a second apparatus provided in an embodiment of the present application;

FIG. 13 is a schematic view of a third apparatus provided in an embodiment of the present application;

fig. 14 is a schematic diagram of an electronic device provided in an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.

In the embodiment of the application, the functions of monitoring, playback and the like in the film and television drama shooting process are improved, specifically, various data acquired in a shooting field can be collected and summarized, and converted into an NDI (Network Device Interface, network equipment interface) signal suitable for network transmission, then the NDI signal is converted into a format suitable for wireless network transmission through transcoding, compression, recording, storage and the like, and the format is distributed to terminal equipment (which can be mobile terminal equipment) associated with various personnel such as directors, assistants, staffs and the like through a wireless network Access Point (AP), and remote distribution can be realized through a mobile communication gateway.

In order to achieve the above object, the present invention may specifically relate to improvements in both hardware and software. Among them, in terms of hardware, in order to reduce the exposed wiring, first, an all-in-one apparatus may be provided. The all-in-one equipment can be deployed to a shooting site and used for aggregating various data acquired by the shooting site, converting the data into a mode suitable for network transmission, and recording, storing and other processing. Meanwhile, the integrated device can also act as a network server, and the aggregated and converted data is distributed to a plurality of terminal devices in a wireless manner through an AP (Wireless Access Point) device or a gateway device of a mobile communication network and the like. It should be noted that, in the conventional application, the AP device of the lan generally needs to be connected to the public network first, receive data from a server in the public network, and then transmit the data to the terminal device in the lan in a wireless manner; however, in the embodiment of the present application, such an AP does not need to be connected to a public network (typically, since the film and television theatrical shooting environment may be an outdoor environment such as a forest, a desert, etc., and thus, the shooting site does not have a public network environment), but the integrated device in the embodiment of the present application acts as a network server, and the integrated device provides a signal suitable for wireless network transmission to the AP through a network line, so that the AP may distribute the signal to a plurality of terminal devices connected to the AP in a wireless manner.

Specifically, as shown in fig. 1, a specific all-in-one device may include a data aggregation and codec conversion module, a switch module, and a service module. In an alternative manner, the all-in-one device may further include a display module. In addition, in the case of a recording device in a shooting site, since audio data generally has only one channel, and video data generally has multiple channels corresponding to cameras with different positions, the integrated device may further include an audio signal distribution module for copying one audio signal into multiple copies to be respectively distributed to each channel of video signal.

The data aggregation and code conversion module and the switch module are connected through a network cable; the service module and the display screen module can be connected through HDMI (High Definition Multimedia Interface ) and other cables; the audio signal distribution module and the data aggregation and codec conversion module may be connected by an audio line (e.g., a kannong-3.5 mm audio line, etc.). Of course, since each module can be built in the integrated equipment, the connecting cables are also located in the integrated equipment and are not exposed outside, so that the condition of a large number of and disordered shooting field connecting wires is avoided.

Specifically, the audio signal distributor may be used for receiving audio signals, in order to shorten the wiring length, a wireless audio receiver may be deployed at the shooting site, and the wireless audio receiver may be wirelessly connected with the recording station device by means of 2.4G or the like, and receive the audio signals collected by the recording station. Thus, the wireless audio receiver may be connected to the above-described audio signal splitter in the all-in-one device via an audio line (e.g., a 3.5 millimeter Transcard agricultural audio line, etc.). In addition, the camera equipment of each machine position can also be connected with the image transmission equipment through modes such as 2.4G, so that the image transmission equipment corresponding to each camera can also be connected with a data aggregation and coding and decoding conversion module in the integrated machine equipment through coaxial cables of an SDI protocol and the like. That is, the output end of the all-in-one device is mainly provided with 1+N connecting cables, and N is the number of machine positions. Because the wireless audio receiver and the recording table equipment and the image transmission equipment and the camera equipment can be connected in a wireless mode of 2.4G and the like, the wireless audio receiver and the image transmission equipment can be placed near the integrated equipment, so that the 1+N cables can be relatively short, and the phenomenon of disordered shooting sites caused by the conditions of more and long cables and the like is avoided.

The data aggregation and codec conversion module can be implemented by a DNI codec box, however, the existing codec boxes on the market generally only support the collection of audio data and video data, and do not support the collection of metadata. In the preferred embodiment of the present application, the existing codec box may also be customized or rewritten by a code, so as to have a function of collecting metadata. Specifically, since metadata is usually carried in the SDI signal of the camera, a process of specifically collecting metadata may be a process of separating and extracting metadata from the SDI signal. In this way, the data actually recorded and stored by the all-in-one device may include not only audio and video data, but also such metadata, which may help the claimant edit the claimant, as will be described in detail later.

The switch module is mainly used for forwarding the NDI data generated by the data aggregation, encoding and decoding conversion module to the service module. The service module is mainly used for carrying out transcoding, compression, recording, storage and other processing on the data provided by the switch module. In the process of data processing by the service module, a related operation interface can be provided, and output display can be performed by the display module, so that an operator of the integrated machine device can execute some operations based on the operation interface. For example, in the process of recording the data provided by the switch module, some video cameras can extract information such as start and end marks, so that the service module can automatically record according to the mark information, but some video cameras may not have the mark, at this time, corresponding operation options can be provided in the operation interface, and thus, an operator can send an instruction of starting or ending recording in a manual triggering manner. In addition, when the service module distributes data, the service module can perform remote plug flow through a public network in addition to the local area network built on the shooting site, and whether the remote plug flow is performed or not can also be determined by an operator through a manual triggering mode, and the like. Furthermore, the operation interface can also be used for performing simple operation processing such as early editing on specific data.

When the service module distributes data, the data collected and converted can be transmitted back to the switch module, and for the case of distribution through the local area network, the switch module can be connected to the AP equipment through a network cable, so that the data processed by the service module can be transmitted to the mobile terminal equipment of the director, the stadium, the assistant and other personnel in a wireless mode through the AP.

In particular, one or more APs may be deployed at the shooting site, for example, assuming that the area of the shooting site is relatively large, the shooting area may be relatively far from the director's monitoring area, where the director, the venue, the assistant, etc. may work in the director's monitoring area, while the cosmetic, the clothing, the auxiliary director, etc. may need to work in the shooting area, so that APs may also be deployed in the director's monitoring area and the shooting area, respectively, and the mobile terminal devices of various people may acquire relevant data from the APs in the respective areas.

In addition, if remote distribution is required, an aggregation gateway device of the mobile communication network (for example, 4G, 5G, etc.) can be deployed at the shooting site, and the switch module can be connected with the gateway device through a network cable, so that specific data can be transmitted to the public network through the gateway device. At this time, the data monitoring service can be provided through the corresponding website, and when remote distribution is required, the service module in the integrated machine device can also perform remote plug flow through the switch module, and information such as the website address of the website is configured. The server side of a specific website can be deployed on a cloud server (of course, other forms of servers are also possible), so that producers and the like can access the website through a Web browser or an applet and the like, and can monitor data through pages of the website.

It can be seen that, for the above-mentioned all-in-one device, there may be 1+n cables at the input end, where N is the number of units, and the output end may include one or more network cables for connection with one or more APs, and if remote push flow is required, one network cable for connection with a gateway device of a mobile network may be further added. The number of cables is greatly reduced relative to m×n or m×n+1 cables in the matrix system, and the length of the input cable can be shortened by using the input wireless audio receiver device or the wireless image transmission device.

In terms of software, the function of collecting metadata in the codec box described above is implemented in a code form, which belongs to the category of software, and in addition, the function of the service and storage module may also be implemented by software, for example, a program may be run in a host of the integrated device, and the function of the service and storage module may be implemented by the program.

At the receiving end of the data, related application programs (such as an App of a mobile end) or websites and the like can be provided, so that the specific data can be reached to various personnel. For example, an App may be provided first, which may be run in a terminal device such as a large-screen monitor device, a mobile phone, a tablet computer, etc., and these terminal devices may be accessed into a local area network built at the shooting site through an access point device AP at the shooting site. In this way, after the switch module transmits the data to be distributed to the AP, the App can obtain specific data from the AP, organize the specific data into a form convenient for viewing, and display the specific data in the relevant interface. Correspondingly, specific director, assistant, talent and other personnel can view the interface displayed in the App through accessing the App on the terminal equipment of the specific director, assistant, talent and other personnel, and view the information displayed in the interface. For example, assuming that the App is currently being shot, after the App is opened, the pictures of the multiple paths of video signals currently being recorded can be viewed in the interface of the App, and the pictures of the video signals can be displayed in a grid or other manner, so that a director and the like can view the pictures acquired by multiple machine positions through the same interface. Of course, the method can be switched to Shan Gongge, the picture acquired by a certain machine position can be monitored, and the like.

In addition, the App may further provide a claimant function, specifically, in the prior art, claimant needs to write claimant information by paper mode, or, even by means of an electronic device, needs to manually enter various information, including metadata information of each machine location, and so on. For example, by manually writing or entering data such as camera parameters that are viewed on large monitoring devices, the process can be slow and error prone. In the embodiment of the application, since the integrated device extracts and stores the metadata when the multi-path data is aggregated, the auxiliary information for generating the script file can be provided based on the metadata. Specifically, a "clap" function module may be provided in the App, and when accessing the App, clap personnel may enter the module to complete the generation of clap files. At this time, the script module may automatically record metadata information included in the data received from the AP into the script file, and the script personnel only need to complement the rest of the script information, for example, including feedback of the director to the current mirror, which time period data is available, and so on. Thus, the generation efficiency and the accuracy of the script file can be improved. The generated script file can be exported in pdf format for the later production process to learn shooting details.

In addition to the App, the remote monitoring service may be provided in the form of a website, an applet, a light application, or the like, and in the case of remote push through a gateway device of a mobile network such as a 5G, specific data may be transmitted to a server of the website, the applet, the light application through the gateway device, and then the data may be organized at the server and displayed through a specific web page or the like. Thus, persons who are not in the shooting site, such as producers, can access the web page through a browser, or can view specific data by accessing the applet, the pages of the light application, and the like. In addition, since the person performing remote monitoring is not in the shooting site, in order to facilitate feedback of data by such person, a function of marking data can be provided through the above-mentioned service. For example, if some opinion or suggestion exists on the current data at a certain moment in monitoring, the option of adding a mark in the page can be clicked, at this time, the opinion or suggestion can be input, meanwhile, a corresponding mark can be added at a corresponding position on the playing progress bar of the specific data, and the mark can also display the identification of the specific labeling personnel, for example, the surname of the labeling personnel, and the like. When other monitors click on the mark, specific marking details can be correspondingly displayed, and the like. Thus, the specific labeling information can be more intuitively watched by the monitor.

It should be noted that, the scheme provided by the embodiment of the present application is generally described above, and in practical application, the scheme is not limited to the implementation manner, for example, for the portion of the integrated device shown in fig. 1, the implementation manner of the integrated device may not be required, but a plurality of functional modules are dispersed in a plurality of different hardware devices, and corresponding functions may be implemented, where only the number of exposed network wires may slightly increase. However, it is within the scope of the present application to fall under the inventive concept of the present application.

Specific implementations provided by embodiments of the present application are described in more detail below.

Example 1

First, the first embodiment provides a data processing method, where the execution subject of each step of the method may be the aforementioned all-in-one device, or may be implemented by different hardware devices, respectively, and so on. Specifically, referring to fig. 2, the method may specifically include:

s201: and aggregating various data collected at the film and television theatre shooting site.

Specifically, the multiple data may include multiple paths of video data generated when the multiple units shoot at the same time, and may further include audio data when the audio data is collected. In addition, in the preferred embodiment of the present application, the data collected and aggregated herein may also include metadata in order to help the claimant make the generation of the claimant more efficient. The metadata may be included in the video data, and in a specific implementation, the video data and the audio data may be collected and aggregated by a device such as a codec box, but the metadata may be collected and aggregated by customizing or rewriting a code in the codec box. Thus, the video data and the audio data can be combined, wherein if the video data has multiple paths, the audio data can be copied into multiple copies, and the multiple paths of audio data are respectively combined to combine the multiple paths of audio and video combined data. In addition, each path of audio and video synthesized data can also be provided with corresponding metadata.

S202: and converting the aggregated data into a coding format suitable for wireless network transmission.

After various data are collected, the data may be converted into a coding format suitable for wireless network transmission, for example, in a specific implementation, the SDI signal may be first converted into an NDI signal by the foregoing codec box or the like, and then, the NDI signal may be further converted into a signal suitable for wireless network transmission by the service module provided in the embodiment of the present application, and so on.

S203: and transmitting the converted aggregate data to network equipment in a wired transmission mode, wherein the network equipment is used for externally transmitting the data in a wireless network transmission mode so as to distribute the converted aggregate data to at least one terminal equipment with monitoring requirements.

After the aggregation and conversion of the data are completed, the converted aggregate data may be transmitted to a network device by a wired transmission mode, and specifically, the network device may be an AP as described above, or may also be a gateway device in a mobile communication network, etc., where the network device may be used to perform data transmission externally in a wireless network transmission mode, so as to distribute the converted aggregate data to at least one terminal device with a monitoring requirement.

In summary, according to the scheme provided by the first embodiment of the present application, multiple data collected in a film and television dramatic shooting scene may be aggregated, the aggregated data may be converted into a coding format suitable for wireless network transmission, and then the converted aggregated data may be transmitted to a network device in a wired transmission manner, where the network device is configured to perform data transmission externally in a wireless network transmission manner, so as to distribute the converted aggregated data to at least one terminal device with monitoring requirements. By the method, various data acquired on the shooting site can be aggregated together, so that the monitoring of the various data can be finished from one terminal device, and the shooting efficiency is improved; meanwhile, in the process of providing the data monitoring service, the wired connection of matrix modes between the data acquisition equipment such as a camera and the plurality of terminal equipment is not relied on, so that the number of cables in a shooting field can be reduced, the cost is lower, and the expansion is facilitated.

Example two

This second embodiment provides an all-in-one apparatus, referring to fig. 3, mainly from the perspective of the all-in-one apparatus shown in fig. 1, which may include:

The data aggregation and encoding and decoding module 301 is configured to aggregate multiple data collected at the film and television theatrical shooting site, and convert the aggregated data into a coding format suitable for network transmission;

a switch module 302, configured to provide the aggregated data after format conversion to a service module 303;

the service module 303 is configured to process the aggregated data after format conversion into a format suitable for wireless network transmission, and return the aggregated data to the switch module;

the switch module 302 is further configured to transmit, by using a wired transmission manner, data returned by the service module to a network device, where the network device performs data transmission to the outside by using a wireless network transmission manner, so as to distribute the received data to at least one terminal device.

In specific implementation, first, various data collected at the shooting site can be input into the integrated machine device. The plurality of data collected at the shooting site may include: and the multiple paths of video data corresponding to the camera positions. The specific input is typically input in a wired transmission. That is, if there are N camera apparatuses in the places, there are N cables required for realizing the connection between the N camera apparatuses in the places and the above-described all-in-one apparatus, respectively. In this case, since the camera device may often need to be moved during photographing, and the all-in-one device is usually not required to be moved, if the cable is directly connected therebetween, the length of the cable may need to be relatively long, and inter-winding between cables of different cameras may also occur.

For this purpose, in a preferred embodiment, a specific shooting site may be further deployed with a plurality of image capturing devices, where the image capturing devices may respectively correspond to a plurality of camera devices, and are configured to receive, by using a wireless reception manner, video data collected by the corresponding camera devices. That is, the camera device and the image transmission device can transmit data in a wireless transmission manner. Meanwhile, the image transmission device can be connected with the data aggregation and encoding and decoding module in a wired mode, and the data aggregation and encoding and decoding module can receive multi-channel video data acquired on a shooting site through the image transmission device. In this way, the image transmission device can be placed near the integrated machine device, and the two devices are connected through the cable, but the length of the cable can be relatively short, and the image transmission device does not need to be moved, so that the situation of intertwining among the cables and the like can not occur.

In addition, the plurality of data collected at the shooting site may further include: audio data. At this time, since the audio data is usually only one channel, and the video data is multiplexed, the all-in-one device may further include an audio signal distribution module, configured to copy the audio data into multiple copies, and provide the copies to the data aggregation and encoding/decoding module; at this time, the data aggregation and encoding/decoding module is specifically configured to synthesize the multiple audio data with the multiple video data, and then convert the multiple audio data into an encoding format suitable for network transmission.

In addition, because the audio data also need to be input into the all-in-one equipment through a wired mode, in order to shorten the length of the cable, a wireless audio receiver device can be deployed on the shooting site and used for receiving the audio data acquired by the recording table device through a wireless mode and connecting with the audio signal distribution module through a wired mode so as to transmit the audio data to the audio signal distribution module.

In order to improve the processing efficiency of the script information, the shooting of the plurality of data collected on site may further include: metadata including parameter data related to video data acquisition and/or data acquisition start and end flag data. At this time, the data aggregation and codec module may be further configured to extract the metadata from the received video data so as to convert the metadata into the encoding format suitable for network transmission.

In addition, the service module is also used for recording and storing the data received from the switch module so as to provide review service. When recording, the start and end of the recording process can be automatically triggered according to the acquisition start and end mark information included in the metadata. Or, the integrated device may further include a display module, where the service module may further be configured to generate a control interface, and output and display the control interface through the display module, so that when the metadata does not include the acquisition start and end flag information, the start and end of the recording process are manually triggered through the control interface. For example, as shown in fig. 4, an interface example shown in the display screen of the all-in-one device is shown, where, as shown at 41, an operation option of "start recording" corresponding to multiple sites respectively may be included, and after clicking the option, the operation option may automatically become "end recording" so as to end recording of data of the same site by clicking the same operation option. In addition, as shown at 42, the interface may further include an operation option for performing manual push flow, and the operator user may select, according to actual needs, a machine location specifically needing to perform data distribution in a manual triggering manner. Furthermore, the interface may also include operation options for remote plug flow, such as "cloud monitoring settings" as shown in fig. 4, and so on.

Example III

In addition to the integrated device provided in the second embodiment, the third embodiment provides a data processing system, and referring to fig. 5, the system may include the integrated device 501, a plurality of image transmission devices 502 corresponding to a plurality of camera devices, a wireless audio receiver device 503 corresponding to a recording station device, and a network device 504.

The image transmission device 502, the wireless audio receiver device 503 and the network device 504 are respectively connected with the all-in-one device in a wired manner; the image transmission device 502 may be configured to receive video data collected by a corresponding camera device in a wireless receiving manner, and transmit the video data to the all-in-one device in a wired manner; the wireless audio receiver device 503 is configured to receive, by using a wireless receiving manner, audio data collected by the recording station device, and transmit the audio data to the all-in-one device by using a wired manner.

Specifically, the network device comprises a local area network access device deployed on the shooting site, so that the data after aggregation and conversion are distributed to at least one terminal device accessed to the local area network access device through the local area network access device.

Or the network device comprises a gateway device of a mobile communication network, so that the aggregated and converted data is transmitted to a network server on a public network through the mobile communication network, and the network server distributes the data to at least one terminal device with remote monitoring requirements when receiving an access request.

Example IV

In view of the client software specifically providing the data monitoring service, the fourth embodiment provides a method for providing the data monitoring service, where the client software may exist in a form of a mobile terminal App, etc., and specifically, referring to fig. 6, the method may include:

s601: responding to a data monitoring request, receiving related data provided by local area network access point equipment deployed in a film and television theatre shooting site, wherein the related data are distributed in a wireless network transmission mode through the local area network access point equipment after the related data are aggregated on various data acquired in the film and television theatre shooting site and converted into a coding format suitable for wireless network transmission;

specifically, the foregoing client software may exist in the form of an application program (for example, a mobile terminal App, etc.), which is mainly oriented to users such as directors, assistants, stadiums, etc. located at the shooting site, and the foregoing application program may be installed in terminal devices associated with these users, where a specific terminal device may be a mobile phone, a tablet computer, or may also be some large monitor devices, etc. In addition, the terminal devices can be accessed into an AP provided by a specific shooting site, so that data distributed by the AP can be obtained. Correspondingly, for the user, if multiple paths of data need to be monitored in the shooting process, the App installed in the terminal device of the user can be opened, and for the App, namely, a data monitoring request is received, and specific related data is acquired from the specifically connected AP. The relevant data may be distributed by the AP device after aggregation and conversion in the manner described in the first embodiment.

S602: decoding the received related data, and organizing according to a preset interface structure to generate a target interface;

s603: and displaying the target interface so as to provide a service for monitoring various data collected in the film and television theatrical shooting scene through the target interface.

Specifically, the multiple data include multiple paths of video data corresponding to multiple camera positions, and at this time, the pictures of the multiple paths of video data can be displayed synchronously in the target interface in a form of multiple grids. That is, after the user opens the application program in the terminal device, the target interface may be displayed, in which the pictures of the multi-channel video signal of the current capturing mirror may be synchronously played. For example, assuming that there are four video signals currently, the monitoring effect provided in the target interface may be as shown in fig. 7-1, which includes four cells, each cell being used to display a picture of one video signal. In an alternative manner, an operation option for switching the layout manner of the interface may also be provided in the interface, for example, an operation option shown at 71 in fig. 7-1 may be used for switching to a single grid for display, and the effect after switching may be shown in fig. 7-2. Of course, the interface described in fig. 7-1 is mainly described by taking an interface on a tablet computer device as an example, and in the case of a mobile phone device, the interface may be displayed in a form of two-grid or the like due to screen limitation.

In addition, because the integrated device and the like can record and store the aggregated data when processing the aggregated data, the relevant data specifically obtained from the AP may also include data for recording various data collected at the movie and television theatre shooting site. At this time, the target interface further includes an operation option for initiating a review operation. After receiving the request through the operation options, a recording file list and operation options for selecting the recording file and initiating a review request can be displayed in the interface so as to play back the recording file. For example, as shown at 72 in fig. 7-1, a "review" option may be provided in the target interface, and after clicking on the option, the presented interface may be as shown in fig. 7-3, through which the file to be reviewed may be checked, and in this way multiple pieces may be checked, playing of the selected file may be triggered by the "one-click review" option, etc. If a plurality of files are selected, the files can be played in a multi-grid mode through floating windows and the like during playing, for example, as shown in fig. 7-4.

In addition, as described above, the related data acquired from the AP may further include metadata, where the metadata includes: parameter data related to video data acquisition and/or data acquisition start and end mark data; at this time, the target interface may further include: an operation option for processing the diary information; after receiving the request through the operation options, a script information processing interface can be provided, and after the metadata is organized, the metadata is automatically filled into the fields corresponding to the script information. For example, as shown at 73 in fig. 7-1, a "scene" option may be provided in the target interface, and after clicking on the option, the displayed interface may be as shown in fig. 7-5, where information about card number, frame rate, etc. may be automatically filled in by the program, and the scene staff only needs to complete information about the times of the mirror, scene, atmosphere, shot content, etc. Because the information such as the card number, the frame rate and the like is automatically filled according to the extracted metadata, the situations of low efficiency, high error rate and the like in the manual input process can be avoided.

Example five

In the fourth embodiment, the function related to the script may be integrated in the application providing the monitoring service, or alternatively, the script function may be provided by a separate application, so the fifth embodiment is a method for providing the script service for the latter, see fig. 8, which may include:

s801: responding to a request for generating the script information, receiving related data provided by local area network access point equipment deployed in a film and television theatre shooting site, wherein the related data are obtained by aggregating various data acquired in the film and television theatre shooting site, and distributing the data in a wireless network transmission mode through the local area network access point equipment after the data are converted into a coding format suitable for wireless network transmission; wherein the related data comprises metadata in the video acquisition process; the metadata includes: parameter data related to video data acquisition and/or data acquisition start and end mark data;

s802: decoding the metadata, and filling the metadata into corresponding input controls in a target interface according to a preset interface structure;

s803: and displaying the target interface so as to generate the script information on the basis that the information is filled in the target interface.

Example six

In a sixth embodiment, from the viewpoint of providing a remote monitoring service, a remote data monitoring service method is provided, and referring to fig. 9, the method may include:

s901: responding to a remote data monitoring request, and acquiring information of a target interface and related data thereof from a server; the related data are collected in a film and television theatre shooting scene, are aggregated and converted into a coding format suitable for wireless network transmission, and are transmitted to the server through gateway equipment of a mobile communication network; the target page is generated after the related data are organized according to a preset interface structure;

s902: and displaying the target interface so as to provide a service for remotely monitoring various data collected in the film and television theatre shooting scene through the target interface.

In particular, operation options for labeling the data displayed in the target interface may also be provided. After the operation option receives the marking information, marking information can be added at a position corresponding to the marking time on the playing progress bar, and the marking information comprises the identification information of the marking adder. For example, as shown in fig. 10, if a producer or the like has a certain opinion or suggestion when monitoring shooting data at a certain moment, marking information can be input through a specific input box, accordingly, marking information such as the form of the producer can be displayed at a corresponding position on a playing progress bar, and when clicking a certain mark on the progress bar, corresponding marking content in a right marking information display column can be synchronously highlighted.

For the parts of the foregoing embodiments that are not described in detail, reference may be made to other embodiments or descriptions of other parts in this specification, and no further description is given here.

It should be noted that, in the embodiments of the present application, the use of user data may be involved, and in practical applications, user specific personal data may be used in the schemes described herein within the scope allowed by applicable legal regulations in the country where the applicable legal regulations are met (for example, the user explicitly agrees to the user to actually notify the user, etc.).

Corresponding to the fourth embodiment, the embodiment of the present application further provides a device for providing a data monitoring service, referring to fig. 11, the device may include:

the data receiving unit 1101 is configured to receive, in response to a data monitoring request, related data provided by a local area network access point device deployed in a movie and television theatre shooting site, where the related data is distributed in a wireless network transmission manner through the local area network access point device after aggregating multiple data collected in the movie and television theatre shooting site and converting the data into a coding format suitable for wireless network transmission;

the interface generating unit 1102 is configured to decode the received related data, and organize the related data according to a preset interface structure to generate a target interface;

The monitoring service data displaying unit 1103 is configured to display the target interface, so as to provide a service for monitoring various data collected in the film and television theatrical shooting field through the target interface.

the interface generating unit may specifically be configured to: and synchronously displaying the pictures of the multipath video data in the target interface in a multi-grid mode.

Or the related data also comprises data for recording various data collected by the film and television dramatic shooting site;

Furthermore, the related data further includes metadata, the metadata including: parameter data related to video data acquisition and/or data acquisition start and end mark data; at this time, the target interface may further include: an operation option for processing the diary information;

at this time, the apparatus may further include:

and the automatic entry unit of the script information is used for providing a script information processing interface after receiving the request through the operation options, and automatically filling the metadata into the fields corresponding to the script information after organizing the metadata.

Corresponding to the fifth embodiment, the embodiment of the present application further provides a device for providing a script service, referring to fig. 12, the device may include:

the data receiving unit 1201 is configured to receive, in response to a request for generating the biographical information, related data provided by a local area network access point device deployed in a movie and television theatre shooting site, where the related data is obtained by aggregating multiple data collected in the movie and television theatre shooting site and converting the aggregated data into a coding format suitable for wireless network transmission, and then distributing the aggregated data in a wireless network transmission manner through the local area network access point device; wherein the related data comprises metadata in the video acquisition process; the metadata includes: parameter data related to video data acquisition and/or data acquisition start and end mark data;

the metadata automatic entry unit 1202 is configured to decode the metadata, and fill the metadata into a corresponding input control in a target interface according to a preset interface structure;

the interface display unit 1203 is configured to display the target interface so as to generate the script information on the basis that the target interface is filled with information.

Corresponding to embodiment six, the embodiment of the present application further provides a remote data monitoring service device, referring to fig. 13, the device may include:

A data obtaining unit 1301, configured to obtain, from a server, information of a target interface and associated related data thereof in response to a remote data monitoring request; the related data are collected in a film and television theatre shooting scene, are aggregated and converted into a coding format suitable for wireless network transmission, and are transmitted to the server through gateway equipment of a mobile communication network; the target page is generated after the related data are organized according to a preset interface structure;

the interface display unit 1302 is configured to display the target interface, so as to provide a service for remotely monitoring multiple data collected in the film and television theatrical shooting field through the target interface.

Wherein the apparatus may further comprise:

the labeling option providing unit is used for providing operation options for labeling the data displayed in the target interface;

and the mark adding unit is used for adding mark information at a position corresponding to the marking time on the playing progress bar after receiving the marking information through the operation options, wherein the mark information comprises the identification information of a mark adder.

In addition, the embodiment of the application further provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps of the method of any one of the foregoing method embodiments.

And an electronic device comprising:

one or more processors; and

a memory associated with the one or more processors for storing program instructions that, when read for execution by the one or more processors, perform the steps of the method of any of the preceding method embodiments.

Fig. 14 illustrates an architecture of an electronic device, which may include a processor 1410, a video display adapter 1411, a disk drive 1412, an input/output interface 1413, a network interface 1414, and a memory 1420, among others. The processor 1410, the video display adapter 1411, the disk drive 1412, the input/output interface 1413, the network interface 1414, and the memory 1420 are communicatively connected by a communication bus 1430.

The processor 1410 may be implemented by a general-purpose CPU (Central Processing Unit, processor), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, etc., to execute related programs to implement the technical solutions provided in the present application.

The Memory 1420 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory ), static storage device, dynamic storage device, or the like. The memory 1420 may store an operating system 1421 for controlling the operation of the electronic device 1400, and a Basic Input Output System (BIOS) for controlling the low-level operation of the electronic device 1400. In addition, a web browser 1423, a data storage management system 1424, a data monitoring service processing system 1425, and the like may also be stored. The data monitoring service processing system 1425 may be an application program that specifically implements the operations of the foregoing steps in the embodiments of the present application. In general, when implemented in software or firmware, the relevant program code is stored in memory 1420 and executed by processor 1410.

The input/output interface 1413 is used to connect with input/output modules to achieve information input and output. The input/output module may be configured as a component in a device (not shown) or may be external to the device to provide corresponding functionality. Wherein the input devices may include a keyboard, mouse, touch screen, microphone, various types of sensors, etc., and the output devices may include a display, speaker, vibrator, indicator lights, etc.

The network interface 1414 is used to connect communication modules (not shown) to enable communication interactions of the present device with other devices. The communication module may implement communication through a wired manner (such as USB, network cable, etc.), or may implement communication through a wireless manner (such as mobile network, WIFI, bluetooth, etc.).

Bus 1430 includes a path to transfer information between the various components of the device (e.g., processor 1410, video display adapter 1411, disk drive 1412, input/output interface 1413, network interface 1414, and memory 1420).

It is noted that although the above-described devices illustrate only the processor 1410, the video display adapter 1411, the disk drive 1412, the input/output interface 1413, the network interface 1414, the memory 1420, the bus 1430, etc., the device may include other components necessary to achieve proper operation in an implementation. Furthermore, it will be understood by those skilled in the art that the above-described apparatus may include only the components necessary to implement the present application, and not all the components shown in the drawings.

From the above description of embodiments, it will be apparent to those skilled in the art that the present application may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the methods described in the embodiments or some parts of the embodiments of the present application.

In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for a system or system embodiment, since it is substantially similar to a method embodiment, the description is relatively simple, with reference to the description of the method embodiment being made in part. The systems and system embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

The foregoing has described in detail the method for providing data monitoring service and the integrated machine device provided by the present application, and specific examples have been applied herein to illustrate the principles and embodiments of the present application, where the foregoing examples are only for aiding in understanding the method and core idea of the present application; also, as will occur to those of ordinary skill in the art, many modifications are possible in view of the teachings of the present application, both in the detailed description and the scope of its applications. In view of the foregoing, this description should not be construed as limiting the application.

Claims

1. A method of providing a data monitoring service, comprising:

2. An all-in-one machine apparatus, comprising:

3. The all-in-one machine apparatus according to claim 2, wherein,

the plurality of data collected at the shooting site comprises: and the multiple paths of video data corresponding to the camera positions.

4. The all-in-one machine apparatus according to claim 3, wherein,

the shooting site is further provided with a plurality of image transmission devices which are respectively corresponding to the camera devices of the plurality of sites, and the image transmission devices are used for receiving video data acquired by the corresponding camera devices in a wireless receiving mode;

5. The all-in-one machine apparatus according to claim 3, wherein,

the plurality of data collected at the shooting site further comprises: audio data;

6. The all-in-one machine apparatus according to claim 5, wherein,

the shooting site is further provided with a wireless audio receiver device, which is used for receiving the audio data collected by the recording station device in a wireless mode and is connected with the audio signal distribution module in a wired mode so as to transmit the audio data to the audio signal distribution module.

7. The all-in-one machine apparatus according to claim 2, wherein,

the plurality of data collected at the shooting site further comprises: metadata including parameter data related to video data acquisition and/or data acquisition start and end flag data;

8. The all-in-one machine apparatus according to claim 7, wherein,

9. The all-in-one machine apparatus according to claim 8, wherein,

the all-in-one machine equipment further comprises a display module;

10. A data processing system, comprising:

the all-in-one device according to claim 2, and a plurality of image transmission devices corresponding to the camera devices of the plurality of stations, a wireless audio receiver device corresponding to the recording station device, a network device;

11. A method for providing data monitoring services, comprising:

12. A method of providing a script service, comprising:

13. A method of remote data monitoring service, comprising:

14. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the steps of the method of any of claims 11 to 13.

15. An electronic device, comprising:

one or more processors; and

a memory associated with the one or more processors for storing program instructions that, when read for execution by the one or more processors, perform the steps of the method of any of claims 11 to 13.