TWM469564U - Digital multimedia data labeling system - Google Patents

Description

Digital audio and video data marking system

This creation is a data transmission technology, especially a marking system for digital audio and video materials.

Nowadays, data acquisition devices are becoming more and more popular, people are capturing digital audio and video materials in the environment all the time. However, it is still unable to effectively store, extract and use a large number of digital audio and video materials. The reason is that the storage or extraction of general digital audio and video data lacks a mechanism of point division or segmentation. Therefore, when the user needs to perform content inspection on a specific interval of digital audio and video data, all audio and video files must be downloaded from the data storage center. And from the beginning to view the content, not only inefficient but also waste the hardware and software resources of data transmission.

In order to solve the above problems, 遂 developed a technique for time stamping digital audio and video materials, which mainly uses the system time of the data acquisition device to mark the digital audio and video data in points or segments, so that it can be used in the future. When extracting data, the specific interval content required can be obtained according to different time points.

However, the time-stamping of digital audio and video data still cannot greatly improve the efficiency of users in extracting and viewing digital audio and video data. The reason is that people cannot clearly remember the precise time point when a specific event occurs, and only grasp a possible interval. For example, for a certain period of time, when there is a need to view the specific event, it is still necessary to capture a large range of digital audio and video materials and start from the beginning. Start viewing content. In the event that the user has an error in the time memory, it is highly probable that the digital audio and video data in the wrong interval will be captured and the game will be busy.

Furthermore, general digital audio and video materials are legally electromagnetic records. Although China's criminal law 359 has criminal liability for the deletion or alteration of electromagnetic records, in practice, digital audio and video materials are often falsified or altered by interested people. The incident caused the legal evidence and the ability of the digital audio and video materials to be questioned.

Therefore, how to accurately mark the interval of digital audio and video data to increase the efficiency of digital audio and video data extraction, and at the same time can greatly save the software and hardware resources consumed by data transmission, as well as the legal evidence and proof of audio and video data. It is an urgent issue to be solved in order to achieve the event record and the performance of the contract.

In view of this, the main purpose of this creation is to provide a technique for interval marking of digital audio and video materials.

In order to achieve the above and other objects, the present invention provides a marking system for digital audio and video data, comprising: at least one digital audio and video capturing device for capturing digital audio and video data in a user environment, wherein the digital audio and video The data has a breakpoint message added in advance; the data center is connected to the digital audio and video capture device to receive the digital audio and video data, and the digital audio and video data is marked. The data center includes: a data transceiver module for receiving The digital audio and video data; the analysis module analyzes the breakpoint information of the digital audio and video data to generate the marking information; the marking module uses the marking information to perform interval marking on the digital audio and video data, and according to the result of the interval marking The digital audio and video data is divided into complex array interval data; and the storage module is used for storing the interval data; and the user terminal device is connected to the data center for identity verification The card is used to extract the interval data from the storage module of the data center after the identity verification.

In an embodiment, the labeling module further includes a predetermined task analyzing unit, wherein the predetermined task analyzing unit performs the interval labeling result and the complex array interval data generated by the labeling module according to the pre-joined task schedule. The analysis is performed to confirm whether the result of the interval indication and the data of the complex array interval meet the task schedule, and if not, an abnormal message is generated.

The present invention further provides a marking system for digital audio and video data, which comprises at least one digital audio and video capturing device for capturing digital audio and video data in a user environment, wherein the digital audio and video data has a breakpoint message added in advance; The service center is connected to the digital audio and video capture device to receive the digital audio and video data, and the digital audio and video data is marked. The service center includes: a data transceiver module for receiving the digital audio and video data; an analysis module, The breakpoint information of the digital audio and video data is analyzed to generate the mark information; and the markup module uses the mark information to perform interval mark on the digital audio and video data, and divides the digital audio and video data into a complex array according to the result indicated by the interval. Inter-section data; the data storage center is linked to the service center for capturing and storing the interval data; and the client device is connected to the data storage center for identity verification to verify the identity from the data storage after the identity verification The center extracts the interval data.

The present invention further provides a marking system for digital audio and video data, which comprises at least one digital audio and video capturing device for capturing digital audio and video data in a user environment, wherein the digital audio and video data has a breakpoint message added in advance; The service center is connected to the digital audio and video capture device to receive the digital audio and video data; the data storage center is connected to the service center to capture the digital audio and video data, and the digital audio and video data is marked. The data storage center includes: The data transceiver module is configured to receive the digital audio and video data; the analysis module is configured to analyze the breakpoint information of the digital audio and video data to generate the marking information; and the marking module is to use the marking information to the digital audio and video The material is subjected to interval indication, and the digital audio and video data is divided into complex array interval data according to the result indicated by the interval; and the storage module is used for storing the interval data; and the user equipment is connected to the data storage center. Identity verification, in order to extract the interval data from the data storage center after verification by the identity.

Compared with the prior art, the digital video and audio data marking system of the present invention can analyze the breakpoint information added in advance in the digital audio and video data, and divide the digital audio and video data into complex array interval data according to the breakpoint information. In this way, the user can quickly and accurately extract a specific interval of the digital audio and video data, thereby greatly increasing the efficiency of data extraction. In addition, the service unit, the data storage center, and the user terminal device jointly manage the digital audio and video materials, so that the digital audio and video materials have the legal evidence ability and the proof power, so that the event record, the certification contract fulfillment, etc. can be achieved. .

1, 2, 3‧‧‧ digital video data marking system

10‧‧‧Data Center

101, 201, 331‧‧‧ data transceiver module

102, 202, 332‧‧‧ Analysis Module

103, 203, 333‧‧‧ marking module

104, 334‧‧‧ storage module

11, 21, 31‧‧‧ digital audio and video capture device

12, 22, 32‧‧‧Customer device

20, 30‧‧‧ Service Center

23, 33‧‧‧ Data Storage Center

FIG. 1 is a schematic diagram of a specific embodiment of the marking system for digital audio and video materials of the present invention.

Figure 2 is a schematic diagram of another embodiment of the marking system for digital audio and video data of the present invention.

Fig. 3 is a schematic diagram showing still another embodiment of the marking system using the digital video material of the present invention.

The embodiments of the present invention are described below by way of specific embodiments, and those skilled in the art can readily appreciate the other advantages and effects of the present invention from the disclosure herein. Of course, this creation can also be implemented or applied by other different embodiments.

Please refer to FIG. 1 , which is a schematic diagram of a specific embodiment of the marking system of the digital audio and video material of the present invention. As shown in the figure, the digital display system 1 of the present invention includes a digital audio and video capture device 11 for capturing digital audio and video data in a user environment, for performing the digital audio and video data. The marked data center 10 and the client device 12 for extracting digital audio and video data from the data center 10. The digital audio and video capturing device 11 can be a device for capturing video or audio data, such as a video camera, a video recorder or a sound recorder, and is connected to the data center 10 through a wired or wireless network, and is served by a service personnel holding the digital audio and video capturing device 11 When a user environment captures digital audio and video data, a breakpoint message must be added to the digital audio and video material. The data center 10 can be a video data server, which can access the digital audio and video data and perform specific time indication or specific interval indication on the digital audio and video data according to the above-mentioned breakpoint information, wherein the breakpoint information can be used by the service personnel. Specific images, text, gestures, actions, voices, or a combination thereof recorded at a particular time. The client device 12 can be a data processing device such as a computer or a mobile phone, and can be connected to the data center 10 via a wired or wireless network for identity verification, and after downloading the identity, download the required digital audio and video materials.

The data center 10 further includes a data transceiving module 101 for receiving digital audio and video data, an analysis module 102 for analyzing the breakpoint information of the digital audio and video data to generate the indication information, and using the indication information to perform interval indication on the digital audio and video data. The identification module 103 for dividing the digital audio and video data into the complex array interval data according to the result of the interval indication, and the storage module 104 for storing the interval data.

Taking home care services as an example, home care providers are usually required to provide services such as back, blood pressure, massage, diaper changing or bathing at a specific time to the care recipient. However, general care providers can only The written report, work record or customer complaint content to know the performance of the field service personnel, the results presented are quite inaccurate, and once the dispute occurs, the above information can not be used as strong evidence. If the digital video recording system 1 of the present creation is used, a network camera can be installed on the service personnel to capture video and audio information when the service personnel provide the care service, and transmit the audio and video data to the care center through the network. So, care clothes The practitioners can accurately grasp the working conditions of the service personnel in the care center. Before the service personnel provide specific care services, you can record specific breakpoint messages, such as making a voice "Now I want to start the beat" before the back shot or "shaking the palm twice" in front of the webcam. After the completion of the back, the voice of "completed back shot" is issued or "OK gesture" is displayed in front of the network camera. Afterwards, the care center first uses the data transceiver module 101 to retrieve the complete digital audio and video data, and then uses the analysis module 102 to analyze the breakpoint information, and the analysis module 102 can pre-store the breakpoint trigger comparison table, for example, when When the voice of "Now I want to start the back" or "Twisting the palm twice" appears in the digital audio and video data, it means that the back is started. When the "recorded back" is detected in the digital audio and video data, When the voice or the "OK gesture" action is performed, it means the end of the beat. Then, the analysis module 102 identifies the digital audio and video data to determine the location of the breakpoint information in the digital audio and video data, and can learn that the segment of the service personnel performing the back-off service is in the interval of the digital audio and video data, and then Then, the labeling module 103 generates corresponding marking information according to the location (or the interval) of the breakpoint message. Finally, the labeling module 103 marks the "beatback" section according to the marking information and divides it into specific section data. And stored in the storage module 104. After that, when the care provider or the caregiver wants to inquire about the content of the "back", it is only necessary to download the "back" data, instead of downloading the complete digital audio and video data from the beginning.

The above specific implementation uses, for example, a conventional time stamp, and cannot obtain accurate results. For example, the service personnel originally scheduled to perform the back-selling service from 2 pm to 2 pm on a certain day, and if the time marking method is directly adopted, The day's digital audio and video materials are defined as the "beat back" interval from 2 pm to 2:30 pm. However, if the service personnel delays the execution of the back or delays due to the incident, the resulting "back" section will not be able to fully display the back. The situation. It can be seen that the marking system of the digital audio and video material of the present invention can more accurately grasp the specific audio and video content than the conventional time marking method. In the interval, it can increase the efficiency of data extraction and browsing.

In another embodiment, the indicator module 103 further includes a predetermined task analysis unit, the predetermined task analysis unit is based on the pre-joined task schedule, and the result of the interval indication generated by the indicator module 103 and the complex array interval data. An analysis is performed to confirm whether the result of the interval indication and the data of the complex array interval meet the task schedule, and if not, an abnormal message is generated. For example, if the service staff is scheduled to perform 20 service tasks (pre-joined task schedules) in one mission, and each job should be re-created and recorded before the service, and then provided to the analysis. The module and the marking module mark the working interval of the digital audio and video data. At this time, the scheduled task analyzing unit analyzes and compares the marked working interval and the task schedule, if a predetermined task does not appear after being marked In the digital audio and video data, it indicates that the service personnel did not perform the task, so the scheduled task analysis unit generates an abnormal message to perform an immediate alarm or provide an after-the-fact abnormality report by the data center 10.

In another embodiment, the data center 10 can include a first two-way communication module and the digital video capture device 11 can include a second two-way communication module, and the data center 10 and the digital video capture device 11 are instantly connected. The two-way communication module and the digital video capture device 11 can exchange information instantaneously through the first two-way communication module and the second two-way communication module.

In another embodiment, the storage module 104 can be provided with a protection housing, and the protection housing is provided with an inductive controller for storing in the storage module when an external force is detected to forcibly destroy the protection housing. The digital audio and video data of the group 104 is reproduced, encrypted, cleared or destroyed to enhance the confidentiality of the digital audio and video materials.

Please refer to FIG. 2, which is a schematic diagram of another specific embodiment of the marking system of the digital audio and video material of the present invention. As shown in the figure, the marking system 2 of the digital audio and video material of the present creation includes at least one number. The video and audio capture device 21, the service center 20, the data storage center 23, and the client device 22, wherein the service center 20 further includes a data transceiving module 201 for receiving digital audio and video data, and a breakpoint message for analyzing digital audio and video data. The analysis module 202 that generates the indication information, uses the indication information to perform interval indication on the digital audio and video data, and divides the digital audio and video data into the identification module 203 of the complex array interval data according to the result of the interval indication.

Compared with the embodiment of FIG. 1 , the data storage center 23 is further added to the embodiment. The data storage center 23 can be, for example, a cloud (remote) server for storing digital audio and video data. In the specific implementation, first, the digital video capture device 21 captures digital audio and video data in the user environment, and uploads the digital audio and video data to the service center 20 through the network, wherein the digital audio and video data has a breakpoint message added in advance. Then, the service center 20 performs interval indication on the digital audio and video data, and divides the digital audio and video data into complex array interval data according to the result of the interval indication. Finally, the service center 20 uploads the section data to the data storage center 23 to connect the data storage center 23 to the identity verification by the client device 22, and extracts the section data from the data storage center 23 after the identity verification. The data storage center 23 has a data extraction restriction module for performing matching verification on the service center 20 and the client device 22 when the client device 22 requests the extraction of the interval data, and if the matching verification cannot be performed, the user is restricted. The end device 22 extracts the interval data.

In detail, the embodiment provides a data transfer mode that is notarized (or authenticated) by a third party. Taking the aforementioned care service as an example, when a dispute occurs, both the caregiver and the care service provider hope to find content that is beneficial to themselves from the digital audio and video materials, and even use it as evidence in litigation. Therefore, in order to avoid the alteration or tampering of digital audio and video materials, it is naturally necessary to limit the access of the caregiver and the care service provider to the digital audio and video materials in the data storage center 23. On the other hand, digital audio and video materials may also involve personal privacy or business secrets. The third-party notary unit belonging to the caregiver and the care service provider obtains the management authority. For example, the data storage center 23 may first encrypt the specific digital audio and video materials and issue corresponding decoded messages to the caregiver and the care service provider respectively, when the care recipient (ie, the client device 22) or the care service provider (ie, the service) Center 20) When an extraction request is sent for a specific interval data, the data storage center 23 must request the caregiver and the care provider to provide respective decoded messages for matching verification. If the decoded message can correctly decrypt the specific interval data, the representative By matching verification, the file can be opened for downloading, and if the matching verification is not possible, the data is restricted.

This method allows the caregiver and the care provider to know at any time that the other party has the information to extract the data, and can enhance the evidence ability and proof of the digital audio and video materials through matching verification, thus speeding up the dispute resolution time. . In other words, this creation discloses a mode in which the service provider, the data storage terminal (the third-party notary unit), and the user-side digitally manage the digital audio and video materials, so that the digital audio-visual materials can have legal evidence and Proof of power, so in the future, whether it is the user, the service provider, or the court, the dispute resolution agency can extract digital audio and video data from the data storage terminal for event recording, event inspection, contract performance, proof, or referee. . Furthermore, the data storage center 23 provided in this embodiment plays the role of a third-party notary unit. Therefore, any digital audio and video data stored in the data storage center 23 is in principle prohibited from being accessed and modified by any person, so as to improve the digital audio and video data. Notarized. If it is necessary to modify, the data storage center 23 also needs to record the modification track and history of all digital audio and video materials after the consent of the above three parties, and provide effective inspection and confirmation when the future dispute occurs.

In an embodiment, the data storage center 23 can also perform two-way verification by means of synchronous encryption and decryption of remote or local extracted information. The encryption and decryption methods can use passwords, pattern codes, or biometric methods. In still another embodiment, the data storage center 23 further includes a encryption and decryption operation. The computing module is connected to the client device 22 and the service center 20 respectively for performing encryption and decryption of digital audio and video data.

During the implementation of this creation, the service personnel carry a set of video equipment that can be instantly connected to the service center, and the service center has pre-stored the procedures for the video recording (such as service plan or standard operation process), when the service personnel start the operation, The service center and the video equipment can exchange information in two directions through the instant connection system. For example, the on-duty staff of the service center can guide the on-site service personnel to work through voice or SMS, or the on-site service personnel can immediately report the situation to the service center. This ensures that the job or program that should be performed goes smoothly. At the same time, the analysis module and the marking module of the service center can segment, mark, save and encrypt the captured audio and video data after each program is completed. If the service center finds the pre-stored program for proofing and actual acquisition If the video material does not match, you can immediately send a message to the on-site service personnel to remedy.

Please refer to FIG. 3, which is a schematic diagram of still another embodiment of the marking system of the digital audio and video material of the present invention. As shown in the figure, the digital video recording system 3 includes at least one digital audio and video capturing device 31, a service center 30, a data storage center 33, and a client device 32. The data storage center 33 further includes receiving data. The data transceiving module 301 of the digital audio and video data, the analysis of the breakpoint information of the digital audio and video data to generate the indication information 302, the use of the indication information to mark the digital audio and video data, and segment the digital audio and video data according to the result of the interval indication The indicator module 303 is a combination of the array data and the storage module 304 for storing the interval data.

Compared with the embodiment in FIG. 2, this embodiment is a function of adding, analyzing, marking, and storing digital audio and video data in the data storage center 23. In detail, taking the aforementioned care service as an example, the service center 30 located at the care service provider may not be able to view the digital image due to insufficient software and hardware. The audio and video data uploaded by the sound capturing device 31 is analyzed, marked and divided. Therefore, the service center 30 of the embodiment directly uploads the digital audio and video data to the data storage center 23 (such as a cloud server), which is relatively large. The resource data storage center 23 analyzes, marks, segments and stores digital audio and video materials. Other than that, the functions of other modules in this embodiment are similar to those of the embodiment in FIG. 2, and will not be described again.

In short, this creation is instantly connected through the data storage center 33, the service center 30 and the user terminal device 32, and can efficiently perform interval indication, identification segmentation and confidential storage for digital audio and video data, thereby achieving high interaction. Sexual, high accuracy, high efficiency, high confidentiality, and high security digital audio and video data transmission and storage process.

In summary, the digital video and audio data marking system of this creation can mark and segment the digital audio and video data, and also provide a third-party notarized data transmission mode, so that all users can quickly, accurately and without dispute. The required digital audio and video data is extracted, so that the efficiency of data extraction can be greatly increased, and the problem that the conventional audio and video materials are excessively large and difficult to manage can be solved. Furthermore, this creation enables the digital audio and video materials to have legal evidence and proficiency by means of the service provider, the data storage terminal, and the user side to jointly manage the digital audio and video materials, thereby shortening the handling of various disputes. Time course and provide users with a secure environment and mechanism for personal data (video privacy).

However, the above embodiments are merely illustrative of the principles of the present invention and its effects, and are not intended to limit the present invention. Anyone who is familiar with the art can modify and change the above embodiments without departing from the spirit and scope of this creation. Therefore, the scope of protection of this creation should be as listed in the scope of the patent application described later.

1‧‧‧Digital audio and video identification system

10‧‧‧Data Center

101‧‧‧ Data Transceiver Module

102‧‧‧Analysis module

103‧‧‧Marking module

104‧‧‧Storage module

11‧‧‧Digital audio and video capture device

12‧‧‧Customer device

Claims (10)

A marking system for digital audio and video data, comprising: at least one digital audio and video capturing device for capturing digital audio and video data in a user environment, wherein the digital audio and video data has a breakpoint message added in advance; Linking the digital audio and video capture device to receive the digital audio and video data, and marking the digital audio and video data, the data center includes: a data transceiver module for receiving the digital audio and video data; the analysis module is analyzed The breakpoint information of the digital audio and video data is used to generate the marking information; the marking module uses the marking information to perform interval marking on the digital audio and video data, and divides the digital audio and video data into complex array interval data according to the result indicated by the interval; The storage module is configured to store the interval data; and the client device is connected to the data center for identity verification to extract the interval data from the storage module of the data center after the identity verification. The marking system for digital audio and video data according to claim 1, wherein the breakpoint message is formed by using the digital audio and video capturing device to capture a specific text, a pattern, a sound, an action, or a combination thereof, and The analysis module identifies the digital audio and video data to determine the location of the breakpoint information in the digital audio and video data, and generates corresponding indication information according to the location. The marking system of the digital audio and video material according to the first aspect of the patent application, wherein the marking module further comprises a predetermined task analyzing unit, wherein the predetermined task analyzing unit generates the marking module according to the pre-joined task scheduling. The result of the interval indication and the complex array interval data An analysis is performed to confirm whether the result of the interval indication and the data of the complex array interval meet the task schedule, and if not, an abnormal message is generated. A marking system for digital audio and video data, comprising: at least one digital audio and video capturing device, configured to capture digital audio and video data in a user environment, wherein the digital audio and video data has a breakpoint message added in advance; a service center, The digital audio and video capture device is connected to receive the digital audio and video data, and the digital audio and video data is marked. The service center includes: a data transceiver module for receiving the digital audio and video data; and an analysis module for analyzing the The breakpoint information of the digital audio and video data is used to generate the marking information; and the marking module uses the marking information to perform interval marking on the digital audio and video data, and divides the digital audio and video data into complex array interval data according to the result indicated by the interval; The data storage center is connected to the service center for capturing and storing the interval data; and the client device is connected to the data storage center for identity verification to extract the identity from the data storage center after verifying the identity Some interval data. The marking system of the digital audio and video material as described in claim 4, wherein the data storage center has a data extraction restriction module, and is used when the user equipment requests the extraction of the interval data, The service center and the client device perform matching verification, and if the matching verification cannot be performed, the user equipment is restricted from extracting the interval data. The marking system for digital audio and video data as described in claim 4, wherein the breakpoint message uses the digital video capture device to capture a specific text, pattern, sound, motion or The combination is formed by the combination, and the analysis module identifies the digital audio and video data to determine the location of the breakpoint information in the digital audio and video data, and generates corresponding indication information according to the location. A marking system for digital audio and video data, comprising: at least one digital audio and video capturing device, configured to capture digital audio and video data in a user environment, wherein the digital audio and video data has a breakpoint message added in advance; a service center, The digital video capture device is connected to receive the digital audio and video data; the data storage center is connected to the service center to capture the digital audio and video data, and the digital audio and video data is marked, the data storage center includes: data transmission and reception module The group is configured to receive the digital audio and video data; the analysis module analyzes the breakpoint information of the digital audio and video data to generate the marking information; and the marking module uses the marking information to perform interval marking on the digital audio and video data, and according to the The result of the interval labeling divides the digital audio and video data into complex array interval data; and the storage module is configured to store the interval data; and the user equipment is connected to the data storage center for identity verification to pass the After the identity verification, the interval data is extracted from the data storage center. The marking system for digital audio and video data as described in claim 7, wherein the data storage center further includes a data extraction restriction module for extracting the interval data when the service center or the user equipment At the request, the service center and the client device perform matching verification, and if the matching verification cannot be passed, the service center or the client device is restricted from extracting the interval data. The marking system for digital audio and video data according to item 8 of the patent application, wherein the data extraction restriction module encrypts the interval data in advance, and when the service center or the user device proposes the extraction request of the interval data The matching verification performed by the data extraction restriction module refers to decrypting the interval data by using the corresponding verification code from the service center and the user equipment, and limiting the service center or the user if the decryption cannot be performed. The end device extracts the interval data. The marking system for digital audio and video data according to claim 7, wherein the breakpoint message is formed by using the digital video capture device to capture a specific text, a pattern, a sound, an action, or a combination thereof, and The analysis module identifies the digital audio and video data to determine the location of the breakpoint message in the digital audio and video material, and generates corresponding indication information according to the location.