WO2021189647A1 - 多媒体信息的确定方法、头戴设备、存储介质及电子设备 - Google Patents

多媒体信息的确定方法、头戴设备、存储介质及电子设备 Download PDF

Info

Publication number
WO2021189647A1
WO2021189647A1 PCT/CN2020/093730 CN2020093730W WO2021189647A1 WO 2021189647 A1 WO2021189647 A1 WO 2021189647A1 CN 2020093730 W CN2020093730 W CN 2020093730W WO 2021189647 A1 WO2021189647 A1 WO 2021189647A1
Authority
WO
WIPO (PCT)
Prior art keywords
head
mounted device
multimedia information
target area
voice
Prior art date
Application number
PCT/CN2020/093730
Other languages
English (en)
French (fr)
Inventor
刘若鹏
栾琳
Original Assignee
深圳光启超材料技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳光启超材料技术有限公司 filed Critical 深圳光启超材料技术有限公司
Publication of WO2021189647A1 publication Critical patent/WO2021189647A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • AHUMAN NECESSITIES
    • A42HEADWEAR
    • A42BHATS; HEAD COVERINGS
    • A42B3/00Helmets; Helmet covers ; Other protective head coverings
    • A42B3/04Parts, details or accessories of helmets
    • A42B3/30Mounting radio sets or communication systems
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01KMEASURING TEMPERATURE; MEASURING QUANTITY OF HEAT; THERMALLY-SENSITIVE ELEMENTS NOT OTHERWISE PROVIDED FOR
    • G01K13/00Thermometers specially adapted for specific purposes
    • G01K13/20Clinical contact thermometers for use with humans or animals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording

Definitions

  • the present invention relates to the field of communications, and in particular to a method for determining multimedia information, a head-mounted device, a storage medium and an electronic device.
  • Smart helmets are technical personnel who combine high-tech products to upgrade an ordinary helmet to achieve the smart functions required by users. Smart helmets have been widely used in the security industry.
  • the existing head-mounted device has a single function and cannot perform area shooting, and no effective solution has been proposed.
  • the embodiments of the present invention provide a method for determining multimedia information, a head-mounted device, a storage medium, and an electronic device, so as to at least solve the technical problems of the existing head-mounted device in the related art that the function of the existing head-mounted device is single and cannot perform area shooting.
  • a method for determining multimedia information includes: receiving a voice instruction sent by a target object through a head-mounted device; Shooting to obtain multimedia information corresponding to the target area.
  • receiving a voice instruction sent by a target object through a head-mounted device includes: directly receiving a voice instruction sent by the target object through the head-mounted device; or receiving an operation instruction sent by a wearable device through the head-mounted device , Wherein the operation instruction corresponds to the voice instruction received by the wearable device from the target object.
  • the method further includes: transmitting the voice instruction to a voice server, so that the voice server determines the operation corresponding to the voice instruction, wherein: The operation includes at least one of the following: taking a picture of the target area, and recording the target area.
  • controlling the camera of the head-mounted device to photograph a target area to obtain multimedia information corresponding to the target area includes: the voice server has determined the operation corresponding to the voice instruction In the case of controlling the camera of the head-mounted device to turn on the function corresponding to the operation; the target area is photographed according to the function corresponding to the operation to determine the multimedia information corresponding to the target area, wherein
  • the multimedia information includes at least one of the following: pictures, videos.
  • controlling the camera of the head-mounted device to photograph a target area to obtain multimedia information corresponding to the target area includes: saving the multimedia information on the head-mounted device; or The multimedia information is uploaded to the application service platform of the headset.
  • the above method further includes: checking the biometric information in the multimedia information Perform recognition, display the recognition results, and/or identify key target objects based on the recognition results.
  • the above method further includes: measuring the temperature of the life body in the target area, and displaying the measurement result.
  • the above method further includes: when the measurement result indicates that the temperature of the living body exceeds a preset temperature, identifying the living body in the multimedia information.
  • a head-mounted device which includes a receiving module for receiving a voice instruction sent by a target object; a processing module for responding to the voice instruction to control a camera of the head-mounted device The target area is photographed, and the multimedia information corresponding to the target area is obtained.
  • the above-mentioned receiving module is further configured to directly receive a voice instruction sent by the target object through the head-mounted device; or receive an operation instruction sent by a wearable device through the head-mounted device, wherein the operation instruction Corresponding to the voice command received by the wearable device from the target object.
  • the above-mentioned head-mounted device further includes: a transmission module, configured to transmit the voice instruction to a voice server, so that the voice server can determine an operation corresponding to the voice instruction, wherein the operation includes at least one of the following One: Take a picture of the target area, and record the target area.
  • a transmission module configured to transmit the voice instruction to a voice server, so that the voice server can determine an operation corresponding to the voice instruction, wherein the operation includes at least one of the following One: Take a picture of the target area, and record the target area.
  • the aforementioned processing module is further configured to control the camera of the head-mounted device to turn on the function corresponding to the operation when the voice server has determined the operation corresponding to the voice instruction; according to the operation
  • the corresponding function captures the target area to determine the multimedia information corresponding to the target area, where the multimedia information includes at least one of the following: pictures and videos.
  • the aforementioned head-mounted device further includes a saving module, configured to save the multimedia information on the head-mounted device; or upload the multimedia information to the application service platform of the head-mounted device.
  • a saving module configured to save the multimedia information on the head-mounted device; or upload the multimedia information to the application service platform of the head-mounted device.
  • the processing module is further configured to recognize the biometric information in the multimedia information, display the recognition result, and/or identify the key target object according to the recognition result.
  • the aforementioned head-mounted device is also used to measure the temperature of the living body in the target area and display the measurement result.
  • the aforementioned head-mounted device is further configured to identify the living body in the multimedia information when the measurement result indicates that the temperature of the living body exceeds a preset temperature.
  • a computer-readable storage medium stores a computer program, wherein the computer program is configured to execute the multimedia information when running. Determine the method.
  • an electronic device including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes the above-mentioned computer program through the computer program. How to determine multimedia information.
  • the voice instruction sent by the target object is received through the head-mounted device; in response to the voice instruction, the camera of the head-mounted device is controlled to shoot the target area, and the multimedia information corresponding to the target area is obtained.
  • FIG. 1 is a schematic diagram of the in-product application of a method for determining multimedia information according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a terminal system framework of a smart helmet according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of the composition of a terminal system of a smart helmet according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of an application environment of a method for determining multimedia information according to an embodiment of the present invention
  • Fig. 5 is a flowchart of a method for determining multimedia information according to an embodiment of the present invention.
  • Fig. 6 is a flowchart of an optional head-mounted device operating to perform photographing and video recording functions according to an embodiment of the present invention
  • Fig. 7 is a flowchart of an optional live broadcast module according to an embodiment of the present invention.
  • Fig. 8 is a schematic structural diagram of a head-mounted device according to an embodiment of the present invention.
  • Fig. 9 is a schematic structural diagram of an optional electronic device according to an embodiment of the present invention.
  • Fig. 1 is a schematic diagram of the in-product application of a method for determining multimedia information according to an embodiment of the present invention; taking the helmet body as a reference, the smart helmet (equivalent to the “head-mounted device” in the embodiment of the present invention) is performed area Divide the smart helmet into seven areas: the outer front side 1, the outer top side 2, the outer left and right sides 3, the outer rear side 4, the inner front side 5, the inner top side 6, and the inner rear side 7.
  • the outer front side is the information collection area, which is used to place the camera.
  • the outer top side is the communication area
  • the outer rear side is the energy supply area
  • the inner top side is the main board and the heat dissipation area
  • the outer left and right sides are the functional areas
  • the inner front side is the AR module.
  • the group and goggles area, the inner rear side is a head lock device.
  • the technical solution of the embodiment of the present invention is applied to an external front side information collection area, and multimedia data information is collected through a camera in the information
  • Functional layer In terms of function, smart helmets must meet the requirements of informatization, intelligence, and modernization. In addition to providing the most basic protection, communication, and live video functions, it also provides navigation, face recognition, ID card recognition, and license plate. Recognition, event push, voice translation and other functions.
  • Supporting layer In addition to the smart helmets and smart watches in the hardware part, it also includes a back-end smart helmet management system and a third-party Internet application service platform to provide hardware and service support for the intelligentization of the terminal system of the wearable smart helmet.
  • the smart helmet terminal system will connect to the system face recognition retrieval database, "one person, one file”, “one vehicle, one file”, OSS cloud, RDS and other databases of the relevant platform through cloud services and smart helmet back-end servers. Realize the intelligence and informationization of wearable smart helmets.
  • the terminal system composition of the smart helmet is shown in Figure 3.
  • the smart helmet terminal system composed of the smart helmet, smart watch, and smart helmet management system improves the efficiency of the smart helmet's collection of multimedia information in the target area in the actual work scene.
  • a method for determining multimedia information is provided.
  • the above-mentioned method for determining multimedia information may, but is not limited to, be applied to the application environment as shown in FIG. 4.
  • the head-mounted device 102 runs an application capable of recognizing voice commands, and the head-mounted device 102 includes a camera.
  • the head-mounted device 102 may receive the voice instruction sent by the target object through the head-mounted device, and respond to the voice instruction to control the camera of the head-mounted device to shoot the target area to obtain the multimedia information corresponding to the target area.
  • the server 104 may It is a voice server for voice commands, which is not limited in the embodiment of the present invention. The above is only an example, and the embodiment of the present application does not limit it here.
  • FIG. 5 is a flowchart of a method for determining multimedia information according to an embodiment of the present invention. As shown in FIG. 5, the above-mentioned method for determining multimedia information includes the following steps:
  • Step S202 receiving a voice instruction sent by a target object through a head-mounted device
  • Step S204 In response to the voice instruction, control the camera of the head-mounted device to shoot a target area to obtain multimedia information corresponding to the target area.
  • the voice instruction sent by the target object is received through the head-mounted device; in response to the voice instruction, the camera of the head-mounted device is controlled to shoot the target area, and the multimedia information corresponding to the target area is obtained, using the above technical solution , It solves the problem of the single function of the existing head-mounted device in the related technology and cannot perform area shooting. Then the head-mounted device camera can be controlled by voice commands to shoot the target area to obtain multimedia information, thereby realizing the head-mounted device Multimedia information of the target area in the actual work scene.
  • receiving the voice instructions sent by the target object through the head-mounted device can be achieved by the following implementations: 1) The voice instructions sent by the target object can be directly received through the head-mounted device, that is, the head-mounted device itself can be used to target the target. The voice command of the object is fed back; 2) The operation instruction sent by the wearable device is received through the head-mounted device, where the operation instruction corresponds to the voice instruction received by the wearable device from the target object, for example, a wearable device It can be a smart watch, the target object can speak a voice command to the smart watch, and then the wearable device forwards the operation command corresponding to the voice command to the head-mounted device, and the head-mounted device can perform the operation corresponding to the voice command.
  • the voice instruction issued by the head-mounted device according to the target object may be the voice instruction of the target object directly received by the head-mounted device.
  • the content corresponding to the voice instruction Turn on the corresponding function of the corresponding voice command in the head-mounted device.
  • It can also be an operation command issued by a wearable device connected to the head-mounted device through the network.
  • a smart watch carried by the target object is connected to the head-mounted device through Bluetooth.
  • the smart watch is preset with software that can operate the head-mounted device, and the smart watch sends out the operating instructions of the head-mounted device during use.
  • the method further includes: transmitting the voice instruction to a voice server, so that the voice server determines the operation corresponding to the voice instruction, wherein:
  • the operation includes at least one of the following: taking a photo of the target area, and recording the target area, that is, uploading a voice command to a voice server connected to the headset, and sending the voice command through the voice server Search to find out the operation of the head-mounted device corresponding to the voice command, control the camera of the head-mounted device through the voice command to take photos or videos of the target area where the event occurred, collect the multimedia information of the target area, in order to understand the event in the target area, Provide information support.
  • the operation of analyzing voice commands in the foregoing embodiment is implemented by a voice server.
  • the received voice commands can also be analyzed through the headset itself, that is, the headset The device itself has the function of analyzing voice commands.
  • the voice server or the smart helmet parses out the operation corresponding to the voice instruction, responding to the voice instruction, control the camera of the head-mounted device to shoot the target area, and obtain the multimedia information corresponding to the target area.
  • This is achieved by the following solution: when the voice server has determined the operation corresponding to the voice instruction, control the camera of the head-mounted device to turn on the function corresponding to the operation; The target area is photographed to determine the multimedia information corresponding to the target area, where the multimedia information includes at least one of the following: pictures and videos.
  • the headset can be controlled by voice commands, so that the headset can turn on the camera operation, turn on the video recording function, and record the occurrence of on-site events in real time, or turn on the camera function for someone or something. Take photos and records to provide a basis for subsequent incident handling.
  • controlling the camera of the head-mounted device to photograph a target area to obtain multimedia information corresponding to the target area includes: saving the multimedia information on the head-mounted device; or The multimedia information is uploaded to the application service platform of the headset.
  • the multimedia information corresponding to the target area obtained through the camera of the head-mounted device can be saved on the head-mounted device.
  • multimedia information needs to be retrieved, the required multimedia information can be retrieved, and the multimedia information can be displayed on the display of the head-mounted device
  • multimedia information can also be uploaded to the application service platform of the headset for real-time sharing of multimedia information, and to prevent the failure of the headset, the headset can be searched through the application service platform until the headset before the failure Multimedia information recorded by the camera.
  • the above method further includes: checking the biometric information in the multimedia information Perform recognition, display the recognition result, and/or identify the key target object according to the recognition result, that is, after the target area is photographed through the headset, the obtained multimedia information of the target area is subjected to biometric information Recognize and display it on the head-mounted device.
  • the key target object can be identified according to the biometric information recognition result of the multimedia information to ensure that the multimedia information taken by the head-mounted device according to the voice command contains the target object. The accuracy and completeness of multimedia information.
  • the above method further includes: measuring the temperature of the life body in the target area, and displaying the measurement result.
  • the temperature of a living body in the target area can also be measured through a camera, and the measurement result can be displayed on the head-mounted device at the same time.
  • the above method further includes: when the measurement result indicates that the temperature of the living body exceeds a preset temperature, identifying the living body in the multimedia information.
  • the headset When using the headset, you need to set the temperature value in the headset in advance. When using the headset to measure the temperature of the life body in the target area, it is found that the temperature of the life body exceeds the preset temperature. At this time, the headset Identify the organisms with over-preset temperature in the acquired multimedia information, and provide multimedia information of the organisms with abnormal temperature in the target area in time for the objects carried by the headset.
  • the computer device 104 in the above-mentioned embodiment and the above-mentioned background server can run in the background of the head-mounted device, and the background client can be a kind of client running on the computer device 104.
  • the manager can operate the computer device 104 to perform processing such as clicking and viewing on the background client.
  • a voice instruction sent by a target object is received through a head-mounted device; in response to the voice instruction, the camera of the head-mounted device is controlled to shoot the target area to obtain multimedia information corresponding to the target area
  • the camera function includes photographing and video recording.
  • Figure 6 is a flowchart of the head-mounted device operating to perform the photographing and recording function applications. Among them, the logical relationship of the head-mounted device when taking pictures and videos is shown in Table 1:
  • the live broadcast service module during real-time recording through the camera, and select an online device to view the live broadcast screen on the web page, as shown in FIG. 7.
  • the live broadcast is started through a voice command, and the multimedia information is uploaded to the streaming media server to confirm the live broadcast status.
  • the media stream server and the application server refresh the live broadcast status regularly and save the live video regularly.
  • the application server saves the received multimedia information, performs server storage on the multimedia information files that are broadcast live on the media stream, and feeds back the stored information to the media stream server.
  • the embodiments of the present invention and the optional embodiments provide a head-mounted device, such as a smart helmet.
  • the main style is intelligent and information wearable equipment integrating cloud computing, big data, Internet of Things, communications, artificial intelligence and augmented reality technology.
  • This equipment (equivalent to the head-mounted device in the embodiment of the present invention) is connected to related background systems through Bluetooth connection, voice input, manual input, etc., and can realize mobile communication, camera recording, GPS/Beidou positioning, intelligent voice, and intelligent image.
  • /Video recognition and other functions can effectively improve the work efficiency of security personnel and enhance wearing comfort and safety, and finally achieve the goal of "three modernizations", namely:
  • the method according to the above embodiment can be implemented by means of software plus the necessary general hardware platform, of course, it can also be implemented by hardware, but in many cases the former is Better implementation.
  • the technical solution of the present invention essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, The optical disc) includes a number of instructions to enable a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the method of each embodiment of the present invention.
  • FIG. 8 is a structure of a head-mounted device according to an embodiment of the present invention. Schematic diagram, the equipment includes:
  • the receiving module 42 is used to receive voice instructions sent by the target object
  • the processing module 44 is configured to respond to the voice instruction to control the camera of the head-mounted device to shoot a target area to obtain multimedia information corresponding to the target area.
  • the voice instruction sent by the target object is received through the head-mounted device; in response to the voice instruction, the camera of the head-mounted device is controlled to shoot the target area, and the multimedia information corresponding to the target area is obtained, and the above technical solution is adopted , It solves the problem of the single function of the existing head-mounted device in the related technology and cannot perform area shooting. Then the head-mounted device camera can be controlled by voice commands to shoot the target area to obtain multimedia information, thereby realizing the head-mounted device Multimedia information of the target area in the actual work scene.
  • the above-mentioned receiving module is further configured to directly receive voice instructions sent by the target object through the headset, that is, the voice instructions of the target object can be fed back through the headset itself; or through the headset
  • the device receives an operation instruction sent by a wearable device, where the operation instruction corresponds to a voice instruction received by the wearable device from a target object.
  • the wearable device may be a smart watch, and the target object may speak a voice command to the smart watch , And then the wearable device forwards the operation instruction corresponding to the voice instruction to the head-mounted device, and then the head-mounted device can perform the operation corresponding to the voice instruction.
  • the voice command issued by the head-mounted device according to the target object may be the voice command of the target object directly received by the head-mounted device.
  • the content corresponding to the voice command Turn on the corresponding function of the corresponding voice command in the head-mounted device.
  • It can also be an operation command issued by a wearable device connected to the head-mounted device through the network.
  • a smart watch carried by the target object is connected to the head-mounted device through Bluetooth.
  • the smart watch is preset with software that can operate the head-mounted device, and the smart watch sends out the operating instructions of the head-mounted device during use.
  • the above-mentioned head-mounted device further includes: a transmission module, configured to transmit the voice instruction to a voice server, so that the voice server can determine an operation corresponding to the voice instruction, wherein the operation includes at least one of the following One: Take a photo of the target area and record the target area, that is, upload the voice command to the voice server connected to the headset, search the voice command through the voice server, and find the voice command
  • the camera of the head-mounted device is controlled by voice commands to take photos or videos of the target area where the event occurs, collect multimedia information of the target area, and provide information support for understanding the event in the target area.
  • the operation of analyzing voice commands in the foregoing embodiment is implemented by a voice server.
  • the received voice commands can also be analyzed through the headset itself, that is, the headset The device itself has the function of analyzing voice commands.
  • the aforementioned processing module is further configured to control the camera of the head-mounted device to turn on the function corresponding to the operation when the voice server has determined the operation corresponding to the voice instruction; according to the operation
  • the corresponding function captures the target area to determine the multimedia information corresponding to the target area, where the multimedia information includes at least one of the following: pictures and videos.
  • the headset can be controlled by voice commands, so that the headset can turn on the camera operation, turn on the video recording function, and record the occurrence of on-site events in real time, or turn on the camera function for someone or something. Take photos and records to provide a basis for subsequent incident handling.
  • the aforementioned head-mounted device further includes a saving module, configured to save the multimedia information on the head-mounted device; or upload the multimedia information to the application service platform of the head-mounted device.
  • a saving module configured to save the multimedia information on the head-mounted device; or upload the multimedia information to the application service platform of the head-mounted device.
  • the multimedia information corresponding to the target area obtained through the camera of the head-mounted device can be saved on the head-mounted device.
  • multimedia information needs to be retrieved, the required multimedia information can be retrieved, and the multimedia information can be displayed on the display of the head-mounted device
  • multimedia information can also be uploaded to the application service platform of the head-mounted device for real-time sharing of multimedia information, and when the head-mounted device is prevented from malfunctioning, it can be found through the application service platform until the head-mounted device is recorded by the camera before the failure Multimedia information.
  • the processing module is also used to identify the biometric information in the multimedia information, to display the recognition result, and/or to identify the key target object according to the recognition result, that is, to use the head-mounted device to After the target area is photographed, the obtained multimedia information of the target area is recognized by the biometric information and displayed on the head-mounted device.
  • the key target object can be identified according to the biometric information recognition result of the multimedia information. Ensure that the multimedia information captured by the headset according to the voice command contains the target object, ensuring the accuracy and integrity of the multimedia information.
  • the aforementioned head-mounted device is also used to measure the temperature of the living body in the target area and display the measurement result.
  • the temperature of a living body in the target area can also be measured through a camera, and the measurement result can be displayed on the head-mounted device at the same time.
  • the aforementioned head-mounted device is further configured to identify the living body in the multimedia information when the measurement result indicates that the temperature of the living body exceeds a preset temperature.
  • the headset When using the headset, you need to set the temperature value in the headset in advance. When using the headset to measure the temperature of the life body in the target area, it is found that the temperature of the life body exceeds the preset temperature. At this time, the headset Identify the organisms with over-preset temperature in the acquired multimedia information, and provide multimedia information of the organisms with abnormal temperature in the target area in time for the objects carried by the headset.
  • the above-mentioned headsets can be used in epidemic prevention scenarios.
  • smart helmets can be used to take head-to-head shots of people passing by, so that staff can collect pictures or videos about people. Information, at the same time, take photos of all target persons within the scope of the smart helmet, and alert when an abnormality is found, and quickly complete the screening and recording of the flow of adults.
  • the monitoring area is widened, the safe distance is guaranteed, the hands are free, and the information and video images of the people in the target area are automatically recorded without contact within the safe distance.
  • a storage medium in which a computer program is stored, wherein the computer program is configured to execute the steps in any one of the foregoing method embodiments when running.
  • the aforementioned storage medium may be configured to store a computer program for executing the following steps:
  • control the camera of the head-mounted device In response to the voice instruction, control the camera of the head-mounted device to shoot a target area to obtain multimedia information corresponding to the target area.
  • the storage medium may include: flash disk, ROM (Read-Only Memory), RAM (Random Access Memory), magnetic disk or optical disk, etc.
  • an electronic device for implementing the above-mentioned method for determining multimedia information.
  • the electronic device may be the above-mentioned head-mounted device, or it may be another application of the above-mentioned method for determining multimedia information.
  • the embodiment of the present invention does not limit this device.
  • the electronic device includes a memory 1002 and a processor 1004.
  • the memory 1002 stores a computer program.
  • the processor 1004 is configured to execute the above through the computer program. Steps in any method embodiment.
  • the above-mentioned electronic device may be located in at least one network device among a plurality of network devices in a computer network.
  • the above-mentioned processor may be configured to execute the following steps through a computer program:
  • control the camera of the head-mounted device In response to the voice instruction, control the camera of the head-mounted device to shoot a target area to obtain multimedia information corresponding to the target area.
  • the structure shown in FIG. 9 is only for illustration, and the electronic device may also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a palmtop computer, and a mobile Internet device (Mobile Internet Devices, MID), PAD and other terminal devices.
  • FIG. 9 does not limit the structure of the above electronic device.
  • the electronic device may also include more or fewer components (such as a network interface, etc.) than shown in FIG. 9 or have a different configuration from that shown in FIG. 9.
  • the memory 1002 can be used to store software programs and modules, such as the method for determining multimedia information and the program instructions/modules corresponding to the head-mounted device in the embodiment of the present invention.
  • the processor 1004 runs the software programs and modules stored in the memory 1002. , So as to perform various functional applications and data processing, that is, to achieve the above-mentioned method for determining multimedia information.
  • the memory 1002 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.
  • the memory 1002 may further include a memory remotely provided with respect to the processor 1004, and these remote memories may be connected to the terminal through a network.
  • Examples of the aforementioned networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.
  • the foregoing memory 1002 may, but is not limited to, include the receiving module 42 and the processing module 44 in the foregoing head-mounted device. In addition, it may also include, but is not limited to, other module units in the aforementioned head-mounted device, which will not be repeated in this example.
  • the aforementioned transmission device 1006 is used to receive or send data via a network.
  • the above-mentioned specific examples of the network may include a wired network and a wireless network.
  • the transmission device 1006 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers via a network cable so as to communicate with the Internet or a local area network.
  • the transmission device 1006 is a radio frequency (RF) module, which is used to communicate with the Internet in a wireless manner.
  • RF radio frequency
  • the above-mentioned electronic device further includes: a display 1008 for displaying the shooting results of the camera of the head-mounted device; and a connection bus 1010 for connecting various module components in the above-mentioned electronic device.
  • the aforementioned terminal or server may be a node in a distributed system, where the distributed system may be a blockchain system, and the blockchain system may be communicated by the multiple nodes through a network Distributed system formed by form connection.
  • nodes can form a peer-to-peer (P2P, Peer To Peer) network, and any form of computing equipment, such as servers, terminals, and other electronic devices, can become a node in the blockchain system by joining the peer-to-peer network.
  • P2P peer-to-peer
  • Peer To Peer Peer To Peer
  • the storage medium may include: a flash disk, a read-only memory (Read-Only Memory, ROM), a random access device (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.
  • the integrated unit in the foregoing embodiment is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in the foregoing computer-readable storage medium.
  • the technical solution of the present invention essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, A number of instructions are included to enable one or more computer devices (which may be personal computers, servers, or network devices, etc.) to execute all or part of the steps of the methods in the various embodiments of the present invention.
  • the disclosed client can be implemented in other ways.
  • the device embodiments described above are only illustrative, for example, the division of units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or integrated into Another system, or some features can be ignored, or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, units or modules, and may be in electrical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)

Abstract

本发明公开了一种多媒体信息的确定方法、头戴设备、存储介质及电子设备,其中,上述确定方法包括:通过头戴设备接收目标对象发送的语音指令;响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,采用上述技术方案,解决了相关技术中,现有的头戴设备的功能单一,无法进行区域拍摄等问题,进而可以通过语音指令控制头戴设备摄像头对目标区域进行拍摄,得到多媒体信息,进而实现了头戴设备在实际工作场景中对目标区域的多媒体信息。

Description

多媒体信息的确定方法、头戴设备、存储介质及电子设备 技术领域
本发明涉及通信领域,具体而言,涉及一种多媒体信息的确定方法、头戴设备、存储介质及电子设备。
背景技术
智能头盔是技术人员结合高新科技产品把一个普通头盔升级,达到使用者所需的智能功能,智能头盔在安保行业得到了广泛应用。
目前,安保人员显著不足,一线安保人员工作强度大,负担重,安保人员在进行安保工作时,头盔则是安保人员在执行任务时不可或缺的个体防护设备之一,在使用智能头盔时,可能还需随身携带的PDA、电台等计算机装置,在一定程度上存在“负荷重、功能集成度不高、业务体验差”等不足,对实际情况的环境和需求考虑不够,后台系统在对智能头盔的部分业务进行工作支撑不力,系统响应速度较慢,应用软件与实际情况的需求贴合不够,而且,在实际工作中遇到突发状况时,安保人员进行记录时,只能通过专用的拍照或录像设备进行记录,无法通过头盔快速的对事件进行处理记录。
因此,针对安保人员在工作中无法通过头盔快速的对事件进行记录并处理的问题,急需要提供一种能够支持拍照和/或录像的头戴设备。
针对相关技术中,现有的头戴设备的功能单一,无法进行区域拍摄等问题,尚未提出有效的解决方案。
发明内容
本发明实施例提供了一种多媒体信息的确定方法、头戴设备、存储介质及电子设备,以至少解决相关技术中现有的头戴设备的功能单一,无法进行区域拍摄等技术问题。
根据本发明的一个实施例,提供了一种多媒体信息的确定方法,包括: 通过头戴设备接收目标对象发送的语音指令;响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息。
可选的,通过头戴设备接收目标对象发送的语音指令,包括:直接通过所述头戴设备接收所述目标对象发送的语音指令;或通过所述头戴设备接收可穿戴设备发送的操作指令,其中,所述操作指令与所述可穿戴设备从目标对象接收的语音指令对应。
可选的,通过头戴设备接收目标对象发送的语音指令之后,所述方法还包括:将所述语音指令传输至语音服务器,以使所述语音服务器确定所述语音指令对应的操作,其中,所述操作至少包括以下之一:对所述目标区域进行拍照,对所述目标区域进行录像。
可选的,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,包括:在所述语音服务器已确定所述语音指令对应的操作的情况下,控制所述头戴设备的摄像头开启与所述操作对应的功能;根据所述操作对应的功能对所述目标区域进行拍摄,以确定所述目标区域对应的多媒体信息,其中,所述多媒体信息至少包括以下之一:图片,视频。
可选的,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,包括:在所述头戴设备保存所述多媒体信息;或将所述多媒体信息上传至所述头戴设备的应用服务平台。
可选的,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息之后,上述方法还包括:对所述多媒体信息中的生物特征信息进行识别,对识别结果进行显示,和/或根据识别结果对重点目标对象进行标识。
可选的,上述方法还包括:测量所述目标区域内的生命体温度,并显示测量结果。
可选的,上述方法还包括:当所述测量结果指示存在生命体温度超过预设温度时,在所述多媒体信息中对所述生命体进行标识。
根据本发明的另一个实施例,提供了一种头戴设备,包括接收模块,用于接收目标对象发送的语音指令;处理模块,用于响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息。
可选的,上述接收模块,还用于直接通过所述头戴设备接收所述目标对象发送的语音指令;或通过所述头戴设备接收可穿戴设备发送的操作指令,其中,所述操作指令与所述可穿戴设备从目标对象接收的语音指令对应。
可选的,上述头戴设备还包括:传输模块,用于将所述语音指令传输至语音服务器,以使所述语音服务器确定所述语音指令对应的操作,其中,所述操作至少包括以下之一:对所述目标区域进行拍照,对所述目标区域进行录像。
可选的,上述处理模块,还用于在所述语音服务器已确定所述语音指令对应的操作的情况下,控制所述头戴设备的摄像头开启与所述操作对应的功能;根据所述操作对应的功能对所述目标区域进行拍摄,以确定所述目标区域对应的多媒体信息,其中,所述多媒体信息至少包括以下之一:图片,视频。
可选的,上述头戴设备还包括保存模块,保存模块用于在所述头戴设备保存所述多媒体信息;或将所述多媒体信息上传至所述头戴设备的应用服务平台。
可选的,处理模块还用于对所述多媒体信息中的生物特征信息进行识别,对识别结果进行显示,和/或根据识别结果对重点目标对象进行标识。
可选的,上述头戴设备还用于测量所述目标区域内的生命体温度,并显示测量结果。
可选的,上述头戴设备还用于当所述测量结果指示存在生命体温度超 过预设温度时,在所述多媒体信息中对所述生命体进行标识。
根据本发明实施例的又一方面,还提供了一种计算机可读的存储介质,该计算机可读的存储介质中存储有计算机程序,其中,该计算机程序被设置为运行时执行上述多媒体信息的确定方法。
根据本发明实施例的又一方面,还提供了一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,上述处理器通过计算机程序执行上述的多媒体信息的确定方法。
在本发明实施例中,通过头戴设备接收目标对象发送的语音指令;响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,采用上述技术方案,解决了相关技术中,现有的头戴设备的功能单一,无法进行区域拍摄等问题,进而可以通过语音指令控制头戴设备摄像头对目标区域进行拍摄,得到多媒体信息,进而实现了头戴设备在实际工作场景中对目标区域的多媒体信息。
附图说明
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:
图1是根据本发明实施例的一种多媒体信息的确定方法的在产品应用的示意图;
图2是根据本发明实施例的一种智能头盔的终端系统框架示意图;
图3是根据本发明实施例的一种智能头盔的终端系统组成示意图;
图4是根据本发明实施例的一种多媒体信息的确定方法的应用环境的示意图;
图5是根据本发明实施例的多媒体信息的确定方法的流程图;
图6是根据本发明实施例的一种可选的头戴设备进行操作执行拍照和 录像功能应用的流程图;
图7是根据本发明实施例的一种可选的直播模块的流程图;
图8是根据本发明实施例的一种头戴设备结构示意图;
图9是根据本发明实施例的一种可选的电子设备的结构示意图。
具体实施方式
为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分的实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明保护的范围。
需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本发明的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
为了更好的理解本发明实施例以及可选实施例的技术方案,以下对本发明实施例以及可选实施例中可能出现的应用场景进行说明,但不用于限定以下场景的应用。
图1是根据本发明实施例的一种多媒体信息的确定方法的在产品应用的示意图;以盔体为参考基准,对智能头盔(相当于本发明实施例中的“头戴设备”)进行区域划分,将智能头盔划分为外部前侧1、外部顶侧2、外部左右侧3、外部后侧4、内部前侧5、内部顶侧6、内部后侧7七个区域。外部前侧为信息采集区域,用来安置摄像头,外部顶侧为通讯区域,外部 后侧为能源供应区域,内部顶侧为主板及散热区域,外部左右侧为功能区域,内部前侧为AR模组及护目镜区域,内部后侧为头锁装置。可选地,本发明实施例的技术方案应用在外部前侧的信息采集区域,通过信息采集区域中的摄像头进行多媒体数据信息的采集。
智能头盔的终端系统框架示意图如图2所示,具体的系统层如下:
功能层:在功能上,智能头盔要满足了信息化、智能化、现代化的要求,除了提供最基本的防护、通信、视频直播功能外,还提供了导航、人脸识别、身份证识别、车牌识别、事件推送、语音翻译等功能。
支撑层:除了硬件部分的智能头盔、智能手表,还包括后台智能头盔管理系统以及第三方互联网应用服务平台,为实现穿戴式智能头盔的终端系统的智能化提供硬件及服务支撑。
资源层:智能头盔终端系统将通过云服务及智能头盔后台服务器,与相关平台的系统人脸识别检索数据库、“一人一档”、“一车一档”及OSS云、RDS等数据库连接,真正实现了穿戴式智能头盔的智能化、信息化。
智能头盔的终端系统组成如图3所示,通过智能头盔、智能手表、智能头盔管理系统组成的智能头盔终端系统,提高了智能头盔在实际工作场景中对目标区域的多媒体信息的采集效率。
根据本发明实施例的一个方面,提供了一种多媒体信息的确定方法。可选地,上述多媒体信息的确定方法可以但不限于应用于如图4所示的应用环境中。如图4所示,头戴设备102运行有能够识别语音指令的应用,且头戴设备102包括摄像头。头戴设备102可以通过头戴设备接收目标对象发送的语音指令,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,服务器104可以是语音指令的语音服务器,本发明实施例对此不作限定,以上仅为一种示例,本申请实施例在此不作限定。
在本实施例中提供了一种多媒体信息的确定方法,图5是根据本发明实施例的多媒体信息的确定方法的流程图,如图5所示,上述多媒体 信息的确定方法流程包括如下步骤:
步骤S202,通过头戴设备接收目标对象发送的语音指令;
步骤S204,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息。
通过上述步骤,通过头戴设备接收目标对象发送的语音指令;响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,采用上述技术方案,解决了相关技术中,现有的头戴设备的功能单一,无法进行区域拍摄等问题,进而可以通过语音指令控制头戴设备摄像头对目标区域进行拍摄,得到多媒体信息,进而实现了头戴设备在实际工作场景中对目标区域的多媒体信息。
可选的,通过头戴设备接收目标对象发送的语音指令可以通过以下实现方式实现:1)直接通过所述头戴设备接收所述目标对象发送的语音指令,即可以通过头戴设备自身对目标对象的语音指令进行反馈;2)通过所述头戴设备接收可穿戴设备发送的操作指令,其中,所述操作指令与所述可穿戴设备从目标对象接收的语音指令对应,例如,可穿戴设备可以是智能手表,目标对象可以对智能手表说语音指令,然后可穿戴设备将语音指令对应的操作指令转发至头戴设备,进而头戴设备可以执行与语音指令对应的操作。
换而言之,头戴设备根据目标对象发出的语音指令可以是头戴设备直接接收到的目标对象的语音指令,例如,头戴设备接收到目标对象的语音指令后,根据语音指令对应的内容打开头戴设备中相对应语音指令的对应功能,也可以是通过与头戴设备通过网络连接的可穿戴设备发出的操作指令,例如,目标对象携带的智能手表与头戴设备通过蓝牙建立连接,可选地,在智能手表预先设置可操作头戴设备的软件,在使用时通过智能手表发出头戴设备的操作指令。
可选的,通过头戴设备接收目标对象发送的语音指令之后,所述方法还包括:将所述语音指令传输至语音服务器,以使所述语音服务器确定所 述语音指令对应的操作,其中,所述操作至少包括以下之一:对所述目标区域进行拍照,对所述目标区域进行录像,也就是说,将语音指令上传至与头戴设备相连接的语音服务器,通过语音服务器对语音指令进行搜索,找出语音指令相对应的头戴设备的操作,通过语音指令控制头戴设备的摄像头对发生事件的目标区域进行拍照或录像,收集目标区域的多媒体信息,为了解目标区域发生事件,提供信息支持。
需要说明的是,上述实施例中对语音指令进行分析的操作是通过语音服务器实现的,在一个可选实施例中,还可以通过头戴设备本身对接收到的语音指令进行分析,即头戴设备本身具备对语音指令进行分析的功能。
可选的,在语音服务器或智能头盔解析出语音指令对应的操作后,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,可以通过以下方案实现:在所述语音服务器已确定所述语音指令对应的操作的情况下,控制所述头戴设备的摄像头开启与所述操作对应的功能;根据所述操作对应的功能对所述目标区域进行拍摄,以确定所述目标区域对应的多媒体信息,其中,所述多媒体信息至少包括以下之一:图片,视频。
例如,目标区域现场突发状况,通过语音指令对头戴设备进行控制,使得头戴设备打开摄像头操作,开启录像功能,实时的记录现场事件的发生过程,或者开启拍照功能对某人、某物进行拍照记录,为后续事件处理提供依据。
可选的,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,包括:在所述头戴设备保存所述多媒体信息;或将所述多媒体信息上传至所述头戴设备的应用服务平台。
通过头戴设备的摄像头获取的目标区域对应的多媒体信息,可以保存在头戴设备上,在需要调取多媒体信息时,可以调取需要的多媒体信息,并将多媒体信息显示在头戴设备的显示屏上,也可将多媒体信息上传至头戴设备的应用服务平台,进行多媒体信息的实时共享,以及预防头戴设备 出现故障时,可以通过应用服务平台查寻到头戴设备直至故障前头戴设备通过摄像头记录的多媒体信息。
可选的,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息之后,上述方法还包括:对所述多媒体信息中的生物特征信息进行识别,对识别结果进行显示,和/或根据识别结果对重点目标对象进行标识,也就是说,通过头戴设备对目标区域进行拍摄后,对得到的目标区域的多媒体信息进行生物特征信息进行识别并在头戴设备上显示出来,进一步的,还可以根据多媒体信息的生物特征信息识别结果对重点目标对象进行标识,保证头戴设备根据语音指令进行拍摄的多媒体信息包含有目标对象,确保了多媒体信息的准确性、完整性。
可选的,上述方法还包括:测量所述目标区域内的生命体温度,并显示测量结果。
通过头戴设备进行多媒体信息获取时,还可以通过摄像头对目标区域内存在的生命体温度进行测量,同时在头戴设备上显示测量结果。
可选的,上述方法还包括:当所述测量结果指示存在生命体温度超过预设温度时,在所述多媒体信息中对所述生命体进行标识。
在使用头戴设备时,需要预先在头戴设备中设置温度值,当使用头戴设备进行目标区域内的生命体温度测量时,发现存在生命体温度超过预设温度,此时,头戴设备对已经获取的多媒体信息中超预设温度生命体进行标识,为头戴设备的携带对象及时提供目标区域内存在异常温度生命体的多媒体信息。
需要说明的是,在一个可选实施例中,上述实施例中的计算机装置104可以和上述后台服务器一起运行在头戴设备的后台,后台客户端可以是运行在计算机装置104的一种客户端,管理人员可以通过对计算机装置104进行操作,以对后台客户端进行点击、查看等处理。
为了更好的理解上述多媒体信息的确定流程,以下结合一可选实施例进行说明,但不用于限定本发明实施例的技术方案。
在本发明可选实施例中,通过头戴设备接收目标对象发送的语音指令;响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,实际操作中摄像头功能包含拍照和录像,图6为头戴设备进行操作执行拍照和录像功能应用的流程图,其中,进行拍照和录像时的头戴设备的逻辑关系如下表1:
表1
Figure PCTCN2020093730-appb-000001
根据本发明可选实施例还可以通过摄像头在实时录像时,打开直播业务模块,在web端页面可选择在线设备查看现场直播画面,如图7所 示。
(1)头盔端(相当于上述实施例的头戴设备),通过语音指令开启直播,并上传多媒体信息到流媒体服务器,进行直播状态确认。
(2)媒体流服务器与应用服务器,对直播状态进行定时刷新,对直播视频进行定时保存。
应用服务器对已接的多媒体信息进行保存,对在媒体流上直播的多媒体信息文件进行服务器存储,并将已存储信息反馈给媒体流服务器。
通过相关应用场景以及本发明可选实施例的说明,面对当前各种安保终端设备存在的问题及不足,本发明实施例以及可选实施例提供了一种头戴设备,以智能头盔等为主要样式,集云计算、大数据、物联网、通信、人工智能及增强现实技术于一体的智能化、信息化穿戴装备。该装备(相当于本发明实施例的头戴设备)通过蓝牙连接、语音输入、手动输入等操控方式,对接相关后台系统,可实现移动通信、拍照录像、GPS/北斗定位、智能语音、智能图像/视频识别等功能,能有效提高安保人员的工作效率并增强佩戴舒适性和安全性,最终实现“三化”目标,即:
(1)智能化:通过现场语音、图像、视频数据即时与相关平台的后台业务系统和大数据进行交互关联,实现安保终端智能化,释放安保人员的双手,让执勤工作更先进、更高效;
(2)一体化:通过集成身体防护、信息采集输入、通信、信息反馈输出于一体,实现终端一体化,让执勤工作更安全、更便捷;
(3)人性化:通过采用高科技材料阻热降温、人体工学轻量化设计等技术,实现终端人性化,让工作人员的佩戴更舒适、更易维护。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质 (如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本发明各个实施例的方法。
在本实施例中还提供了一种头戴设备,该设备用于实现上述实施例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的设备较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的,图8是根据本发明实施例的一种头戴设备的结构示意图,该设备包括:
(1)接收模块42,用于接收目标对象发送的语音指令;
(2)处理模块44,用于响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息。
通过上述设备,通过头戴设备接收目标对象发送的语音指令;响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,采用上述技术方案,解决了相关技术中,现有的头戴设备的功能单一,无法进行区域拍摄等问题,进而可以通过语音指令控制头戴设备摄像头对目标区域进行拍摄,得到多媒体信息,进而实现了头戴设备在实际工作场景中对目标区域的多媒体信息。
可选的,上述接收模块,还用于直接通过所述头戴设备接收所述目标对象发送的语音指令,即可以通过头戴设备自身对目标对象的语音指令进行反馈;或通过所述头戴设备接收可穿戴设备发送的操作指令,其中,所述操作指令与所述可穿戴设备从目标对象接收的语音指令对应,例如,可穿戴设备可以是智能手表,目标对象可以对智能手表说语音指令,然后可穿戴设备将语音指令对应的操作指令转发至头戴设备,进而头戴设备可以执行与语音指令对应的操作。
需要说明的是,头戴设备根据目标对象发出的语音指令可以是头戴设备直接接收到的目标对象的语音指令,例如,头戴设备接收到目标对象的语音指令后,根据语音指令对应的内容打开头戴设备中相对应语音指令的 对应功能,也可以是通过与头戴设备通过网络连接的可穿戴设备发出的操作指令,例如,目标对象携带的智能手表与头戴设备通过蓝牙建立连接,可选地,在智能手表预先设置可操作头戴设备的软件,在使用时通过智能手表发出头戴设备的操作指令。
可选的,上述头戴设备还包括:传输模块,用于将所述语音指令传输至语音服务器,以使所述语音服务器确定所述语音指令对应的操作,其中,所述操作至少包括以下之一:对所述目标区域进行拍照,对所述目标区域进行录像,也就是说,将语音指令上传至与头戴设备相连接的语音服务器,通过语音服务器对语音指令进行搜索,找出语音指令相对应的头戴设备的操作,通过语音指令控制头戴设备的摄像头对发生事件的目标区域进行拍照或录像,收集目标区域的多媒体信息,为了解目标区域发生事件,提供信息支持。
需要说明的是,上述实施例中对语音指令进行分析的操作是通过语音服务器实现的,在一个可选实施例中,还可以通过头戴设备本身对接收到的语音指令进行分析,即头戴设备本身具备对语音指令进行分析的功能。
可选的,上述处理模块,还用于在所述语音服务器已确定所述语音指令对应的操作的情况下,控制所述头戴设备的摄像头开启与所述操作对应的功能;根据所述操作对应的功能对所述目标区域进行拍摄,以确定所述目标区域对应的多媒体信息,其中,所述多媒体信息至少包括以下之一:图片,视频。
例如,目标区域现场突发状况,通过语音指令对头戴设备进行控制,使得头戴设备打开摄像头操作,开启录像功能,实时的记录现场事件的发生过程,或者开启拍照功能对某人、某物进行拍照记录,为后续事件处理提供依据。
可选的,上述头戴设备还包括保存模块,保存模块用于在所述头戴设备保存所述多媒体信息;或将所述多媒体信息上传至所述头戴设备的应用服务平台。
通过头戴设备的摄像头获取的目标区域对应的多媒体信息,可以保存在头戴设备上,在需要调取多媒体信息时,可以调取需要的多媒体信息,并将多媒体信息显示在头戴设备的显示屏上,也可将多媒体信息上传至头戴设备的应用服务平台,进行多媒体信息的实时共享,以及预防头戴设备出现故障时,可以通过应用服务平台查寻到直至故障前头戴设备通过摄像头记录的多媒体信息。
可选的,处理模块还用于对所述多媒体信息中的生物特征信息进行识别,对识别结果进行显示,和/或根据识别结果对重点目标对象进行标识,也就是说,通过头戴设备对目标区域进行拍摄后,对得到的目标区域的多媒体信息进行生物特征信息进行识别并在头戴设备上显示出来,进一步的,还可以根据多媒体信息的生物特征信息识别结果对重点目标对象进行标识,保证头戴设备根据语音指令进行拍摄的多媒体信息包含有目标对象,确保了多媒体信息的准确性、完整性。
可选的,上述头戴设备还用于测量所述目标区域内的生命体温度,并显示测量结果。
通过头戴设备进行多媒体信息获取时,还可以通过摄像头对目标区域内存在的生命体温度进行测量,同时在头戴设备上显示测量结果。
可选的,上述头戴设备还用于当所述测量结果指示存在生命体温度超过预设温度时,在所述多媒体信息中对所述生命体进行标识。
在使用头戴设备时,需要预先在头戴设备中设置温度值,当使用头戴设备进行目标区域内的生命体温度测量时,发现存在生命体温度超过预设温度,此时,头戴设备对已经获取的多媒体信息中超预设温度生命体进行标识,为头戴设备的携带对象及时提供目标区域内存在异常温度生命体的多媒体信息。
在实际应用场景中,上述头戴设备可以应用在防疫场景中,例如,在疫情防控过程中,可以通过智能头盔进行头对人员经过的地方进行拍摄,便于工作人员收集关于人员的图片或者视频信息,同时对智能头盔范围内的所有目标人员进行拍照,发现异常时进行告警,快速的完成大 人流的筛查和记录工作。
通过智能头盔进行多媒体信息的确定时,拓宽了监测面积,并保证安全距离,解放双手,在安全距离内无接触自动记录被拍摄目标区域内人员的信息与视频图像。
根据本发明的实施例的又一方面,还提供了一种存储介质,该存储介质中存储有计算机程序,其中,该计算机程序被设置为运行时执行上述任一项方法实施例中的步骤。
可选地,在本实施例中,上述存储介质可以被设置为存储用于执行以下步骤的计算机程序:
S1,通过头戴设备接收目标对象发送的语音指令;
S2,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息。
可选地,在本实施例中,本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令终端设备相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:闪存盘、ROM(Read-Only Memory,只读存储器)、RAM(Random Access Memory,随机存取器)、磁盘或光盘等。
根据本发明实施例的又一个方面,还提供了一种用于实施上述多媒体信息的确定方法的电子设备,该电子设备可以是上述头戴设备,也可以是其他应用上述多媒体信息的确定方法的设备,本发明实施例对此不进行限定,如图9所示,该电子设备包括存储器1002和处理器1004,该存储器1002中存储有计算机程序,该处理器1004被设置为通过计算机程序执行上述任一项方法实施例中的步骤。
可选地,在本实施例中,上述电子设备可以位于计算机网络的多个网络设备中的至少一个网络设备。
可选地,在本实施例中,上述处理器可以被设置为通过计算机程序执 行以下步骤:
S1,通过头戴设备接收目标对象发送的语音指令;
S2,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息。
可选地,本领域普通技术人员可以理解,图9所示的结构仅为示意,电子设备也可以是智能手机(如Android手机、iOS手机等)、平板电脑、掌上电脑以及移动互联网设备(Mobile Internet Devices,MID)、PAD等终端设备。图9其并不对上述电子设备的结构造成限定。例如,电子设备还可包括比图9中所示更多或者更少的组件(如网络接口等),或者具有与图9所示不同的配置。
其中,存储器1002可用于存储软件程序以及模块,如本发明实施例中的多媒体信息的确定方法和头戴设备对应的程序指令/模块,处理器1004通过运行存储在存储器1002内的软件程序以及模块,从而执行各种功能应用以及数据处理,即实现上述的多媒体信息的确定方法。存储器1002可包括高速随机存储器,还可以包括非易失性存储器,如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中,存储器1002可进一步包括相对于处理器1004远程设置的存储器,这些远程存储器可以通过网络连接至终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。作为一种示例,上述存储器1002中可以但不限于包括上述头戴设备中的接收模块42、处理模块44。此外,还可以包括但不限于上述头戴设备中的其他模块单元,本示例中不再赘述。
可选地,上述的传输设备1006用于经由一个网络接收或者发送数据。上述的网络具体实例可包括有线网络及无线网络。在一个实例中,传输设备1006包括一个网络适配器(Network Interface Controller,NIC),其可通过网线与其他网络设备与路由器相连从而可与互联网或局域网进行通讯。在一个实例中,传输设备1006为射频(Radio Frequency,RF)模块, 其用于通过无线方式与互联网进行通讯。
此外,上述电子设备还包括:显示器1008,用于显示头戴设备的摄像头的拍摄结果;和连接总线1010,用于连接上述电子设备中的各个模块部件。
在其他实施例中,上述终端或者服务器可以是一个分布式系统中的一个节点,其中,该分布式系统可以为区块链系统,该区块链系统可以是由该多个节点通过网络通信的形式连接形成的分布式系统。其中,节点之间可以组成点对点(P2P,Peer To Peer)网络,任意形式的计算设备,比如服务器、终端等电子设备都可以通过加入该点对点网络而成为该区块链系统中的一个节点。
可选地,在本实施例中,本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令终端设备相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:闪存盘、只读存储器(Read-Only Memory,ROM)、随机存取器(Random Access Memory,RAM)、磁盘或光盘等。
上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。
上述实施例中的集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在上述计算机可读取的存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在存储介质中,包括若干指令用以使得一台或多台计算机设备(可为个人计算机、服务器或者网络设备等)执行本发明各个实施例方法的全部或部分步骤。
在本发明的上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。
在本申请所提供的几个实施例中,应该理解到,所揭露的客户端,可通过其它的方式实现。其中,以上所描述的设备实施例仅仅是示意性的, 例如单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,单元或模块的间接耦合或通信连接,可以是电性或其它的形式。
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
以上仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。

Claims (13)

  1. 一种多媒体信息的确定方法,其特征在于,包括:
    通过头戴设备接收目标对象发送的语音指令;
    响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息。
  2. 根据权利要求1所述的方法,其特征在于,通过头戴设备接收目标对象发送的语音指令,包括:
    直接通过所述头戴设备接收所述目标对象发送的语音指令;或
    通过所述头戴设备接收可穿戴设备发送的操作指令,其中,所述操作指令与所述可穿戴设备从目标对象接收的语音指令对应。
  3. 根据权利要求1所述的方法,其特征在于,通过头戴设备接收目标对象发送的语音指令之后,所述方法还包括:
    将所述语音指令传输至语音服务器,以使所述语音服务器确定所述语音指令对应的操作,其中,所述操作至少包括以下之一:对所述目标区域进行拍照,对所述目标区域进行录像。
  4. 根据权利要求3所述的方法,其特征在于,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,包括:
    在所述语音服务器已确定所述语音指令对应的操作的情况下,控制所述头戴设备的摄像头开启与所述操作对应的功能;
    根据所述操作对应的功能对所述目标区域进行拍摄,以确定所述目标区域对应的多媒体信息,其中,所述多媒体信息至少包括以下之一:图片,视频。
  5. 根据权利要求1至4任一项所述的方法,其特征在于,响应所述语音指 令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息,包括:
    在所述头戴设备保存所述多媒体信息;或
    将所述多媒体信息上传至所述头戴设备的应用服务平台。
  6. 根据权利要求1所述的方法,其特征在于,响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息之后,所述方法还包括:
    对所述多媒体信息中的生物特征信息进行识别,对识别结果进行显示,和/或根据识别结果对重点目标对象进行标识。
  7. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    测量所述目标区域内的生命体温度,并显示测量结果。
  8. 根据权利要求7所述的方法,其特征在于,所述方法还包括:
    当所述测量结果指示存在生命体温度超过预设温度时,在所述多媒体信息中对所述生命体进行标识。
  9. 一种头戴设备,其特征在于,包括:
    接收模块,用于接收目标对象发送的语音指令;
    处理模块,用于响应所述语音指令,控制所述头戴设备的摄像头对目标区域进行拍摄,得到所述目标区域对应的多媒体信息。
  10. 根据权利要求9所述的头戴设备,其特征在于,所述接收模块,还用于直接通过所述头戴设备接收所述目标对象发送的语音指令;或通过所述头戴设备接收可穿戴设备发送的操作指令,其中,所述操作指令与所述可穿戴设备从目标对象接收的语音指令对应。
  11. 根据权利要求9所述的头戴设备,其特征在于,所述头戴设备还包括:传输模块,用于将所述语音指令传输至语音服务器,以使所述语音服务器确定所述语音指令对应的操作,其中,所述操作至少包括以下之 一:对所述目标区域进行拍照,对所述目标区域进行录像。
  12. 根据权利要求9所述的头戴设备,其特征在于,所述处理模块,还用于在所述语音服务器已确定所述语音指令对应的操作的情况下,控制所述头戴设备的摄像头开启与所述操作对应的功能;根据所述操作对应的功能对所述目标区域进行拍摄,以确定所述目标区域对应的多媒体信息,其中,所述多媒体信息至少包括以下之一:图片,视频。
  13. 一种计算机可读的存储介质,所述计算机可读的存储介质包括存储的程序,其中,所述程序运行时执行上述权利要求1至8任一项中所述的方法。
PCT/CN2020/093730 2020-03-27 2020-06-01 多媒体信息的确定方法、头戴设备、存储介质及电子设备 WO2021189647A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010231609.5 2020-03-27
CN202010231609.5A CN111405184A (zh) 2020-03-27 2020-03-27 多媒体信息的确定方法、头戴设备、存储介质及电子设备

Publications (1)

Publication Number Publication Date
WO2021189647A1 true WO2021189647A1 (zh) 2021-09-30

Family

ID=71433382

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/093730 WO2021189647A1 (zh) 2020-03-27 2020-06-01 多媒体信息的确定方法、头戴设备、存储介质及电子设备

Country Status (2)

Country Link
CN (1) CN111405184A (zh)
WO (1) WO2021189647A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115171676A (zh) * 2022-05-30 2022-10-11 青岛海尔科技有限公司 意图行为的确定方法和装置、存储介质及电子装置

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112385927A (zh) * 2020-10-09 2021-02-23 河南理工大学 一种用于应急定距测温的智能安全帽及导航方法

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104182051A (zh) * 2014-08-29 2014-12-03 百度在线网络技术(北京)有限公司 头戴式智能设备和具有该头戴式智能设备的交互系统
CN104427372A (zh) * 2013-08-30 2015-03-18 Lg电子株式会社 可佩戴的手表式终端和装备有可佩戴的手表式终端的系统
CN105630157A (zh) * 2015-11-27 2016-06-01 东莞酷派软件技术有限公司 控制方法及控制装置、终端和控制系统
CN106488120A (zh) * 2016-09-22 2017-03-08 上海斐讯数据通信技术有限公司 一种基于云技术的可穿戴智能拍摄装置及智能拍摄系统
CN107591207A (zh) * 2017-08-24 2018-01-16 深圳市华盛昌科技实业股份有限公司 一种疫情排查方法、装置、系统及设备
JP2018032094A (ja) * 2016-08-22 2018-03-01 キヤノン株式会社 画像処理装置、画像処理方法
CN108344525A (zh) * 2018-02-09 2018-07-31 英华达(上海)科技有限公司 自适应体温监控方法及系统
CN109700113A (zh) * 2018-11-30 2019-05-03 迅捷安消防及救援科技(深圳)有限公司 智能头盔、消防救援方法及相关产品
CN111127699A (zh) * 2019-11-25 2020-05-08 爱驰汽车有限公司 汽车缺陷数据自动录入方法、系统、设备及介质

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090262205A1 (en) * 2008-04-21 2009-10-22 Dana Stephen Smith Voice activated headset imaging system
US20150358768A1 (en) * 2014-06-10 2015-12-10 Aliphcom Intelligent device connection for wireless media in an ad hoc acoustic network
CN104090973B (zh) * 2014-07-18 2018-09-07 百度在线网络技术(北京)有限公司 一种信息呈现方法及装置
CN205866105U (zh) * 2016-07-28 2017-01-11 浙江华安安全设备有限公司 一种带摄录功能的新型警用头盔
CN107495528A (zh) * 2017-08-18 2017-12-22 广州市酷恩科技有限责任公司 一种多功能头盔控制系统
CN108497603B (zh) * 2018-05-02 2020-12-25 上海钜星科技有限公司 警务终端智能头盔
CN110874132A (zh) * 2018-08-29 2020-03-10 塔普翊海(上海)智能科技有限公司 头戴式虚实交互装置和虚实交互方法
CN109407312A (zh) * 2018-09-27 2019-03-01 深圳奇迹智慧网络有限公司 一种头戴式显示设备
CN110411570B (zh) * 2019-06-28 2020-08-28 武汉高德智感科技有限公司 基于人体检测和人体跟踪技术的红外人体温度筛查方法
CN110517683A (zh) * 2019-09-04 2019-11-29 上海六感科技有限公司 头戴式vr/ar设备及其控制方法

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104427372A (zh) * 2013-08-30 2015-03-18 Lg电子株式会社 可佩戴的手表式终端和装备有可佩戴的手表式终端的系统
CN104182051A (zh) * 2014-08-29 2014-12-03 百度在线网络技术(北京)有限公司 头戴式智能设备和具有该头戴式智能设备的交互系统
CN105630157A (zh) * 2015-11-27 2016-06-01 东莞酷派软件技术有限公司 控制方法及控制装置、终端和控制系统
JP2018032094A (ja) * 2016-08-22 2018-03-01 キヤノン株式会社 画像処理装置、画像処理方法
CN106488120A (zh) * 2016-09-22 2017-03-08 上海斐讯数据通信技术有限公司 一种基于云技术的可穿戴智能拍摄装置及智能拍摄系统
CN107591207A (zh) * 2017-08-24 2018-01-16 深圳市华盛昌科技实业股份有限公司 一种疫情排查方法、装置、系统及设备
CN108344525A (zh) * 2018-02-09 2018-07-31 英华达(上海)科技有限公司 自适应体温监控方法及系统
CN109700113A (zh) * 2018-11-30 2019-05-03 迅捷安消防及救援科技(深圳)有限公司 智能头盔、消防救援方法及相关产品
CN111127699A (zh) * 2019-11-25 2020-05-08 爱驰汽车有限公司 汽车缺陷数据自动录入方法、系统、设备及介质

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115171676A (zh) * 2022-05-30 2022-10-11 青岛海尔科技有限公司 意图行为的确定方法和装置、存储介质及电子装置

Also Published As

Publication number Publication date
CN111405184A (zh) 2020-07-10

Similar Documents

Publication Publication Date Title
WO2021189650A1 (zh) 实时视频流的显示方法、头戴设备、存储介质及电子设备
US11636880B2 (en) System and method for event data collection and video alignment
WO2021189647A1 (zh) 多媒体信息的确定方法、头戴设备、存储介质及电子设备
WO2017024975A1 (zh) 一种无人机便携式地面站处理方法及系统
US20160191591A1 (en) Live crowdsourced media streaming
US20160100093A1 (en) Live video system
EP2892205B1 (en) Method and device for determining a sharing terminal
US11443613B2 (en) Real-time crime center solution with text-based tips and panic alerts
CN112969049A (zh) 一种船舶违章行为智能侦测系统
WO2020227996A1 (zh) 一种拍摄控制方法、装置及控制设备、拍摄设备
CN113378616A (zh) 视频分析方法、视频分析的管理方法及相关设备
CN116894613B (zh) 一种应用于机场的可视化管理系统及方法
CN112346845A (zh) 编码任务的调度方法、装置、设备及存储介质
EP3140913B1 (en) Embedding biometric data from a wearable computing device in metadata of a recorded image
CN108900608A (zh) 基于云平台的机器人实时反馈系统
WO2021189648A1 (zh) 轨迹信息的显示方法、头戴设备、存储介质及电子设备
CN110601891A (zh) 一种报警处理的方法以及相关装置
WO2021189682A1 (zh) 目标识别方法及头戴设备
CN102427520A (zh) 一种基于两层id结构的多路网络视频监控方法及系统
TWI503759B (zh) 人臉偵測之雲端智慧監視系統
WO2021189651A1 (zh) 头戴设备的轨迹确定方法和装置、存储介质及电子装置
WO2021189654A1 (zh) 异常区域的确定方法、头戴设备、存储介质
EP3474530A1 (en) Image compressing method, image reconstructing method, image compressing device, image reconstructing device, image compressing program product, and image reconstructing program product
JP2014042170A (ja) 撮影システム、撮影支援方法、撮影装置及びその制御方法、管理装置及びその制御方法、並びにプログラム
CN207611416U (zh) 一种具备自动识别的考勤系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20926554

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20926554

Country of ref document: EP

Kind code of ref document: A1