CN114339344A - Intelligent device and video recording method - Google Patents
Intelligent device and video recording method Download PDFInfo
- Publication number
- CN114339344A CN114339344A CN202011077710.6A CN202011077710A CN114339344A CN 114339344 A CN114339344 A CN 114339344A CN 202011077710 A CN202011077710 A CN 202011077710A CN 114339344 A CN114339344 A CN 114339344A
- Authority
- CN
- China
- Prior art keywords
- capability
- video
- camera
- coding
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000004806 packaging method and process Methods 0.000 claims abstract description 5
- 238000004590 computer program Methods 0.000 claims description 13
- 230000009849 deactivation Effects 0.000 claims description 4
- 238000004891 communication Methods 0.000 description 16
- 238000010586 diagram Methods 0.000 description 16
- 230000006870 function Effects 0.000 description 11
- 238000012545 processing Methods 0.000 description 10
- 238000006243 chemical reaction Methods 0.000 description 6
- 230000006835 compression Effects 0.000 description 6
- 238000007906 compression Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000003993 interaction Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 239000002131 composite material Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000002194 synthesizing effect Effects 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Abstract
The embodiment of the invention relates to the technical field of videos, in particular to an intelligent device and a video recording method, which comprise the following steps: a controller, a user interface, a video processor and a video interface; the video interface is used for receiving a first video stream coded by the camera according to a first coding capability; the first encoding capability is the highest encoding capability of the encoding capabilities of the cameras that matches the decoding capability of the video processor; and the controller is used for packaging the first video stream into a recording file when determining that the second coding capacity of the video processor is lower than the first coding capacity based on the video recording instruction. The scheme fully utilizes the capability of the camera capable of outputting the high-specification coded video stream; the intelligent device generates the video recording file with the high specification based on the first video stream with the high specification, and user experience is greatly enhanced.
Description
Technical Field
The embodiment of the invention relates to the technical field of videos, in particular to intelligent equipment and a video recording method.
Background
With the development of artificial intelligence and the popularization of intelligent equipment, a camera is used as image/video input equipment, has more and more related functions, becomes a standard device of the intelligent equipment, and is widely applied to aspects such as video conferences, telemedicine, real-time monitoring and the like.
Generally, the smart device can display local images of image/video data collected by the camera or form a recording file for convenient subsequent storage. Specifically, after the camera collects a video, the video is encoded by a photosensitive assembly circuit and a control assembly in the camera to generate an encoded video stream, and then the encoded video stream is input into the intelligent device through a parallel port or a USB connection; the intelligent equipment decodes the coded video stream input by the camera, and the decoded video stream can be displayed through local preview by application software in the intelligent equipment; meanwhile, the intelligent device can also encode the decoded video stream to form a recording file.
Compared with a camera, the intelligent device has a bias in decoding capability and a weaker encoding capability. In the prior art, in order to ensure that the intelligent device can record videos, a camera is set to output a coded video stream with a lower specification, but obviously, the high coding capability of the camera is not fully utilized, and the high decoding capability of the intelligent device is not fully utilized.
In summary, there is a need for an intelligent device and a video recording method for solving the problem that the intelligent device cannot encode and record a high-specification video stream.
Disclosure of Invention
The embodiment of the invention provides intelligent equipment and a video recording method, which are used for solving the problem that the intelligent equipment cannot encode and record high-specification video streams.
An embodiment of the present invention provides an intelligent device, including: a controller, a user interface, a video processor and a video interface;
the video interface is used for receiving a first video stream coded by the camera according to a first coding capability; the first encoding capability is the highest encoding capability of the encoding capabilities of the cameras that matches the decoding capability of the video processor;
the video processor is configured to decode the first video stream according to a first decoding capability to obtain a second video stream; the first decoding capability matches the first encoding capability;
the user interface is used for receiving a video recording instruction;
and the controller is used for packaging the first video stream into a recording file when determining that the second coding capacity of the video processor is lower than the first coding capacity based on the video recording instruction.
Because the decoding capability of the intelligent equipment is equivalent to the encoding capability of the camera, the first encoding capability of the camera is set to be the highest encoding capability matched with the decoding capability of the intelligent equipment, the first video stream output by the camera can be ensured to be the highest specification of the camera, the encoding capability of the intelligent equipment is not considered, the capability of the camera for outputting the high-specification encoded video stream is fully utilized, and the limitation of the lower encoding capability of the intelligent equipment is avoided. When the second coding capability of the intelligent equipment is lower than the first coding capability, the intelligent equipment directly packages the first video stream output by the camera according to the first coding capability into a recording file, so that the intelligent equipment can generate a video recording file with a high specification based on the first video stream with a high specification instead of coding the second video stream obtained according to the first decoding capability based on the second coding capability, the definition, the fluency, the compression format and the like of the recorded video file are improved, and the user experience is greatly enhanced; in addition, the intelligent device directly encapsulates the first video stream, so that a complex encoding process is omitted, computing resources of the intelligent device are released, and the efficiency of forming a video recording file is effectively improved.
In some embodiments, the video processor is further configured to encode the second video stream according to the second encoding capability to obtain a recording file when the second encoding capability is not lower than the first encoding capability.
Therefore, under the condition that the second coding capacity of the intelligent equipment is not lower than the first coding capacity, the intelligent equipment can be ensured to code the second video stream based on the second coding capacity with higher coding capacity, so that a video recording file with higher specification is generated, and the higher coding capacity of the intelligent equipment is fully utilized. The recording file is generated by the intelligent device according to the coding capability of the intelligent device, so that a plurality of applications of the recording file on the intelligent device can be shared.
In some embodiments, the user interface is further configured to receive a camera enabling instruction;
the controller is further configured to determine the first encoding capability and the first decoding capability according to each encoding capability supported by the camera and each decoding capability supported by the video processor;
the controller is further configured to configure the encoding capability of the camera to be the first encoding capability based on the camera enabling instruction, and start the camera; and also for configuring the decoding capability of the video processor to the first decoding capability.
The first coding capability and the first decoding capability are determined through the coding capabilities supported by the camera and the decoding capabilities supported by the intelligent device, the first coding capability is the highest coding capability matched with the decoding capability of the intelligent device in the coding capabilities of the camera, the first video stream generated through the first coding capability is ensured to be the highest specification of the camera, and the first coding capability is also ensured to be matched with the first decoding capability, namely the intelligent device can decode the first video stream through the first decoding capability for local preview display, and the problem that the camera blindly outputs the first video stream by adopting higher or lower coding capability and the intelligent device cannot decode the first video stream under the condition that the coding capabilities supported by the camera and the decoding capabilities supported by the intelligent device are not obtained is solved.
In some embodiments, the smart device further comprises: a display;
the display is used for playing the second video stream.
Under the condition that the intelligent equipment can decode the first video stream generated according to the highest specification of the camera certainly through the first decoding capacity, the intelligent equipment can decode the first video stream, and the second video stream is generated and used for local preview display.
In some embodiments, the controller is further configured to determine that the video processor does not have a decoding capability matching the encoding capability of the camera according to the encoding capabilities supported by the camera and the decoding capabilities supported by the video processor, and send a camera deactivation instruction to the camera.
Therefore, the situation that the intelligent equipment does not have the capability of decoding the first video stream obtained by coding the camera, the camera is blindly opened for coding and outputting the first video stream, the first video stream is blindly packaged to form a recording file, and the intelligent equipment cannot perform local preview display, namely the intelligent equipment cannot perform real-time adjustment on the picture visual field and the focusing condition of the recorded video file is avoided; the camera is not started for coding after the judgment that the intelligent equipment does not have the decoding capability matched with the coding capability of the camera, so that the computing resources of the camera and the intelligent equipment are saved, and the operating pressure is relieved.
The embodiment of the invention also provides a video recording method, which is suitable for intelligent equipment provided with a camera, and the method comprises the following steps:
the intelligent equipment receives a video recording instruction aiming at a currently played video; the currently played video is a second video stream obtained by decoding a first video stream coded by the camera according to a first coding capability by the intelligent equipment according to the first decoding capability; the first coding capability is the highest coding capability matched with the decoding capability of the intelligent equipment in the coding capabilities of the camera;
and when the second coding capability of the intelligent equipment is lower than the first coding capability, the intelligent equipment packages the first video stream into a recording file.
In some embodiments, the method further comprises:
and when the second coding capability is not lower than the first coding capability, the intelligent equipment codes the second video stream according to the second coding capability to obtain a recording file.
In some embodiments, before the intelligent device receives the video recording instruction for the currently playing video, the method further includes:
the intelligent equipment receives a camera starting instruction;
the intelligent equipment determines the first coding capacity and the first decoding capacity according to each coding capacity supported by the camera and each decoding capacity supported by the intelligent equipment;
and the intelligent equipment configures the coding capability of the camera to be the first coding capability and starts the camera.
An embodiment of the present invention further provides a computing device, including:
a memory for storing a computer program;
and the processor is used for calling the computer program stored in the memory and executing the video recording method listed in any mode according to the obtained program.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer-executable program is stored in the computer-readable storage medium, and the computer-executable program is used to enable a computer to execute the video recording method listed in any of the above manners.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 schematically illustrates an operation scenario between a smart device and a control apparatus according to an embodiment;
FIG. 2 illustrates an intelligent device for video recording;
fig. 3 is a block diagram of a hardware configuration of a possible smart device 200 according to an embodiment of the present invention;
fig. 4 illustrates a possible video recording method according to an embodiment of the present invention;
fig. 5 illustrates a possible video recording method according to an embodiment of the present invention;
fig. 6 is a block diagram of another possible hardware configuration of the smart device 200 according to an embodiment of the present invention;
fig. 7 is a schematic diagram of an overall flow involved in an embodiment of the present invention.
Detailed Description
To make the objects, embodiments and advantages of the present application clearer, the following description of exemplary embodiments of the present application will clearly and completely describe the exemplary embodiments of the present application with reference to the accompanying drawings in the exemplary embodiments of the present application, and it is to be understood that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.
All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments described herein without inventive step, are intended to be within the scope of the claims appended hereto. In addition, while the disclosure herein has been presented in terms of one or more exemplary examples, it should be appreciated that aspects of the disclosure may be implemented solely as a complete embodiment.
It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.
The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and are not necessarily intended to limit the order or sequence of any particular one, Unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.
Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.
Fig. 1 is a schematic diagram illustrating an operation scenario between an intelligent device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the smart device 200 through the mobile terminal 300 and the control apparatus 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the smart device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, etc., and the smart device 200 is controlled by a wireless or other wired method. The user may input user instructions via keys on a remote control, voice input, control panel input, etc. to control the smart device 200. Such as: the user can input a corresponding control instruction through a video recording key, a volume up/down key, a channel control key, an up/down/left/right moving key, a voice input key, a menu key, a power on/off key, etc. on the remote controller, thereby implementing the function of controlling the smart device 200.
In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the smart device 200. For example, the smart device 200 is controlled using an application running on the smart device. The application, through configuration, may provide the user with various controls in an intuitive User Interface (UI) on a screen associated with the smart device.
In some embodiments, the mobile terminal 300 may install a software application with the smart device 200 to implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication. Such as: the control instruction protocol can be established between the mobile terminal 300 and the intelligent device 200, the remote control keyboard is synchronized to the mobile terminal 300, and the function of controlling the intelligent device 200 is realized by controlling the user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the intelligent device 200, so that the synchronous display function is realized.
As also shown in fig. 1, the smart device 200 is also in data communication with the server 400 through a variety of communication means. The smart device 200 may be allowed to communicatively connect through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various content and interactions to the smart device 200. Illustratively, the smart device 200 receives software program updates, or accesses a remotely stored digital media library, by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers. Other web service contents such as video on demand and advertisement services are provided through the server 400.
The smart device 200 may be a television, a camera, a smart box, a network box, a monitoring device, etc. The specific smart device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the smart device 200 may be modified in performance and configuration as desired.
The smart device 200 may additionally provide a smart web tv function of a computer support function in addition to the broadcast receiving tv function, including but not limited to a web tv, a smart tv, an Internet Protocol Tv (IPTV), and the like.
The camera may be mounted on the smart device 200, such as the camera 501 (e.g., a camera of the smart device 200 itself, or a camera that is connected to the smart device 200 in a pluggable manner); smart device 200, such as camera 502, may also be remotely connected.
Fig. 2 illustrates a smart device for video recording, the smart device including a video interface, a video processor, and a display.
The video interface is used for receiving the coded video stream output by the camera and sending the coded video stream to the video processor;
the video processor is used for decoding the coded video stream output by the camera to form a decoded video stream; sending the decoded video stream to a display for local preview display;
a display for playing the decoded video stream formed by the video processor;
and the video processor is also used for encoding the decoded video stream formed by the video processor and packaging the encoded video stream into a recorded video file.
However, for the above scheme, in most cases, the smart device is biased to the decoding capability and weaker in the encoding capability compared to the camera. For example, the decoding capability of a camera ISP (image signal processing) can maximally support 4K @30HZ H264/H265, and the encoding capability can maximally support 4K @30HZ H264/H265; the decoding capability of the television SOC maximally supports 4K @30HZ H264/H265, and the encoding capability maximally supports 1080p @30HZ H264. The resolution ratio of the video image, namely the number of pixels contained in the video image, is 4K and 1080p, and the resolution ratio is higher and the definition is higher; the 30HZ and the 60HZ refer to the refresh rate of the video, namely the refreshing frequency of the screen per second, and are used for representing the fluency of the video image, and the fluency is better when the refresh rate is higher; h264 and H265 refer to video compression formats, and compared with H264, H265 has lower code rate and higher definition, saves bandwidth or storage space and improves efficiency. The above indexes and numbers of the codec capability are merely examples, and are not limited thereto.
It can be seen that the decoding capability of the television is comparable to that of the camera, while the encoding capability is poor. Thus, when the camera inputs a high-specification encoded video stream, such as 4K resolution, the smart device can decode it without the ability to encode it. Therefore, if the intelligent device is required to record video, the camera needs to output a coded video stream with a lower specification, for example, the resolution is 1080p, which obviously does not fully utilize the capability of the camera that can output a coded video stream with a high specification (the camera has the coding capability of the resolution of 4K); meanwhile, the intelligent device cannot generate a video recording file with a high specification due to the encoding capacity of the intelligent device, the definition, the fluency, the compression format and the like are affected, and the user experience is greatly reduced; in addition, the process of encoding by the intelligent device is complicated, and the intelligent device occupies more computing resources, so that the video recording efficiency is reduced.
In addition, in the method, a matching process of the coding capability of the camera and the decoding capability of the intelligent device is not performed. Therefore, under the condition that the intelligent device does not configure the coding capability of the camera and the decoding capability of the intelligent device, the camera blindly codes according to the set coding format and outputs the coded video stream, and the intelligent device does not have the corresponding decoding capability and cannot decode the coded video stream.
In order to solve the above problems, embodiments of the present invention provide an intelligent device, so as to solve the problems that the coding capability of a camera is wasted, the intelligent device cannot perform coding and recording on a high-specification video stream, the video recording efficiency is low, and the intelligent device cannot perform decoding and displaying on the video stream.
Fig. 3 is a block diagram of a hardware configuration of a possible smart device 200 according to an embodiment of the present invention.
In some embodiments, the smart device includes at least one of a controller 210, a user interface 220, a video processor 230, and a video interface 240;
in some embodiments, the video interface 240 is configured to receive a first video stream transmitted by a camera; one possible implementation is that the video interface is a video interface, connected to the camera. The video interface can also be connected with any one or more of a high-definition multimedia interface (HDMI) interface, an analog or data high-definition component input interface, a composite video input interface, a USB input interface, an RGB port and the like. The plurality of interfaces may form a composite input/output interface. One possible video interface is an interface for interaction between internal devices of the smart device, such as in the case of a built-in camera.
In some embodiments, the video processor 230 is configured to receive the video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of the input signal, so as to obtain a signal that can be directly displayed or played. In this embodiment, the video processor 230 is configured to decode the first video stream according to a first decoding capability to obtain a second video stream; the first decoding capability matches the first encoding capability;
in some embodiments, the video processor 230 includes a demultiplexing part, a video decoding part, an image synthesizing part, a frame rate conversion part, a display formatting part, and the like.
The demultiplexing part is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing part demultiplexes the input audio and video data stream into a video signal, an audio signal and the like.
The video decoding unit is used for processing the demultiplexed video signal, including decoding, scaling and the like.
And an image synthesizing part, such as an image synthesizer, for performing superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.
The frame rate conversion unit is used for converting the input video frame rate, such as 60Hz frame rate to 120Hz frame rate or 240Hz frame rate, and the normal format is implemented by using frame interpolation, for example.
The display format part is used for converting the received video output signal after frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting RGB data signal. A user interface 220 for receiving an input signal of a user and then transmitting the received user input signal to the controller 210. The user input signal may be a remote controller signal received through an infrared receiver, and various user control signals may be received through the network communication part. In the present embodiment, the user interface 220 is used for receiving a video recording instruction.
In some embodiments, the user inputs a user command through the control device 100 or the mobile terminal 300, and the user input interface responds to the user input through the controller 210 according to the user input.
In some embodiments, a user may enter a user command in a displayed Graphical User Interface (GUI) and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
The controller 210 generally includes at least one of a Random Access Memory (RAM), a Read-Only Memory (ROM), a Central Processing Unit (CPU), a Communication Interface (Communication Interface), and a Communication Bus (Bus). Wherein a communication bus connects the various components.
In some embodiments, RAM is used to store temporary data for the operating system or other programs that are running.
In some embodiments, the ROM is used to store instructions for various system boots.
In some embodiments, the ROM is used to store a Basic Input Output System (BIOS). The system is used for completing power-on self-test of the system, initialization of each functional part in the system, a driver of basic input/output of the system and booting an operating system.
In some embodiments, when the power-on signal is received, the power supply starts to be started, the CPU executes a system starting instruction in the ROM, and temporary data of the operating system stored in the memory is copied to the RAM so as to start or run the operating system. After the operating system is started, the CPU copies the temporary data of various application programs in the memory to the RAM, and then the various application programs are started or run conveniently.
In some embodiments, a CPU processor is used to execute operating system and application program instructions stored in memory. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.
In some exemplary embodiments, the CPU processor may include a plurality of processors. The plurality of processors may include a main processor and one or more sub-processors. A main processor for performing some operations in a pre-power-up mode and/or operations for displaying a screen in a normal mode. One or more sub-processors for one operation in a standby mode or the like.
In this embodiment, the controller 210 is configured to package the first video stream into a recording file when determining that the second encoding capability of the video processor is lower than the first encoding capability based on the video recording instruction.
Based on the hardware configuration block diagram of the intelligent device 200 shown in fig. 3, an embodiment of the present invention further provides a video recording method, as shown in fig. 4.
For example, the camera supports two encoding capabilities of 4K @30HZ H265 and 1080p @30HZ H265, the television supports two decoding capabilities of 4K @30HZ H265 and 1080p @30HZ H265, and supports two encoding capabilities of 1080p @30HZ H264 and 720p @30HZ H264, as shown in table 1. Based on the principle that the encoding capability of the camera is matched with the decoding capability of the television and is the highest encoding capability of the camera, the first encoding capability of the camera is 4K @30HZ H265, and the first decoding capability of the television is 4K @30HZ H265. The camera outputs a first video stream according to the first coding capacity of 4K @30HZ H265, the television decodes the first video stream according to the first decoding capacity of 4K @30HZ H265 to obtain a second video stream with the format of 4K @30HZ, and the television plays the second video stream, so that the definition, the fluency and the compression format are high. And clicking a video recording key on the television by the user, and sending a video recording instruction to the television. After the television receives the video recording instruction, the second encoding capacity of the television is determined to be 1080p @30HZ H264 with the highest specification in the encoding capacities, and the television cannot encode the second video stream with the format of 4K @30 HZ. The television directly packages the first video stream with the format of 4K @30HZ H265 into a recording file without an encoding process, the format of the generated video recording file is 4K @30HZ H265, and the definition, the fluency, the compression format and the like of the video recording file are equivalent to those of the encoded video stream output by the camera. The above are merely examples, and embodiments of the present invention are not limited thereto.
| Camera supported coding capability | Television supported decoding capability | Television supported coding capability |
| 4K@30HZ H265 | 4K@30HZ H265 | 1080p@30HZ H264 |
| 1080p@30HZ H265 | 1080p@30HZ H265 | 720p@30HZ H264 |
TABLE 1
Therefore, the decoding capability of the intelligent equipment is equivalent to the encoding capability of the camera, so that the first encoding capability of the camera is set to be the highest encoding capability matched with the decoding capability of the intelligent equipment, the first video stream output by the camera can be ensured to be the highest specification of the camera, the encoding capability of the intelligent equipment is not considered, the capability of the camera for outputting the high-specification encoded video stream is fully utilized, and the limitation of the lower encoding capability of the intelligent equipment is avoided. When the second coding capability of the intelligent equipment is lower than the first coding capability, the intelligent equipment directly packages the first video stream output by the camera according to the first coding capability into a recording file, so that the intelligent equipment can generate a video recording file with a high specification based on the first video stream with a high specification instead of coding the second video stream obtained according to the first decoding capability based on the second coding capability, the definition, the fluency, the compression format and the like of the recorded video file are improved, and the user experience is greatly enhanced; in addition, the intelligent device directly encapsulates the first video stream, so that a complex encoding process is omitted, computing resources of the intelligent device are released, and the efficiency of forming a video recording file is effectively improved.
In some embodiments, the video processor is further configured to encode the second video stream according to the second encoding capability to obtain a recording file when the second encoding capability is not lower than the first encoding capability.
Based on the above intelligent device, the embodiment of the present invention further provides a method for recording a video, including:
and when the second coding capability is not lower than the first coding capability, the intelligent equipment codes the second video stream according to the second coding capability to obtain a recording file.
For example, the camera supports two encoding capabilities of 720p @30HZ H265 and 1080p @30HZ H265, the television supports one decoding capability of 720p @30HZ H265, and supports two encoding capabilities of 1080p @30HZ H264 and 720p @30HZ H264, as shown in table 2. Based on the principle that the coding capability of the camera is matched with the decoding capability of the television and is the highest coding capability of the camera, the first coding capability of the camera is 720p @30HZ H265, and the first decoding capability of the television is 720p @30HZ H265. The camera outputs a first video stream according to the first coding capacity of 720p @30HZ H265, the television decodes the first video stream according to the first decoding capacity of 720p @30HZ H265 to obtain a second video stream with the format of 720p @30HZ, and the television plays the second video stream. And clicking a video recording key on the television by the user, and sending a video recording instruction to the television. After receiving the video recording instruction, the television determines that the second encoding capability of the television is 1080p @30HZ H264, which is higher than the specification of the first video stream, namely the first encoding capability. Thus, the television encodes the second video stream in accordance with the second encoding capability of 1080p @30HZ H264, and then encapsulates it into a video recording file. The above are merely examples, and embodiments of the present invention are not limited thereto.
TABLE 2
Therefore, under the condition that the second coding capacity of the intelligent equipment is not lower than the first coding capacity, the intelligent equipment can be ensured to code the second video stream based on the second coding capacity with higher coding capacity, so that a video recording file with higher specification is generated, and the higher coding capacity of the intelligent equipment is fully utilized. The recording file is generated by the intelligent device according to the coding capability of the intelligent device, so that a plurality of applications of the recording file on the intelligent device can be shared.
In some embodiments, the user interface is further configured to receive a camera enabling instruction;
the controller is further configured to determine the first encoding capability and the first decoding capability according to each encoding capability supported by the camera and each decoding capability supported by the video processor;
the controller is further configured to configure the encoding capability of the camera to be the first encoding capability based on the camera enabling instruction, and start the camera; and also for configuring the decoding capability of the video processor to the first decoding capability.
As shown in fig. 5, the embodiment of the present invention further provides the following steps: before the intelligent device receives a video recording instruction for a currently played video, the method further includes:
For example, the camera supports two encoding capabilities of 4K @30HZ H265 and 1080p @30HZ H265, the television supports two decoding capabilities of 4K @30HZ H265 and 1080p @30HZ H265, and the first encoding capability of the camera is configured to be 4K @30HZ H265 and the decoding capability of the television is configured to be 4K @30HZ H265 based on the principle that the encoding capability of the camera is matched with the decoding capability of the television and is the highest encoding capability of the camera. The above are merely examples, and embodiments of the present invention are not limited thereto.
The first coding capability and the first decoding capability are determined through the coding capabilities supported by the camera and the decoding capabilities supported by the intelligent device, the first coding capability is the highest coding capability matched with the decoding capability of the intelligent device in the coding capabilities of the camera, the first video stream generated through the first coding capability is ensured to be the highest specification of the camera, and the first coding capability is also ensured to be matched with the first decoding capability, namely the intelligent device can decode the first video stream through the first decoding capability for local preview display, and the problem that the camera blindly outputs the first video stream by adopting higher or lower coding capability and the intelligent device cannot decode the first video stream under the condition that the coding capabilities supported by the camera and the decoding capabilities supported by the intelligent device are not obtained is solved.
Another possible hardware configuration block diagram of the smart device 200 is provided in the embodiment of the present invention, as shown in fig. 6.
In some embodiments, the smart device 200 further comprises: a display 250;
and a display 250 for receiving the image signal, and displaying the video content and image and the components of the menu manipulation interface. In some embodiments, the video content is displayed from broadcast television content, or alternatively, from various broadcast signals that may be received via wired or wireless communication protocols. Alternatively, various image contents received from the network communication protocol and sent from the network server side can be displayed. In this embodiment, the second video stream is played.
In some embodiments, display 250 includes a display screen component for presenting a picture, and a driving component for driving the display of an image.
In some embodiments, a driving component for driving the display is also included, depending on the type of display 250.
In some embodiments, display 250 is a projection display and may further include a projection device and a projection screen.
Based on the hardware configuration block diagram of the intelligent device 200 shown in fig. 6, the embodiment of the present invention further provides the following steps:
after the camera is started, the method further comprises the following steps:
the smart device decoding the first video stream into a second video stream using the first decoding capability;
and the intelligent equipment plays the second video stream.
Under the condition that the intelligent equipment can decode the first video stream generated according to the highest specification of the camera certainly through the first decoding capacity, the intelligent equipment can decode the first video stream, and the second video stream is generated and used for local preview display.
In some embodiments, the controller is further configured to determine that the video processor does not have a decoding capability matching the encoding capability of the camera according to the encoding capabilities supported by the camera and the decoding capabilities supported by the video processor, and send a camera deactivation instruction to the camera.
The video recording method further comprises the following steps:
and the intelligent equipment determines that the intelligent equipment does not have decoding capability matched with the coding capability of the camera according to the coding capabilities supported by the camera and the decoding capabilities supported by the intelligent equipment, and then sends a camera stopping instruction.
For example, the camera supports 4K @30HZ H265 encoding capability, the television supports 1080p @30HZ H265 decoding capability, and based on the principle that the encoding capability of the camera is matched with the decoding capability of the television and is the highest encoding capability of the camera, it can be found that if the television does not have the decoding capability matched with the encoding capability of the camera, a camera deactivation instruction is sent, the camera is turned off, and no video image is collected. The above are merely examples, and embodiments of the present invention are not limited thereto.
Therefore, the situation that the intelligent equipment does not have the capability of decoding the first video stream obtained by coding the camera, the camera is blindly opened for coding and outputting the first video stream, the first video stream is blindly packaged to form a recording file, and the intelligent equipment cannot perform local preview display, namely the intelligent equipment cannot perform real-time adjustment on the picture visual field and the focusing condition of the recorded video file is avoided; the camera is not started for coding after the judgment that the intelligent equipment does not have the decoding capability matched with the coding capability of the camera, so that the computing resources of the camera and the intelligent equipment are saved, and the operating pressure is relieved.
In order to more clearly describe the above video recording method, the flow involved in the embodiment of the present invention is generally described below with reference to fig. 7. As shown in fig. 7, the following steps may be included:
703, judging whether each decoding capability of the television has a decoding capability matched with the encoding capability of the camera, and if not, executing 504; if yes, go to step 505;
and step 713, ending the video recording.
An embodiment of the present invention further provides a computing device, including:
a memory for storing a computer program;
and the processor is used for calling the computer program stored in the memory and executing the video recording method listed in any mode according to the obtained program.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer-executable program is stored in the computer-readable storage medium, and the computer-executable program is used to enable a computer to execute a video recording method listed in any of the above manners.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. A smart device, comprising: a controller, a user interface, a video processor and a video interface;
the video interface is used for receiving a first video stream coded by the camera according to a first coding capability; the first encoding capability is the highest encoding capability of the encoding capabilities of the cameras that matches the decoding capability of the video processor;
the video processor is configured to decode the first video stream according to a first decoding capability to obtain a second video stream; the first decoding capability matches the first encoding capability;
the user interface is used for receiving a video recording instruction;
and the controller is used for packaging the first video stream into a recording file when determining that the second coding capacity of the video processor is lower than the first coding capacity based on the video recording instruction.
2. The smart device of claim 1,
and the video processor is further configured to encode the second video stream according to the second encoding capability to obtain a recording file when the second encoding capability is not lower than the first encoding capability.
3. The smart device of claim 1,
the user interface is also used for receiving a camera starting instruction;
the controller is further configured to determine the first encoding capability and the first decoding capability according to each encoding capability supported by the camera and each decoding capability supported by the video processor;
the controller is further configured to configure the encoding capability of the camera to be the first encoding capability based on the camera enabling instruction, and start the camera; and also for configuring the decoding capability of the video processor to the first decoding capability.
4. The smart device of claim 1, further comprising: a display;
the display is used for playing the second video stream.
5. The smart device of claim 4,
the controller is further configured to determine that the video processor does not have a decoding capability that matches the encoding capability of the camera according to each encoding capability supported by the camera and each decoding capability supported by the video processor, and send a camera deactivation instruction to the camera.
6. A method for video recording, adapted to a smart device equipped with a camera, the method comprising:
the intelligent equipment receives a video recording instruction aiming at a currently played video; the currently played video is a second video stream obtained by decoding a first video stream coded by the camera according to a first coding capability by the intelligent equipment according to the first decoding capability; the first coding capability is the highest coding capability matched with the decoding capability of the intelligent equipment in the coding capabilities of the camera;
and when the second coding capability of the intelligent equipment is lower than the first coding capability, the intelligent equipment packages the first video stream into a recording file.
7. The method for video recording according to claim 6, further comprising:
and when the second coding capability is not lower than the first coding capability, the intelligent equipment codes the second video stream according to the second coding capability to obtain a recording file.
8. The method for video recording according to claim 6, wherein before the intelligent device receives the video recording instruction for the currently playing video, the method further comprises:
the intelligent equipment receives a camera starting instruction;
the intelligent equipment determines the first coding capacity and the first decoding capacity according to each coding capacity supported by the camera and each decoding capacity supported by the intelligent equipment;
and the intelligent equipment configures the coding capability of the camera to be the first coding capability and starts the camera.
9. A computing device, comprising:
a memory for storing a computer program;
a processor for calling a computer program stored in said memory, for executing the method of any one of claims 6 to 8 in accordance with the obtained program.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer-executable program for causing a computer to execute the method of any one of claims 6 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011077710.6A CN114339344B (en) | 2020-10-10 | 2020-10-10 | Intelligent device and video recording method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011077710.6A CN114339344B (en) | 2020-10-10 | 2020-10-10 | Intelligent device and video recording method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114339344A true CN114339344A (en) | 2022-04-12 |
| CN114339344B CN114339344B (en) | 2024-03-05 |
Family
ID=81032164
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011077710.6A Active CN114339344B (en) | 2020-10-10 | 2020-10-10 | Intelligent device and video recording method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114339344B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20060085020A (en) * | 2005-01-21 | 2006-07-26 | 엘지전자 주식회사 | Video recoding and playing apparatus for mobile communication device |
| CN104349100A (en) * | 2013-07-25 | 2015-02-11 | 杭州海康威视数字技术股份有限公司 | DVR monitoring system supporting single-channel dual-stream video recording and method thereof |
| CN105100663A (en) * | 2014-05-15 | 2015-11-25 | 北京同步科技有限公司 | Recording system based on hardware encoders, audio and video processing apparatus, and recording method |
| CN107682672A (en) * | 2017-09-30 | 2018-02-09 | 深圳市普天宜通技术股份有限公司 | A kind of two-way video stream implementation method, storage medium and multimedia terminal |
| CN108235107A (en) * | 2016-12-15 | 2018-06-29 | 广州市动景计算机科技有限公司 | Video recording method, device and electric terminal |
| CN111641804A (en) * | 2020-06-16 | 2020-09-08 | 广州迈聆信息科技有限公司 | Video data processing method and device, terminal, camera and video conference system |
-
2020
- 2020-10-10 CN CN202011077710.6A patent/CN114339344B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20060085020A (en) * | 2005-01-21 | 2006-07-26 | 엘지전자 주식회사 | Video recoding and playing apparatus for mobile communication device |
| CN104349100A (en) * | 2013-07-25 | 2015-02-11 | 杭州海康威视数字技术股份有限公司 | DVR monitoring system supporting single-channel dual-stream video recording and method thereof |
| CN105100663A (en) * | 2014-05-15 | 2015-11-25 | 北京同步科技有限公司 | Recording system based on hardware encoders, audio and video processing apparatus, and recording method |
| CN108235107A (en) * | 2016-12-15 | 2018-06-29 | 广州市动景计算机科技有限公司 | Video recording method, device and electric terminal |
| CN107682672A (en) * | 2017-09-30 | 2018-02-09 | 深圳市普天宜通技术股份有限公司 | A kind of two-way video stream implementation method, storage medium and multimedia terminal |
| CN111641804A (en) * | 2020-06-16 | 2020-09-08 | 广州迈聆信息科技有限公司 | Video data processing method and device, terminal, camera and video conference system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114339344B (en) | 2024-03-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021109487A1 (en) | Control method for audio data stream output and display device | |
| CN114302194B (en) | Display device and playing method during multi-device switching | |
| CN112153446B (en) | Display device and streaming media video audio and video synchronization method | |
| CN111901654A (en) | Display device and screen recording method | |
| CN113407142A (en) | Display device and screen projection method | |
| CN111405221B (en) | Display device and display method of recording file list | |
| CN113507638B (en) | Display equipment and screen projection method | |
| CN112153447B (en) | Display device and sound and picture synchronous control method | |
| CN112188279A (en) | Channel switching method and display equipment | |
| CN112118400B (en) | Display method of image on display device and display device | |
| WO2022021669A1 (en) | Method for controlling intelligent image mode switching and display device | |
| CN112887778A (en) | Switching method of video resource playing modes on display equipment and display equipment | |
| CN111107428A (en) | Method for playing two-way media stream data and display equipment | |
| CN111954043B (en) | Information bar display method and display equipment | |
| CN113630654A (en) | Display device and media resource pushing method | |
| CN111277911B (en) | Image processing method of panoramic video, display device and server | |
| CN114095778A (en) | Audio hard decoding method of application-level player and display equipment | |
| CN114339344B (en) | Intelligent device and video recording method | |
| CN113453069B (en) | Display device and thumbnail generation method | |
| CN112218156B (en) | Method for adjusting video dynamic contrast and display equipment | |
| CN111629250A (en) | Display device and video playing method | |
| CN112702549B (en) | Sound output method and display device | |
| CN113099308B (en) | Content display method, display equipment and image collector | |
| CN112929724B (en) | Display device, set top box and far-field pickup awakening control method | |
| CN111246282B (en) | Program information acquisition method in display equipment and display equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |