CN114339344B - Intelligent device and video recording method - Google Patents

Intelligent device and video recording method Download PDF

Info

Publication number
CN114339344B
CN114339344B CN202011077710.6A CN202011077710A CN114339344B CN 114339344 B CN114339344 B CN 114339344B CN 202011077710 A CN202011077710 A CN 202011077710A CN 114339344 B CN114339344 B CN 114339344B
Authority
CN
China
Prior art keywords
video
camera
capability
decoding
encoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011077710.6A
Other languages
Chinese (zh)
Other versions
CN114339344A (en
Inventor
胡修振
甘胜军
王之奎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Visual Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Visual Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Priority to CN202011077710.6A priority Critical patent/CN114339344B/en
Publication of CN114339344A publication Critical patent/CN114339344A/en
Application granted granted Critical
Publication of CN114339344B publication Critical patent/CN114339344B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The embodiment of the invention relates to the technical field of videos, in particular to intelligent equipment and a video recording method, which comprises the following steps: a controller, a user interface, a video processor, and a video interface; the video interface is used for receiving a first video stream which is encoded by the camera according to a first encoding capacity; the first encoding capability is the highest encoding capability of the camera, which is matched with the decoding capability of the video processor; and the controller is used for packaging the first video stream into a recording file when the second coding capacity of the video processor is lower than the first coding capacity based on the video recording instruction. The scheme fully utilizes the capability of the camera for outputting high-specification coded video streams; the intelligent device generates the video recording file with the high specification based on the first video stream with the high specification, so that the user experience is greatly enhanced.

Description

Intelligent device and video recording method
Technical Field
The embodiment of the invention relates to the technical field of videos, in particular to intelligent equipment and a video recording method.
Background
With the development of artificial intelligence and the popularization of intelligent equipment, a camera is used as an image/video input device, and related functions are more and more, so that the camera becomes a standard device of the intelligent equipment and is widely applied to the aspects of video conference, remote medical treatment, real-time monitoring and the like.
Generally, the intelligent device can perform local picture display on the image/video data collected by the camera, or form a recorded file for convenient subsequent storage. Specifically, after the camera collects video, a photosensitive component circuit and a control component in the camera encode the video to generate an encoded video stream, and then the encoded video stream is input into the intelligent device through a parallel port or USB connection; the intelligent equipment decodes the coded video stream input by the camera, and the decoded video stream can be subjected to local preview display through application software in the intelligent equipment; meanwhile, the intelligent equipment can also encode the decoded video stream to form a recorded file.
The smart device is biased towards decoding capability and weaker encoding capability than the camera. In the prior art, in order to ensure that the intelligent device can record video, the camera is arranged to output a coded video stream with a lower specification, but the high coding capability of the camera is obviously not fully utilized, and the high decoding capability of the intelligent device is not fully utilized.
In summary, there is a need for an intelligent device and a video recording method for solving the problem that the intelligent device cannot encode and record a high-specification video stream.
Disclosure of Invention
The embodiment of the invention provides intelligent equipment and a video recording method, which are used for solving the problem that the intelligent equipment cannot record a high-specification video stream in a coding way.
The embodiment of the invention provides intelligent equipment, which comprises: a controller, a user interface, a video processor, and a video interface;
the video interface is used for receiving a first video stream which is encoded by the camera according to a first encoding capacity; the first encoding capability is the highest encoding capability of the camera, which is matched with the decoding capability of the video processor;
the video processor is used for decoding the first video stream according to a first decoding capability to obtain a second video stream; the first decoding capability matches the first encoding capability;
the user interface is used for receiving a video recording instruction;
and the controller is used for packaging the first video stream into a recording file when the second coding capacity of the video processor is lower than the first coding capacity based on the video recording instruction.
The decoding capability of the intelligent device is equivalent to the encoding capability of the camera, so that the first encoding capability of the camera is set to be the highest encoding capability matched with the decoding capability of the intelligent device, the first video stream output by the camera can be ensured to be the highest specification of the camera, the encoding capability of the intelligent device is not considered, the capability of the camera for outputting high-specification encoded video streams is fully utilized, and the limitation of the lower encoding capability of the intelligent device is avoided. When the second coding capacity of the intelligent device is lower than the first coding capacity, the intelligent device directly packages the first video stream output by the camera according to the first coding capacity into a recording file, so that the intelligent device can generate a video recording file with high specification based on the first video stream with high specification, but not encode the second video stream obtained according to the first decoding capacity based on the second coding capacity, thereby improving the definition, fluency, compression format and the like of the recording video file and greatly enhancing user experience; in addition, the intelligent device directly encapsulates the first video stream, so that a complicated encoding process is omitted, the computing resources of the intelligent device are released, and the efficiency of forming video recording files is effectively improved.
In some embodiments, the video processor is further configured to encode the second video stream according to the second encoding capability to obtain a recording file when the second encoding capability is not lower than the first encoding capability.
Therefore, under the condition that the second coding capacity of the intelligent equipment is not lower than the first coding capacity, the intelligent equipment can be ensured to code the second video stream based on the second coding capacity with higher coding capacity, so that a video recording file with higher specification is generated, and the higher coding capacity of the intelligent equipment is fully utilized. The intelligent device generates the recorded file according to the coding capability of the intelligent device, so that a plurality of applications of the recorded file on the intelligent device can be shared.
In some embodiments, the user interface is further configured to receive a camera enabling instruction;
the controller is further configured to determine the first encoding capability and the first decoding capability according to each encoding capability supported by the camera and each decoding capability supported by the video processor;
the controller is further configured to configure the encoding capability of the camera to be the first encoding capability based on the camera enabling instruction, and start the camera; and is further configured to configure a decoding capability of the video processor to be the first decoding capability.
The first coding capacity and the first decoding capacity are determined through the coding capacities supported by the camera and the decoding capacities supported by the intelligent device, the first coding capacity is the highest coding capacity matched with the decoding capacity of the intelligent device in the coding capacities of the camera, the first video stream generated through the first coding capacity is guaranteed to be the highest specification of the camera, the first coding capacity and the first decoding capacity are guaranteed to be matched, namely the intelligent device can decode the first video stream through the first decoding capacity for local preview display, and the problem that the intelligent device cannot decode the first video stream due to the fact that the camera blindly adopts the higher or lower coding capacity under the condition that the coding capacities supported by the camera and the decoding capacities supported by the intelligent device are not obtained is avoided.
In some embodiments, the smart device further comprises: a display;
the display is used for playing the second video stream.
Under the condition that the intelligent device can decode the first video stream generated according to the highest specification of the camera through the first decoding capability, the intelligent device can decode the first video stream to generate the second video stream for local preview display, so that a user can watch the picture acquired by the camera in real time, the field of view, focusing conditions and the like of the video picture are convenient to adjust, and the accuracy and definition of the video recording file are guaranteed.
In some embodiments, the controller is further configured to send a camera disabling instruction to the camera if it is determined that the video processor does not have a decoding capability matching the encoding capability of the camera according to each encoding capability supported by the camera and each decoding capability supported by the video processor.
Therefore, the situation that the intelligent device does not have the capability of decoding the first video stream obtained by encoding the camera is avoided, the camera is blindly opened for encoding, the first video stream is output, the first video stream is blindly packaged to form a recorded file, the intelligent device cannot perform local preview display, namely, the intelligent device cannot perform real-time adjustment on the picture field and focusing condition of the recorded video file; the camera is not started to encode after judging that the intelligent device does not have decoding capability matched with the encoding capability of the camera, so that the computing resources of the camera and the intelligent device are saved, and the operation pressure is relieved.
The embodiment of the invention also provides a video recording method which is suitable for intelligent equipment provided with a camera, and comprises the following steps:
the intelligent equipment receives a video recording instruction aiming at the currently played video; the current playing video is a second video stream obtained by decoding a first video stream which is encoded by the camera according to the first encoding capability by the intelligent device according to the first decoding capability; the first encoding capability is the highest encoding capability matched with the decoding capability of the intelligent device in the encoding capability of the camera;
And the intelligent device encapsulates the first video stream into a recorded file when the second coding capacity of the intelligent device is lower than the first coding capacity.
In some embodiments, the method further comprises:
and when the second coding capacity is not lower than the first coding capacity, the intelligent equipment codes the second video stream according to the second coding capacity to obtain a recorded file.
In some embodiments, before the smart device receives the video recording instruction for the currently playing video, the method further includes:
the intelligent equipment receives a camera enabling instruction;
the intelligent equipment determines the first coding capacity and the first decoding capacity according to the coding capacities supported by the camera and the decoding capacities supported by the intelligent equipment;
the intelligent device configures the coding capacity of the camera to be the first coding capacity and starts the camera.
The embodiment of the invention also provides a computing device, which comprises:
a memory for storing a computer program;
and the processor is used for calling the computer program stored in the memory and executing the video recording method listed in any mode according to the obtained program.
Embodiments of the present invention also provide a computer-readable storage medium storing a computer-executable program for causing a computer to perform the method of video recording listed in any of the above-described modes.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 schematically illustrates an operational scenario between a smart device and a control device according to an embodiment;
FIG. 2 illustrates a smart device for video recording;
fig. 3 is a block diagram of a possible hardware configuration of a smart device 200 according to an embodiment of the present invention;
FIG. 4 illustrates one possible video recording method according to an embodiment of the present invention;
FIG. 5 illustrates one possible video recording method according to an embodiment of the present invention;
FIG. 6 is a block diagram of another possible hardware configuration of a smart device 200 according to an embodiment of the present invention;
Fig. 7 is a schematic diagram of an overall process involved in an embodiment of the present invention.
Detailed Description
For purposes of clarity, embodiments and advantages of the present application, the following description will make clear and complete the exemplary embodiments of the present application, with reference to the accompanying drawings in the exemplary embodiments of the present application, it being apparent that the exemplary embodiments described are only some, but not all, of the examples of the present application.
Based on the exemplary embodiments described herein, all other embodiments that may be obtained by one of ordinary skill in the art without making any inventive effort are within the scope of the claims appended hereto. Furthermore, while the disclosure is presented in the context of an exemplary embodiment or embodiments, it should be appreciated that the various aspects of the disclosure may, separately, comprise a complete embodiment.
It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.
The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated (Unless otherwise indicated). It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.
Furthermore, the terms "comprise" and "have," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to those elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
A schematic diagram of an operational scenario between a smart device and a control device according to an embodiment is schematically shown in fig. 1. As shown in fig. 1, a user may operate the smart device 200 through the mobile terminal 300 and the control apparatus 100.
In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the smart device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, etc., and the smart device 200 is controlled by a wireless or other wired mode. The user may control the smart device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc. Such as: the user can input corresponding control instructions through a video recording key, a volume up-down key, a channel control key, an up/down/left/right moving key, a voice input key, a menu key, an on-off key and the like on the remote controller, so as to realize the function of controlling the intelligent device 200.
In some embodiments, mobile terminals, tablet computers, notebook computers, and other smart devices may also be used to control the smart device 200. For example, the smart device 200 is controlled using an application running on the smart device. The application program, by configuration, can provide various controls to the user in an intuitive User Interface (UI) on a screen associated with the smart device.
In some embodiments, the mobile terminal 300 may install a software application with the smart device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 300 and the intelligent device 200 can be used for establishing a control instruction protocol, the remote control keyboard is synchronized to the mobile terminal 300, and the functions of the intelligent device 200 are controlled by controlling the user interface on the mobile terminal 300. The audio and video contents displayed on the mobile terminal 300 can also be transmitted to the intelligent device 200, so that the synchronous display function can be realized.
As also shown in fig. 1, the smart device 200 is also in data communication with the server 400 via a variety of communication means. The smart device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various content and interactions to the smart device 200. By way of example, the smart device 200 receives software program updates, or accesses a remotely stored digital media library by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers. Other web service content such as video on demand and advertising services are provided through the server 400.
The smart device 200 may be a television, a camera, a smart box, a network box, a monitoring device, etc. The particular smart device type, size, resolution, etc. are not limited, and those skilled in the art will appreciate that the smart device 200 may be subject to some changes in performance and configuration as desired.
The smart device 200 may additionally provide a smart network television function of a computer support function, including, but not limited to, a network television, a smart television, an Internet Protocol Television (IPTV), etc., in addition to the broadcast receiving television function.
The camera may be mounted on the smart device 200, such as the camera 501 (e.g., a camera carried by the smart device 200 or a camera removably connected to the smart device 200); the smart device 200, such as the camera 502, may also be remotely connected.
Fig. 2 illustrates a smart device for video recording, the smart device including a video interface, a video processor, and a display.
The video interface is used for receiving the coded video stream output by the camera and sending the coded video stream to the video processor;
the video processor is used for decoding the coded video stream output by the camera to form a decoded video stream; transmitting the decoded video stream to a display for local preview display;
A display for playing the decoded video stream formed by the video processor;
and the video processor is also used for encoding the decoded video stream formed by the video processor and packaging the decoded video stream into a recorded video file.
However, for the above scheme, in most cases, the smart device is biased to decoding capability and encoding capability is weaker than the camera. For example, the decoding capability of the camera ISP (image signal processing) supports 4K@30HZH264/H265 at maximum, and the encoding capability supports 4K@30HZH264/H265 at maximum; the decoding capability of the television SOC supports 4K@30HZH264/H265 at maximum, and the encoding capability supports 1080p@30HZH264 at maximum. Wherein 4K and 1080p refer to the resolution of the video image, namely the number of pixels contained in the video image, which is used for representing the definition of the video image, and the higher the resolution is, the higher the definition is; 30HZ and 60HZ refer to the refresh rate of the video, namely the number of times that a screen is refreshed every second of pictures, and are used for representing the fluency of video images, and the higher the refresh rate is, the better the fluency is; h264 and H265 refer to video compression formats, and H265 has lower code rate and higher definition than H264, saves more bandwidth or storage space, and improves efficiency. The above indicators and numbers of codec capability are merely examples, and are not limiting.
It can be seen that the decoding capability of the television is comparable to that of the camera, while the encoding capability is poor. Thus, when the camera inputs a high-specification coded video stream, such as a resolution of 4K, the smart device can decode it without the ability to encode it. Therefore, if the intelligent device is required to record video, the camera needs to output a lower-specification coded video stream, for example, the resolution is 1080p, which obviously does not fully utilize the capability of the camera to output a high-specification coded video stream (the camera has the coding capability of 4K resolution); meanwhile, the method is limited by the coding capability of the intelligent equipment, the intelligent equipment cannot generate video recording files with high specification, the definition, the fluency, the compression format and the like are influenced, and the user experience is greatly reduced; in addition, the intelligent equipment is complicated in coding process, more computing resources of the intelligent equipment can be occupied, and video recording efficiency is reduced.
In addition, in the method, a matching process of the encoding capability of the camera and the decoding capability of the intelligent device is not available. Therefore, under the condition that the intelligent equipment does not configure the coding capability of the camera and the decoding capability of the intelligent equipment, the camera blindly codes according to the set coding format and outputs the coded video stream, and the intelligent equipment does not have the corresponding decoding capability and cannot decode the coded video stream.
In order to solve the problems, the embodiment of the invention provides an intelligent device, which is used for solving the problems that the encoding capability of a camera is wasted, the intelligent device cannot encode and record a high-specification video stream, the video recording efficiency is low, and the intelligent device cannot decode and display the video stream.
Fig. 3 is a block diagram of a possible hardware configuration of a smart device 200 according to an embodiment of the present invention.
In some embodiments, the smart device includes at least one of a controller 210, a user interface 220, a video processor 230, and a video interface 240;
in some embodiments, the video interface 240 is configured to receive a first video stream transmitted by the camera; one possible implementation is that the video interface is a video interface, which is connected to a camera. The video interface may also be connected to any one or more of a high definition multimedia interface HDMI interface, an analog or data high definition component input interface, a composite video input interface, a USB input interface, an RGB port, and the like. The plurality of interfaces may form a composite input/output interface. One possible video interface is an interface for interaction between devices within the intelligent device, as is the case with a built-in camera.
In some embodiments, the video processor 230 is configured to decompress, decode, scale, reduce noise, frame rate convert, resolution convert, image synthesize, etc. the received video signal according to the standard codec protocol of the input signal, and may result in a directly displayable or playable signal. In this embodiment, the video processor 230 is configured to decode the first video stream according to a first decoding capability to obtain a second video stream; the first decoding capability matches the first encoding capability;
in some embodiments, the video processor 230 includes a demultiplexing section, a video decoding section, an image synthesizing section, a frame rate converting section, a display formatting section, and the like.
Wherein, the demultiplexing part is used for demultiplexing the input audio/video data stream, such as the input MPEG-2, and the demultiplexing part demultiplexes the input audio/video data stream into video signals, audio signals and the like.
And the video decoding part is used for processing the demultiplexed video signal, including decoding, scaling and the like.
And an image synthesizing section, such as an image synthesizer, for performing superimposition mixing processing on the graphic generator and the scaled video image according to the user input or the GUI signal generated by the graphic generator itself to generate an image signal for display.
A frame rate conversion unit for converting the input video frame rate, for example, converting the 60Hz frame rate to 120Hz frame rate or 240Hz frame rate, and the normal format is implemented by inserting frames.
And a display format part for converting the received frame rate into a video output signal, and changing the signal to a signal conforming to the display format, such as outputting an RGB data signal. The user interface 220 is used for receiving an input signal of a user and then transmitting the received user input signal to the controller 210. The user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication unit. In this embodiment, the user interface 220 is configured to receive a video recording instruction.
In some embodiments, a user inputs a user command through the control device 100 or the mobile terminal 300, and the user input interface responds to the user input through the controller 210 according to the user input.
In some embodiments, a user may input a user command at a displayed Graphical User Interface (GUI), and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
The controller 210 generally includes at least one of a random access Memory (Random Access Memory, RAM), a Read-Only Memory (ROM), a central processing unit (Central Processing Unit, CPU), a communication interface (Communication Interface), and a communication Bus (Bus). Wherein the communication bus connects the various components.
In some embodiments, RAM is used to store temporary data for the operating system or other on-the-fly programs.
In some embodiments, ROM is used to store instructions for various system boots.
In some embodiments, ROM is used to store a basic input output system called a basic input output system (Basic Input Output System, BIOS). The system comprises a drive program and a boot operating system, wherein the drive program is used for completing power-on self-test of the system, initialization of each functional part in the system and basic input/output of the system.
In some embodiments, upon receipt of a power-on signal, the power supply begins to boot, the CPU runs system boot instructions in ROM, and copies temporary data of the operating system stored in memory into RAM for starting or running the operating system. When the starting of the operating system is completed, the CPU copies the temporary data of various application programs in the memory into the RAM, and then the temporary data are convenient for starting or running the various application programs.
In some embodiments, the CPU processor is configured to execute operating system and application program instructions stored in memory. And executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents.
In some exemplary embodiments, the CPU processor may include a plurality of processors. The plurality of processors may include one main processor and one or more sub-processors. A main processor for performing some operations in a pre-power-up mode and/or displaying a picture in a normal mode. One or more sub-processors for one operation in a standby mode or the like.
In this embodiment, the controller 210 is configured to encapsulate the first video stream into a recording file when determining that the second encoding capability of the video processor is lower than the first encoding capability based on the video recording instruction.
Based on the hardware configuration block diagram of the smart device 200 shown in fig. 3, the embodiment of the present invention further provides a video recording method, as shown in fig. 4.
Step 401, the intelligent equipment receives a video recording instruction aiming at the currently played video; the current playing video is a second video stream obtained by decoding a first video stream which is encoded by the camera according to the first encoding capability by the intelligent device according to the first decoding capability; the first encoding capability is the highest encoding capability matched with the decoding capability of the intelligent device in the encoding capability of the camera;
step 402, when the second encoding capability of the intelligent device is lower than the first encoding capability, the intelligent device encapsulates the first video stream into a recording file.
For example, the camera supports two encoding capabilities of 4K@30HZH265, 1080p@30HZH265, the television supports two decoding capabilities of 4K@30HZH265, 1080p@30HZH265, and supports two encoding capabilities of 1080p@30HZH264, 720 p@30HZH264, as shown in Table 1. Based on the principle that the coding capacity of the camera is matched with the decoding capacity of the television and is the highest coding capacity of the camera, the first coding capacity of the camera is configured to be 4K@30HZH265, and the first decoding capacity of the television is 4K@30HZH265. The camera outputs a first video stream according to the first coding capability of 4K@30HZH265, the television decodes the first video stream according to the first decoding capability of 4K@30HZH265 to obtain a second video stream with the format of 4K@30HZ, and the television plays the second video stream with higher definition, smoothness and compression format. And the user clicks a video recording key on the television to send a video recording instruction to the television. After receiving the video recording instruction, the television determines that the second coding capacity of the television is 1080p@30HZH264 with the highest specification in the coding capacities, and the television cannot code the second video stream with the format of 4K@30HZ. The television directly packages the first video stream with the format of 4K@30HZH265 into a recorded file, the encoding process is not performed any more, and the format of the video recorded file generated in the way is 4K@30HZH265, and the definition, fluency, compression format and the like are equal to those of the encoded video stream output by the camera. The above is merely an example, which is not limiting in this respect.
Camera supported encoding capability Television-supported decoding capability Coding capability for television support
4K@30HZ H265 4K@30HZ H265 1080p@30HZ H264
1080p@30HZ H265 1080p@30HZ H265 720p@30HZ H264
TABLE 1
Therefore, the decoding capability of the intelligent device is equivalent to the encoding capability of the camera, so that the first encoding capability of the camera is set to be the highest encoding capability matched with the decoding capability of the intelligent device, the first video stream output by the camera can be ensured to be the highest specification of the camera, the encoding capability of the intelligent device is not considered, the capability that the camera can output the high-specification encoded video stream is fully utilized, and the limitation of the lower encoding capability of the intelligent device is avoided. When the second coding capacity of the intelligent device is lower than the first coding capacity, the intelligent device directly packages the first video stream output by the camera according to the first coding capacity into a recording file, so that the intelligent device can generate a video recording file with high specification based on the first video stream with high specification, but not encode the second video stream obtained according to the first decoding capacity based on the second coding capacity, thereby improving the definition, fluency, compression format and the like of the recording video file and greatly enhancing user experience; in addition, the intelligent device directly encapsulates the first video stream, so that a complicated encoding process is omitted, the computing resources of the intelligent device are released, and the efficiency of forming video recording files is effectively improved.
In some embodiments, the video processor is further configured to encode the second video stream according to the second encoding capability to obtain a recording file when the second encoding capability is not lower than the first encoding capability.
Based on the intelligent device, the embodiment of the invention also provides a method for recording the following videos:
and when the second coding capacity is not lower than the first coding capacity, the intelligent equipment codes the second video stream according to the second coding capacity to obtain a recorded file.
For example, the camera supports two encoding capabilities 720 p@30HZH265, the television supports 720 p@30HZH265 a decoding capability, and supports two encoding capabilities 720 p@30HZH264 and 720 p@30HZH264, as shown in Table 2. Based on the principle that the coding capacity of the camera is matched with the decoding capacity of the television and is the highest coding capacity of the camera, the first coding capacity of the camera is 720 p@30HZH265, and the first decoding capacity of the television is 720 p@30HZH265. The camera outputs a first video stream according to the first coding capability of 720 p@30HZH265, the television decodes the first video stream according to the first decoding capability of 720 p@30HZH265 to obtain a second video stream with the format of 720p@30HZ, and the television plays the second video stream. And the user clicks a video recording key on the television to send a video recording instruction to the television. After receiving the video recording instruction, the television determines that the second coding capacity of the television is 1080p@30HZH264, which is higher than the specification of the first video stream, namely the first coding capacity. Thus, the television encodes the second video stream with a second encoding capability of 1080p@30HZH264 and then encapsulates it into a video recording file. The above is merely an example, which is not limiting in this respect.
TABLE 2
Therefore, under the condition that the second coding capacity of the intelligent equipment is not lower than the first coding capacity, the intelligent equipment can be ensured to code the second video stream based on the second coding capacity with higher coding capacity, so that a video recording file with higher specification is generated, and the higher coding capacity of the intelligent equipment is fully utilized. The intelligent device generates the recorded file according to the coding capability of the intelligent device, so that a plurality of applications of the recorded file on the intelligent device can be shared.
In some embodiments, the user interface is further configured to receive a camera enabling instruction;
the controller is further configured to determine the first encoding capability and the first decoding capability according to each encoding capability supported by the camera and each decoding capability supported by the video processor;
the controller is further configured to configure the encoding capability of the camera to be the first encoding capability based on the camera enabling instruction, and start the camera; and is further configured to configure a decoding capability of the video processor to be the first decoding capability.
As shown in fig. 5, the embodiment of the present invention further provides the following steps: before the intelligent device receives the video recording instruction for the currently played video, the intelligent device further comprises:
Step 501, the intelligent device receives a camera enabling instruction;
step 502, the intelligent device determines the first encoding capability and the first decoding capability according to each encoding capability supported by the camera and each decoding capability supported by the intelligent device;
step 503, the intelligent device configures the coding capability of the camera to be the first coding capability and starts the camera.
For example, the camera supports two encoding capabilities of 4K@30HZH265, 1080p@30HZH265, the television supports two decoding capabilities of 4K@30HZH265, 1080p@30HZH265, based on the principle that the coding capacity of the camera is matched with the decoding capacity of the television and is the highest coding capacity of the camera, the first coding capacity of the camera is configured to be 4K@30HZH265, and the decoding capacity of the television is 4K@30HZH265. The above is merely an example, which is not limiting in this respect.
The first coding capacity and the first decoding capacity are determined through the coding capacities supported by the camera and the decoding capacities supported by the intelligent device, the first coding capacity is the highest coding capacity matched with the decoding capacity of the intelligent device in the coding capacities of the camera, the first video stream generated through the first coding capacity is guaranteed to be the highest specification of the camera, the first coding capacity and the first decoding capacity are guaranteed to be matched, namely the intelligent device can decode the first video stream through the first decoding capacity for local preview display, and the problem that the intelligent device cannot decode the first video stream due to the fact that the camera blindly adopts the higher or lower coding capacity under the condition that the coding capacities supported by the camera and the decoding capacities supported by the intelligent device are not obtained is avoided.
The embodiment of the present invention also provides another possible hardware configuration block diagram of the smart device 200, as shown in fig. 6.
In some embodiments, the smart device 200 further comprises: a display 250;
and a display 250 for receiving the image signals, and performing components for displaying video contents and images and a menu manipulation interface. In some embodiments, the video content is displayed from broadcast television content, or alternatively, from various broadcast signals that may be received via a wired or wireless communication protocol. Alternatively, various image contents received from the network server side transmitted from the network communication protocol may be displayed. In this embodiment, the second video stream is played.
In some embodiments, display 250 includes a display screen assembly for presenting pictures, and a drive assembly to drive the display of images.
In some embodiments, depending on the type of display 250, a drive assembly for driving the display is also included.
In some embodiments, display 250 is a projection display and may further include a projection device and a projection screen.
Based on the hardware configuration block diagram of the smart device 200 shown in fig. 6, the embodiment of the present invention further provides the following steps:
After the camera is started, the method further comprises the following steps:
the intelligent device decodes the first video stream into a second video stream using the first decoding capability;
and the intelligent equipment plays the second video stream.
Under the condition that the intelligent device can decode the first video stream generated according to the highest specification of the camera through the first decoding capability, the intelligent device can decode the first video stream to generate the second video stream for local preview display, so that a user can watch the picture acquired by the camera in real time, the field of view, focusing conditions and the like of the video picture are convenient to adjust, and the accuracy and definition of the video recording file are guaranteed.
In some embodiments, the controller is further configured to send a camera disabling instruction to the camera if it is determined that the video processor does not have a decoding capability matching the encoding capability of the camera according to each encoding capability supported by the camera and each decoding capability supported by the video processor.
The video recording method further comprises the following steps:
and the intelligent equipment determines that the intelligent equipment does not have the decoding capability matched with the coding capability of the camera according to the coding capability supported by the camera and the decoding capability supported by the intelligent equipment, and then sends a camera disabling instruction.
For example, the camera supports 4k@30hz H265 with a coding capability, the television supports 1080p@30hz H265 with a decoding capability, and based on the principle that the coding capability of the camera is matched with the decoding capability of the television and is the highest coding capability of the camera, it can be found that the television does not have the decoding capability matched with the coding capability of the camera, then a camera disabling instruction is sent, the camera is closed, and video image acquisition is not performed any more. The above is merely an example, which is not limiting in this respect.
Therefore, the situation that the intelligent device does not have the capability of decoding the first video stream obtained by encoding the camera is avoided, the camera is blindly opened for encoding, the first video stream is output, the first video stream is blindly packaged to form a recorded file, the intelligent device cannot perform local preview display, namely, the intelligent device cannot perform real-time adjustment on the picture field and focusing condition of the recorded video file; the camera is not started to encode after judging that the intelligent device does not have decoding capability matched with the encoding capability of the camera, so that the computing resources of the camera and the intelligent device are saved, and the operation pressure is relieved.
In order to more clearly describe the video recording method, the overall description of the flow involved in the embodiment of the present invention is described below with reference to fig. 7. As shown in fig. 7, the steps may be included as follows:
step 701, clicking application software for opening a camera by a user;
step 702, the television obtains each coding capability of the camera, each decoding capability and each coding capability of the television;
step 703, judging whether each decoding capability of the television has a decoding capability matched with the encoding capability of the camera, if not, executing step 504; if yes, go to step 505;
step 704, the television sends a camera disabling instruction, the camera is closed, and the acquisition of video images is stopped;
step 705, determining, by the television, the first encoding capability and the first decoding capability based on each encoding capability supported by the camera and each decoding capability supported by the intelligent device;
step 706, configuring the coding capability of the camera to be the first coding capability by the television and starting the camera;
step 707, the camera encodes the video picture according to the first encoding capability to form a first video stream;
step 708, the television decodes the first video stream into a second video stream by using the first decoding capability, for local display and play;
Step 709, clicking a video recording key by the user;
step 710, the television determines the second encoding capability, and determines whether the second encoding capability of the television is lower than the first encoding capability, if yes, step 511 is executed; if not, go to step 512;
step 711, the television directly encapsulates the first video stream into a recording file;
step 712, the television encodes the second video stream according to the second encoding capability, and encapsulates the second video stream into a video recording file;
step 713, video recording ends.
The embodiment of the invention also provides a computing device, which comprises:
a memory for storing a computer program;
and the processor is used for calling the computer program stored in the memory and executing the video recording method listed in any mode according to the obtained program.
Embodiments of the present invention also provide a computer-readable storage medium storing a computer-executable program for causing a computer to perform a method of video recording as set forth in any one of the above modes.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present application without departing from the spirit or scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims and the equivalents thereof, the present application is intended to cover such modifications and variations.

Claims (10)

1. An intelligent device, comprising: a controller, a user interface, a video processor, and a video interface;
the video interface is used for receiving a first video stream which is encoded by the camera according to a first encoding capacity; the first encoding capability is the highest encoding capability of the camera, which is matched with the decoding capability of the video processor;
the video processor is used for decoding the first video stream according to a first decoding capability to obtain a second video stream; the first decoding capability matches the first encoding capability;
The user interface is used for receiving a video recording instruction;
and the controller is used for packaging the first video stream into a recording file when the second coding capacity of the video processor is lower than the first coding capacity based on the video recording instruction.
2. The smart device of claim 1, wherein,
and the video processor is further configured to encode the second video stream according to the second encoding capability when the second encoding capability is not lower than the first encoding capability, so as to obtain a recording file.
3. The smart device of claim 1, wherein,
the user interface is also used for receiving a camera enabling instruction;
the controller is further configured to determine the first encoding capability and the first decoding capability according to each encoding capability supported by the camera and each decoding capability supported by the video processor;
the controller is further configured to configure the coding capability of the camera to be the first coding capability based on the camera enabling instruction, and start the camera; and is further configured to configure a decoding capability of the video processor to be the first decoding capability.
4. The smart device of claim 1, further comprising: a display;
the display is used for playing the second video stream.
5. The smart device of claim 4, wherein,
and the controller is also used for determining that the video processor does not have the decoding capability matched with the encoding capability of the camera according to the encoding capability supported by the camera and the decoding capability supported by the video processor, and sending a camera disabling instruction to the camera.
6. A method of video recording adapted for use with a smart device configured with a camera, the method comprising:
the intelligent equipment receives a video recording instruction aiming at the currently played video; the current playing video is a second video stream obtained by decoding a first video stream which is encoded by the camera according to the first encoding capability by the intelligent device according to the first decoding capability; the first encoding capability is the highest encoding capability matched with the decoding capability of the intelligent device in the encoding capability of the camera;
and the intelligent device encapsulates the first video stream into a recorded file when the second coding capacity of the intelligent device is lower than the first coding capacity.
7. The method for video recording of claim 6, further comprising:
and when the second coding capacity is not lower than the first coding capacity, the intelligent equipment codes the second video stream according to the second coding capacity to obtain a recorded file.
8. The method for video recording of claim 6, wherein before the intelligent device receives the video recording instruction for the currently playing video, further comprising:
the intelligent equipment receives a camera enabling instruction;
the intelligent equipment determines the first coding capacity and the first decoding capacity according to the coding capacities supported by the camera and the decoding capacities supported by the intelligent equipment;
the intelligent device configures the coding capacity of the camera to be the first coding capacity and starts the camera.
9. A computing device, comprising:
a memory for storing a computer program;
a processor for invoking a computer program stored in said memory, performing the method according to any of claims 6 to 8 in accordance with the obtained program.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer-executable program for causing a computer to execute the method of any one of claims 6 to 8.
CN202011077710.6A 2020-10-10 2020-10-10 Intelligent device and video recording method Active CN114339344B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011077710.6A CN114339344B (en) 2020-10-10 2020-10-10 Intelligent device and video recording method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011077710.6A CN114339344B (en) 2020-10-10 2020-10-10 Intelligent device and video recording method

Publications (2)

Publication Number Publication Date
CN114339344A CN114339344A (en) 2022-04-12
CN114339344B true CN114339344B (en) 2024-03-05

Family

ID=81032164

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011077710.6A Active CN114339344B (en) 2020-10-10 2020-10-10 Intelligent device and video recording method

Country Status (1)

Country Link
CN (1) CN114339344B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060085020A (en) * 2005-01-21 2006-07-26 엘지전자 주식회사 Video recoding and playing apparatus for mobile communication device
CN104349100A (en) * 2013-07-25 2015-02-11 杭州海康威视数字技术股份有限公司 DVR monitoring system supporting single-channel dual-stream video recording and method thereof
CN105100663A (en) * 2014-05-15 2015-11-25 北京同步科技有限公司 Recording system based on hardware encoders, audio and video processing apparatus, and recording method
CN107682672A (en) * 2017-09-30 2018-02-09 深圳市普天宜通技术股份有限公司 A kind of two-way video stream implementation method, storage medium and multimedia terminal
CN108235107A (en) * 2016-12-15 2018-06-29 广州市动景计算机科技有限公司 Video recording method, device and electric terminal
CN111641804A (en) * 2020-06-16 2020-09-08 广州迈聆信息科技有限公司 Video data processing method and device, terminal, camera and video conference system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060085020A (en) * 2005-01-21 2006-07-26 엘지전자 주식회사 Video recoding and playing apparatus for mobile communication device
CN104349100A (en) * 2013-07-25 2015-02-11 杭州海康威视数字技术股份有限公司 DVR monitoring system supporting single-channel dual-stream video recording and method thereof
CN105100663A (en) * 2014-05-15 2015-11-25 北京同步科技有限公司 Recording system based on hardware encoders, audio and video processing apparatus, and recording method
CN108235107A (en) * 2016-12-15 2018-06-29 广州市动景计算机科技有限公司 Video recording method, device and electric terminal
CN107682672A (en) * 2017-09-30 2018-02-09 深圳市普天宜通技术股份有限公司 A kind of two-way video stream implementation method, storage medium and multimedia terminal
CN111641804A (en) * 2020-06-16 2020-09-08 广州迈聆信息科技有限公司 Video data processing method and device, terminal, camera and video conference system

Also Published As

Publication number Publication date
CN114339344A (en) 2022-04-12

Similar Documents

Publication Publication Date Title
CN111277881A (en) Control method for audio data stream output in display equipment and display equipment
CN112153446B (en) Display device and streaming media video audio and video synchronization method
CN114302190B (en) Display equipment and image quality adjusting method
CN113407142A (en) Display device and screen projection method
CN111405221B (en) Display device and display method of recording file list
US11288033B2 (en) Method for outputting audio data of applications and display device
CN113507638B (en) Display equipment and screen projection method
CN110213657A (en) A kind of starting-up method and smart television
CN111107428A (en) Method for playing two-way media stream data and display equipment
CN111601144B (en) Streaming media file playing method and display equipment
CN111954043B (en) Information bar display method and display equipment
CN113849143A (en) Display method, display device, and storage medium
CN111935510B (en) Double-browser application loading method and display equipment
CN111556350B (en) Intelligent terminal and man-machine interaction method
CN111064982B (en) Display control method, storage medium and display device
CN114095769A (en) Live broadcast low-delay processing method of application-level player and display equipment
CN114095778A (en) Audio hard decoding method of application-level player and display equipment
CN114339344B (en) Intelligent device and video recording method
CN111629250A (en) Display device and video playing method
CN113099308B (en) Content display method, display equipment and image collector
CN111277911A (en) Image processing method of panoramic video, display device and server
CN115119035B (en) Display device, image processing method and device
CN112702549B (en) Sound output method and display device
CN113038193B (en) Method for automatically repairing asynchronous audio and video and display equipment
CN115225970A (en) Display device and video skipping method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant