CN108574816A - It is a kind of to regard networked terminals and based on communication means, the device regarding networked terminals - Google Patents
It is a kind of to regard networked terminals and based on communication means, the device regarding networked terminals Download PDFInfo
- Publication number
- CN108574816A CN108574816A CN201710797449.9A CN201710797449A CN108574816A CN 108574816 A CN108574816 A CN 108574816A CN 201710797449 A CN201710797449 A CN 201710797449A CN 108574816 A CN108574816 A CN 108574816A
- Authority
- CN
- China
- Prior art keywords
- video data
- chip
- chips
- depending
- networked terminals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Abstract
Networked terminals are regarded an embodiment of the present invention provides a kind of and based on communication means, the device regarding networked terminals, described depending on networked terminals includes interchanger and the first chip being connected with the interchanger and at least two second chips, first chip is connected with depending on networked server, for being decoded depending on the first video data that networked server is sent to receiving described, and decoded first video data is played out；Described at least two second chips are connected with camera, for being encoded to the second video data for getting the camera acquisition, and the second video data after the coding are sent to described and regards networked server.Through the embodiment of the present invention, it realizes and video data is encoded and decoded using different chips, improve coding, decoded efficiency, ensure that the real-time of video communication.
Description
Technical field
The present invention relates to regarding networking arenas, networked terminals are regarded and based on the communication regarding networked terminals more particularly to a kind of
Method, apparatus.
Background technology
With the development of science and technology, the mode of communication becomes increasingly diversification, and video communication becomes a kind of more normal
The communication mode seen, by video communication can enable the people positioned at different places carry out Face to face remote communication and
Cooperation, promotes the usage experience of user.
In the prior art, generally use mobile terminal carries out video communication, and user can be by being mounted on mobile terminal
On social software initiate video request, the mobile terminal for being then based on ICP/IP protocol and communication counterpart is established and is connected, to
Realize the video communication between mobile terminal.
However, existing video communication mode be dfficult to apply to regard networking arenas, and in face of in video communication with day
The video data volume all increased, it is also desirable to which one novel to cope with video communication depending on networked terminals, is especially applied to video council
View.
Invention content
In view of the above problems, it is proposed that the embodiment of the present invention is in order to provide overcoming the above problem or solve at least partly
The a kind of of the above problem regards networked terminals and based on communication means, the device regarding networked terminals.
To solve the above-mentioned problems, the embodiment of the invention discloses one kind regarding networked terminals, described to include depending on networked terminals
Interchanger and the first chip being connected with the interchanger and at least two second chips；
First chip is connected with depending on networked server, for receiving first sent regarding networked server
Video data is decoded, and decoded first video data is played out；
Described at least two second chips are connected with camera, for the second video to getting the camera acquisition
Data are encoded, and the second video data after the coding is sent to described and regards networked server.
Preferably, first chip is connected with microphone, and few two second chips pass through the interchanger and institute
The first chip is stated to be connected；
At least two chip is used to the second video data after the coding being sent to institute by the interchanger
The first chip is stated, is sent to by first chip described regarding networked server；
First chip is used for receiving the second video data after the coding and getting Mike's elegance
The second audio data of collection carries out time synchronization, and the second video data after the time synchronization is sent out with second audio data
It send to described and regards networked server.
Preferably, first chip is additionally operable to the second video data and second audio data after the time synchronization
It plays out.
Preferably, first chip be additionally operable to receive first audio data sent regarding networked server into
Row decoding, and decoded first audio data and the first video data are synchronized into broadcasting.
Preferably, the decoding capability of first chip is more than the code capacity of described at least two second chips, described
First chip is RK3288 chips, and described at least two second chips are HI3516A chips.
Preferably, described depending on networked terminals further includes the network interface being connected with first chip, the first HDMI interface, with
And the second HDMI interface being connected with described at least two second chips；
First chip is connected with described depending on networked server by the network interface, and first chip is using described the
One HDMI interface plays out, and described at least two second chips are connected by second HDMI interface with the camera.
The embodiment of the invention also discloses a kind of communication means based on regarding networked terminals, the networked terminals that regard include handing over
The first chip and at least two second chips changed planes and be connected with the interchanger, first chip with regard the Internet services
Device is connected, and described at least two second chips are connected with camera, the method includes：
First video data sent regarding networked server is received, and is regarded to described first using first chip
Frequency plays out decoded first video data according to being decoded；
And the second video data of the camera acquisition is obtained, and using at least two second chip to institute
It states the second video data to be encoded, the second video data after the coding is sent to described and regards networked server
The embodiment of the invention also discloses a kind of communication device based on regarding networked terminals, the networked terminals that regard include handing over
The first chip and at least two second chips changed planes and be connected with the interchanger, first chip with regard the Internet services
Device is connected, and described at least two second chips are connected with camera, and described device includes：
First video data playing module for receiving first video data sent regarding networked server, and is adopted
First video data is decoded with first chip, decoded first video data is played out；
Second video data sends module, the second video data for obtaining the camera acquisition, and described in use
At least two second chips encode second video data, and the second video data after the coding is sent to institute
It states and regards networked server.
The embodiment of the invention also discloses a kind of electronic equipment, including memory, processor and storage are on a memory simultaneously
The step of computer program that can be run on a processor, the processor realizes method as described above when executing described program.
The embodiment of the invention also discloses a kind of computer readable storage mediums, are stored thereon with computer program, the journey
The step of method as described above is realized when sequence is executed by processor.
The embodiment of the present invention includes following advantages：
In embodiments of the present invention, by that will be set as may include interchanger depending on networked terminals and be connected with interchanger
The first chip and at least two second chips, the first chip can be connected with depending on networked server, can be used for receiving
The first video data sent depending on networked server is decoded, and decoded first video data is played out, at least
Two the second chips can be connected with camera, can be used for compiling the second video data for getting camera acquisition
Code, and the second video data after coding is sent to regarding networked server, it realizes using different chips to video data
It is encoded and is decoded, improved coding, decoded efficiency, ensure that the real-time of video communication.
Description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention
Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the present invention
Example, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these attached drawings
Obtain other attached drawings.
Fig. 1 is a kind of networking schematic diagram regarding networking of the present invention；
Fig. 2 is a kind of hardware architecture diagram of node server of the present invention；
Fig. 3 is a kind of hardware architecture diagram of access switch of the present invention；
Fig. 4 is that a kind of Ethernet association of the present invention turns the hardware architecture diagram of gateway；
Fig. 5 is a kind of structural schematic diagram regarding networked terminals of the embodiment of the present invention；
Fig. 6 is a kind of step flow chart based on the communication means regarding networked terminals of the embodiment of the present invention；
Fig. 7 is a kind of structure diagram based on the communication device regarding networked terminals of the embodiment of the present invention.
Specific implementation mode
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, below in conjunction with the accompanying drawings and specific real
Applying mode, the present invention is described in further detail.Obviously, described embodiments are some of the embodiments of the present invention, without
It is whole embodiment.Based on the embodiments of the present invention, those of ordinary skill in the art are not before making creative work
The every other embodiment obtained is put, shall fall within the protection scope of the present invention.
It is the important milestone of network Development depending on networking, is a real-time network, can realize HD video real-time Transmission,
Push numerous the Internet, applications to HD video, high definition is face-to-face.
Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service
Clear video conference, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring
Field live streaming, VOD program requests, TV Mail, individual character recording (PVR), Intranet (manage) channel, intelligent video Broadcast Control, information publication by oneself
All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, word, communication, data, by TV or
Computer realizes that high-definition quality video plays.
To make those skilled in the art more fully understand the embodiment of the present invention, below to being introduced depending on networking：
Depending on networking, applied portion of techniques is as described below：
Network technology (NetworkTechnology)
Network technology innovation depending on networking improves traditional ethernet (Ethernet), potential huge on network to face
Video flow.(Circuit is exchanged different from simple network packet packet switch (Packet Switching) or lattice network
Switching), Streaming demands are met using Packet Switching depending on networking technology.Has grouping depending on networking technology
Flexible, the simple and low price exchanged, is provided simultaneously with quality and the safety assurance of circuit switching, it is virtually electric to realize the whole network switch type
The seamless connection of road and data format.
Switching technology (Switching Technology)
Depending on two advantages of asynchronous and packet switch networked using Ethernet, it is scarce under the premise of complete be compatible with to eliminate Ethernet
It falls into, has the end-to-end seamless connection of the whole network, direct user terminal directly carries IP data packets.User data is in network-wide basis
It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can realizes at present mutually
The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous Internet video applications to high Qinghua, unitizes.
Server technology (ServerTechnology)
It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform
Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy
Enough include signaling and data transmission.For voice and video business, handled depending on networking and unified video platform Streaming Media
Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.
Reservoir technology (Storage Technology)
The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and
State-of-the-art real time operating system is used, the programme information in server instruction is mapped to specific hard drive space, media
Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits for typical time to be less than 0.2 second.It optimizes
Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internets ad eundem IP, but
The concurrent flow more than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.
Network security technology (Network Security Technology)
Structural design depending on networking by servicing independent licence system, equipment and the modes such as user data is completely isolated every time
The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, fire wall generally, has prevented black
The attack of visitor and virus, provide structural carefree secure network to the user.
Service innovative technology (Service Innovation Technology)
Business and transmission are merged by unified video platform, whether single user, private user or a net
The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich
The multimedia video service of rich colorful various forms.Unified video platform is substituted using " menu type " with table schema traditional
Complicated applications program, and can use considerably less code that complicated application can be realized, and realize the new business innovation of " endless ".
Networking depending on networking is as described below：
It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class
Type, but centralized control node is needed to control whole network in network on this basis.
As shown in Figure 1, being divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.
The equipment of access mesh portions can be mainly divided into 3 classes：Node server, access switch, terminal (including various machines
Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases
Even, and Ethernet can be connected.
Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal.
Node server can directly be connected with access switch, can also directly be connected with terminal.
Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes：Metropolitan area server, node switch, node serve
Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.
Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end
Point, and belong to metropolitan area mesh portions.
Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve
Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.
It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area
The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.
Visually claim, access mesh portions can form unified video platform (part in virtual coil), and multiple unified videos are flat
Platform can be formed regarding networking；Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.
1, networked devices are regarded to classify
1.1 embodiment of the present invention can be mainly divided into 3 classes depending on the equipment in networking：Server, interchanger (including ether
Net association turns gateway), terminal (including various set-top boxes, encoding board, memory etc.).It can be divided into Metropolitan Area Network (MAN) on the whole depending on networking
(or national net, World Wide Web etc.) and access net.
The equipment of 1.2 wherein access mesh portions can be mainly divided into 3 classes：Node server, access switch (including ether
Net association turns gateway), terminal (including various set-top boxes, encoding board, memory etc.).
The particular hardware structure of each access network equipment is：
Node server：
As shown in Fig. 2, including mainly Network Interface Module 201, switching engine module 202, CPU module 203, disk array
Module 204；
Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine
Module 202；Switching engine module 202 to the packet come in look into the operation of address table 205, to obtain the navigation information of packet；
And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206；If the queue of pack buffer 206 is close
It is full, then it abandons；All pack buffer queues of 202 poll of switching engine mould, are forwarded if meeting the following conditions：1) port
It is less than to send caching；2) the queue package counting facility is more than zero.Disk array module 204 mainly realizes the control to hard disk, including
The operations such as initialization, read-write to hard disk；CPU module 203 is mainly responsible between access switch, terminal (not shown)
Protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table)
Configuration, and, the configuration to disk array module 204.
Access switch：
As shown in figure 3, including mainly Network Interface Module (downstream network interface module 301, uplink network interface module
302), switching engine module 303 and CPU module 304；
Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305；Packet detection mould
Whether mesh way address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met,
Corresponding flow identifier (stream-id) is then distributed, and enters switching engine module 303, is otherwise abandoned；Uplink network interface mould
The packet (downlink data) that block 302 is come in enters switching engine module 303；The data packet that CPU module 204 is come in enters switching engine
Module 303；Switching engine module 303 to the packet come in look into the operation of address table 306, to obtain the navigation information of packet；
It is gone toward uplink network interface if the packet into switching engine module 303 is downstream network interface, in conjunction with flow identifier
(stream-id) packet is stored in the queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
It abandons；If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet
Navigation information is stored in the data packet queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
Then abandon.
All pack buffer queues of 303 poll of switching engine module, are divided to two kinds of situations in embodiments of the present invention：
It is gone toward uplink network interface if the queue is downstream network interface, meets the following conditions and be forwarded：1)
It is less than that the port sends caching；2) the queue package counting facility is more than zero；3) token that rate control module generates is obtained；
It is gone toward uplink network interface if the queue is not downstream network interface, meets the following conditions and be forwarded：
1) it is less than to send caching for the port；2) the queue package counting facility is more than zero.
Rate control module 208 is configured by CPU module 204, to all downlink networks in programmable interval
The pack buffer queue that interface is gone toward uplink network interface generates token, to control the code check of forwarded upstream.
CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and,
Configuration to rate control module 308.
Ethernet association turns gateway：
As shown in figure 4, including mainly Network Interface Module (downstream network interface module 401, uplink network interface module
402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, Bao Huan
Storage 407 and MAC add modules 409, MAC removing modules 410.
Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405；Packet detection module 405 is examined
The ethernet mac DA of measured data packet, ethernet mac SA, Ethernet length or frame type, networking mesh way address is regarded
DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting
Identifier (stream-id)；Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing modules 410
(2byte), and enter corresponding order caching, otherwise abandon；
Downstream network interface module 401 detects the transmission caching of the port, if there is Bao Ze regarding with networking mesh according to packet
Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway
SA, Ethernet length or frame type, and send.
The function that Ethernet association turns other modules in gateway is similar with access switch.
Terminal：
Include mainly Network Interface Module, Service Processing Module and CPU module；For example, set-top box mainly connects including network
Mouth mold block, video/audio encoding and decoding engine modules, CPU module；Encoding board includes mainly Network Interface Module, video encoding engine
Module, CPU module；Memory includes mainly Network Interface Module, CPU module and disk array module.
The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 2 classes：Node server, node switch, metropolitan area server.
Wherein, node switch includes mainly Network Interface Module, switching engine module and CPU module；Metropolitan area server includes mainly
Network Interface Module, switching engine module and CPU module are constituted.
2, networking data package definition is regarded
2.1 access network data package definitions
The data packet for accessing net includes mainly following sections：Destination address (DA), source address (SA), reserve bytes,
payload(PDU)、CRC。
As shown in the table, the data packet for accessing net includes mainly following sections：
| DA | SA | Reserved | Payload | CRC |
Wherein：
Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet
Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address,
Seven, the 8th bytes are access net address；
Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA)；
Reserve bytes are made of 2 bytes；
The parts payload have different length according to the type of different datagrams, are if it is various protocol packages
64 bytes are 32+1024=1056 bytes if it is single group unicast packets words, are not restricted to above 2 kinds certainly；
CRC is made of 4 bytes, and computational methods follow the Ethernet CRC algorithm of standard.
2.2 Metropolitan Area Network (MAN) packet definitions
The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment
2 kinds can be all can exceed that between machine and node server, node switch and node switch, node switch and node server
Connection.But the metropolitan area net address of metropolitan area network equipment is unique, is closed to accurately describe the connection between metropolitan area network equipment
System, introduces parameter in embodiments of the present invention：Label uniquely describes a metropolitan area network equipment.
(Multi-Protocol Label Switch, multiprotocol label are handed over by the definition of label and MPLS in this specification
Change) label definition it is similar, it is assumed that between device A and equipment B there are two connection, then data packet from device A to equipment B just
There are 2 labels, data packet also there are 2 labels from equipment B to device A.Label is divided into label, outgoing label, it is assumed that data packet enters
The label (entering label) of device A is 0x0000, and the label (outgoing label) when this data packet leaves device A may reform into
0x0001.The networking flow of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN)
Distribution is all dominated by metropolitan area server, and node switch, node server are all passive execution, this point with
The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.
As shown in the table, the data packet of Metropolitan Area Network (MAN) includes mainly following sections：
| DA | SA | Reserved | Label | Payload | CRC |
That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its
In, the format of label, which can refer to, such as gives a definition：Label is 32bit, wherein high 16bit retains, only with low 16bit, its position
Set is between the reserve bytes and payload of data packet.
Based on the above-mentioned characteristic regarding networking, it is proposed that the core idea of the embodiment of the present invention, by will be set depending on networked terminals
It may include interchanger and the first chip being connected with interchanger and at least two second chips to be set to, and the first chip can be with
It is connected depending on networked server, can be used for being decoded to receiving the first video data sent depending on networked server, and will
Decoded first video data plays out, and at least two second chips can be connected with camera, can be used for obtaining
The second video data acquired to camera is encoded, and the second video data after coding is sent to regarding the Internet services
Device realizes and video data is encoded and decoded using different chips, improves coding, decoded efficiency, ensure that
The real-time of video communication.
With reference to Fig. 5, a kind of structural schematic diagram regarding networked terminals of the embodiment of the present invention is shown, it is described to regard networked terminals
May include the entities terminals such as set-top box (SetTopBox, STB), set-top box can be referred to as box on set-top box or machine, be a company
The equipment for connecing television set and outside source, the digital signal of compression can be changed into television content by it, and be shown on a television set
It shows to come.In general, set-top box can connect camera and microphone, for acquiring more matchmakers such as video data and audio data
Volume data can also connect television set, for multi-medium datas such as playing video data and audio datas.
Can also include virtually regarding networked terminals depending on networked terminals, be depending on networked terminals virtually in order to realize particular service and
Access refers to a kind of special software regarding the terminal of networking, it can create a kind of environment between terminal and terminal user, and
Terminal user is then the environment that is created based on this software come operating software, it is virtual can be as real machine one depending on networked terminals
Sample runs the software realization of the terminal of program.
In embodiments of the present invention, may include interchanger 501 depending on networked terminals and be connected with interchanger 501 first
Chip 502 and at least two second chips 503.
Wherein, interchanger 501 can be used for the data transmission between the first chip 502 and at least two second chips 503,
At least two second chips 503 can be connected by interchanger 501 with the first chip 502, to send data to the first chip
502。
The decoding capability of first chip 502 can be more than the code capacity of at least two second chips 503, such as at least two
The code capacity of second chip 503 is 1080P 30fps, and the decoding capability of the first chip 502 can be 4K 60fps.
As an example, the first chip 502 can be RK3288 chips, and RK3288 chips are first ARM of the whole world
(Advanced RISC Machines) completely new framework kernel chip, or the newest Mali-T76x series GPU in first, the whole world
Chip, and global first hard solution of 4Kx2K H.265 video chip.
At least two second chips 503 can be HI3516A chips, and HI3516A chips are that semiconductor is thought for high definition in sea
A high-end SOC of profession (System on Chip, system level chip) of IPCamera (web camera) products application exploitation
Chip, 1080P@30fps H.264 multi-code stream encryption performance, excellent ISP (In-System Programmability,
Line System Programming) and the characteristics such as coded video quality, high performance intelligent accelerating engine, meeting client's differentiation IPCamera
While product function, performance, image quality requirements, ebom costs can be substantially reduced.
Specifically, the first chip 502 can be connected with depending on networked server, for regarding networked server transmission to receiving
The first video data be decoded, and decoded first video data is played out；At least two second chips 503 can
To be connected with camera, for being encoded to the second video data for getting camera acquisition, and by second after coding
Video data is sent to regarding networked server.
During video conference, can be connected with other-end by regarding networked server depending on networked terminals, with into
The transmission of row video data, other-end can be regarding networked terminals or internet terminal.
On the one hand, other-end can send the first video data acquired in real time to regarding networked server, depending on networking
Server can send the first video data to regarding networked terminals, and the first video data can be received depending on networked terminals, use
The first video data of decoder pair of first chip 502 is decoded, then decoded first video data is played out.
As an example, the first chip 502 may be used based on being H.264 decoded, and the first video data is decoding
Before can be based on video data H.264, after the decoding can be the video data based on YUV, so as to realize play.
Can also include the network interface being connected with the first chip 502, first depending on networked terminals in a kind of preferable example
HDMI (High DefinitionMultimedia Interface, high-definition multimedia interface) interface, the first chip 502
It can be connected with depending on networked server by network interface, the first chip 502 may be used first HDMI interface and play out.
On the other hand, the second video data that camera acquisition can be obtained depending on networked terminals, using at least two second
Chip 503 encodes the second video data, then sends the second video data after coding to regarding networked server, depending on
Networked server sends the second video data after coding to other-end, and other-end can play out.
Can also include second to be connected at least two second chips 503 depending on networked terminals in a kind of preferable example
HDMI interface, at least two second chips 503 can be connected by the second HDMI interface with camera.
It should be noted that the second video data can also be after being acquired by the camera of other equipment, depending on networked terminals
The video data obtained from other equipment, as notebook by HDMI to the video data exported depending on networked terminals.
In one preferred embodiment of the invention, the first chip 502 can be connected with microphone, such as using card agriculture head,
LINE_IN is connected equal to microphone, to carry out the acquisition of audio data.
Correspondingly, the second video data after at least two chips 503 can be used for encode is sent by interchanger 501
To the first chip 502, it is sent to regarding networked server by the first chip 502；
First chip 502 can be used for receiving the second video data after coding and getting the of microphone acquisition
Two audio datas carry out time synchronization, and the second video data after time synchronization is sent to second audio data regarding networking
Server.
Specifically, while camera acquires the second video data, microphone is also in acquisition second audio data, at least
Two chips 503 can send the second video data after coding to the first chip 502, and microphone can also be by the second audio
Data are sent to the first chip 502.
First chip 502 can receive coding after the second video data and second audio data, then by the two into
Identical timestamp is such as arranged in row time synchronization, and the second video data after time synchronization is sent to second audio data
Depending on networked server, retransmited to other-end depending on networked server, other-end can be by the second video after time synchronization
Data synchronize broadcasting with second audio data.
In one preferred embodiment of the invention, the first chip 502 can be also used for regarding second after time synchronization
Frequency evidence is played out with second audio data.
During video communication, depending on networked terminals in addition to can be carried out to the first video data that other-end is sent
It plays, it can also be after the second video data of itself acquisition carries out time synchronization with second audio data, after time synchronization
The second video data and second audio data carry out local broadcasting, with realize in networked terminals to video communication both sides'
Video data is carried out while being played.
Can also include external interface depending on networked terminals, as USB interface, HDMI_OUTx2 connect in a kind of preferable example
Mouth, HDMI_IN interfaces, card agriculture head interface, RCA (Radio Corporation ofAmerican, AV interface) etc..
In embodiments of the present invention, by that will be set as may include interchanger depending on networked terminals and be connected with interchanger
The first chip and at least two second chips, the first chip can be connected with depending on networked server, can be used for receiving
The first video data sent depending on networked server is decoded, and decoded first video data is played out, at least
Two the second chips can be connected with camera, can be used for compiling the second video data for getting camera acquisition
Code, and the second video data after coding is sent to regarding networked server, it realizes using different chips to video data
It is encoded and is decoded, improved coding, decoded efficiency, ensure that the real-time of video communication.
With reference to Fig. 6, a kind of communication means based on regarding networked terminals of the embodiment of the present invention is shown, it is described to regard networking eventually
End may include interchanger and the first chip being connected with interchanger and at least two second chips, the first chip can with regarding
Networked server is connected, and at least two second chips can be connected with camera, can specifically include following steps：
Step 601, first video data sent regarding networked server is received, and using first chip to institute
It states the first video data to be decoded, decoded first video data is played out；
In practical applications, networking is regarded as the network with centralized control functions, including main control server and undernet
Equipment, which includes terminal, and one of the core idea depending on networking is, by notifying to exchange by main control server
Equipment is directed to when time downstream communications link of service matches table, and the table for being then based on the configuration carries out the transmission of data packet.
That is, including depending on the communication means in networking：
Main control server configuration is when time downstream communications link of service；
Work as time data packet of service by what source terminal was sent, target terminal is sent to (such as according to the downstream communications link
Depending on networked terminals).
In embodiments of the present invention, it configures when time downstream communications link of service includes：Notice is logical when time downlink of service
Believe that the switching equipment involved by link matches table；
Furthermore, include according to downstream communications link transmission：Inquiry configured table, switching equipment is to being received
Data packet is transmitted by corresponding port.
In the concrete realization, service includes unicast communication service and Multicast Communication Service.I.e. either cast communication is still
Unicast communication can use the above-mentioned core idea with table-table to realize the communication regarded in networking.
As previously mentioned, including access mesh portions regarding networking net, in access is netted, which is node server,
Undernet equipment includes access switch and terminal.
For the unicast communication service during access is netted, the main control server configuration is when time downlink communication chain of service
The step of road, may comprise steps of：
Sub-step S11, the service request protocol package that main control server is initiated according to source terminal are obtained when time downlink of service
Communication link information, downstream communications link information include participating in when time downlink of the main control server and access switch of service
Communication port information；
Sub-step S12, downstream communication ports information of the main control server according to control server, data packet inside it
The downlink port that setting is oriented to when time data packet of service in the table of location；And believe according to the downstream communication ports of access switch
Breath, to corresponding access switch sending port configuration order；
Sub-step S13, access switch according in port configuration command data packet addressed table inside it, setting when time
The downlink port that the data packet of service is oriented to.
For the Multicast Communication Service (such as video conference) during access is netted, main control server is obtained when under time service
The step of row communication link information may include following sub-step：
Sub-step S21, main control server obtain the service request agreement for the application Multicast Communication Service that target terminal is initiated
Packet, service request protocol package includes the access net address of service type information, service content information and target terminal；Wherein,
Service content information includes service number；
Sub-step S22, main control server according to the service number in preset content-address mapping table, extraction source
The access net address of terminal；
Sub-step S23, main control server obtains the corresponding multicast address of source terminal, and distributes to target terminal；And according to
According to the access net address of service type information, source terminal and target terminal, the communication link information when time multicast services is obtained.
Based on above-mentioned communication means, video communication can be carried out with other-end depending on networked terminals, it can be with depending on networked terminals
Video communication interface is carried out, the mode that may then pass through dialing connects other-end.
After communicating pair successful connection, other-end may be used camera and acquire the first video data, then by the
One video data is sent to regarding networked server, can be by the first video after receiving the first video data depending on networked server
Data are sent to regarding networked terminals, and the first video data can be received depending on networked terminals.
After receiving the first video data regarding networked terminals, first the first video data of chip pair may be used and solve
Code, then plays out decoded first video data.
Step 602, and, the second video data of the camera acquisition is obtained, and uses described at least two second
Chip encodes second video data, and the second video data after the coding is sent to described and regards the Internet services
Device.
After communicating pair successful connection, camera may be used depending on networked terminals and shoot video, obtain the second video counts
According to then being encoded using at least two second the second video datas of chip pair, then by the second video data transmitting after coding
Other ends can be sent to depending on networked server after the second video data after receiving coding by sending to regarding networked server
End, to play the second video data in other-end.
In embodiments of the present invention, by that will be set as may include interchanger depending on networked terminals and be connected with interchanger
The first chip and at least two second chips, the first chip can be connected with depending on networked server, can be used for receiving
The first video data sent depending on networked server is decoded, and decoded first video data is played out, at least
Two the second chips can be connected with camera, can be used for compiling the second video data for getting camera acquisition
Code, and the second video data after coding is sent to regarding networked server, it realizes using different chips to video data
It is encoded and is decoded, improved coding, decoded efficiency, ensure that the real-time of video communication.
It should be noted that for embodiment of the method, for simple description, therefore it is all expressed as a series of action group
It closes, but those skilled in the art should understand that, the embodiment of the present invention is not limited by the described action sequence, because according to
According to the embodiment of the present invention, certain steps can be performed in other orders or simultaneously.Secondly, those skilled in the art also should
Know, embodiment described in this description belongs to preferred embodiment, and the involved action not necessarily present invention is implemented
Necessary to example.
With reference to Fig. 7, a kind of structure diagram based on the communication device regarding networked terminals of the embodiment of the present invention, institute are shown
It may include interchanger and the first chip being connected with the interchanger and at least two second chips, institute to state depending on networked terminals
It states the first chip with depending on networked server to be connected, described at least two second chips are connected with camera, and described device includes：
First video data playing module 701, for receiving first video data sent regarding networked server, and
First video data is decoded using first chip, decoded first video data is broadcast
It puts；
Second video data sends module 702, the second video data for obtaining the camera acquisition, and uses institute
At least two second chips are stated to encode second video data, by the second video data after the coding send to
It is described to regard networked server.
In embodiments of the present invention, by that will be set as may include interchanger depending on networked terminals and be connected with interchanger
The first chip and at least two second chips, the first chip can be connected with depending on networked server, can be used for receiving
The first video data sent depending on networked server is decoded, and decoded first video data is played out, at least
Two the second chips can be connected with camera, can be used for compiling the second video data for getting camera acquisition
Code, and the second video data after coding is sent to regarding networked server, it realizes using different chips to video data
It is encoded and is decoded, improved coding, decoded efficiency, ensure that the real-time of video communication.
The embodiment of the invention also discloses a kind of electronic equipment, including memory, processor and storage are on a memory simultaneously
The step of computer program that can be run on a processor, the processor realizes method as described above when executing described program.
The embodiment of the invention also discloses a kind of computer readable storage mediums, are stored thereon with computer program, special
The step of sign is, which realizes method as described above when being executed by processor.
For device, electronic equipment, computer readable storage medium embodiment, since it is basic with embodiment of the method
Similar, so description is fairly simple, the relevent part can refer to the partial explaination of embodiments of method.
Each embodiment in this specification is described in a progressive manner, the highlights of each of the examples are with
The difference of other embodiment, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can be provided as method, apparatus or calculate
Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can
With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code
The form of the computer program product of implementation.
The embodiment of the present invention be with reference to according to the method for the embodiment of the present invention, terminal device (system) and computer program
The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions
In each flow and/or block and flowchart and/or the block diagram in flow and/or box combination.These can be provided
Computer program instructions are set to all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals
Standby processor is to generate a machine so that is held by the processor of computer or other programmable data processing terminal equipments
Capable instruction generates for realizing in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxes
The device of specified function.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing terminal equipments
In computer-readable memory operate in a specific manner so that instruction stored in the computer readable memory generates packet
The manufacture of command device is included, which realizes in one flow of flow chart or multiple flows and/or one side of block diagram
The function of being specified in frame or multiple boxes.
These computer program instructions can be also loaded into computer or other programmable data processing terminal equipments so that
Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus
The instruction executed on computer or other programmable terminal equipments is provided for realizing in one flow of flow chart or multiple flows
And/or in one box of block diagram or multiple boxes specify function the step of.
Although the preferred embodiment of the embodiment of the present invention has been described, once a person skilled in the art knows bases
This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as
Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap
Those elements are included, but also include other elements that are not explicitly listed, or further include for this process, method, article
Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited
Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device including the element.
Above to it is provided by the present invention it is a kind of regarding networked terminals and based on communication means, the device regarding networked terminals,
It is described in detail, principle and implementation of the present invention are described for specific case used herein, the above reality
The explanation for applying example is merely used to help understand the method and its core concept of the present invention；Meanwhile for the general technology of this field
Personnel, according to the thought of the present invention, there will be changes in the specific implementation manner and application range, in conclusion this theory
Bright book content should not be construed as limiting the invention.
Claims (10)
1. one kind regarding networked terminals, which is characterized in that described to include interchanger depending on networked terminals and be connected with the interchanger
The first chip and at least two second chips；
First chip is connected with depending on networked server, for receiving first video sent regarding networked server
Data are decoded, and decoded first video data is played out；
Described at least two second chips are connected with camera, for the second video data to getting the camera acquisition
It is encoded, and the second video data after the coding is sent to described and regards networked server.
2. according to claim 1 regard networked terminals, which is characterized in that first chip is connected with microphone, described
Few two the second chips are connected by the interchanger with first chip；
At least two chip is used to the second video data after the coding being sent to described the by the interchanger
One chip is sent to described regarding networked server by first chip；
First chip is used for receiving the second video data after the coding and getting the microphone acquisition
Second audio data carries out time synchronization, and the second video data after the time synchronization is sent to second audio data
It is described to regard networked server.
3. it is according to claim 2 regard networked terminals, which is characterized in that first chip be additionally operable to by the time it is same
The second video data after step is played out with second audio data.
4. according to claim 1 or 2 or 3 regard networked terminals, which is characterized in that first chip is additionally operable to receiving
It is decoded to first audio data sent depending on networked server, and by decoded first audio data and the
One video data synchronizes broadcasting.
5. according to claim 4 regard networked terminals, which is characterized in that the decoding capability of first chip is more than described
The code capacity of at least two second chips, first chip are RK3288 chips, and described at least two second chips are
HI3516A chips.
6. according to claim 1 regard networked terminals, which is characterized in that described to further include and described first depending on networked terminals
Network interface that chip is connected, the first HDMI interface, and the second HDMI interface for being connected with described at least two second chips；
First chip is connected with described depending on networked server by the network interface, and first chip uses described first
HDMI interface plays out, and described at least two second chips are connected by second HDMI interface with the camera.
7. a kind of communication means based on regarding networked terminals, which is characterized in that it is described depending on networked terminals include interchanger and with
The interchanger connected the first chip and at least two second chips, first chip are connected with depending on networked server, institute
At least two second chips are stated with camera to be connected, the method includes：
First video data sent regarding networked server is received, and using first chip to first video counts
According to being decoded, decoded first video data is played out；
And the second video data of camera acquisition is obtained, and using at least two second chip to described the
Two video datas are encoded, and the second video data after the coding is sent to described and regards networked server.
8. a kind of communication device based on regarding networked terminals, which is characterized in that it is described depending on networked terminals include interchanger and with
The interchanger connected the first chip and at least two second chips, first chip are connected with depending on networked server, institute
It states at least two second chips with camera to be connected, described device includes：
First video data playing module for receiving first video data sent regarding networked server, and uses institute
It states the first chip to be decoded first video data, decoded first video data is played out；
Second video data sends module, the second video data for obtaining the camera acquisition, and described at least
Two the second chips encode second video data, and the second video data after the coding is sent to described and is regarded
Networked server.
9. a kind of electronic equipment, including memory, processor and storage are on a memory and the calculating that can run on a processor
Machine program, which is characterized in that the processor realizes the step of any one of claim 7 the method when executing described program.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The step of any one of claim 7 the method is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710797449.9A CN108574816B (en) | 2017-09-06 | 2017-09-06 | Video networking terminal and communication method and device based on video networking terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710797449.9A CN108574816B (en) | 2017-09-06 | 2017-09-06 | Video networking terminal and communication method and device based on video networking terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108574816A true CN108574816A (en) | 2018-09-25 |
| CN108574816B CN108574816B (en) | 2020-08-25 |
Family
ID=63576272
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710797449.9A Active CN108574816B (en) | 2017-09-06 | 2017-09-06 | Video networking terminal and communication method and device based on video networking terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108574816B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110446069A (en) * | 2019-07-10 | 2019-11-12 | 视联动力信息技术股份有限公司 | A kind of video communication method, device and storage medium based on view networked terminals |
| CN110602542A (en) * | 2019-08-13 | 2019-12-20 | 视联动力信息技术股份有限公司 | Audio and video synchronization method, audio and video synchronization system, equipment and storage medium |
| CN111083425A (en) * | 2019-11-25 | 2020-04-28 | 视联动力信息技术股份有限公司 | Video stream processing method and device, server, electronic equipment and storage medium |
| WO2020248650A1 (en) * | 2019-06-10 | 2020-12-17 | 海信视像科技股份有限公司 | Display apparatus |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070070179A1 (en) * | 2005-09-28 | 2007-03-29 | Pieter Van Rooyen | Method and system for a reconfigurable OFDM radio |
| CN101094358A (en) * | 2007-07-12 | 2007-12-26 | 北京华纬讯电信技术有限公司 | Video transmission system and method based on 1394 collection and HDMI / DVI |
| CN101577820A (en) * | 2009-06-12 | 2009-11-11 | 深圳市锐取软件技术有限公司 | Hybrid encoding device |
| CN107087138A (en) * | 2017-04-07 | 2017-08-22 | 华南理工大学 | A kind of video conferencing system based on H.265 video code model |
-
2017
- 2017-09-06 CN CN201710797449.9A patent/CN108574816B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070070179A1 (en) * | 2005-09-28 | 2007-03-29 | Pieter Van Rooyen | Method and system for a reconfigurable OFDM radio |
| CN101094358A (en) * | 2007-07-12 | 2007-12-26 | 北京华纬讯电信技术有限公司 | Video transmission system and method based on 1394 collection and HDMI / DVI |
| CN101577820A (en) * | 2009-06-12 | 2009-11-11 | 深圳市锐取软件技术有限公司 | Hybrid encoding device |
| CN107087138A (en) * | 2017-04-07 | 2017-08-22 | 华南理工大学 | A kind of video conferencing system based on H.265 video code model |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020248650A1 (en) * | 2019-06-10 | 2020-12-17 | 海信视像科技股份有限公司 | Display apparatus |
| CN110446069A (en) * | 2019-07-10 | 2019-11-12 | 视联动力信息技术股份有限公司 | A kind of video communication method, device and storage medium based on view networked terminals |
| CN110602542A (en) * | 2019-08-13 | 2019-12-20 | 视联动力信息技术股份有限公司 | Audio and video synchronization method, audio and video synchronization system, equipment and storage medium |
| CN110602542B (en) * | 2019-08-13 | 2022-02-08 | 视联动力信息技术股份有限公司 | Audio and video synchronization method, audio and video synchronization system, equipment and storage medium |
| CN111083425A (en) * | 2019-11-25 | 2020-04-28 | 视联动力信息技术股份有限公司 | Video stream processing method and device, server, electronic equipment and storage medium |
| CN111083425B (en) * | 2019-11-25 | 2022-12-23 | 视联动力信息技术股份有限公司 | Video stream processing method, device, server, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108574816B (en) | 2020-08-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106341515B (en) | A kind of monitoring method and device of terminal | |
| CN108173804B (en) | A kind of networked by view accesses the method and view connection cat client of internet | |
| CN108462727A (en) | A kind of data transmission method and device | |
| CN108063745B (en) | A kind of video call method and its system based on Android device | |
| CN108322809A (en) | The method and system that control video file plays under depending on networking under a kind of internet | |
| CN108616328A (en) | A kind of audio/video flow loss recovery method and audio/video flow transmitting terminal and receiving terminal | |
| CN108243343B (en) | A kind of point distribution statistical method and its server based on view networking | |
| CN108881135A (en) | It is a kind of based on view networking information transferring method, device and system | |
| CN108989078A (en) | A kind of view networking interior joint equipment fault detection method and device | |
| CN109756789A (en) | A kind of loss treating method and system of audio, video data packet | |
| CN108616487A (en) | Based on the sound mixing method and device regarding networking | |
| CN108632559A (en) | A kind of video data handling procedure and device | |
| CN108574816A (en) | It is a kind of to regard networked terminals and based on communication means, the device regarding networked terminals | |
| CN109246486A (en) | A kind of framing method and device | |
| CN110049346A (en) | A kind of method and system of net cast | |
| CN110049341A (en) | Method for processing video frequency and device | |
| CN108630215A (en) | A kind of echo suppressing method and device based on regarding networking | |
| CN108881818A (en) | A kind of transmission method and device of video data | |
| CN108632679A (en) | A kind of method of multi-medium data transmission and a kind of regarding networked terminals | |
| CN110149305A (en) | A kind of method and transfer server of the multi-party playing audio-video based on view networking | |
| CN110035297A (en) | Method for processing video frequency and device | |
| CN109729184A (en) | A kind of method and apparatus of view networking service processing | |
| CN108989831A (en) | A kind of network REC method and apparatus of multi-code stream | |
| CN108574819B (en) | A kind of terminal device and a kind of method of video conference | |
| CN110445761A (en) | A kind of video drawing stream method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 100000 Gehua Building 1103, No. 1 Qinglong Hutong, Dongcheng District, Beijing Applicant after: VISIONVERA INFORMATION TECHNOLOGY Co.,Ltd. Address before: 100000 Beijing city Dongcheng District Qinglong Hutong No. 1 Gehua building A1103-1113 Applicant before: BEIJING VISIONVERA INTERNATIONAL INFORMATION TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |