CN110602805B - Information processing method, first electronic device and computer system - Google Patents
Information processing method, first electronic device and computer system Download PDFInfo
- Publication number
- CN110602805B CN110602805B CN201910948746.8A CN201910948746A CN110602805B CN 110602805 B CN110602805 B CN 110602805B CN 201910948746 A CN201910948746 A CN 201910948746A CN 110602805 B CN110602805 B CN 110602805B
- Authority
- CN
- China
- Prior art keywords
- channel
- electronic device
- data
- network connection
- input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/10—Connection setup
- H04W76/14—Direct-mode setup
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/10—Connection setup
- H04W76/15—Setup of multiple wireless link connections
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephone Function (AREA)
Abstract
The present disclosure provides an information processing method, including: obtaining device information of a second electronic device; establishing a network connection channel between the first electronic device and the second electronic device based on the device information; establishing a negotiation channel, a control channel, a data channel, an input channel and an output channel based on the network connection channel, wherein the negotiation channel, the control channel and the data channel are bidirectional transmission channels; the input channel is a one-way transmission channel for transmitting to the second electronic equipment; the output channel is a unidirectional transmission channel for transmitting to the first electronic device. The present disclosure also provides a first electronic device and a computer system.
Description
Technical Field
The present disclosure relates to an information processing method, a first electronic device, and a computer system.
Background
With the development of scientific technology, electronic devices are changing day by day, and in some cases, there are interaction requirements such as data transmission and instruction transmission between two or more devices, and if it is desired to realize interaction between two devices, a connection needs to be established between the two devices. In the existing connection mode, only one transmission channel is simply established between two devices to transmit all data, and in a complex interaction scene, the connection mode in the prior art cannot meet the transmission requirement, so that the interaction effect is poor.
Disclosure of Invention
One aspect of the present disclosure provides an information processing method, including: obtaining device information of a second electronic device; establishing a network connection channel between the first electronic device and the second electronic device based on the device information; establishing a negotiation channel, a control channel, a data channel, an input channel and an output channel based on the network connection channel, wherein the negotiation channel, the control channel and the data channel are bidirectional transmission channels; the input channel is a one-way transmission channel for transmitting to the second electronic equipment; the output channel is a unidirectional transmission channel for transmitting to the first electronic device.
Optionally, the network connection channel is located at a kernel layer; the input channel and the output channel are positioned in a Framework layer; the negotiation channel, the control channel and the data channel are located in an APP layer.
Optionally, the method further comprises: obtaining at least display data from a display screen of the second electronic device through the output channel, so that the first electronic device presents display content corresponding to the display data in a first area of the display screen of the first electronic device based on the display data; transmitting the input parameters of the input device of the first electronic device for the first area to the second electronic device through the input channel; performing equipment state interaction with the second electronic equipment through the negotiation channel; performing control instruction interaction with the second electronic equipment through the control channel; and interacting file data with the second electronic equipment through the data channel.
Optionally, the obtaining the device information of the second electronic device includes: and obtaining the device information broadcasted by the second electronic device through the near field communication module.
Optionally, the establishing a network connection channel between the first electronic device and the second electronic device based on the device information includes: and establishing a network connection channel with the second electronic equipment based on the equipment information.
Another aspect of the present disclosure provides a first electronic device, including: a near field communication module; a high-speed communication module; the control module is used for obtaining the device information of the second electronic device based on the near field communication module; establishing a network connection channel between the first electronic device and the second electronic device based on the high-speed communication module and the device information; establishing a negotiation channel, a control channel, a data channel, an input channel and an output channel based on the network connection channel, wherein the negotiation channel, the control channel and the data channel are bidirectional transmission channels; the input channel is a one-way transmission channel for transmitting to the second electronic equipment; the output channel is a unidirectional transmission channel for transmitting to the first electronic device.
Optionally, the network connection channel is located at a kernel layer; the input channel and the output channel are positioned in a Framework layer; the negotiation channel, the control channel and the data channel are located in an APP layer.
Optionally, the Framework layer includes: the display processing module is used for receiving display data from the second electronic equipment and performing image rendering on the basis of the display data of the second electronic equipment and the display data of the first electronic equipment to obtain a display image, wherein the display image comprises a first area used for presenting display content corresponding to the display data of the second electronic equipment; the audio processing module is used for receiving audio data from the second electronic equipment, analyzing and outputting the audio data; and the input event intercepting module is used for acquiring input parameters of the input equipment of the first electronic equipment aiming at the first area and transmitting the input parameters to the second electronic equipment through the input channel.
Optionally, the APP layer comprises: the negotiation module is used for interacting the equipment state with the second electronic equipment through the negotiation channel; the control module is used for carrying out interaction of control instructions with the second electronic equipment through the control channel; and the data module is used for interacting file data with the second electronic equipment through the data channel.
Another aspect of the present disclosure provides a computer system comprising: one or more processors; a computer readable storage medium for storing one or more programs, wherein loading in a system build, when the one or more programs are executed by the one or more processors, comprises: the drive module of the kernel layer is used for driving the network connection device to realize data transmission; the network management module of the Framework layer is used for obtaining the equipment information of the second electronic equipment; establishing a network connection channel between the first electronic device and the second electronic device based on the device information; a connection management module of the APP layer, configured to create a negotiation channel, a control channel, a data channel, an input channel, and an output channel based on the network connection channel, where the negotiation channel, the control channel, and the data channel are bidirectional transmission channels; the input channel is a one-way transmission channel for transmitting to the second electronic equipment; the output channel is a unidirectional transmission channel for transmitting to the first electronic device.
Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions for implementing the method as described above when executed.
Another aspect of the disclosure provides a computer program comprising computer executable instructions for implementing the method as described above when executed.
Drawings
For a more complete understanding of the present disclosure and the advantages thereof, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, in which:
fig. 1 schematically shows an application scenario of an information processing method according to an embodiment of the present disclosure;
FIG. 2 schematically shows a flow chart of an information processing method according to an embodiment of the present disclosure;
FIG. 3 schematically illustrates a schematic diagram of a connection process according to an embodiment of the disclosure;
FIG. 4 schematically shows a flow chart of an information processing method according to another embodiment of the present disclosure;
FIG. 5 schematically shows a schematic view of a display interface of a first electronic device according to an embodiment of the disclosure;
FIG. 6 schematically shows a schematic view of another display interface of the first electronic device, in accordance with an embodiment of the present disclosure;
FIG. 7 schematically illustrates a schematic view of another display interface of the first electronic device, in accordance with an embodiment of the present disclosure;
fig. 8 schematically shows an architectural schematic of a first electronic device and a second electronic device according to an embodiment of the disclosure;
FIG. 9 schematically shows a block diagram of a first electronic device according to an embodiment of the present disclosure; and
FIG. 10 schematically illustrates a block diagram of a computer system suitable for implementing the above-described method, according to an embodiment of the present disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
Some block diagrams and/or flow diagrams are shown in the figures. It will be understood that some blocks of the block diagrams and/or flowchart illustrations, or combinations thereof, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the instructions, which execute via the processor, create means for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks. The techniques of this disclosure may be implemented in hardware and/or software (including firmware, microcode, etc.). In addition, the techniques of this disclosure may take the form of a computer program product on a computer-readable storage medium having instructions stored thereon for use by or in connection with an instruction execution system.
An embodiment of the present disclosure provides an information processing method, including: obtaining device information of a second electronic device; establishing a network connection channel between the first electronic equipment and the second electronic equipment based on the equipment information; and creating a negotiation channel, a control channel, a data channel, an input channel, and an output channel based on the network connection channel. The negotiation channel, the control channel and the data channel are bidirectional transmission channels; the input channel is a one-way transmission channel for transmitting to the second electronic equipment; the output channel is a one-way transmission channel for transmitting to the first electronic device.
Fig. 1 schematically shows an application scenario of an information processing method according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of a scenario in which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.
As shown in fig. 1, the application scenario 100 includes, for example, a first electronic device 101 and a second electronic device 102. The first electronic device 101 and the second electronic device 102 both have display screens capable of displaying graphical interfaces, and the first electronic device 101 and the second electronic device 102 both have communication modules, for example, bluetooth modules, WIFI modules, and the like, and are capable of realizing data transmission with external devices. The first electronic device 101 includes, but is not limited to, a laptop, a tablet, a desktop, and the like, and the second electronic device 102 includes, but is not limited to, a mobile phone, a tablet, and the like.
Various client applications, such as a document processing application, a messaging application, a shopping application, a web browser application, a search application, an instant messaging tool, a mailbox client, etc. (by way of example only) may be installed on the first electronic device 101 and the second electronic device 102.
The first electronic device 101 and the second electronic device 102 may establish a near field communication channel, for example, a bluetooth connection, then establish a high speed communication channel based on the near field communication channel, for example, a WIFI direct channel, and then may create a plurality of transmission channels based on the high speed communication channel, the plurality of transmission channels may include, for example, a negotiation channel 103, a control channel 104, a data channel 105, an input channel 106, and an output channel 107, each channel may be used to transmit different types of data, for example, the negotiation channel 103 may be used to transmit a device state, the control channel 104 may be used to transmit a control instruction, and the data channel 105 may be used to transmit a file.
The second electronic device 102 may transmit the display data of its screen to the first electronic device 101 through the output channel 107. After receiving the display data of the second electronic device 102, the first electronic device 101 may present a display screen corresponding to the display data on the first display area of the screen of the first electronic device 101, which is equivalent to projecting the screen of the second electronic device 102 onto the screen of the first electronic device 101, and therefore, the first display area may also be referred to as a screen projection area.
The first electronic device 101 may receive an input operation of a user on a screen of the first electronic device 101, where the input operation may be, for example, a mouse click operation, a touch input operation, a keyboard input operation, and the like, and if the input operation is located in a screen projection area, the first electronic device 101 may generate a corresponding control instruction or an input event based on the input operation, where the control instruction is sent to the second electronic device 102 through the control channel 104, and the input event is sent to the second electronic device 102 through the input channel 106, so that the second electronic device 102 responds to the input operation.
The information processing method provided by the embodiment of the disclosure can create a plurality of transmission channels based on network connection, and each transmission channel can be used for transmitting data of different types, so that the interaction requirements among devices can be better met, and the user experience is improved.
An information processing method according to an exemplary embodiment of the present disclosure is described below with reference to fig. 2 to 4 in conjunction with an application scenario of fig. 1. It should be noted that the above application scenarios are merely illustrated for the convenience of understanding the spirit and principles of the present disclosure, and the embodiments of the present disclosure are not limited in this respect. Rather, embodiments of the present disclosure may be applied to any scenario where applicable.
Fig. 2 schematically shows a flow chart of an information processing method according to an embodiment of the present disclosure.
As shown in fig. 2, the method includes operations S210 to S230, and the method may be performed by a first electronic device, which may be, for example, a notebook computer, and a second electronic device, which may be, for example, a mobile phone.
In operation S210, device information of a second electronic device is obtained.
In operation S220, a network connection channel between the first electronic device and the second electronic device is established based on the device information.
In operation S230, a negotiation channel, a control channel, a data channel, an input channel, and an output channel are created based on the network connection channel, where the negotiation channel, the control channel, and the data channel are bidirectional transmission channels; the input channel is a one-way transmission channel for transmitting to the second electronic equipment; the output channel is a one-way transmission channel for transmitting to the first electronic device.
According to an embodiment of the present disclosure, obtaining device information of the second electronic device includes: and obtaining the device information broadcasted by the second electronic device through a near field communication module, wherein the near field communication module can be a Bluetooth module or an NFC near field communication module.
According to an embodiment of the present disclosure, establishing a network connection channel between a first electronic device and a second electronic device based on device information includes: and establishing a network connection channel with the second electronic device based on the device information, wherein the network connection channel may refer to a high-speed network connection channel, and the high-speed network connection channel may be, for example, a WIFI direct connection channel or a local area network connection channel.
Fig. 3 schematically shows a schematic diagram of a connection process according to an embodiment of the present disclosure.
As shown in fig. 3, for example, the second electronic device may broadcast information such as a bluetooth address, a device name, a WIFI address, and a local area network address to surrounding devices through bluetooth broadcast, and listen to whether there is a connection request for access. The first electronic device may search for surrounding devices and receive information broadcast by the surrounding devices. The Bluetooth connection request can be sent to the second electronic equipment after the first electronic equipment detects the information broadcasted by the second electronic equipment, the second electronic equipment establishes Bluetooth connection based on the Bluetooth connection request and replies the connection state to the first electronic equipment, and a Bluetooth channel is established between the first electronic equipment and the second electronic equipment, so that data can be transmitted in a short distance.
The first electronic device may send a second connection request to the second electronic device based on the bluetooth channel, where the second connection request may include a screen-casting request, and after receiving the second connection request, the second electronic device displays a prompt message to prompt the user whether to start a screen-casting service. After receiving the confirmation instruction of the user, the second electronic device may notify the first electronic device that the request is accepted, and the first electronic device may confirm whether the first electronic device and the second electronic device are in the same local area network based on the local area network address acquired by the bluetooth broadcast.
If the first electronic device and the second electronic device are located in the same local area network, the first electronic device may establish a local area network connection channel with the second electronic device to implement network connection in an equipment layer, and then establish a negotiation channel, a control channel, a data channel, an input channel, and an output channel based on the local area network connection channel to implement data communication in an application layer.
If the first electronic device and the second electronic device are not located in the same local area network, the first electronic device can establish a WIFI direct connection networking, the second electronic device is informed to join based on a WIFI address notification of the second electronic device acquired through Bluetooth broadcasting, the second electronic device requests the first electronic device to join the networking after receiving the notification, and a WIFI direct connection channel is established between the first electronic device and the second electronic device to realize network connection of the devices. And then, a negotiation channel, a control channel, a data channel, an input channel and an output channel are established based on the WIFI direct connection channel, so that communication of various types of data is realized.
In the process of creating the negotiation channel, the control channel, the data channel, the input channel and the output channel, the first electronic device or the second electronic device is required to establish a corresponding connection service first, wait for an access request of the opposite electronic device, and establish a corresponding transmission channel with the opposite electronic device after receiving the access request. For example, the first electronic device establishes a negotiation service and notifies the second electronic device, the second electronic device requests to connect a negotiation channel, and the first electronic device establishes the negotiation channel with the second electronic device after confirmation. The first electronic device can establish data transmission service, the second electronic device requests to connect the data channel, and the first electronic device establishes the data channel with the second electronic device after confirmation. In this way, output channels, control channels and input channels may also be established.
Fig. 4 schematically shows a flow chart of an information processing method according to another embodiment of the present disclosure.
As shown in fig. 4, the information processing method may further include operations S240 to S280, according to an embodiment of the present disclosure.
In operation S240, at least display data from a display screen of the second electronic device is obtained through the output channel, so that the first electronic device presents display content corresponding to the display data in a first area of the display screen of the first electronic device based on the display data.
For example, the second electronic device may convert a display screen of the screen into a video image frame in real time and transmit the video image frame to the first electronic device through the output channel, and after the first electronic device receives the image frame, the first electronic device may generate a display interface based on the received image frame of the second electronic device and a display image of the first electronic device itself, and display the display interface on the screen of the first electronic device.
Fig. 5 schematically shows a schematic view of a display interface of a first electronic device according to an embodiment of the disclosure.
As shown in fig. 5, the display interface includes a first area 310 and a second area 320, and the first area 310 may be used to display a display screen corresponding to display data received from the second electronic device, for example, a screen of a mobile phone. The second area 320 may be used to display a display screen corresponding to the display data of the first electronic device itself, for example, a screen of a notebook computer. The above operation is equivalent to projecting the image of the screen of the second electronic device onto the screen of the first electronic device in real time, the display image in the first area 310 and the display image on the screen of the second electronic device are synchronized in real time, and any change in the display image on the screen of the second electronic device can be updated to the first area 310 synchronously. Since the screen of the second electronic device occupies a part of the screen of the first electronic device, the display of the first electronic device may only display a part of the screen area, or the part of the display of the first electronic device covered by the screen of the second electronic device may be adjusted to the second area 320 for displaying by adjusting the policy such as the graphic position.
In operation S250, input parameters of the input device of the first electronic device for the first area are transmitted to the second electronic device through the input channel.
The first electronic device may acquire an input operation performed by a user, and the input operation may be acquired through an input device such as a mouse, a touch screen, or a keyboard. If the input operation is located in the first area 310, the input parameter corresponding to the input operation may be sent to the second electronic device through the input channel, so that the second electronic device performs the corresponding operation. The input parameters may include an input action and a conversion position, wherein the input action may be, for example, a click, a double click, a drag, a release, a touch, a press, and the like, and the conversion position may be a coordinate position obtained by coordinate conversion of an input position acquired by the first electronic device. Since the input position of the input action acquired by the first electronic device is a coordinate position relative to the entire display screen of the first electronic device, that is, a coordinate position in a coordinate system constructed based on the entire display screen of the first electronic device, if the input position is directly sent to the second electronic device, the second electronic device cannot recognize the execution position of the input operation, the input position may be firstly subjected to coordinate conversion at the first electronic device end and converted into a coordinate position in a coordinate system constructed based on the first area 310, the coordinates of the first area 310 and the coordinates of the screen of the second electronic device may be corresponding to each other, for example, the upper left corner of a certain figure is (X1, Y1) at the conversion position of the first area 310, and the position of the figure on the screen of the second electronic device may also be (X1, Y1). In this way, the input action and the conversion position are transmitted to the second electronic device, and the second electronic device can determine the position corresponding to the input action and respond to the input action based on the conversion position.
In operation S260, file data is interacted with the second electronic device through the data channel.
The first electronic device and the second electronic device can transmit file data such as pictures and documents through the data channel.
For example, the user drags the picture 311 of the first region 310 into the second region 320 by a mouse, indicating that the user wants to transfer the picture 311 from the second electronic device to the first electronic device. In the process of dragging, the first electronic device can send the dragging action and the conversion position to the second electronic device through the input channel in real time, and the second electronic device can determine the dragged file and the storage position of the file according to the position of the starting point of the dragging action and the current display screen of the second electronic device. When the drag action is finished, the second electronic device may acquire the picture 311 from the corresponding storage location, and send the picture 311 to the first electronic device through the data channel, and the first electronic device may receive and store the picture 311 sent by the second electronic device. Conversely, if the user drags the document 321 of the second region 320 into the first region 310 through the mouse, the document 321 may be transmitted from the first electronic device to the second electronic device through the data channel.
Fig. 6 schematically shows a schematic view of another display interface of the first electronic device according to an embodiment of the present disclosure.
As shown in fig. 6, for another example, if a word document 312 is displayed in the first area 310, the user double-clicks the document 312 in the first area 310 to indicate that the user wants to view or edit the document 312, but since office files such as word, excel or powerpoint or some image editing files are not convenient to view and edit on a second electronic device such as a mobile phone, such files can be opened on the first electronic device side. The first electronic device may send the conversion position and the input action of the double-click operation to the second electronic device, so that the second electronic device may determine the document 312 corresponding to the conversion position as a file to be operated by the user through the current input, and send the document 312 to the first electronic device through the data channel, so that the first electronic device opens the document 312 by using software installed on the first electronic device.
In operation S270, a control instruction is interacted with the second electronic device through the control channel.
After the first electronic device obtains the input operation related to the first area 310, a corresponding control instruction may also be obtained according to the input operation, and the control instruction is sent to the second electronic device through the control channel, so that the second electronic device executes the corresponding instruction.
For example, when the cursor is located in the first area 310, the user presses the shortcut key "Ctrl + a" through the keyboard to indicate that the user wants to perform the full selection operation, so the first electronic device may generate a first control instruction, where the first control instruction is a control instruction for controlling the second electronic device to select all the contents in the display screen. And then sending the first control instruction to the second electronic equipment through the control channel so that the second electronic equipment selects all contents in the display picture according to the first control instruction.
The second electronic device may also send control instructions to the first electronic device via the control channel. For example, when playing music, the second electronic device may send audio data and a control instruction to the first electronic device to control the first electronic device to play corresponding audio data.
In operation S280, a device status interaction is performed with the second electronic device through the negotiation channel.
The first electronic device may transmit screen status information, network status information, file configuration information, etc. about the first electronic device to the second electronic device through the negotiation channel. The screen state information may include, for example, information such as a black screen, a bright screen, and the like, and when the first electronic device is in a black screen, the second electronic device may not send any more screen display data to the first electronic device. The network status information may include information such as a WIFI address of the current connection, and the file configuration information may include, for example, a type of a file that the first electronic device may open.
The second electronic device may also transmit screen status information, network status information, configuration information, etc. about the second electronic device to the first electronic device through the negotiation channel. The screen state information may include information such as a black screen and a bright screen, the network state information may include information such as a currently connected WIFI address, and the configuration information may include information such as a type of a file that the second electronic device may open, and whether a navigation key is configured.
Fig. 7 schematically shows a schematic view of another display interface of the first electronic device according to an embodiment of the present disclosure.
As shown in fig. 7, for example, the screen of the second electronic device such as a mobile phone may be configured with a navigation key such as "return", "home screen", etc., and the user may control the screen to return to the previous interface or switch to the home screen through the navigation key, and after the screen of the mobile phone is projected to the first area, the user may also control the mobile phone to perform a corresponding operation through the navigation key displayed on the first area. However, some mobile phones do not have a navigation key, and the operations of returning to the previous level, returning to the main screen, and the like are implemented by a full-screen gesture of sliding left, sliding up, and the like, and after the mobile phones without the navigation key are projected to the first area of the first electronic device, it is inconvenient for a user to perform the operations of returning, and the like by operating an interface of the first area, and therefore, the navigation key 313 may be separately added to the first area 310 for the user to operate.
Therefore, the second electronic device can send the screen configuration information to the first electronic device through the negotiation channel, the first electronic device determines whether the navigation key is configured on the screen of the second electronic device, and the navigation key is added in the first area under the condition that the navigation key is not configured on the screen of the second electronic device.
According to the embodiment of the disclosure, a network connection channel is located in a kernel layer, an input channel and an output channel are located in a Framework layer, and a negotiation channel, a control channel and a data channel are located in an APP layer.
Fig. 8 schematically shows an architectural schematic of a first electronic device and a second electronic device according to an embodiment of the disclosure.
As shown in fig. 8, the kernel layer is a kernel layer, and has drivers of the I/O devices, such as a video card driver, a sound card driver, a network device driver, and the like, for driving the corresponding hardware devices to implement input and output of information. The network device may be, for example, a bluetooth device and a wireless network card for connecting WiFi, and the network connection channel located in the kernel layer may be configured to drive the network device to send a network signal through a network device driving module of the kernel layer, so as to implement establishment of the network connection channel and data transmission in the channel.
The HAL layer is a hardware abstraction layer, the HAL layer of the second electronic device comprises a graph extraction module and an audio extraction module, the graph extraction module can be used for acquiring display data of a display screen of the second electronic device, and the audio extraction module can be used for acquiring audio data played by an audio device of the second electronic device and transmitting the display data and the audio data to a coding module of the Framework layer for coding.
The Framework layer is a Framework layer and is used for managing system services and providing a system service interface for the application layer. The input channel and the output channel are located in the Framework layer, which means that data transmitted by the input channel and the output channel are processed by the Framework layer.
For example, the data transmitted by the output channel is display data and audio data which are encoded by an encoding module in a Framework layer of the second electronic device, the encoded display data and audio data transmitted by the output channel are transmitted upwards from a bottom layer of the first electronic device to a decoding module in the Framework layer for decoding after reaching the first electronic device, the display data obtained by decoding are transmitted to an image processing module in the Framework layer for image rendering, and the audio data obtained by decoding are transmitted to an audio processing module in the Framework layer for analysis.
For another example, the input parameters transmitted by the input channel are acquired by an input event interception module in a Framework layer of the first electronic device, and after the input parameters transmitted by the input channel reach the second electronic device, the input parameters are transmitted to an input event simulation module in the Framework layer of the second electronic device, and an input operation that can be recognized by the second electronic device is simulated by the input event simulation module according to the input parameters, for example, the received input parameters are the double-click coordinate position (X1, Y1), so that the input event simulation module can simulate and generate a double-click event at the (X1, Y1) position on the screen of the second electronic device.
In addition, the Framework layers of the first electronic device and the second electronic device may further include a network management module, and the network management module of the first electronic device may obtain device information of the second electronic device from the kernel layer, and establish a network connection channel between the first electronic device and the second electronic device based on the device information, for example, establish and manage a bluetooth channel and a WiFi direct connection channel.
The APP layer is an application layer, and the negotiation channel, the control channel and the data channel are located in the APP layer, which means that data transmitted by the negotiation channel, the control channel and the data channel are processed by the APP layer.
For example, a control instruction sent by the first electronic device to the second electronic device through the control channel is generated by a first control module in an APP layer of the first electronic device, and after the control instruction is sent to the second electronic device, the control instruction is transmitted to a second control module in the APP layer for processing. For another example, a file sent by the first electronic device to the second electronic device through the data channel is obtained from a storage address of the file by the first data module in the APP layer of the first electronic device, and after being sent to the second electronic device, the file is transmitted to the second data module in the APP layer for storage operation. For another example, the first negotiation module and the second negotiation module in the APP layer may be used to obtain the device state.
In addition, the APP layers of the first electronic device and the second electronic device may further include a connection management module, and the connection management module may be configured to create a negotiation channel, a control channel, a data channel, an input channel, and an output channel. For example, the operations of establishing a negotiation service, establishing a data transmission service, requesting to establish an output channel, establishing a control service, and the like in fig. 3 for creating the respective channels may be performed by the connection management module of the first electronic device. After each channel is established, the connection management module can also monitor and manage the connection state of each channel.
Another aspect of the disclosed embodiments provides a first electronic device.
Fig. 9 schematically shows a block diagram of a first electronic device 400 according to an embodiment of the disclosure.
As shown in fig. 9, the first electronic device 400 includes a short-range communication module 410, a high-speed communication module 420, and a control module 430.
The near field communication module 410 may be, for example, a bluetooth driver module or an NFC driver module.
The high-speed communication module 420 may be, for example, a wireless network card driver module.
The control module 430 may be, for example, a processor, the control module 430 being configured to: obtaining device information of the second electronic device based on the near field communication module; establishing a network connection channel between the first electronic equipment and the second electronic equipment based on the high-speed communication module and the equipment information; establishing a negotiation channel, a control channel, a data channel, an input channel and an output channel based on the network connection channel, wherein the negotiation channel, the control channel and the data channel are bidirectional transmission channels; the input channel is a one-way transmission channel for transmitting to the second electronic equipment; the output channel is a one-way transmission channel for transmitting to the first electronic device.
The control module 430 may execute the information processing method, which may specifically refer to fig. 1 to 8 and the description of the corresponding figures, and is not described herein again.
According to the embodiment of the disclosure, a network connection channel is located in a kernel layer, an input channel and an output channel are located in a Framework layer, and a negotiation channel, a control channel and a data channel are located in an APP layer.
According to an embodiment of the present disclosure, a Framework layer includes an image processing module, an audio processing module, a decoding module, and an input event intercepting module.
The display processing module is used for receiving display data from the second electronic device, and performing image rendering based on the display data of the second electronic device and the display data of the first electronic device to obtain a display image, wherein the display image comprises a first area used for presenting display content corresponding to the display data of the second electronic device.
The audio processing module is used for receiving the audio data from the second electronic equipment, analyzing the audio data and outputting the audio data.
The input event intercepting module is used for acquiring input parameters of input equipment of the first electronic equipment aiming at the first area and transmitting the input parameters to the second electronic equipment through the input channel.
According to an embodiment of the present disclosure, the APP layer includes a first management module, a first control module, and a first data module.
The first management module is used for interacting the equipment state with the second electronic equipment through the negotiation channel;
the first control module is used for interacting control instructions with the second electronic equipment through the control channel;
the first data module is used for interacting file data with the second electronic device through the data channel.
Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.
For example, any number of the above modules may be combined and implemented in one module, or any one of the modules may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to the embodiments of the present disclosure, at least one of the above modules may be implemented at least partially as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or implemented by any one of three implementations of software, hardware, and firmware, or any suitable combination of any of them. Alternatively, at least one of the above-mentioned respective modules may be at least partially implemented as a computer program module, which, when executed, may perform a corresponding function.
Another aspect of the disclosed embodiments provides a computer system.
FIG. 10 schematically illustrates a block diagram of a computer system suitable for implementing the above-described method, according to an embodiment of the present disclosure. The computer system illustrated in FIG. 10 is only one example and should not impose any limitations on the scope of use or functionality of embodiments of the disclosure.
As shown in fig. 10, the computer system 500 includes one or more processors 510 and a computer-readable storage medium 520. The computer system 500 may perform a method according to an embodiment of the disclosure.
The computer readable storage medium is used for storing one or more programs, wherein when the one or more programs are executed by one or more processors, a network device driver module including a kernel layer, a network management module including a Framework layer, and a connection management module including an APP layer are loaded in a system configuration.
And the network equipment driving module of the kernel layer is used for driving the network equipment to receive and send information. The network management module of the Framework layer is used for obtaining the equipment information of the second electronic equipment; and establishing a network connection channel between the first electronic equipment and the second electronic equipment based on the equipment information. The connection management module of the APP layer is used for establishing a negotiation channel, a control channel, a data channel, an input channel and an output channel based on the network connection channel, wherein the negotiation channel, the control channel and the data channel are bidirectional transmission channels; the input channel is a one-way transmission channel for transmitting to the second electronic equipment; the output channel is a unidirectional transmission channel for transmitting to the first electronic device.
When the one or more programs are executed by the one or more processors, a decoding module, an image processing module, an audio processing module and an input event intercepting module including a Framework layer, and a first negotiation module, a first control module and a first data module of an APP layer may be further loaded in the system construction.
In particular, processor 510 may include, for example, a general purpose microprocessor, an instruction set processor and/or related chip set and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), and/or the like. The processor 510 may also include on-board memory for caching purposes. Processor 510 may be a single processing unit or a plurality of processing units for performing different actions of a method flow according to embodiments of the disclosure.
Computer-readable storage media 520, for example, may be non-volatile computer-readable storage media, specific examples including, but not limited to: magnetic storage devices, such as magnetic tape or Hard Disk Drives (HDDs); optical storage devices, such as compact disks (CD-ROMs); a memory, such as a Random Access Memory (RAM) or a flash memory; and so on.
The computer-readable storage medium 520 may include a computer program 521, which computer program 521 may include code/computer-executable instructions that, when executed by the processor 510, cause the processor 510 to perform a method according to an embodiment of the disclosure, or any variation thereof.
The computer program 521 may be configured with, for example, computer program code comprising computer program modules. For example, in an example embodiment, code in computer program 521 may include one or more program modules, including for example 521A, modules 521B, … …. It should be noted that the division and number of modules are not fixed, and those skilled in the art may use suitable program modules or program module combinations according to actual situations, and when these program modules are executed by the processor 510, the processor 510 may execute the method according to the embodiment of the present disclosure or any variation thereof.
According to an embodiment of the present invention, at least one of the above modules may be implemented as a computer program module described with reference to fig. 5, which, when executed by processor 510, may implement the corresponding operations described above.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
While the disclosure has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents. Accordingly, the scope of the present disclosure should not be limited to the above-described embodiments, but should be defined not only by the appended claims, but also by equivalents thereof.
Claims (10)
1. An information processing method comprising:
obtaining device information of a second electronic device;
establishing a network connection channel between the first electronic device and the second electronic device based on the device information; and
creating a negotiation channel, a control channel, a data channel, an input channel, and an output channel based on the network connection channel,
the negotiation channel, the control channel and the data channel are bidirectional transmission channels; the input channel is a one-way transmission channel for transmitting to the second electronic equipment; the output channel is a one-way transmission channel for transmitting to the first electronic device;
wherein the obtaining of the device information of the second electronic device comprises: acquiring equipment information broadcasted by second electronic equipment through a near field communication module, wherein the near field communication module comprises a Bluetooth module or an NFC near field communication module;
the establishing a network connection channel between the first electronic device and the second electronic device based on the device information includes: the network connection channel is a high-speed network connection channel and comprises a WIFI direct connection channel or a local area network connection channel.
2. The method of claim 1, wherein,
the network connecting channel is positioned on a kernel layer;
the input channel and the output channel are positioned in a Framework layer;
the negotiation channel, the control channel and the data channel are located in an APP layer.
3. The method of claim 2, further comprising:
obtaining at least display data from a display screen of the second electronic device through the output channel, so that the first electronic device presents display content corresponding to the display data in a first area of the display screen of the first electronic device based on the display data;
transmitting the input parameters of the input device of the first electronic device for the first area to the second electronic device through the input channel;
performing equipment state interaction with the second electronic equipment through the negotiation channel;
performing control instruction interaction with the second electronic equipment through the control channel; and
and interacting file data with the second electronic equipment through the data channel.
4. The method of claim 1, wherein the obtaining device information of the second electronic device comprises:
and obtaining the device information broadcasted by the second electronic device through the near field communication module.
5. The method of claim 4, wherein the establishing a network connection channel between a first electronic device and the second electronic device based on the device information comprises:
and establishing a network connection channel with the second electronic equipment based on the equipment information.
6. A first electronic device, comprising:
a near field communication module;
a high-speed communication module; and
the control module is used for obtaining the equipment information of the second electronic equipment based on the near field communication module; establishing a network connection channel between the first electronic device and the second electronic device based on the high-speed communication module and the device information; establishing a negotiation channel, a control channel, a data channel, an input channel and an output channel based on the network connection channel, wherein the negotiation channel, the control channel and the data channel are bidirectional transmission channels; the input channel is a one-way transmission channel for transmitting to the second electronic equipment; the output channel is a one-way transmission channel for transmitting to the first electronic device;
the near field communication module comprises a Bluetooth module or an NFC near field communication module, and the network connection channel is a high-speed network connection channel and comprises a WIFI direct connection channel or a local area network connection channel.
7. The apparatus of claim 6, wherein:
the network connecting channel is positioned on a kernel layer;
the input channel and the output channel are positioned in a Framework layer;
the negotiation channel, the control channel and the data channel are located in an APP layer.
8. The device of claim 7, wherein the Framework layer comprises:
the image processing module is used for receiving display data from the second electronic device and performing image rendering on the basis of the display data of the second electronic device and the display data of the first electronic device to obtain a display image, wherein the display image comprises a first area used for presenting display content corresponding to the display data of the second electronic device;
the audio processing module is used for receiving audio data from the second electronic equipment, analyzing and outputting the audio data;
and the input event intercepting module is used for acquiring input parameters of the input equipment of the first electronic equipment aiming at the first area and transmitting the input parameters to the second electronic equipment through the input channel.
9. The device of claim 7, wherein the APP layer comprises:
the negotiation module is used for interacting the equipment state with the second electronic equipment through the negotiation channel;
the control module is used for carrying out interaction of control instructions with the second electronic equipment through the control channel;
and the data module is used for interacting file data with the second electronic equipment through the data channel.
10. A computer system, comprising:
one or more processors;
a computer-readable storage medium for storing one or more programs,
wherein loading in a system build when the one or more programs are executed by the one or more processors comprises:
the network equipment driving module of the kernel layer is used for driving the network equipment to receive and send information;
the network management module of the Framework layer is used for obtaining the equipment information of the second electronic equipment; establishing a network connection channel between the first electronic device and the second electronic device based on the device information;
a connection management module of the APP layer, configured to create a negotiation channel, a control channel, a data channel, an input channel, and an output channel based on the network connection channel, where the negotiation channel, the control channel, and the data channel are bidirectional transmission channels; the input channel is a one-way transmission channel for transmitting to the second electronic equipment; the output channel is a one-way transmission channel for transmitting to the first electronic device;
wherein the obtaining of the device information of the second electronic device comprises: acquiring equipment information broadcasted by second electronic equipment through a near field communication module, wherein the near field communication module comprises a Bluetooth module or an NFC near field communication module;
the establishing a network connection channel between the first electronic device and the second electronic device based on the device information includes: the network connection channel is a high-speed network connection channel and comprises a WIFI direct connection channel or a local area network connection channel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910948746.8A CN110602805B (en) | 2019-09-30 | 2019-09-30 | Information processing method, first electronic device and computer system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910948746.8A CN110602805B (en) | 2019-09-30 | 2019-09-30 | Information processing method, first electronic device and computer system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110602805A CN110602805A (en) | 2019-12-20 |
| CN110602805B true CN110602805B (en) | 2021-06-15 |
Family
ID=68865667
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910948746.8A Active CN110602805B (en) | 2019-09-30 | 2019-09-30 | Information processing method, first electronic device and computer system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110602805B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113157231A (en) * | 2019-09-18 | 2021-07-23 | 华为技术有限公司 | Data transmission method and related equipment |
| CN117492611A (en) * | 2019-12-24 | 2024-02-02 | 华为技术有限公司 | File processing method, electronic equipment, system and storage medium |
| CN111371864A (en) * | 2020-02-26 | 2020-07-03 | 维沃移动通信有限公司 | Data transmission method and electronic equipment |
| CN114115629A (en) * | 2020-08-26 | 2022-03-01 | 华为技术有限公司 | Interface display method and equipment |
| CN114356195B (en) * | 2020-09-28 | 2024-03-26 | 华为技术有限公司 | File transmission method and related equipment |
| CN111629240B (en) | 2020-05-06 | 2021-08-10 | 上海幻电信息科技有限公司 | Multi-screen interactive display method and device |
| CN111818669B (en) * | 2020-06-04 | 2022-09-02 | 青岛海信移动通信技术股份有限公司 | Mobile terminal and data transmission method thereof |
| CN114816294A (en) | 2020-09-02 | 2022-07-29 | 华为技术有限公司 | Display method and device |
| CN112346799A (en) * | 2020-10-14 | 2021-02-09 | 视联动力信息技术股份有限公司 | Terminal control method and device, electronic equipment and storage medium |
| CN112333474B (en) * | 2020-10-28 | 2022-08-02 | 深圳创维－Rgb电子有限公司 | Screen projection method, system, equipment and storage medium |
| CN114845035B (en) * | 2021-01-30 | 2024-04-26 | 华为技术有限公司 | Distributed shooting method, electronic equipment and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101674298A (en) * | 2008-09-11 | 2010-03-17 | 华为技术有限公司 | Method, system and device for transmitting media contents in file mode |
| CN101674308A (en) * | 2009-10-13 | 2010-03-17 | 中兴通讯股份有限公司 | Method and device for transmitting packet-switched domain business data |
| WO2013100994A1 (en) * | 2011-12-28 | 2013-07-04 | Intel Corporation | Wireless communication device and method for power-efficient data transfer |
| CN105493621A (en) * | 2014-08-04 | 2016-04-13 | 华为技术有限公司 | Terminal, server, and terminal control method |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103580791A (en) * | 2012-07-31 | 2014-02-12 | 华为技术有限公司 | Method and device for device-to-device communication |
| CN104426858B (en) * | 2013-08-26 | 2018-03-23 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| US10820361B2 (en) * | 2017-05-02 | 2020-10-27 | Samsung Electronics Co., Ltd. | Method and system for application-controlled multiple Wi-Fi connections |
-
2019
- 2019-09-30 CN CN201910948746.8A patent/CN110602805B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101674298A (en) * | 2008-09-11 | 2010-03-17 | 华为技术有限公司 | Method, system and device for transmitting media contents in file mode |
| CN101674308A (en) * | 2009-10-13 | 2010-03-17 | 中兴通讯股份有限公司 | Method and device for transmitting packet-switched domain business data |
| WO2013100994A1 (en) * | 2011-12-28 | 2013-07-04 | Intel Corporation | Wireless communication device and method for power-efficient data transfer |
| CN105493621A (en) * | 2014-08-04 | 2016-04-13 | 华为技术有限公司 | Terminal, server, and terminal control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110602805A (en) | 2019-12-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110602805B (en) | Information processing method, first electronic device and computer system | |
| WO2020147665A1 (en) | File processing method and device, terminal, and storage medium | |
| KR102350329B1 (en) | Real-time sharing during a phone call | |
| US11902286B2 (en) | Dynamic control of playlists | |
| CN110618970A (en) | File transmission method and electronic equipment | |
| US10725972B2 (en) | Continuous and concurrent device experience in a multi-device ecosystem | |
| JP5681191B2 (en) | Method and apparatus for providing an application interface on a computer peripheral | |
| US20170185373A1 (en) | User terminal device, and mode conversion method and sound system for controlling volume of speaker thereof | |
| JP2023529868A (en) | SHARING METHODS, DEVICES AND ELECTRONICS | |
| US10313426B2 (en) | Method of managing control right, client device therefor, and master device therefor | |
| CN110597474A (en) | Information processing method and electronic equipment | |
| US20150067536A1 (en) | Gesture-based Content Sharing Between Devices | |
| CN110618971B (en) | Information interaction method and electronic equipment | |
| US20240089529A1 (en) | Content collaboration method and electronic device | |
| US20200162876A1 (en) | Copy and Paste Between Devices | |
| US20130028132A1 (en) | Method and electronic device for communication traffic management | |
| EP2963935A1 (en) | Multi screen display controlled by a plurality of remote controls | |
| KR20150137911A (en) | user terminal apparatus, communication system and control method thereof | |
| WO2022135156A1 (en) | Distributed cross-device collaboration method, and electronic device and communication system | |
| US20230259250A1 (en) | Control method and apparatus, and electronic device | |
| WO2020220777A1 (en) | Method for pushing information, device, equipment, and medium | |
| US10666787B2 (en) | Electronic device and method of executing application | |
| US20150326705A1 (en) | Mobile Device Data Transfer Using Location Information | |
| KR20150127505A (en) | Device and method for managing application test | |
| WO2023221791A1 (en) | Chat channel display method and apparatus, device, readable storage medium, and product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |