CN115878191A

CN115878191A - Equipment hot plug method and terminal equipment

Info

Publication number: CN115878191A
Application number: CN202110901795.3A
Authority: CN
Inventors: 李毅
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-08-06
Filing date: 2021-08-06
Publication date: 2023-03-31
Also published as: WO2023011216A1

Abstract

A device hot plug method and a terminal device are provided, the method comprises: the real device is connected to the terminal device in a wireless connection or wired connection mode, the Windows system of the terminal device can receive the virtual device information sent by the application, and then the corresponding real device information is found based on the mapping relation between the real device information and the virtual device information, so that the real device is called, and communication connection is established. Moreover, when the real equipment connected with the terminal equipment is hot-plugged, the mapping relation can be updated in real time, normal calling of the real equipment side is guaranteed, and user experience can be improved.

Description

Equipment hot plug method and terminal equipment

Technical Field

The application relates to the technical field of terminals, in particular to a device hot plug method and terminal equipment.

Background

Various brands of simulators exist on the market today, for example, lightning, night spirit, mumu simulators are android simulators. The android simulator is software which enables a user to run and simulate an android operating system in a personal computer except a native computer system, and can install, use and uninstall android applications. For example, a camera application, a music application, etc. may be installed on the android simulator, but if a camera, a microphone, a speaker, etc. need to be used on the simulator, a camera, a microphone, a speaker, etc. that is configured in advance on the personal computer or is externally connected to the user is needed.

At present, when an android simulator is started, the simulator can acquire external device information on a personal computer in an initial state, however, if an external device is newly added or pulled out of the personal computer in the using process of the simulator, the simulator cannot update the external device information acquired in the initial state. That is, if an external device is newly added or removed from the personal computer, the application on the simulator may not be normally used. For example, a camera device is externally connected to a personal computer in an initial state, and in the using process of the simulator, a user unplugs the externally connected camera device, which can result in that the camera application in the simulator cannot be normally used, for example, the user opens the camera application, cannot acquire an image or cannot switch a front camera and a rear camera, and the like, so that the user experience is not good.

Disclosure of Invention

The application provides a device hot plug method and terminal equipment, which are used for realizing hot plug of multiple devices and improving user experience.

In a first aspect, the present application provides a device hot plug method, which may be applied to a terminal device equipped with a Windows system, where the terminal device is externally connected to a first real device. The method comprises the following steps: the Windows system of the terminal equipment receives a first virtual equipment identifier sent by a first application, then determines a first real equipment identifier corresponding to the first virtual equipment identifier based on the first virtual equipment identifier, and finally, the Windows system of the terminal equipment can acquire data collected by the first real equipment corresponding to the first real equipment identifier and sends the data collected by the first real equipment to the first application.

Through the technical scheme, the Windows system of the terminal equipment can determine the real equipment identification corresponding to the virtual equipment identification based on the virtual equipment identification, so that when the external equipment is changed, the Windows system can update the information of the external equipment, the real equipment can be normally called when the application in the simulator is used, the normal use of the application is ensured, and the user experience can be improved. And hot plug of multiple devices can be realized.

In one possible design, the determining, by the Windows system of the terminal device, a first real device identifier corresponding to the first virtual device identifier includes: and the Windows system of the terminal equipment determines a first real equipment identifier corresponding to the first virtual equipment identifier according to a first mapping relation, wherein the first mapping relation comprises the corresponding relation between the identifier of the first real equipment connected with the terminal equipment and the identifier of the configured virtual equipment.

Through the technical scheme, the Windows system of the terminal equipment can determine the real equipment identifier corresponding to the virtual equipment identifier based on the mapping relation between the virtual equipment and the real equipment, so that the real equipment corresponding to the real equipment identifier is called, and communication connection is established.

In a possible design, the device connected to the terminal device further includes a second real device, and the first real device and the second real device are devices of the same type.

When the first real device is unplugged, the method further comprises: the Windows system of the terminal equipment determines a second real equipment identifier corresponding to the first virtual equipment identifier according to a second mapping relation, wherein the second mapping relation comprises the corresponding relation between the identifier of the second real equipment connected with the terminal equipment and the identifier of the configured virtual equipment; and the Windows system of the terminal equipment acquires the data acquired by the second real equipment corresponding to the second real equipment identification and sends the data acquired by the second real equipment to the first application.

Through the technical scheme, the mapping relation between the virtual equipment and the real equipment can be updated along with the change of the external equipment. For example, when the external devices connected to the terminal device include external devices of the same type, such as a first real device and a second real device, if the first real device is pulled out, the mapping relationship may be updated, that is, the mapping relationship between the first real device and the corresponding virtual device is deleted. Or when the first real device is pulled out and an external device of the same type, such as a second real device, is newly inserted, the mapping relationship can be updated, so that the corresponding real device can be found according to the updated mapping relationship, and the real device can be normally called.

In one possible design, the method further includes: the Windows system of the terminal equipment receives the second virtual equipment identification sent by the first application; the Windows system of the terminal equipment determines a first real equipment identifier corresponding to a second virtual equipment identifier; and the Windows system of the terminal equipment acquires the data acquired by the first real equipment corresponding to the first real equipment identification and sends the data acquired by the first real equipment to the first application.

By the technical scheme, when only one external real device of the same type is provided, the same real device can correspond to a plurality of virtual devices, namely, the same real device identifier can be found out through different virtual device identifiers. For example, when the external real device is a camera, the virtual device identifiers of the front camera and the rear camera are different, but the external real camera can be used as the front camera and can also be used as the rear camera.

In a possible design, when the device to which the terminal device is connected further includes a second real device, and the first real device and the second real device are devices of the same type, the method further includes: the Windows system of the terminal equipment receives the second virtual equipment identification sent by the first application; the Windows system of the terminal equipment determines a second real equipment identifier corresponding to the second virtual equipment identifier; and the Windows system of the terminal equipment acquires the data acquired by the second real equipment corresponding to the second real equipment identification and sends the data acquired by the second real equipment to the first application.

Through the technical scheme, when the same type of equipment in the external real equipment of the terminal equipment comprises at least two pieces of equipment, one piece of real equipment can correspond to one piece of virtual equipment. That is, the Windows system of the terminal device can find the first real device identifier according to the first virtual device identifier, and can find the second real device identifier according to the second virtual device identifier. For example, when there are two external cameras, one camera may be called as a front camera, and the other camera may be called as a rear camera. Of course, there may be a case where one real device corresponds to multiple virtual devices, which is not limited in this application.

In one possible design, the first real device comprises at least one of the following devices: camera, microphone, speaker.

Through the technical scheme, the terminal equipment can be connected with equipment such as a camera, a microphone, a loudspeaker and the like, so that the normal use of the application under the simulator of the terminal equipment is ensured.

In one possible design, the first real device is a device connected to the terminal device by a wired connection or a wireless connection.

Through the technical scheme, the external real equipment can be connected with the terminal equipment in a wireless or wired mode, so that communication connection is established between the real equipment and the terminal equipment.

In one possible design, the first real device is a device connected to a terminal device different from the terminal device by a wired connection or a wireless connection.

Through the technical scheme, the external real equipment on the terminal equipment can be external equipment on other terminal equipment. That is, the external real device can be connected to at least one terminal device at the same time.

In one possible design, the wired connection includes a Universal Serial Bus (USB) line and a patch cord, and the wireless connection includes wireless fidelity (Wi-Fi), bluetooth, ultra Wide Band (UWB) and Near Field Communication (NFC).

In one possible design, the first application is any one of applications under an android simulator hosted system.

In this embodiment of the application, the simulator on the terminal device may be an android simulator, and the first application may be an android application under the android simulator, for example, the first application may be a camera application, a video application, a music application, and the like.

In one possible design, the first virtual device identification is pre-stored in the android system.

Through the technical scheme, the Windows system of the terminal equipment can acquire the real equipment identifier connected with the Windows system, then configures the virtual equipment identifier based on the real equipment identifier, and sends the virtual equipment identifier to the android system. After the android system receives the virtual equipment identifier, the virtual equipment identifier can be stored, so that the virtual equipment identifier can be found when the application under the simulator calls the external equipment.

In one possible design, the method further includes: and displaying the data collected by the first real equipment.

Through the technical scheme, after the Windows system of the terminal equipment sends the data acquired by the first real equipment to the first application, the data acquired by the first real equipment can be displayed on the application interface of the first application. For example, when the real device is a camera, an image (or picture) captured by the camera may be displayed on an application interface of the camera for a user to view.

In a second aspect, the present application provides a terminal device, which includes a display screen; one or more processors; one or more memories; one or more sensors; a plurality of applications; and one or more computer programs; wherein the one or more computer programs are stored in the one or more memories, the one or more computer programs comprising instructions which, when executed by the one or more processors, cause the terminal device to perform the method of the first aspect described above and any possible design of the first aspect.

In a third aspect, the present application further provides a terminal device, which includes a module/unit for performing the method of the first aspect or any one of the possible designs of the first aspect; these modules/units may be implemented by hardware or by hardware executing corresponding software.

In a fourth aspect, the present application further provides a computer-readable storage medium, in which instructions are stored, and when the instructions are executed on a terminal device, the instructions cause the terminal device to execute the method according to the first aspect and any one of the possible designs of the first aspect.

In a fifth aspect, a computer program product according to an embodiment of the present application is configured to, when the computer program product runs on a terminal device, enable the terminal device to execute the method according to any one of the first aspect and the possible design of the first aspect of the embodiment of the present application.

For each of the second aspect to the fifth aspect and possible technical effects of each aspect, please refer to the above description of the possible technical effects of each possible solution in the first aspect, and no repeated description is given here.

Drawings

Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application;

fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 3A is a block diagram of a terminal device according to an embodiment of the present disclosure;

fig. 3B is a schematic flowchart of a device hot plug method according to an embodiment of the present disclosure;

fig. 4A is a schematic flowchart of hot plug of a device according to an embodiment of the present disclosure;

fig. 4B is a schematic flowchart of a hot plug process of a camera device according to an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of a user interface provided by an embodiment of the present application;

fig. 6 is a flowchart of a method for hot plug of a device according to an embodiment of the present disclosure;

FIG. 7 is a flowchart of another device hot plug method according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of another electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described in detail below with reference to the drawings in the following embodiments of the present application.

First, concepts related to embodiments of the present application will be explained.

1) A simulator: the software is a simulator which can enable a user to run and simulate other operating systems in addition to a native computer system on a personal computer, and can install, use and uninstall other operating system applications. For example, an android simulator is a software that enables a user to run and simulate an android operating system on a personal computer in addition to a native computer system, and to install, use, and uninstall android applications.

2) Hot plugging: refers to devices that allow a user to insert, remove and replace devices, such as cameras, microphones, speakers, etc., connected to a terminal device by wired or wireless connections without shutting down the system and without cutting power. The wired connection mode may be a Universal Serial Bus (USB) line, a patch cord, or the like; the wireless connection may be at least one of wireless fidelity (Wi-Fi), bluetooth, ultra Wide Band (UWB), and Near Field Communication (NFC).

3) Application (APP): application for short, is a software program capable of implementing one or more specific functions. Generally, a plurality of applications can be installed in a terminal device. Such as camera applications, short message applications, mailbox applications, video applications, music applications, weilink, etc. The application mentioned below may be an application installed when the terminal device leaves a factory, or an application downloaded from a network or acquired by another terminal device during the process of using the terminal device.

It should be noted that the device hot plug method provided in the embodiments of the present application may be applied to a terminal device having a display screen, such as a Personal Computer (PC) (e.g., a tablet PC, a notebook PC, an ultra-mobile personal computer (UMPC)), a smart screen, and the like, and the embodiments of the present application are not limited thereto. Also, exemplary embodiments of the terminal device include, but are not limited to, a piggy-back

Hongmeng>

Or other operating system terminal equipment.

First, an application scenario of the embodiment of the present application is described. As shown in fig. 1, a schematic view of an application scenario provided in an embodiment of the present application is shown. Referring to fig. 1, the application scenario may include a terminal device 10, an external real device (which may also be referred to as an external device or a real device), such as a bluetooth speaker 20, a camera 21, a camera 22, a microphone 23, and a speaker 24. It should be understood that fig. 1 only illustrates five external devices, and that more or fewer external devices may be provided in the present application, which is not limited in particular.

The terminal device 10 and the external device may be connected through a USB interface, that is, a connection may be established through a USB cable. Of course, the terminal device 10 may also establish connection with the external device by other means, such as Bluetooth (BT), and the like, which is not limited thereto.

The structure of the terminal device in the application scenario shown in fig. 1 is described below.

As shown in fig. 2, the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a usb interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a Subscriber Identification Module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors. The controller may be a neural center and a command center of the terminal device 100, among others. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution. A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the terminal device 100, and may also be used to transmit data between the terminal device 100 and a peripheral device. The charging management module 140 is configured to receive a charging input from a charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. In some embodiments of the present application, the terminal device 100 may be communicatively connected to the real device through a USB interface or bluetooth.

The wireless communication function of the terminal device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like. The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in terminal device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied on the terminal device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication applied to the terminal device 100, including Wireless Local Area Networks (WLANs) (e.g., wi-Fi networks), bluetooth (BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), NFC, infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves via the antenna 2 to radiate the electromagnetic waves.

In some embodiments, the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150 and the antenna 2 is coupled to the wireless communication module 160 so that the terminal device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), wideband Code Division Multiple Access (WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long Term Evolution (LTE), fifth generation (5G) mobile communication systems, future communication systems such as sixth generation (6G) systems, etc., GNSS, WLAN, NFC, BT, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The display screen 194 is used to display a display interface of an application and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the terminal device 100 may include 1 or N display screens 194, N being a positive integer greater than 1. In an embodiment of the present application, the display screen 194 may be used to display an application interface.

The camera 193 is used to capture still images or video. The cameras 193 may include a front camera and a rear camera.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications of the terminal device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Wherein, the storage program area can store an operating system, software codes of at least one application program (such as an Aichi art application, a WeChat application, etc.), and the like. The storage data area may store data (e.g., images, videos, etc.) generated during use of the terminal device 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as pictures, videos, and the like are saved in an external memory card.

The terminal device 100 may implement an audio function through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playing, recording, etc.

The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The terminal device 100 may receive a key input, and generate a key signal input related to user setting and function control of the terminal device 100. The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc. The SIM card interface 195 is used to connect a SIM card. The SIM card can be attached to and detached from the terminal device 100 by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195.

It is to be understood that the components shown in fig. 2 do not constitute a specific limitation to the terminal device 100, and the handset may include more or less components than those shown, or combine some components, or split some components, or arrange different components. In the following embodiments, the terminal device 100 shown in fig. 2 is taken as an example for description.

Fig. 3A is a block diagram illustrating a terminal device 100 according to an embodiment of the present disclosure. Illustratively, as shown in fig. 3A, the terminal device 100 may be an electronic device that mounts a Windows system under which a plurality of application programs, such as a simulator application (simulator. Exe), may be installed. The simulator application may be an application that carries an Android (Android) system, and the Android system may include a plurality of Android applications, such as a camera application, a music application, a huachen video application, and the like.

The terminal device takes a notebook computer as an example, in the embodiment of the application, when a user connects a real device to the notebook computer externally, the same number of virtual devices can be generated on the android simulator, and then a mapping relation between the virtual devices and the external device is established. Therefore, when the virtual equipment on the simulator is called, the external real equipment can be called according to the mapping relation, so that communication can be established with the real equipment, and the hot plug function of the simulator for supporting the equipment is realized. It will be appreciated that the real plant may be as described above: and the devices connected to the terminal equipment by means of wired connection or wireless connection, such as cameras, microphones, speakers and the like.

For example, referring to fig. 3B, it is assumed that the terminal device is externally connected with N (where N is a positive integer greater than or equal to 1) real devices, and the Windows system may obtain information of the externally connected real devices. When the simulator is started, the simulator can send an initialization request message to the Windows system, and after the Windows system receives the initialization request message, the information of the external real equipment can be converted into the virtual equipment information, namely, the mapping relation between the real equipment information and the virtual equipment information is established, and the virtual equipment information is sent to the Android system. When the user uses the camera application, the camera needs to be called, at the moment, the camera application can acquire the virtual equipment information from the Android system and send the virtual equipment information to the Windows system, and then the Windows system finds the corresponding real equipment information according to the mapping relation. Taking the camera device as an example, when the simulator is started, the simulator may send an initialization request message to the Windows system to initialize the Android camera. The initialization request message may include virtual camera information, such as a resolution of the virtual camera. For example, in this embodiment of the present application, the initialization request message may include three resolutions supported by the camera, 1:1 (720 × 720), 4 (960 × 720), 16. It should be understood that the above-mentioned resolution is only an illustration, and the external real camera does not necessarily support the above-mentioned three resolutions completely, and may support only one of the three resolutions, which is not limited in this application.

Fig. 4A is an interaction diagram illustrating a device hot plug method according to an embodiment of the present application. As shown in fig. 4A, the terminal device 100 is an electronic device equipped with a Windows system, under which a simulator application may be installed, and the simulator is an application equipped with an Android system. Also, the terminal device 100 may be externally connected with at least one real device. For example, referring to (a) in fig. 4A, when the simulator is started, the simulator may send an initialization request message to the Windows system, and after the Windows system receives the initialization request message, the Windows system may convert the information of the external real device into virtual device information, and construct a mapping relationship between the information of the real device and the virtual device information, for example, the mapping relationship between the virtual device and the real device on the Windows side may be established according to the name of the real device. Then, the Windows system may send the virtual device information to the Android system, and the Android system may store the virtual device information after receiving the virtual device information.

Referring to fig. 4A (b), a Real Device (Real Device) is externally connected to the Windows side, and a user may perform a hot plug (Device Plugging) of the Real Device, such as adding or deleting the Device. For example, if a user connects a new external device on the Windows side, that is, adds a new real device, the Windows side may update the mapping relationship through hot plug of the device. Referring to (c) in fig. 4A, the Windows side performs a corresponding operation by responding to a device operation instruction of the user to the real device. The device operation of the real device may include connection (Connect), disconnection (Disconnect), and the like of the device.

As shown in fig. 4B, taking a Camera as an example to continuously introduce an interaction diagram of a hot plug method of a device, referring to (a) in fig. 4B, when the simulator is started, the simulator may send an initialization request message to the Windows system, and after the Windows system receives the initialization request message, the Windows system may configure Virtual Camera information (Virtual Camera Info) according to external real Camera information, and establish a mapping relationship between the Virtual Camera information and the real Camera information. Then, the Windows system may send virtual camera information, such as a Name of the virtual camera (Name), an orientation of the virtual camera (Direction), a resolution of the virtual camera (Frame), and an identification of the virtual camera (ID), to the Android system. After the Android system receives the virtual camera information, the virtual camera information can be stored.

Referring to (B) in fig. 4B, when the user inserts or extracts the external real camera device from the terminal device, that is, when the camera device is hot-plugged, the mapping relationship may be updated accordingly, so as to ensure that the Android can map to the real camera when calling the virtual camera, thereby ensuring normal use of the camera. Referring to (c) in fig. 4B, the Windows system may respond to a device operation command received by an external real camera device to perform a corresponding operation. Wherein, the device operation of the external real camera device can include: a connection (Connect) of the camera, an image capture Start (Start), a resolution (Frame) of the camera, an image capture Stop (Stop), a disconnection (Disconnect) operation of the camera, and the like. For example, when a user opens a camera application and needs to use a camera, an external real camera device may receive a connection (Connect) instruction of the camera, and then open the camera, and when the user clicks a shooting button, the external real camera device may receive an image capture Start (Start) instruction, start shooting or recording, and the like.

It should be noted that the identifier of the virtual camera is used to identify whether the camera is a front camera or a rear camera, for example, when the identifier of the virtual camera is a, the virtual camera can be considered as the front camera; when the identification of the virtual camera is B, the virtual camera can be considered as a rear camera. Or, the identifier of the virtual camera may be used to identify whether the camera is a camera preset on the terminal device when the camera leaves the factory or an external camera, for example, when the identifier of the virtual camera is a, the virtual camera may be considered as a camera preset on the terminal device when the virtual camera leaves the factory; when the identification of the virtual camera is B, the virtual camera can be considered as an external camera.

The following embodiments are described by taking an application in the architecture shown in the terminal device 100 shown in fig. 2 as an example.

Furthermore, the embodiments described below relate to at least one, including one or more; wherein a plurality means greater than or equal to two. In addition, it should be understood that, in the description of the present application, the words "first", "second", etc. are used only for the purpose of distinguishing the description.

Taking a notebook computer as an example, the notebook computer may be a device equipped with a Windows system, and a simulator application (hereinafter referred to as a simulator) may be installed on the notebook computer equipped with the Windows system. Assuming that the simulator is an android simulator, an android application, such as a camera application, a music application, a Huanyi video application, etc., can be installed in the android simulator. For example, referring to fig. 5, assuming that a notebook computer displays an interface 500, the interface 500 may include at least one application icon, such as a simulator application icon 501, a camera application icon 502, a music application icon 503, and a huazi video application icon 504. The camera application, the music application and the Huawei video application are android applications installed in an android simulator, namely the simulator places the application icons on a Windows desktop after the applications are installed. Of course, the interface 500 may further include a task bar 505, etc., which is not limited in this application. After the user clicks the simulator application icon 501 in the interface 500, the notebook computer may display the interface 510. The interface 510 may include a desktop window 511 of an android system installed in a simulator, and the desktop window 511 may include application icons of android applications, such as a camera application icon 502, a music application icon 503, and a huazi video application icon 504.

In some embodiments, before the android simulator is started, at least one device, such as two camera devices or one camera device and one audio device, may be externally connected to the notebook computer. When the simulator is started, the simulator can send an initialization request message to the Windows system, and after the Windows system receives the initialization request message, the Windows system can convert the real device information (such as a real device list) into the virtual device information (such as a virtual device list) and construct a mapping relationship between the virtual device information and the real device information. Then, the Windows system can send the virtual device information to the Android system, and the Android system can store the virtual device information, so that when the corresponding device is called, the corresponding virtual device can be found in the Android system, and then the corresponding real device can be found according to the mapping relation, so that the real device can be successfully called, and the application program on the simulator can be normally used. That is to say, in the embodiment of the present application, the mapping relationship is used for the Windows system to determine, according to the virtual device information, the real device information corresponding to the virtual device information.

The mapping relationship between the virtual device and the real device may be a one-to-one relationship. I.e. each virtual device may correspond to a real device. Specifically, the virtual device may be mapped to a device identification (display name) of the real device by the device identification (display name). That is, the same device identifier (display name) may correspond to a virtual device identifier (fake name) and a real device identifier (real name). Taking a camera device as an example, the device identifier of the camera device may be camera (), the virtual camera device identifier may be fake camera (), and the real camera device identifier may be real camera (). For example, the display name is camera1, the virtual camera device identifier is fake camera1, and the real camera device identifier is real camera2, when the fake camera1 is called, the corresponding display name, namely, camera1, can be found according to the fake camera1, and then the real camera identifier, namely, real camera2, corresponding to the camera1 can be found in the real device identifier according to the display name, so as to call the real camera.

For example, the mapping relationship between the real device and the virtual device can be referred to as table 1 below.

TABLE 1

External equipment	Virtual appliance
		Camera1	Virtual camera1
Camera2	Virtual camera2
		Audio device
1	Virtual audio device 1

It should be understood that the above table 1 is only an illustrative illustration, and 1 and 2 can be understood as the identification information of the device, that is, the mapping relationship between the real device and the virtual device can be established through the identification information.

In other embodiments, the mapping relationship may be updated in real time according to the insertion and extraction of the external real device. For example, the camera1 in the external real device is pulled out from the notebook computer, and a new camera 3 is inserted, so that the mapping relationship between the camera1 and the virtual camera1 can be deleted, and a new mapping relationship can be established, for example, the mapping relationship between the camera 3 and the virtual camera 1. Or when the camera1 in the external real equipment is pulled out and the external real equipment only remains the camera2 and the audio equipment 1, the camera2 can be mapped to the virtual camera1 and the virtual camera2 simultaneously. Or on the basis of the table 1, if a camera 3 is newly inserted, a mapping relationship between the camera 3 and the virtual camera 3 can be newly added on the basis of the table.

The hot plug method of the device according to the embodiment of the present application is described below with reference to the foregoing scenarios.

Referring to fig. 6, a flowchart of a method for hot plug of a device according to an embodiment of the present application is shown, where the method may include the following steps:

s601: a first application in the simulator responds to a first operation of a user and searches for first virtual equipment information.

For convenience of description, the android application within the simulator may be denoted as a "first application," e.g., the first application may be a camera application. The first operation may be an operation of opening the first application, for example, the first operation may be an operation of clicking an application icon of the first application by a user, or may also be an operation of opening the first application in a voice-triggered manner by the user, which is not limited in this application. Illustratively, the first operation may be a click operation of the camera application icon 502 by the user on the interface 500 or the interface 510 shown in fig. 5. Of course, the first operation may also be a click operation of a button by a user on an application interface of the first application, for example, the first operation may be a click operation of a front-facing camera button before and after switching.

In some embodiments, after a user clicks an application icon of an android application under the android system hosted by the simulator, such as an application icon of a camera application, the simulator may send a notification message to the android system to notify the android system of which application is to be launched. Accordingly, after receiving the notification message, the android system can launch the camera application. And send a feedback message to the simulator after launching the application to inform the simulator that the android application has been opened.

Based on the introduction of the application scenario, after the laptop with the Windows system is connected with the external device, the Android system can store the corresponding virtual device information, so that the virtual device information can be searched in the Android system when the corresponding device needs to be called. For example, when a user opens a camera application, that is, needs to call a camera, the user needs to search for virtual camera information in the Android system.

In this embodiment, the first virtual device information may include information of at least one virtual device, that is, the first virtual device may include at least one virtual device. For example, when a notebook computer is externally connected with a camera, the front and rear cameras of the camera can be mapped through one camera. An external camera can be simultaneously used as a front camera and a rear camera, and the first virtual equipment is virtual equipment at the moment. For example, when the notebook computer is externally connected with two cameras, the front and rear cameras of the camera can be mapped through one camera respectively, namely one camera is used as the front camera, the other camera is used as the rear camera, and at the moment, the first virtual device is two virtual devices.

Further, the first virtual device information may include attribute information of the virtual device, such as identification, resolution, and the like.

S602: a first application within the simulator sends first virtual device information to the Windows system.

In some embodiments, after the first application finds the first virtual device information from the Android system, the first virtual device information may be sent to the Windows system, so that the Windows system can find corresponding real device information according to the first virtual device information.

For example, the first application may send the attribute information of the first virtual device to the Windows system, so that the Windows system can find the corresponding real device information according to the attribute information of the first virtual device. For example, the first application may send device identification (display name) information of the first virtual device to the Windows system.

S603: and the Windows system determines corresponding first real equipment information according to the first virtual equipment information.

In the embodiment of the application, the Windows system may match the first real device information corresponding to the first virtual device information according to the mapping relationship between the virtual device and the real device. For example, assuming that the first virtual device information is a virtual camera1 and a virtual camera2, the mapping relationship according to table 1 may be obtained as follows: the first real device information may be the camera1 and the camera2. It should be understood that the first virtual device and the first real device are the same type of device, and the number of the first virtual device and the number of the first real device may be the same or different, and this is not specifically limited in this application.

For example, assume that the virtual device information found in S601 is: the identification information of the virtual camera device is fake camera1, and the device identifier display name corresponding to the virtual camera device is camera1, then the virtual device information sent to the Windows system in S602 may be display name, and then the Windows system finds the real camera identifier corresponding to camera1, such as real camera2, in the real device identifier according to the display name.

Because the mapping relation is updated along with the insertion and extraction of the equipment, namely the mapping relation can be updated in real time by monitoring the plugging and extraction of the external equipment in real time, normal communication can still be realized when different external equipment of the same type are switched, the hot plugging and extraction of multiple devices of the same type can be realized, and the user experience can be improved.

S604: the Windows system acquires data acquired by the first real device.

After the Windows system determines the information of the first real device according to the mapping relationship, the Windows system may acquire the data acquired by the first real device. For example, when the external real device is a camera, the Windows system can establish connection with the real camera after determining the real camera corresponding to the virtual camera according to the mapping relationship, call the camera driver of the real camera externally connected to the Windows side to take a picture, and then acquire the image acquired by the real camera. When the external real equipment is a microphone/loudspeaker, the Windows system can call the audio driver of the external real equipment to acquire audio data, and then acquire the audio data acquired by the real equipment.

S605: and the Windows system sends the data collected by the first real equipment to the first application.

In some embodiments, the Windows system may call the real device to collect data, and then feed back the data collected by the real device to the first application, so that the first application can be used normally. For example, the Windows system may call a real camera to acquire an image, and then feed back the image acquired by the real camera to the camera application, so that the user sees the image acquired by the real camera on an interface of the camera application.

Optionally, after S605, the following steps may be further included:

s606: and displaying the data collected by the first real equipment.

For example, when the real device is a camera, the Windows system may call the real camera to capture an image, and then send the captured image to the camera application, where the image captured by the real camera may be displayed on a display interface of the camera application. For example, the real camera supports a resolution of 4 (960 × 720), and then an image with a resolution of 4.

Of course, the data collected by the real device is not necessarily displayed on the display interface of the application, for example, when the real device is a microphone, the data collected by the microphone is audio data, and at this time, the audio data may be played through a speaker and may not be displayed on the application interface.

Through the technical scheme, the device hot plug of the simulator can be realized, so that a user can normally use the camera, the microphone and the like on the simulator, and the user experience can be improved.

It should be noted that the above embodiments can be arbitrarily separated and combined to form a new embodiment, which is not limited in this application. For example, in a possible embodiment, the real device externally connected to the terminal device equipped with the Windows system may also be an external device connected to another device. For example, the terminal device equipped with the Windows system is the terminal device 1, and the real devices connected to the terminal device 1 include the camera1, the camera2, and the speaker 1, where the camera1 may be a camera of a terminal device (for example, the terminal device 2) outside the terminal device 1. That is, the terminal device 1 and the terminal device 2 may be distributed devices, and the terminal device 1 may invoke the local device (camera, speaker, etc.) and the external device (camera, speaker, etc.) of the terminal device 2, where the optional invoking manner is that the terminal device 1 virtualizes the local device and/or the external device of the terminal device 2 into the local device and/or the external device of the terminal device 1. The terminal device 2 may be an android system, a Windows system, or another system, which is not limited in this application.

The method shown in fig. 6 will be described in detail below by taking a camera as an example. Fig. 7 is a flowchart illustrating another hot plug method for a device according to an embodiment of the present disclosure. FIG. 7 may include a two-part flow diagram, with the left flow diagram illustrating how the mapping is created and the right flow diagram illustrating how the mapping is updated when a device hot plug event occurs. First, a process of creating a mapping relationship is introduced: the Windows system may first obtain information about the connected cameras on the terminal device, and determine whether the number of the connected cameras is greater than or equal to two, where the following situations may be included:

case 1: and if the number of the connected camera equipment is more than or equal to two, storing the information of the connected camera equipment.

Case 2: if the number of the connected camera devices is less than two, for example, the number of the connected camera devices is 1, creating a virtual camera device, and storing the created virtual camera device information and the information of the connected camera devices.

Case 3: if the number of the connected camera devices is less than two, for example, the number of the connected camera devices is 0, two virtual camera devices are created, and the created virtual camera device information is stored.

It should be noted that, in the above process, the number of the cameras is distinguished according to whether the number of the cameras is greater than or equal to 2, and in the present application, the number of the cameras may be different according to different application scenarios, for example, the number of the cameras may also be 4, and the present application does not limit this. It should be understood that the virtual camera device created here is used for space-occupying, i.e. to ensure that the number of cameras is at least two. For convenience of understanding, the connected camera device information and/or the created virtual camera device information for occupying may be recorded as the initial camera information. Then, the initial camera information (g _ camera service desc) may be saved in the g _ camera update desc and used as a basis for real device update.

After obtaining the initial camera information, the Windows system may create corresponding virtual camera information based on the initial camera information, and construct a mapping relationship between the initial camera (or the real camera) and the virtual camera.

The following describes how to update the mapping relationship when a device hot plug event occurs. When the device hot plug event is triggered, that is, when the external real device on the terminal device is pulled out or a new device is inserted, the Windows system can acquire the information of the currently connected camera devices, and then update the mapping relationship according to the number of the currently connected camera devices. Specifically, the following cases can be classified here:

case 1: if the number of currently connected camera apparatuses is equal to 0, no processing is performed.

Case 2: if the number of the currently connected camera devices is one, the front camera and the rear camera both use the same camera.

Case 3: and if the number of the currently connected camera devices is two, continuously judging whether the currently connected camera devices have the same device connection, and if so, updating another device except the same device. For example, suppose that two camera devices, namely, the camera device 1 and the camera device 2, are connected to the terminal device, if a user pulls out one camera device, such as the camera device 1, from the terminal device and newly inserts one camera device (for example, the camera device 3), the camera device 2 is the same device at this time, and the different device is the camera device 3, so that only the mapping relationship between the newly-accessed camera device (i.e., the camera device 3) and the virtual camera device needs to be established.

That is, as the real camera device is updated, the mapping relationship may be updated accordingly. Thus, the Windows system can search the real camera information corresponding to the virtual camera information according to the mapping relation which is updated continuously. Specifically, a device identifier (display name) in the virtual device information may be mapped to real device information that is continuously updated, and the same device identifier (display name) may correspond to one real device and one virtual device. Therefore, the Windows system may map the device identifier (display name) in the virtual device information to the real device having the same device identifier in the continuously updated real device information, thereby finding the real device corresponding to the virtual device.

According to the method, the Android is prevented from being repeatedly initialized by detecting the real-time update of the hot plug of the equipment, the hot plug of multiple equipment in the same product is realized, and the real-time switching of the multiple equipment can be realized. For example, if the connected camera is unplugged, a new camera device is plugged in, the camera is opened, the newly plugged camera can be smoothly called to collect pictures, normal use of the camera application is guaranteed, and user experience can be improved.

It should be understood that the foregoing embodiments are only described by taking a camera as an example, and when a plurality of audio (microphone and speaker) devices are accessed on the Windows side, a designated device may be selected as an input/output device on the Android side, which is not limited in this application.

In the embodiments provided in the present application, the method provided in the embodiments of the present application is described from the perspective of an electronic device as an execution subject. In order to implement the functions in the method provided by the embodiments of the present application, the electronic device may include a hardware structure and/or a software module, and the functions are implemented in the form of a hardware structure, a software module, or a hardware structure and a software module. Whether any of the above functions is implemented as a hardware structure, a software module, or a combination of a hardware structure and a software module depends upon the particular application and design constraints imposed on the technical solution.

As shown in fig. 8, other embodiments of the present application disclose a terminal device, which may be an electronic device having a display screen. Referring to fig. 8, the terminal apparatus 800 includes: a display screen 801; one or more processors 802; one or more memories 803; one or more sensors 804 (not shown), a plurality of applications 805 (not shown); and one or more computer programs 806 (not shown), which may be connected via one or more communication buses 807.

The display screen 801 is used for displaying a display interface of an application in the electronic device. One or more computer programs, including instructions, are stored in the memory 803; the processor 802 invokes the instructions stored in the memory 803 so that the terminal device 800 can perform the device hot plug method of the above-described embodiment.

In the embodiments of the present application, the processor 802 may be a general-purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and may implement or execute the methods, steps, and logic blocks disclosed in the embodiments of the present application. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of a method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in a processor. Software modules may be located in the memory 803 and the processor 802 reads the program instructions from the memory 803 and performs the steps of the method described above in conjunction with its hardware.

In the embodiment of the present application, the memory 803 may be a non-volatile memory, such as a Hard Disk Drive (HDD) or a solid-state drive (SSD), and may also be a volatile memory (RAM). The memory can also be, but is not limited to, any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory in the embodiments of the present application may also be a circuit or any other device capable of performing a storage function to store instructions and/or data.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

Based on the above embodiments, the present application also provides a computer storage medium, in which a computer program is stored, and when the computer program is executed by a computer, the computer causes the computer to execute the method provided by the above embodiments.

Also provided in an embodiment of the present application is a computer program product including instructions that, when executed on a computer, cause the computer to perform the method provided in the above embodiment.

Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by instructions. These instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

Claims

1. A device hot plug method is applied to terminal devices loaded with Windows systems, the devices connected with the terminal devices comprise first real devices, and the method is characterized by comprising the following steps:

a Windows system of the terminal equipment receives a first virtual equipment identifier sent by a first application;

the Windows system of the terminal equipment determines a first real equipment identifier corresponding to the first virtual equipment identifier;

and the Windows system of the terminal equipment acquires the data acquired by the first real equipment corresponding to the first real equipment identification and sends the data acquired by the first real equipment to the first application.

2. The method of claim 1, wherein determining, by the Windows system of the terminal device, a first real device identification corresponding to the first virtual device identification comprises:

and the Windows system of the terminal equipment determines a first real equipment identifier corresponding to the first virtual equipment identifier according to a first mapping relation, wherein the first mapping relation comprises the corresponding relation between the identifier of the first real equipment connected with the terminal equipment and the identifier of the configured virtual equipment.

3. The method of claim 1 or 2, wherein the terminal device connected devices further comprise a second real device, and the first real device and the second real device are the same type of device;

when the first real device is unplugged, the method further comprises:

the Windows system of the terminal equipment determines a second real equipment identifier corresponding to the first virtual equipment identifier according to a second mapping relation, wherein the second mapping relation comprises the corresponding relation between the identifier of the second real equipment connected with the terminal equipment and the identifier of the configured virtual equipment;

and the Windows system of the terminal equipment acquires the data acquired by the second real equipment corresponding to the second real equipment identification and sends the data acquired by the second real equipment to the first application.

4. The method of claim 1 or 2, wherein the method further comprises:

the Windows system of the terminal equipment receives a second virtual equipment identifier sent by a first application;

the Windows system of the terminal equipment determines a first real equipment identifier corresponding to the second virtual equipment identifier;

5. The method according to claim 1 or 2, wherein the terminal device connected device further comprises a second real device, and when the first real device and the second real device are the same type of device, the method further comprises:

the Windows system of the terminal equipment determines a second real equipment identifier corresponding to the second virtual equipment identifier;

6. The method of any one of claims 1-5, wherein the first real device comprises at least one of: camera, microphone, speaker.

7. The method according to any of claims 1-6, wherein the first real device is a device connected to the terminal device by means of a wired connection or a wireless connection.

8. The method according to any of claims 1-6, characterized in that the first real device is a device connected to a terminal device different from the terminal device by means of a wired or wireless connection.

9. The method of claim 7 or 8, wherein the wired connection comprises a Universal Serial Bus (USB) line, a patch cord, and the wireless connection comprises wireless fidelity (Wi-Fi), bluetooth, ultra wideband wireless communication (UWB), near field wireless communication (NFC).

10. The method of any one of claims 1-9, wherein the first application is any one application under a system hosted by an android simulator.

11. The method of claim 1, in which the first virtual device identification is pre-stored in an android system.

12. The method of claim 1, wherein the method further comprises:

and displaying the data collected by the first real equipment.

13. A terminal device, characterized in that the terminal device comprises a display screen; one or more processors; one or more memories; one or more sensors; a plurality of applications; and one or more computer programs;

wherein the one or more computer programs are stored in the one or more memories, the one or more computer programs comprising instructions which, when executed by the one or more processors, cause the terminal device to perform the method of any of claims 1-12.

14. A computer-readable storage medium having instructions stored thereon, which when run on a terminal device, cause the terminal device to perform the method of any one of claims 1 to 12.

15. A computer program product comprising instructions for causing a terminal device to perform the method according to any one of claims 1 to 12 when the computer program product is run on the terminal device.