WO2022017209A1

WO2022017209A1 - Electronic device and distributed system

Info

Publication number: WO2022017209A1
Application number: PCT/CN2021/105741
Authority: WO
Inventors: 朱欣; 罗育峰; 张文铿
Original assignee: 华为技术有限公司
Priority date: 2020-07-21
Filing date: 2021-07-12
Publication date: 2022-01-27
Also published as: CN114040349B; CN114040349A

Abstract

The present application provides an electronic device and a distributed system. The electronic device comprises: a first body and a second body which are separable, a processor, a microcontroller, and a display screen; the microcontroller and the display screen are provided on the first body, and the processor is provided on the second body; the first body and the second body establish a data connection in a wired or wireless manner; the processor is configured to generate first image data, and send the first image data to the microcontroller; the microcontroller is configured to output the first image data to the display screen for display. Compared with conventional electronic devices, both the first body and the second body abandon use of some devices, so that the size of the body is smaller and the thickness is thinner, it is convenient to hold by a user, and it is also convenient to accommodate a battery having larger capacity. In daily use, the user is only needed to hold the first body to implement common functions of the electronic device, and the second body may be arbitrarily placed in a backpack or pocket instead of being held, thus improving user experience.

Description

An electronic device and distributed system

This application claims the priority of the Chinese patent application filed on July 21, 2020 with the application number 202010704193.4 and the invention title "An Electronic Device and Distributed System", the entire contents of which are incorporated by reference in in this application.

technical field

The present application relates to the field of terminal technologies, and in particular, to an electronic device and a distributed system.

Background technique

With the development of semiconductor technology, wireless data connection technology (wireless communication) and Internet technology, more and more intelligent terminal devices have entered people's lives and have gradually become a necessity in people's lives. In order to realize the above-mentioned various services and functions, the intelligent terminal device is usually equipped with a full-featured chip system, so that the intelligent terminal device has the complete ability to run the application program APP, display the image and interact with the user.

In recent years, in order to improve the user experience and meet the needs of more scenarios, the performance of smart terminal devices has been continuously improved. Taking a mobile phone as an example, its performance improvement is mainly reflected in: using a processor with a more advanced architecture and more transistors to improve computing performance; using a larger sensor size and more camera modules to improve camera performance; Use larger, higher-resolution screens to enhance user perception, etc. However, with the improvement of the performance of intelligent terminal equipment, its power consumption is also getting higher and higher, so intelligent terminal equipment needs to be equipped with a battery with a larger capacity to ensure battery life. It is also heavier, which seriously affects the user experience of the handheld terminal device.

Moreover, with the gradual popularization of the 5th generation mobile networks (5G), the power consumption of terminal devices will be further improved, which brings advantages to the design of terminal devices that take into account factors such as size, weight, battery life and aesthetics. bigger test.

SUMMARY OF THE INVENTION

The embodiments of the present application provide an electronic device and a distributed system, which can reduce the volume and weight of the electronic device, achieve longer battery life, facilitate the user to hold, and improve the user experience.

To achieve the above purpose, the embodiments of the present application provide the following technical solutions:

In a first aspect, an embodiment of the present application provides an electronic device, the electronic device includes: a detachable first body and a second body, a processor, a microcontroller and a display screen; the microcontroller and the display screen The first fuselage is arranged on the first fuselage, and the processor is arranged on the second fuselage; the first fuselage and the second fuselage establish a data connection through a wired or wireless manner; the processor is used to generate the first image data, and send the first image data to the Microcontroller; the microcontroller is used for outputting the first image data to the display screen for display.

According to the electronic device provided by the embodiments of the present application, the first body includes a display screen and a microcontroller, which are mainly used to realize interactive functions such as image display of the electronic device, and the second body includes a processor, which is mainly used to realize the electronic device's image display and other interactive functions. calculation function. Compared with the traditional electronic device, the first body and the second body both have some components reduced, so the body size can be smaller, the thickness can be thinner, and it is more convenient for users to hold. In daily use, users only need to hold the first body to realize common functions of electronic devices, and the second body can be placed in a backpack or pocket without holding, thus improving the user experience. In addition, since the first body and the second body both reduce a part of the components, when the thickness of the first body and the second body is the same as that of the traditional electronic device, a battery with a larger capacity can be accommodated, and the Longer battery life.

In an implementation manner, the first body includes a touch panel, and the touch panel is used to detect the user's touch input on the display screen; the microcontroller is used to send the touch input to the processor; the processor is used to generate the touch input according to the touch input. first image data.

In an implementation manner, the first body includes keys, and the keys are used to detect a user's key input; the microcontroller is used to send the key input to the processor; the processor is used to generate the first image data according to the key input.

In an implementation manner, the first body includes a sensor module; the microcontroller is configured to send sensor data collected by the sensor module to the processor; and the processor is configured to generate the first image data according to the sensor data.

In an implementation manner, the first body includes a camera, and the camera is used to collect the second image data; the microcontroller is used to send the second image data to the display screen for display; the microcontroller is also used to store the second image data After encoding, it is sent to the second fuselage.

In an implementation manner, the first body and the second body further include a wireless communication module; the wireless communication module includes a Bluetooth module and/or a Wi-Fi module; the first body and the second body pass through the Bluetooth module and/or the Wi-Fi module. or Wi-Fi module to establish a data connection.

In an implementation manner, the first body and the second body further include an external interface; when a cable is used to connect the external interfaces of the first body and the second body, the first body and the second body establish Wired data connection.

In an implementation manner, the processor is configured to acquire display screen parameters of the display screen, and the display screen parameters include the resolution and/or refresh rate of the display screen; the processor adjusts the first image data according to the display screen parameters, and the adjustment includes adjusting the The first image data is subjected to at least one of scaling, cropping, frame insertion, and compression; the processor sends the adjusted first image data to the microcontroller.

In an implementation manner, the microcontroller is used for broadcasting a beacon frame, and the beacon frame includes display screen parameters; the processor is used for acquiring display screen parameters from the beacon frame.

In an implementation manner, the processor is configured to send a first request message to the microcontroller; the microcontroller is configured to send display screen parameters to the processor according to the first request message.

In an implementation manner, when the first body and the second body establish a data connection through the Wi-Fi module and the Bluetooth module, if the microcontroller does not acquire the user operation within the first preset time period, the The microcontroller controls the first body to enter a first sleep state, wherein the first sleep state includes that the first body turns off the display screen and locks the screen, and maintains a data connection with the second body through the Wi-Fi module and the Bluetooth module.

In an implementation manner, after the first body enters the first sleep state, if the microcontroller does not acquire a user operation within the second preset time period, the microcontroller controls the first body to enter the second sleep state The second sleep state includes that the first body turns off the display screen and locks the screen, and maintains a data connection with the second body through a Wi-Fi module or a Bluetooth module.

In an implementation manner, after the first body enters the second sleep state, if the microcontroller does not obtain a user operation within a third preset time period, the microcontroller controls the first body to enter the third sleep state state, wherein the third sleep state includes that the first body turns off the display screen and locks the screen, and disconnects the data connection from the second body.

It can be understood that the device sleep method provided by the embodiment of the present application sets three sleep states for the first body according to the length of time that the user does not operate the first body, and gradually disconnects the first body and the second body according to the level. The data connection between the two fuselage not only enables the first fuselage to synchronize data with the second fuselage during short-term sleep, so that the user can use it again, but also enables the second fuselage to disconnect from the second fuselage during long-term sleep. The data connection of the fuselage to save power consumption and prolong battery life.

In an implementation manner, multiple sensors are distributed on both sides of the display screen, and some or all of the multiple sensors are used to detect whether the first body is touched by the user and whether it is picked up by the user; the microcontroller is used for When the first body is touched by the user in the third sleep state, the first body is controlled to establish a data connection with the second body; the processor is configured to obtain a display after the first body and the second body establish a data connection display screen parameters of the screen, and generate the first image data according to the display screen parameters; the microcontroller is used to send a first wake-up message to the processor when the first body is lifted by the user; the processor is used to point to the first wake-up message Turn on the display screen and send the first image data to the microcontroller.

It can be understood that, in the device wake-up method provided by the embodiment of the present application, when the first body detects the user's touch, it starts to interact with the second body to wake up. the image data, so that the first body can wake up quickly when it is detected that the user lifts up, and the user experience is improved.

In a second aspect, an embodiment of the present application provides a distributed system, including: a plurality of first fuselage and a second fuselage as provided in the first aspect and each implementation manner of the embodiment of the present application; a plurality of first fuselage The fuselage and the second fuselage establish a data connection through a wired or wireless manner.

In a third aspect, an embodiment of the present application provides a chip system, where the chip system includes a microcontroller, which is used to support the above-mentioned first body to implement the functions involved in the above-mentioned aspects and implementation manners, such as displaying an image on a display screen data.

In a fourth aspect, an embodiment of the present application provides a chip system, where the chip system includes a processor for supporting the above-mentioned second body to implement the functions involved in the above-mentioned aspects and implementation manners, such as generating image data.

In a fifth aspect, the embodiments of the present application further provide a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium runs on the microcontroller of the first body, the microcontroller enables the microcontroller to implement the above Aspects and functions of the first fuselage involved in their implementation.

In a sixth aspect, the embodiments of the present application further provide a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium runs on the processor of the second fuselage, the processor enables the processor to implement the above aspects and The function of the second fuselage involved in its implementation.

Description of drawings

Fig. 1 is the system structure block diagram of the current intelligent terminal equipment;

FIG. 2 is a schematic diagram of a scenario in which two terminal devices currently share data;

Fig. 3 is a scene diagram of the interaction of multiple terminal devices at present;

4 is a schematic structural diagram of a first fuselage;

5 is a schematic structural diagram of a second fuselage;

6 is a schematic diagram of the physical connection between the first body and the second body;

Fig. 7 is a schematic diagram of the combined use of the first fuselage and the second fuselage in a separated state;

8 is another schematic diagram of the combined use of the first body and the second body in a separated state;

9 is a logical block diagram of data interaction when the first body and the second body are used in combination;

10 is a logical block diagram of data interaction when the first body and the second body are used in combination;

FIG. 11 is a schematic diagram of the thickness of a first body, a second body and a conventional mobile phone;

12 is a schematic diagram of the first body and the second body establishing a wireless data connection through a Wi-Fi link;

13 is a schematic diagram of the second body wirelessly charging the first body;

14 is a schematic diagram of a device form of the first fuselage and the second fuselage;

15 is a schematic diagram of another device form of the first body and the second body;

FIG. 16 is a schematic diagram of another equipment form of the first fuselage and the second fuselage;

FIG. 17 is a schematic diagram of another equipment form of the first fuselage and the second fuselage;

18 is a schematic diagram of a second body displaying a UI image on a display screen of the first body;

19 is a schematic diagram of a usage scenario of the camera and the microphone of the second body;

20 is a schematic diagram of another usage scenario of the camera and the microphone of the second body;

21 is a schematic diagram of the speakers of the first fuselage and the second fuselage playing audio together;

22 is a flowchart of a shooting control method provided by an embodiment of the present application;

23 is a schematic diagram of a scene in which the first fuselage controls the second fuselage to take pictures;

24 is a schematic diagram of multi-focus shooting performed by the second body;

FIG. 25 is a schematic diagram of the outline of a character displayed on the display screen of the first fuselage by the second fuselage;

Figure 26 is a schematic diagram of a distributed system;

Figure 27 is a schematic diagram of a usage scenario of a distributed system;

28 is a flowchart of a device verification method provided by an embodiment of the present application;

Figure 29 is a schematic diagram of another usage scenario of the distributed system;

30 is a flowchart of an image adaptation method provided by an embodiment of the present application;

31 is an example diagram of an image adaptation method provided by an embodiment of the present application;

FIG. 32 is a flowchart of a device dormancy method provided by an embodiment of the present application;

33 is a flowchart of another device sleep method provided by an embodiment of the present application;

FIG. 34 is a flowchart of a device wake-up method provided by an embodiment of the present application;

FIG. 35 is a schematic diagram of sensor distribution of the first fuselage provided by an embodiment of the present application.

detailed description

With the development of semiconductor technology, wireless data connection technology (wireless communication) and Internet technology, more and more intelligent terminal devices have entered people's lives and have gradually become a necessity in people's lives. Common smart terminal devices include, for example, mobile phones, smart TVs, wearable devices (such as smart watches, wristbands), tablet computers, smart TVs, smart screens, smart projectors, smart speakers, and virtual reality (VR) devices , intelligent driving computing platform, etc. A variety of intelligent terminal devices provide users with various services in the fields of learning, entertainment, life, health management, office, and travel. Taking the most widely used mobile phone carried by users as an example, users can use the various services and functions enjoyed by the mobile phone at any time and place, such as making calls, instant data connection, video chat, taking pictures, positioning and navigation, mobile Payment, online shopping, mobile office, multimedia services, etc.

In order to realize the above-mentioned various services and functions, the smart terminal device is usually equipped with a full-featured chip system. The full-featured chip system here means that the smart terminal device can have a complete running application program APP, The ability to display images and interact with the user.

FIG. 1 is a block diagram of the system structure of the current intelligent terminal equipment. Generally speaking, an intelligent terminal device with a full-featured chip system, as shown in Figure 1, needs to include at least the following parts:

A central processing unit (central processing unit, CPU) 101 includes a CPU based on an ARM architecture, a CPU based on an X86 architecture, or a CPU based on a MIPS architecture. The CPU 101 is mainly used to run application programs, execute related program instructions, process data, and the like.

A graphics processor (graphic processing unit, GPU) 102 is used to perform graphics operations to render images that the application or game needs to display on the display screen.

The video codec 103 is used to compress (encode) or decompress (decode) digital videos that support different formats, so as to facilitate storage, playback or transmission in smart terminal devices, wherein the formats of common digital videos such as The standard format of H.264 and H.265 of advanced video coding (AVC) may be included.

The display subsystem (DSS) 104 may include, for example, a display controller (DISPC), etc. The DSS 104 can perform operations such as overlaying and transforming images such as interfaces and status bars of different applications, and finally output to display on the display.

The wireless communication module 105 may include one or more chip devices, such as a baseband processor, a modem, a Wi-Fi chip, a Bluetooth chip, etc., for at least one data connection of a cellular network, Wi-Fi, Bluetooth, etc. of the intelligent terminal device Features. It can be understood that, in order to realize the above-mentioned transmission of the wireless data connection signal, the intelligent terminal device is further provided with corresponding components such as an antenna and a power amplifier.

The peripheral interface 106, for example, may include a mobile industry processor interface (mobile industry processor interface)-display serial interface specification (display serial interface specification) MIPI-DSI interface, a displayport (DP) interface for supporting the display screen to display images, Mobile industry processor interface for supporting cameras - camera serial interface specification (camera serial interface specification) MIPI-CSI interface, serial peripheral interface (SPI) interface for supporting sensors, integrated circuit bus ( inter-integrated circuit, I2C) interface, etc.

In recent years, in order to improve the user experience and meet the needs of more scenarios, the performance of smart terminal devices has been continuously improved. Taking a mobile phone as an example, its performance improvement is mainly reflected in: using a processor with a more advanced architecture and more transistors to improve computing performance; using a larger sensor size and more camera modules to improve camera performance; Use larger, higher-resolution screens to enhance user perception, etc. However, with the improvement of the performance of intelligent terminal equipment, its power consumption is also getting higher and higher, so intelligent terminal equipment needs to be equipped with a battery with a larger capacity to ensure battery life. It is also heavier. For such a device that is mainly operated by a user by hand, the excessive size and excessive weight will greatly affect the user experience.

Moreover, with the gradual popularization of 5th generation mobile networks (5G), more and more smart terminal devices will support 5G networks. To this end, smart terminal equipment requires additional devices such as 5G chips, 5G antennas, and power amplifiers. However, the addition of these devices also brings some new problems. For example: (1) The power consumption of the smart terminal device will be further increased. If the battery life of the smart terminal device is to be guaranteed, a battery with a larger capacity must be used, but it will further increase the size and weight of the smart terminal device and affect the user experience. . (2) The increase in power consumption of intelligent terminal equipment also puts forward higher requirements for the heat dissipation design inside the fuselage. If the heat dissipation capacity of intelligent terminal equipment is not enough to cope with the high power consumption of intelligent terminal equipment, the performance of intelligent terminal equipment will be reduced. will be restricted and affect the user experience. (3) The increase of 5G antennas also brings greater challenges to the antenna design inside the smart terminal equipment. It is required that the antenna design will not increase the volume of the smart terminal equipment excessively, but can also exert the performance of the antenna. Well, it is very likely that the performance and frequency band of the wire will be sacrificed.

In addition, in the current smart terminal equipment, due to consideration of factors such as size, weight, battery life and aesthetics, the size of the camera should not be too large, otherwise it will not only increase the weight of the equipment, but also compress the battery space, limiting the camera performance. further improvement.

In addition, the current smart terminal devices also have deficiencies in some actual usage scenarios. Figures 2 and 3 illustrate two use cases where there are deficiencies.

FIG. 2 is a schematic diagram of a scenario in which two terminal devices currently share data.

As shown in FIG. 2 , it is assumed that the user has two smart terminal devices A and B; on a certain day, the user takes device A to go out to work, and leaves device B at home. While the user is out of office, the user uses the device A to process some documents, but some documents remain unfinished. Then, when the user returns home, if he wants to continue to use device B to process these documents, he may need to transfer the documents in device A to device B in the following ways: 1. Use a third-party application to transfer the documents in device A to device A. 2. Send the documents in device A to device B through functions such as one-touch transfer between devices A and B of a specific model; 3. Send the documents in device A through cloud storage sharing The document is synced to device B. However, the above methods all require the user to perform multiple operations on two devices, such as starting the corresponding third-party application, sending documents, receiving documents, saving documents to cloud storage, downloading documents from cloud storage, etc. The above operations are not friendly enough for the user; and, if the device A is not around the user, the above methods cannot be implemented.

FIG. 3 is a scene diagram of interaction between multiple terminal devices at present.

As shown in Figure 3, when user 1 uses terminal device A to make an online video call with user 2 at home, if user 3, another family member, also wants to join the video call, then user 3 needs to come to the camera of terminal device A. Only then can user 2 see the video screen of user 3 . In this way, if user 3 wishes to continue the video call with user 2, he cannot go back to his room to do other things, which affects user 3's use experience.

In order to solve the above problems and improve the user experience, the embodiments of the present application provide an electronic device, the electronic device is composed of a first body and a second body that can be detachably arranged. and the specific structure of the second fuselage will be described.

FIG. 4 is a schematic structural diagram of the first fuselage. As shown in FIG. 4 , the first body may include: a display screen 201, a touch panel 202, a camera 203, a fingerprint identification module 204, a Bluetooth module 205, a wireless fidelity (Wi-Fi) module 206, and a satellite navigation system. System (Global Navigation Satellite System, GNSS) module 207, earpiece 208, speaker 209, microphone 210, motor 211, power management module 212, battery 213, key 214, microcontroller (MCU, MCU) 215 and sensor module 216, etc. .

It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the first body, and the first body may mainly include modules or devices related to the user interaction function, and some components used to realize the data connection function. module or device. The above-mentioned modules or devices related to user interaction functions may include, for example, modules or devices that transmit information to users, such as: display screen 201, microphone 210, motor 211, etc., as well as modules or devices that receive user input information, such as: camera 203 , earpiece 208, fingerprint recognition module 204, etc. Besides, the first body may not include modules or devices for realizing the main computing capabilities of the electronic device, such as: application processors, graphics processors, modems, and the like.

In other embodiments of the present application, the first fuselage may include more or less components than those shown in FIG. 4 , or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The display screen 201 is used to display images, videos and the like. The display includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light). emitting diode, AMOLED), flexible light emitting diode (flex light-emitting diode, FLED), mini light emitting diode MiniLED, micro light emitting diode MicroLED, micro light emitting organic diode Micro-OLED, quantum dot light emitting diode (quantum dot light emitting diodes, QLED) )Wait. In some embodiments, the first body may include 1 or N display screens 201 , where N is a positive integer greater than 1. In some embodiments, the display screen 201 may have different shapes, such as a flat shape, a hyperboloid shape, a quadrangular shape, a waterfall screen shape, a foldable shape, a scroll shape, and the like. In some embodiments, the display screen 201 may also have different sizes, such as small-sized display screens of mobile phones and wearable devices, medium-sized display screens of tablet computers, personal computers, etc., and large-sized display screens such as televisions.

The touch panel 202 and the display screen 201 can form a touch screen, also called a touch screen, and the touch panel 202 is used to detect a touch operation on or near the display screen 201 . The touch panel 202 can transmit the detected touch operation to its own microcontroller 215 or to the processor of the second body to determine the content of the touch operation, thereby providing visual output related to the touch operation through the display screen 201 . In other embodiments, the touch panel 202 can also be disposed on the surface of the first body, which is different from the position where the display screen 201 is located.

The camera 203 is used to collect image data, such as taking photos and videos. The camera 203 may include a lens and a photosensitive element. The object generates an optical image through the lens and projects it to the photosensitive element of the camera. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS). ) phototransistor. The photosensitive element is used to convert the optical signal into an electrical signal, and transmit the electrical signal to an image signal processor (ISP) to convert it into a digital image signal. The ISP outputs the digital image signal to a digital signal processor (DSP) for processing. DSP converts digital image signals into standard GB, RYYB, YUV and other formats of image signals. The ISP and the DSP may preferably be arranged in the second body, or may be arranged in the first body. In some embodiments, the first body may include 1 or N cameras 203 , where N is a positive integer greater than 1.

The fingerprint identification module 204 is used to collect user fingerprints, and the first body can use the collected fingerprint characteristics to realize functions such as fingerprint unlocking, access application lock, and fingerprint payment. The fingerprint identification module 204 can be implemented by different fingerprint identification technologies, such as ultrasonic fingerprint identification technology, optical fingerprint identification technology, capacitive fingerprint identification technology, and the like.

The Bluetooth module 205 is used to realize the function of wireless data connection between the first body and the second body based on the Bluetooth protocol, and is used to realize the function of the wireless data connection between the first body and other electronic devices based on the Bluetooth protocol. The Bluetooth module 205 preferably supports the Bluetooth low energy protocol to reduce power consumption.

The Wi-Fi module 206 is used to realize the function of wireless data connection between the first body and the second body based on the IEEE 802.11 standard, and is used to realize the function of the first body and the access point device AP based on the IEEE 802.11 standard. The function of wireless data connection enables the first body to access the Internet through the AP. The above-mentioned 802.11 standards may include, for example, 802.11ac, 802.11ax, 802.11ad, 802.11ay standards, and the like. In some embodiments, the Wi-Fi module 206 may also be used to implement a Wi-Fi Direct (Wi-Fi Direct) data connection or a FlashLinQ data connection between the first body and the second body or other electronic devices.

The GNSS module 207 is used to provide location services for the first body, so as to realize functions such as positioning and navigation. In some embodiments, the GNSS module 207 may provide a system including a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), One or more location services including quasi-zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).

The earpiece 208 is used to convert audio electrical signals into sound signals. When the user uses the first body to answer a call or a voice message, the receiver 208 can be close to the human ear to answer the voice.

The speaker 209 is used to convert audio electrical signals into sound signals. The user can listen to audio through speaker 209, or listen to a hands-free call. In some embodiments, the first body may include two or more speakers 209 to achieve stereo effect.

The microphone 210, also referred to as a "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 210 through a human mouth, and input the sound signal into the microphone 210 . The first body may be provided with at least one microphone 210 . In other embodiments, the first body may be provided with two microphones 210, which can implement a noise reduction function in addition to collecting sound signals. In other embodiments, three, four or more microphones 210 may be provided on the first body to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The motor 211 is used to generate vibration, which can be used for vibration prompting of incoming calls and messages, and can also be used for touch vibration feedback. When the user is in contact with the first body, the vibration of the motor 211 can be transmitted to the user, so that the user can feel the interactive feedback brought by the motor 211 . For example, when the user clicks on the input method interface of the display screen to type, the motor 211 may vibrate with the user's click; when the user presses the fingerprint recognition area of the display screen to unlock the device, the motor 211 may vibrate at the moment of unlocking. In some embodiments, different application scenarios (eg, time reminder, receiving information, alarm clock, game, etc.) may also correspond to different vibration feedback effects.

The power management module 212 is used for managing the charging and discharging strategy of the battery 213 of the first body and monitoring the battery status. In some embodiments, the first body may receive the charging input of the wired charger through the external interface 218 or the like. In other embodiments, the first body can receive wireless charging input through a built-in wireless charging coil. In this embodiment of the present application, the first body may not include a processor, so the display screen 201 is the main energy-consuming device of the first body. The battery 213 may be a small capacity battery.

The keys 214 include a power-on key, a volume key, and the like. Keys 214 may be mechanical keys. It can also be a touch key. The first body can receive key input, and generate key signal input related to user settings and function control of the first body.

The microcontroller 215 is used to realize a small part of the computing power of the electronic device to satisfy the interactive function of the first body. For example: the microcontroller 215 may include a video decoder module for decoding the encoded video data sent by the second body, and output it to the display screen 201 for display as an image; the microcontroller 215 may also include an audio decoder module , which is used to decode the encoded audio data sent by the second body, and output it to the earpiece 208 or the speaker 209 to play sound.

Sensor module 216 may include one or more sensors, such as: proximity light sensor 216A, ambient light sensor 216B, gravity sensor 216C, compass 216D, gyroscope 216E, and the like. The sensor module 216 collects information related to device posture, user behavior, and interaction through one or more sensors, and implements various functions independently or in cooperation with other devices or modules. For example: when the user uses the camera 203 to shoot, the gyroscope 216E can detect the shaking of the first body, and calculate the compensation value of the lens according to the shaking, so that the lens can offset the shaking of the first body through the reverse motion to realize anti-shake; The instrument 216E can also be used for navigation, somatosensory game scenarios. For another example, the proximity light sensor 216A can detect whether there is an object near the first body, so as to realize functions such as automatically turning on the screen when taking it out of a pocket or bag, and automatically turning off the display screen 201 when talking close to the ear.

In addition, the first body may further include memory, including volatile memory and non-volatile memory, for buffering or saving data generated by each device or module of the first body during operation, as well as saving the microcontroller, etc. Program instructions, etc., required for the operation of the device or module.

FIG. 5 is a schematic structural diagram of the second fuselage. As shown in FIG. 5 , the second body may include: a processor 301 , a camera 302 , a flash 303 , a laser ranging sensor 304 , a power management module 305 , a battery 306 , a Bluetooth module 307 , a Wi-Fi module 308 , and a GNSS module 309 , a radio frequency module 310, a card slot 311, an external interface 312, a button 313, a near-field communication (NFC) module 314, a microphone 315, a speaker 316, and the like.

It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the second body, and the second body may mainly include modules or devices related to computing capabilities such as the processor 301, and a module or device for realizing data connection. functional modules or devices. In addition, the second body may not include modules or devices for realizing the main interactive capabilities of the electronic device, such as a display screen, a touch panel, a fingerprint identification module, a sensor module, and the like.

In other embodiments of the present application, the second fuselage may include more or less components than those shown in FIG. 5 , or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 301 undertakes the main computing power of the electronic device. In some embodiments, the processor 301 may include an application processor (application processor, AP), a baseband processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller , video codec, digital signal processor (digital signal processor, DSP), and/or neural network processor (neural-network processing unit, NPU), etc. Different processors 301 may be independent devices, or may be inherited in one or more processors 301, for example, some or all of the above-mentioned processors 301 may be integrated in a system on a chip (SoC) .

Different from the camera 203 in the first body, the sensor size, pixel size and pixel resolution of the camera 302 in the second body can be larger, so the camera 302 can be used as the main camera for taking high-quality pictures, The camera 203 can be used as an auxiliary camera, and is used in scenarios that do not require high shooting quality, such as self-portraits, video chats, and scanning of two-dimensional codes. In some embodiments, the second body may include two or more cameras 302, and different cameras 302 may have different specifications, such as: a macro camera, a telephoto camera, a wide-angle camera, etc., to achieve more shooting mode.

The flash 303 and the laser ranging sensor 304 are used to cooperate with the camera to achieve better shooting quality. The flash 303 is used to turn on when the camera 302 focuses or exposes, and plays a role of supplementary light, so as to improve the shooting quality. In some embodiments, the flash 303 can be a dual-color temperature flash, including two light sources with different color temperatures, so as to have a better fill light effect and make the white balance of the shooting more accurate. The laser ranging sensor 304 is used to measure the distance between the camera 302 and the object to be photographed, so as to realize the phase detection auto focus (PDAF) function of the camera 302 .

The power management module 305 is used for managing the charging and discharging strategy of the battery 306 of the second body and monitoring the battery status. In some embodiments, the second body may receive the charging input of the wired charger through the external interface 312 or the like. In other embodiments, the second body can receive wireless charging input through a built-in wireless charging coil. In the embodiment of the present application, the battery 306 in the second body mainly supplies power to the processor 301 and other devices in the second body. Since the processor 301 is the main energy-consuming device in the electronic device, the Battery 306 may be a high-capacity battery.

The Wi-Fi module 308 is used to realize the function of wireless data connection between the second body and the first body based on the IEEE 802.11 standard, and is used to realize the connection between the second body and the access point device AP based on the IEEE 802.11 standard The function of wireless data connection enables the second body to access the Internet through the AP. The above-mentioned 802.11 standards may include, for example, 802.11ac, 802.11ax, 802.11ad, 802.11ay standards, and the like. In some embodiments, the Wi-Fi module 308 may also be used for the second body and the first body to implement a Wi-Fi Direct data connection, or a FlashLinQ data connection.

The GNSS module 309 is used to provide location services for the second body to implement functions such as positioning and navigation. In some embodiments, the GNSS module 309 may provide one or more including Global Positioning System GPS, Global Navigation Satellite System GLONASS, Beidou Satellite Navigation System BDS, Quasi-Zenith Satellite System QZSS and/or Satellite Based Augmentation System SBAS Multiple location services.

The radio frequency module 310, together with the baseband processor and the like, realizes the cellular mobile data connection function of the electronic device. The radio frequency module 310 may include a radio frequency circuit, a radio frequency power amplifier, an antenna, etc., and is used to implement the transmission and reception of electromagnetic wave signals of a cellular mobile network and/or a Wi-Fi network. Generally speaking, the cellular mobile data connection function of an electronic device may include: global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (code division multiple access) division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (LTE) ), 5th generation mobile networks new radio (5G NR), etc.

The card slot 311 may include a SIM card slot, and may also include a TransFlash (TF) card slot. In one embodiment, the second body may contain only a SIM card slot. In another embodiment, the second body may include a SIM card slot and a TF card slot at the same time.

The external interface 312 may include a USB interface, a 3.5mm headphone jack, and the like. The external interface 312 is used to connect external devices such as data cables and earphones, and realize functions such as charging, data transmission, and audio playback.

The keys 313 include a power-on key, a volume key, and the like. The keys 313 may be mechanical keys. It can also be a touch key. The second body can receive key input and generate key signal input related to user settings and function control of the second body.

The NFC module 314 is used to implement various NFC-based functions, such as: NFC mobile payment, swiping public transportation cards, simulating access control cards, reading or writing data from smart cards (IC cards), and identification cards (Identification Card), etc. .

The second body may be provided with at least one microphone 315 . In other embodiments, the second body may be provided with two microphones 315, which can implement a noise reduction function in addition to collecting sound signals. In other embodiments, three, four or more microphones 315 may be set on the second body to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

Speakers 316 are used to convert audio electrical signals into sound signals. The user can listen to audio through speaker 316, or listen to a hands-free call. In some embodiments, the second body may include two or more speakers 316 to achieve stereo effect.

The first body and the second body can be used in combination to realize all the functions of the electronic device.

In one embodiment, the first fuselage and the second fuselage can be physically connected to form a whole to realize combined use.

FIG. 6 is a schematic diagram of the physical connection between the first body and the second body.

As shown in FIG. 6 , both the first body 100 and the second body 200 may be designed in the form of a mobile phone. Wherein, the first body 100 may include a display screen 201 , a touch panel, a fingerprint identification module, and other related devices for user interaction, as well as other devices as shown in FIG. 4 . The first body 100 does not include some or all of the components in the second body 200 , for example, does not include a processor, a large-capacity battery, a radio frequency module, a main camera, etc. Therefore, compared with a traditional mobile phone, the first body 100 The thickness of the fuselage can be thinner, the volume can be smaller, and the weight can be lighter. When the user holds the first body 100 alone, they will feel better in hand, lighter and more portable, and will not tire their hands when holding for a long time. The second body 200 may include computing-related devices such as a processor, as well as a large-capacity battery, a radio frequency module, a main camera, and other devices as shown in FIG. 5 , and the second body 200 may not include a display screen 201 and a touch panel , fingerprint recognition module and other user interaction related devices, therefore, compared with the traditional mobile phone, the thickness of the second body 200 can also be thinner, the volume can be smaller, and the weight can be lighter.

Further as shown in FIG. 6 , the first body 100 and the second body 200 may form a whole in the form of a mobile phone by being fastened up and down. The first fuselage 100 and the second fuselage 200 may have the same or similar length and width, so that the two have stronger integrity after being fastened together.

In addition, in order to realize that the first body 100 and the second body 200 can be fixed to each other after being snapped together, the first body 100 and/or the second body 200 may further include a fixing structure. In one embodiment, the first fuselage 100 and the second fuselage 200 may respectively include magnetic attraction devices corresponding to positions. When the first fuselage 100 and the second fuselage 200 are close to each other, the magnetic attraction devices The first body 100 and the second body 200 are fixed. In one embodiment, the first body 100 and the second body 200 may include buckle structures that cooperate with each other. When the first body 100 and the second body 200 are buckled, the buckle structures are locked to lock the first body 100 and the second body 200 together. A body 100 is fixed to the second body 200 . In one embodiment, one of the first body 100 and the second body 200 may be provided with a back clip structure. When the first body 100 and the second body 200 are fastened together, a back clip structure is provided. The sub-device clamps another sub-device through the back clip structure to fix the first body 100 and the second body 200 .

It can be understood that when the first body 100 and the second body 200 are used in combination, some data interaction may be required between the first body 100 and the second body 200. To achieve this purpose, the first body The body 100 and the second body 200 may also be provided with data connection interfaces that cooperate with each other.

In an implementation manner, the data connection interface may be disposed on the buckling surface of the first body 100 and the second body 200. For example, the data connection interface may include a pair of mutually matched male terminals 217 and female terminals 317, The male terminal 217 is arranged on one of the sub-devices, and the female terminal 317 is arranged on the other sub-device. When the first body 100 and the second body 200 are fastened together, the male terminal 217 and the female terminal 317 are inserted into each other. Together, a data transmission channel between the first body 100 and the second body 200 is established. In some embodiments, the data connection interface can be designed based on a specific interface protocol, such as: PCI Express protocol (PCI-E for short), Thunderbolt and the like. In another implementation manner, the data connection interface may be an optical interface for receiving and receiving optical signals. When the first body 100 and the second body 200 are fastened together, the optical interface is connected to establish the connection between the first body 100 and the second body 200 . The optical signal transmission channel between the two bodies 200 enables the first body 100 and the second body 200 to transmit data based on the optical signal.

In one embodiment, the first fuselage 100 and the second fuselage 200 may also be used in combination when they are separated from each other.

FIG. 7 is a schematic diagram of the combined use of the first body 100 and the second body 200 in a separated state.

As shown in FIG. 7 , a wired data connection can be established between the first body 100 and the second body 200 through a cable 401 . In an implementation manner, the cable 401 may be a cable that transmits data through electrical signals or short-distance millimeter wave technology. Then, both the first body 100 and the second body 200 are provided with an external interface for docking the terminals of the cable 401 . For the

interfaces

218 and 312, according to the different types of terminal protocols of the cables, the

external interfaces

218 and 312 can be correspondingly PCI-E interfaces, Thunderbolt interfaces, USB interfaces, and the like. In another implementation manner, the cable 401 may be an optical fiber, and data is transmitted through an optical signal. Then, the first body 100 and the second body 200 are both provided with optical interfaces. According to different types of optical fiber connectors, the optical interfaces are correspondingly It can be an SC-type optical fiber interface, an FC-type optical fiber interface, and the like.

FIG. 8 is another schematic diagram of the combined use of the first body 100 and the second body 200 in a separated state.

As shown in FIG. 8 , the first body 100 and the second body 200 can establish a wireless data connection. In an implementation manner, both the first body 100 and the second body 200 include a Wi-Fi module, and the first body 100 and the second body 200 can establish a wireless data connection through the Wi-Fi module. In a specific implementation, the first body 100 and the second body 200 can be data connected to an access point (AP) device 402 through their respective Wi-Fi modules, and a wireless data connection is established through data forwarding of the AP device 402; The first body 100 and the second body 200 can establish a Wi-Fi Direct data connection through the Wi-Fi module, so that a wireless data connection can also be established without other devices. In another implementation manner, both the first body 100 and the second body 200 include a Bluetooth module, and the first body 100 and the second body 200 can establish a wireless data connection through the Bluetooth module. In another implementation manner, the first body 100 includes a Wi-Fi module and can be connected to the Internet through the Wi-Fi module, the second body 200 includes a radio frequency module and a baseband processor and has a cellular mobile data connection function, And the base station 404 can be connected to the Internet, so the first body 100 and the second body 200 can establish a wireless data connection based on the Internet. In another embodiment, both the first body 100 and the second body 200 have a cellular mobile data connection function, so the first body 100 and the second body 200 can establish a 3GPP standard device based on the cellular mobile data connection function Direct data connection to the device-to-device (D2D) protocol, thus eliminating the need to rely on other devices.

9 and 10 are logical block diagrams of data interaction when the first body and the second body are used in combination. Below, based on FIG. 9 and FIG. 10 and in combination with some usage scenarios, the data interaction logic between the first body and the second body under wired data connection and wireless data connection state will be exemplarily described.

Scenario 1: The first body plays the image data provided by the second body.

As shown in Figure 9(a), when the first body and the second body are connected by wired data, the processor of the second body can encode the image data to be displayed and output it to its PCI-E interface, The encoded image data is sent to the first fuselage through the PCI-E cable; the first fuselage receives the encoded image data through its PCI-E interface, and hands it over to the microcontroller of the first fuselage for processing; The controller has a built-in video decoder module, which can decode the encoded image data and send the decoded image data to the display screen through the MIPI-DSI interface for display.

As shown in Figure 9(b), when the first body and the second body are connected by wireless data, the processor of the second body can encode the image data with display and output to its Wi-Fi module; The Wi-Fi module of the second body sends the encoded image data to the Wi-Fi module of the first body through the Wi-Fi link established based on Wi-Fi Direct or AP device; the Wi-Fi module of the first body The Fi module receives the encoded image data and hands it over to the microcontroller MCU of the first body for processing; the microcontroller MCU has a built-in video decoder module, which can decode the encoded image data and convert the decoded image The data is sent to the display screen for display through the MIPI-DSI interface.

Scenario 2: The first body sends image data to the second body.

As shown in Figure 10, when the camera is turned on in the first body, the camera driver running on the microcontroller MCU reads the image data captured by the camera through the MIPI-CSI interface; the image data is encoded by the video encoder inside the MCU Then output to the second fuselage. Among them, as shown in Figure 10(a), when the first body and the second body are connected by wired data, the microcontroller can output the encoded image data to its PCI-E interface, so that the encoded image The data is sent to the PCI-E interface of the second body through the PCI-E cable; as shown in Figure 10(b), when the first body and the second body are connected by wireless data, the microcontroller can encode the The resulting image data is output to its Wi-Fi module; the Wi-Fi module of the first fuselage sends the encoded image data to the second fuselage through the Wi-Fi link established based on Wi-Fi Direct or AP devices. Wi-Fi module.

It can be seen that, no matter in the wired data connection state or the wireless data connection state, data transmission can be realized between the first body and the second body, so that all functions of the electronic device can be realized in cooperation with each other.

FIG. 11 is a schematic diagram of the thickness of the first body 100 , the second body 200 and a conventional mobile phone. As shown in FIG. 11 , since the first body 100 only includes some components for realizing all functions of the electronic device, and does not include a processor, a large-capacity battery, a radio frequency module, a main camera, etc., therefore, compared with a traditional mobile phone, the Under the condition that the size of the display screen is the same, the thickness B1 of the first body 100 will be smaller and the weight will be lighter, which is convenient for the user to hold. In addition, because the second body 200 also only includes some components for realizing all functions of the electronic device, and does not include components related to user interaction such as a display screen, a touch panel, a fingerprint identification module, etc., therefore, compared with a traditional mobile phone, the Under the condition that the length and width are the same and the battery capacity is the same, the thickness B2 of the second body 200 will also be smaller. In addition, since the second body does not need to be held frequently by the user, it is not necessary to consider whether its thickness and weight are easy to hold in the design. Therefore, the thickness of the second body 200 can be further increased to B3 to accommodate a larger capacity The battery 306 can improve the battery life of the second body 200 .

In one embodiment, the first body and the second body can cooperate to realize all functions of the mobile phone.

As an implementation, as shown in FIG. 12 , the first body 100 and the second body 200 establish a wireless data connection through a Wi-Fi link. When the user uses the electronic device of the present application, as shown in FIG. 12( a ) As shown, the second body 200 can be placed in a pocket of clothing or a backpack 403, and the user only needs to hold the first body 100 and perform interactive operations on the first body 100 to complete making calls, sending and receiving Information, using APP, playing media, motion monitoring, fingerprint payment, Selfie and other operations do not need to take out the second body 200, and these operations cover most scenarios of users using mobile phones. Correspondingly, the user only needs to hold the second fuselage 200 in a few scenarios, as shown in FIG. 12(b), when the user wants to take high-quality photos or videos, the user can choose from the pocket or backpack 403 Take out the second body 200 and use the second body 200 to complete the shooting process. After the shooting is completed, the second body 200 can be put back into the pocket or backpack 403 . It can be seen from this that, since the user does not need to hold the second body 200 in most scenarios, the design of the second body 200 does not need to consider the device thickness, volume, grip, weight, etc. that affect the user experience. Therefore, the second body 200 can have a larger thickness, accommodate a battery with a larger capacity, and improve the longer battery life. In this way, even if the power consumption of the second body 200 increases due to the support of the 5G network, the battery life can be achieved. Not shortened or even longer.

In one embodiment, as shown in FIG. 13 , the first body 100 may further include a wireless charging coil 219 , and the wireless charging coil 318 is coupled to the battery 213 of the first body 100 through the power management module of the first body 100 . Correspondingly, the second body 200 may also be provided with a wireless charging coil 318 , and the wireless charging coil 318 is coupled to the battery 306 of the second body 200 through the power management module of the second body 200 . In this way, when the first body 100 and the second body 200 are buckled into a whole, the power management module of the second body 200 can obtain the battery power of the first electronic device from the power management module of the first body 100. If When the battery level of the first electronic device is lower than a certain threshold, such as 100% or 50%, the power management module of the second electronic device enables the wireless charging function, and uses the electromagnetic induction between the coils to use the power of the second body 200 The electric energy in the battery charges the battery 213 of the first body 100 to prolong the battery life of the first body 100 .

In addition to the mobile phone form, the first body and the second body in the embodiments of the present application may also have other forms, and some of the achievable forms will be exemplarily described below with reference to more drawings.

In one embodiment, as shown in FIG. 14 , the first body 100 may be a device in the form of a mobile phone, and the second body 200 may be a device in the form of a handheld game console. The second body 200 includes buttons 320 and/or joysticks 321 for implementing a game control input function, and a structure for fixing the first body 100 . For example, the structure for fixing the first body 100 may be, for example, a groove 319 provided on the body of the second body 200, and the shape of the groove 319 matches the shape of the first body 100, so that the The first body 100 can be embedded in the groove 319 to form a whole with the second body 200 . Based on the structure shown in FIG. 14 , when the first body 100 is separated from the second body 200 , the first body 100 can make calls, send and receive information, use APPs, play media, and monitor motion according to user operations. , fingerprint payment, Selfie and other functions; in the case where the first body 100 and the second body 200 form a whole, the first body 100 and the second body 200 can jointly realize the functions of a handheld game console. The second body 200 is held by the user, and is used for receiving the game control input generated by the user through the buttons 320 and the joystick 321, and the first body 100 is used for displaying the game screen.

In one embodiment, as shown in FIG. 15 , the first body 100 may be a device in the form of a mobile phone, and the second body 200 may be a smart speaker device. Based on the structure shown in FIG. 15 , in the state where the first body 100 is separated from the second body 200 , if the first body 100 receives an operation of the user to play audio, the first body 100 will use its own speakers Play audio; in specific implementation, the processor of the second body 200 can send the encoded audio data to the first body 100 through a Wi-Fi link or the like, and after the first body 100 receives the encoded audio data, the The audio decoder in the MCU decodes and outputs it to the speaker of the first body 100 for playback. When the second body 200 can detect the approach of the first body 100 through the NFC module 314, the laser ranging sensor, etc. (for example, the user places the first body 100 on the second body 200), the second body 200 will take over the audio playback behavior of the first body 100 to realize the conversion of different audio playback modes; in specific implementation, the second body 200 can stop sending encoded audio data to the first body 100, and at the same time, the second body 200 can stop sending encoded audio data to the first body 100. The processor of the body 200 can decode the encoded audio data and output it to the speaker 316 of the second body 200 for playback.

In one embodiment, as shown in FIG. 16 , the first body 100 may be in the form of a wearable device, such as a smart watch, a smart bracelet, a VR device, etc., and the second electronic device may be any device that can be put into a clothes pocket, The device form in the backpack 403 is not specifically limited in this embodiment of the present application. Taking the first body 100 as a smart watch as an example, based on the structure shown in FIG. 16 , the first body 100 and the second body 200 can establish a low-power Bluetooth data connection through their respective Bluetooth modules to exchange data. The MCU of the first body 100 can collect the user's physiological data, such as blood flow, cardiac electrical signals, etc., through various sensors it is equipped with, and send it to the second body 200 through the Bluetooth module, and the Bluetooth module of the second body 200 After receiving the physiological data, it is processed by the second body 200 to obtain the user's heart rate, electrocardiogram and other information, and sent back to the first body 100 for display, or through the Wi-Fi module or cellular mobile data connection function Upload to the cloud for users to share data on other electronic devices. In this way, the first body 100 does not need to perform calculation and analysis on the data collected by the sensor, so power consumption can be saved and battery life can be prolonged.

In one embodiment, as shown in FIG. 17 , the first body 100 may be a large-screen display device, such as a television, a monitor, etc., and the second electronic device may be, for example, a smart camera. The second body 200 and the first body 100 may be distributed at different positions, and the second body 200 may also be fixed on the first body 100 . The image data displayed on the display screen of the first body 100 is provided by the second body 200 . The second body 200 is further configured to receive and process control instructions transmitted by the user through a remote control or voice, run an application program, and display a corresponding interface on the display screen of the first body 100 .

In an implementation manner, as shown in FIG. 17 , the second body 200 can be woken up by a remote control signal or voice, wherein the voice command for waking up the second body 200 can be a default voice command or a User-defined voice commands. For example, when the voice command is "Xiaoyi Xiaoyi", when the user uses the second fuselage 200 for the first time, the second fuselage 200 can remember the user's voice characteristics by reading "Xiaoyi Xiaoyi" a few times. In this way, when the second body 200 detects that the user says "Xiaoyi Xiaoyi" after that, it wakes up itself. After the second body 200 wakes up, the processor of the second body 200 can turn on the camera of the second body 200 to capture an image, and encode the image and send it to the first body 100. After receiving the encoded image, the microcontroller of the first body 100 decodes the image and sends it to the display screen 201 for display.

In an implementation manner, as shown in FIG. 18 , after the second fuselage wakes up, it can also take over the signal source of the display screen of the first fuselage, so that all the images displayed on the display screen of the first fuselage are provided by the second fuselage. provided. In a specific implementation, after the second fuselage wakes up, a user interface (UI) image 501 may be generated according to parameters such as the resolution and refresh rate of the display screen of the first fuselage, and the UI image may include, for example, a status bar, a camera application interface, etc. For example, the status bar may include information such as battery power, network status, and time of the second body; the camera application program interface may include multiple virtual buttons or options, for example: the working mode of the camera (eg, professional shooting, video recording mode, Photo mode, portrait mode, night scene mode, panorama mode, micro-recording Vlog mode, slow motion mode, time-lapse photography, etc.), photo settings (such as: high dynamic range imaging HDR switch, artificial intelligence AI mode switch, filters, etc.), etc. . Further, after the processor of the second fuselage generates the UI image, the UI image, the image 502 collected by the camera, and the images of other users received through the network can be layered, for example, the UI image is superimposed on the image collected by the camera. On top of the received image, a video stream is obtained, and then the video stream is encoded and sent to the microcontroller of the first fuselage. After the microcontroller of the first body receives the video stream, it decodes the video stream and sends it to the display screen for display. In this way, according to the UI image displayed on the display screen, the user can use the remote control to issue an operation command to the second body to select different camera working modes or different photographing settings, etc., so as to improve the user experience.

Further as shown in FIG. 19 , the camera 302 of the second body 200 can be arranged on a rotating mechanism 322, and the rotating mechanism 322 can make the camera 302 rotate within a certain angle range, preferably, it can rotate 360 degrees. In addition, The microphone 315 of the second body 200 may be a multi-microphone array. When the user makes a video call, the second body 200 turns on the camera 302 to capture images, and the processor of the second body 200 is used to encode the captured images, and then send them to the first body 100 for display, and to send to The remote device of the call party is displayed. When a user speaks, the multi-microphone array collects the user's voice information, and transmits the voice information to the processor for analysis and processing. The azimuth rotation mechanism 322 sends a rotation instruction to control the rotation of the camera 302 , so that the camera 302 is always aimed at the speaking user, and the user is always located in the center of the image captured by the camera 302 .

Further as shown in FIG. 20 , when there are multiple users speaking at the same time (the simultaneous speaking here may refer to the intersection of the speaking times of at least two users), the microphone 315 (for example, a multi-microphone array) can simultaneously collect multiple users. The processor of the second body 200 can identify the voice information of each user from the voice information of multiple users according to voiceprint recognition or timbre recognition, and judge the orientation of each user respectively. In addition, the second body 200 may further include a laser ranging sensor 304. The laser ranging sensor 304 may be arranged in the same direction as the camera 302. When there are multiple users talking at the same time, the laser ranging sensor 304 may measure the relative distance of each user respectively. Based on the distance of the camera 302, the distance measurement result is sent to the processor. Next, the processor determines whether the direction of the camera 302 can be adjusted according to the orientation of each user, the distance relative to the camera 302, and the viewing angle of the camera 302, so that the above-mentioned multiple users are simultaneously within the field of view of the camera 302; The above-mentioned multiple users are located in the field of view of the camera 302 at the same time, then the processor can send a rotation instruction to the rotation mechanism 322 to control the rotation of the camera 302, so that the above-mentioned multiple users appear in the field of view of the camera 302 at the same time; If two users are located in the field of view of the camera 302 at the same time, the processor can send a rotation instruction to the rotation mechanism 322 to control the rotation of the camera 302, so that the camera 302 is aimed at the user closest to the camera 302, so that the user is located in the center of the field of view of the camera 302 .

In an implementation manner, the rotation mechanism 322 may have its own angular coordinate system, and the angular coordinate may take the camera 302 facing directly in front of the display screen of the first body 100 as an angle of 0°, and the rotation mechanism 322 rotates clockwise or The counterclockwise direction is used as the positive direction of the coordinate system. Based on the above angle coordinate system, the rotation command of the processor may be an angle command, for example: 30°, so that the rotation mechanism 322 rotates to a position of 30°.

In another implementation manner, the rotation command may further include at least one speed command and one stop command, where the speed command is used to instruct the angular speed at which the rotation mechanism 322 rotates. The rotation mechanism 322 starts to rotate when it receives a speed command, and if a new speed command is received during the rotation, the angular velocity is adjusted according to the new speed command; when the rotation mechanism 322 receives a stop command, it stops rotating. For example, when the camera needs to be rotated from 0° to 30°, the processor may first send a speed command of 10° per second to the rotation mechanism 322, and then send a stop command to the rotation mechanism 322 after 3 seconds.

In some other implementation manners, when the processor of the second fuselage 200 determines that the user is talking while walking according to the sound information collected by the microphone array, the processor may change the orientation of the user within a period of time before the current moment, The user's next azimuth change trend is predicted, the angular velocity at which the rotating mechanism 322 rotates next is determined according to the predicted result of the azimuth change trend, and a corresponding speed command is generated and sent to the rotating mechanism 322 . In this way, when the user talks while walking, the camera 302 can rotate in real time following the change of the user's orientation, and the user is always kept in the center of the camera 302's field of view.

In one embodiment, as shown in FIG. 21 , both the first body and the second body may include one or more speakers, and the speaker 209 of the first body and the speaker 316 of the second body may be used simultaneously to Output stereo effect. In a specific implementation, when the audio resource played by the second body includes multiple channels, the processor 301 of the second body may decode the audio of a part of the channels and output it to the speaker 316 of the second body for playback; The processor 301 of the second body can also send the audio of another part of the channel to the first body, which is decoded by the microcontroller 215 of the first body and then sent to the speaker 209 of the first body for playback. For example, both the first body and the second body include two speakers, each speaker may include at least one speaker, and the audio resources played by the second body include at least four channels, for example: left channel, right channel channel, center channel and subwoofer channel. Then, the processor 301 can send the audio of the center channel and the subwoofer channel to the first body, and the microcontroller 215 of the first body can decode the audio of the center channel and send it to the one of the first body. One speaker 209 plays, and the audio of the subwoofer channel is decoded and sent to another speaker 209 of the first body for playback. In addition, the processor 301 can decode the audio of the left channel and send it to the speaker 316 on the left side of the second body for playback, and decode the audio of the right channel and send it to the speaker 316 on the right side of the second body for playback. Therefore, the speakers 209 of the first body and the speakers 316 of the second body cooperate with each other to realize stereo effect output, which improves the user's audio-visual experience. For example, when the user is watching a movie, the left and right channels can be used for To play background music and ambient sound effects, the subwoofer channel can be used to play sound effects such as drum music, and the center channel can be used to play the voice of the character speaking, with clear layers and a good audio-visual experience.

In addition, in other embodiments, when the second body is a smart camera, it can be used as a monitoring camera, so that when someone enters the monitoring area, the second body can use its array microphone to lock the position of the person, and keep The picture of the shooting personnel, and send an alarm to the first body, and transmit the real-time image of the captured picture to the first body, etc.

When the first fuselage and the second fuselage are jointly used for shooting videos or photos, the embodiment of the present application provides a shooting control method, and the steps of the method are described in detail below with reference to a specific application scenario:

As shown in FIG. 22 , if the user wants to take a picture for himself when he is playing alone, he can take out the first body 100 and the second body 200 and place the second body 200 at a certain position , so that the camera 302 of the second body 200 faces the landscape to be photographed. Then, the user can click on the camera application icon 503 on the display screen 201 of the first body 100 to launch the camera application.

Next, as shown in FIG. 23 , when the display screen of the first body detects that the user clicks the camera application icon, the microcontroller of the first body sends an instruction to start the camera application to the processor of the second body. After receiving the instruction to start the camera application, the processor of the second body starts the camera application and turns on the camera of the second body. After that, the processor encodes the image data collected by the camera in real time and sends it to the first body. After the microcontroller of the first body receives the encoded image data, it decodes it and sends it to the display screen of the first body for display, so that the user can see the first body on the display screen of the first body in real time. The image captured by the camera of the fuselage. Wherein, the first body and the second body can establish a connection and transmit data through one or more of cellular mobile network, Wi-Fi Direct, Bluetooth, etc. -When the connection is established by Fi Direct, Bluetooth, etc., the first body and the second body can establish a connection at any place without being restricted by geographical location. For example, when the user is exploring or climbing in the wild, even if there is no communication base station in these places , the first fuselage and the second fuselage can also be connected and used normally.

Next, as shown in FIG. 22 , the user can adjust the relative position of himself and the second body 200 according to the image displayed on the display screen 201 , so that the user appears at an appropriate position within the viewing range of the camera 302 . When the user has adjusted his position and is ready to take a photo, the user can click the photo button 504 on the display screen 201 .

Next, as shown in FIG. 23 , when the display screen of the first body detects that the user clicks the photographing button, the microcontroller of the first body sends a photographing instruction to the processor of the second body. After receiving the photographing instruction, the processor of the second fuselage starts to count down the photographing, for example, 10 seconds, 5 seconds, etc. The duration of the photographing countdown may be a preset default value or a value preset by the user. During the period of the countdown for taking pictures, the user may perform preparation activities for taking pictures, such as posing for a pose or putting the first body in a clothing pocket or a backpack, and so on. After the countdown for taking pictures ends, the processor controls the camera to expose and take pictures, and sends the taken pictures to the first fuselage for display on the display screen of the first fuselage.

In an implementation manner, after the countdown for taking pictures ends, the processor may control the camera to take multiple pictures continuously, so as to avoid the user blinking or moving when taking a single picture, which affects the picture quality. In addition, in order to avoid inappropriate selection of the focal point of the photo resulting in too bright or too dark, poor definition or inaccurate white balance of the photo, the above-mentioned multiple photos may also be photos with different focal points. In a specific implementation, as shown in FIG. 24 , during the countdown period for taking pictures, the processor of the second body 200 can analyze the images collected by the camera 302 based on artificial intelligence technologies such as deep neural networks, so as to identify the character part and the background part. , and select at least one focus on the character part and the background part, for example, select a focus on the face of the character, select a focus on the body of the character, select a focus at the near point of the background, select a focus at the far point of the background, etc. After the countdown for taking pictures is over, the processor can control the camera 302 to focus at different focal points, and take at least one picture after each focal point is focused, so that the user can select his favorite picture from multiple pictures, Improved user experience.

In an implementation manner, in order to improve the shooting quality, the first body and the second body may cooperate with each other to realize the function of automatic composition. After turning on the camera, the processor of the second fuselage can analyze the images collected by the camera to identify the close-range content, such as trees, roads, mountains, buildings, etc., and identify the distant content, such as the sky, Sun, Moon, etc. Then, according to the distribution of these contents in the image, the processor determines a suitable position where the character appears in the framing content, and generates a character outline 506 at the position. As shown in FIG. 25 , the character outline 506 and the image captured by the camera The data is collectively sent to the microcontroller of the first body. After receiving the outline 506 of the person and the image data collected by the camera, the microcontroller of the first body decodes and sends it to the display screen 201 for display. In this way, the user can adjust his position relative to the second fuselage according to the character outline 506, for example, adjust his position within the character outline 506, thereby taking high-quality pictures and improving the user experience.

In one implementation, as shown in FIG. 22 , in order to enable the user to know the end time of the countdown for taking pictures, the processor of the second body can send a countdown prompt sound to the microcontroller of the first body after the countdown starts. The microcontroller of the first body can decode the received countdown sound and output it to the speaker of the first body for playback. For example, the countdown prompt sound may be a beep sound played by pulses, or a countdown number broadcast by voice or the like. In this way, the user can know the end time of the photo-taking countdown according to the countdown sound, so that the POSE can be placed before the photo-taking countdown ends, and the user can wait for the photo to be taken, which improves the user experience.

In some embodiments of the present application, as shown in FIG. 26 , the second body 200 may also establish data connections with multiple first bodies 100 (A to N) simultaneously by means of wireless data connection or wired data connection, A distributed system is formed, wherein N is a positive integer, and a plurality of first fuselages 100 (A˜N) share data resources and network resources of the second fuselage 200, so as to realize a plurality of first fuselages 100 (A to N) Data synchronization between A to N). The application scenarios and beneficial effects of the distributed system shown in FIG. 26 will be described in detail below with reference to more drawings.

In one embodiment, as shown in FIG. 27 , the distributed system consists of two first fuselages and one second fuselage. For the convenience of description, the two first fuselages are referred to as first fuselage A respectively here. and the first fuselage B. Based on FIG. 27 , in an application scenario, the user carries the first fuselage A to go out to work, and places the first fuselage B at home. When the user goes out to work, the first fuselage A and the second fuselage maintain a data connection through a cellular mobile network or a Wi-Fi network, and the user uses the first fuselage A to remotely create a document in the second fuselage and edit it documents, and these documents are all stored in the second fuselage, and the second fuselage is used to generate an editing page of the document and send it to the first fuselage A for display. In this way, when the user returns home, the user can use the first fuselage B to directly open the above-mentioned document located in the second fuselage, and continue the editing work. At this time, the second fuselage is used to generate the editing page of the document and send it to The first body B is displayed. As a result, the operation of sending a document from device A to device B as shown in FIG. 2 is eliminated, so that there is no need to share any data between the first fuselage A and the first fuselage B, which simplifies user operations and improves user experience.

In order to improve the security of synchronizing documents or other data between the second body and multiple first bodies, an embodiment of the present application further provides a device verification method.

In a specific implementation, when the user places the first body on the second body for the first time, the NFC modules of the first body and the second body detect that they can approach each other, and then establish an initial connection. After that, as shown in FIG. 28 , the processor of the second body can acquire the device information of the first body, such as the device model, media access control (MAC) address, international mobile device identity (international mobile device identity) mobile equipment identity, IMEI) and other information. Then, the processor of the second fuselage generates a dedicated seed password for the first fuselage, and the seed password can be generated randomly or in a specific manner. Next, the processor of the second body uses the seed password to encrypt the device information of the first body, and uses the encryption result as the master password for storing data in the NFC module of the first body, wherein the seed password is used Encryption of the device information of the first body may optionally be implemented in various ways, such as the advanced encryption standard AES algorithm and the like. Next, the processor of the second body can assign an exclusive security token token and a dynamic check code, such as a cyclic redundancy check (CRC) code to the first body, and use the master password The token sum is encrypted, and the encrypted data is written into the NFC module of the first body.

When the user places the first body on the second body again, the NFC module of the second body reads the encrypted data in the NFC module of the first body and hands it to the processor of the second body for processing. decrypt. After the processor of the second fuselage decrypts the encrypted data using the master password, the decrypted token and dynamic check code, as well as the device model, media access control and/or international mobile equipment identification code of the first fuselage are processed. Consistency check; if the consistency check passes, the processor of the second fuselage generates an edit page of the document and sends it to the first fuselage for display to realize the document synchronization function; if the consistency check fails, the first fuselage The second fuselage is disconnected from the first fuselage, and the processor of the second fuselage adds the current token, the dynamic verification code and all device information of the first fuselage to the blacklist. In addition, after the consistency check is passed, the processor of the second machine is also used to generate a new dynamic check code, and then generates new encrypted data according to the token and the new check code, and writes it to the first machine In the NFC module of the body, to update the original encrypted data.

In this way, the first fuselage and the second fuselage use dynamic verification for device verification. Since the dynamic verification code changes, when an illegal device steals the encrypted data stored in the NFC module of the first fuselage, When trying to verify with the second body, the processor of the second body will detect that the dynamic check code from the illegal device is inconsistent with the current dynamic check code, so that the illegal device is connected to the blacklist, making the illegal device It is impossible to establish a connection with the second fuselage, which improves the security of file synchronization.

In one embodiment, as shown in FIG. 29 , the distributed system consists of at least two first fuselage and one second fuselage. For the convenience of description, the at least two first fuselage is referred to as the first fuselage here respectively. Body A, first body B, ..., first body N. Wherein, in a home scenario, the second body may be, for example, a smart camera, the first body A may be, for example, a large-screen display device, the first body B may be, for example, a mobile phone, and the first body N may be, for example, a tablet computer For example, the second body can be fixed on the first body A and establish a wired data connection with the first body; the first body B to the second body N can be held by different local family members, and the first body The body B to the second body N can establish a wireless data connection with the second body. When a video interactive call is made between two families, on the one hand, the second body can receive the video image Vr from the remote home device through the network, and distribute the video image Vr to the first body A ~ the first body N, the first body A ~ the first body N can use their own microcontroller to decode the received video image Vr, and display it on the display screen; on the other hand, the first body B ~ the first body N The cameras can respectively capture the video images Vb～Vn of the family members who hold them, and these video images Vb～Vn are encoded by the respective first body respectively and can be sent to the second body, and the second body receives the video. After the images Vb to Vn, operations such as Vb to Vn decoding, cropping, scaling and arrangement can be performed on the video image, and the video image Vs is obtained by superimposing with the video image Va collected by the second body itself, and finally the Vs is encoded and passed through. The network is sent to the remote home device, so that the user of the remote home device can see multiple local family members in one video image Vs at the same time, and the above-mentioned multiple local family members can be located in different locations, different rooms in the home, not It needs to be gathered in front of the second fuselage, which greatly improves the user experience of multi-person video.

It can be understood that when the image displayed by the first body comes from the second body, if the resolution and frame rate of the image sent by the second body to the first body are the same as those of the display screen of the first body If the rate and refresh rate are matched, the display screen of the first body can present the best display effect. However, in a practical application scenario, the second body may establish a data connection with a different first body, and the display screen resolutions and refresh rates of the different first bodies are also likely to be different, then, if the second body If the fuselage sends images of the same resolution and frame rate to the above-mentioned different first fuselage, there will inevitably be a part of the first fuselage whose display screen resolution and refresh rate do not match the received image resolution and frame rate , which affects the display effect. In order to solve this problem, the embodiment of the present application also provides an image adaptation method. As shown in FIG. 30 , the method may include the following steps:

Step S101, the second fuselage acquires the display screen parameters of the first fuselage.

The parameters of the display screen may include at least one of a resolution and a refresh rate of the display screen.

In one embodiment, step S101 may occur during the process of establishing a data connection between the first body and the second body. For example, when the first body and the second body are connected by wireless data such as Wi-Fi or Bluetooth, the microcontroller of the first body can carry the data of the display screen in the beacon frame broadcast by the Wi-Fi module. Display parameters, the processor of the second fuselage can search for beacon frames through the Wi-Fi module to obtain display parameters.

In one embodiment, step S101 may occur after the first body establishes a data connection with the second body. For example, after the first fuselage establishes a data connection with the second fuselage, the processor of the second fuselage may send a request message for acquiring parameter information to the microcontroller of the first fuselage, and the first fuselage After receiving the request message, the microcontroller sends the display screen parameters to the processor of the second fuselage.

In one embodiment, the second fuselage may maintain a display screen parameter list, and the display screen parameter list may be used to record the display screen parameters of the first fuselage known to the second fuselage, so that when there are unknown parameters of the first fuselage When the first fuselage is data-connected to the second fuselage, the processor of the second fuselage can save the unknown display screen parameters of the first fuselage in the display parameter list. When there is a known first fuselage During data connection with the second fuselage, the processor of the second fuselage can directly obtain the known display screen parameters of the first fuselage from the information parameter list.

Illustratively, the display parameter list may be in the form shown in Table 1 below:

设备IDDevice ID	显示屏分辨率Display resolution	显示屏刷新率Display refresh rate
XX-XX-XX-XX-XXXX-XX-XX-XX-XX	1920×1080(1080P)1920×1080(1080P)	60Hz60Hz
YY-YY-YY-YY-YYYY-YY-YY-YY-YY	2340×10802340×1080	90Hz90Hz
ZZ-ZZ-ZZ-ZZ-ZZZZ-ZZ-ZZ-ZZ-ZZ	1280×720(720P)1280×720(720P)	60Hz60Hz
……...	……...	……...

Table 1

The device ID may be, for example, a media access control address (MAC), a service set identifier (SSID), and an international mobile equipment identity (IMEI) of the first body. , or other information that can be used to uniquely identify the identity of the first fuselage. Display resolution refers to the number of rows × columns of display pixels. Display refresh rate refers to the number of image frames per second the display can display, and 60 hertz (Hz) means the display can display up to 60 frames per second. Among them, the resolution of 1920×1080 and the refresh rate of 60Hz can also be represented by 1920×1080@60Hz.

Step S102, the second body generates an image to be displayed according to the parameters of the display screen.

In specific implementation, if the image to be displayed is non-media content such as operating system UI interface, application program interface, etc., then the processor of the second fuselage can directly draw the image with the resolution and resolution of the display screen of the first fuselage in the stage of drawing the image. An image with a matching refresh rate; if the image to be displayed is video, picture and other media content, the processor of the second fuselage can perform scaling, cropping, frame insertion, compression and other adjustment operations on the image to convert the image into An image that matches the display resolution and refresh rate of the first body.

Step S103, the second body sends the adjusted image to the first body for display.

The effects that can be achieved in steps S101 to S103 will be specifically described below with reference to an example. As shown in FIG. 31 , the second fuselage establishes data connections with the first fuselage A, the first fuselage B, and the first fuselage C, wherein the display screen parameter of the first fuselage A is 1920×1080@60Hz, The display parameters of the first body B are 2340×1080@90Hz, and the display parameters of the first body C are 1280×720@60Hz. When the second body needs to send the video with the original quality of 1920×1080@60Hz to the three first bodies for display, for the first body A, since its display parameters are the same as the original quality of the video, so The second fuselage does not need to process the video, but directly sends it to the first fuselage A for display. For the first fuselage B, the second fuselage can add a black background with a size of 210×1080 on the left and right sides of the video. , so that the resolution of the video is expanded to 2340×1080@60Hz, and then the video is sent to the first body B for display. For the first body C, the second body can compress the resolution of the video to 1280 × 720@60Hz, and then send the video to the first body C for display. It can be seen from this that the second fuselage can make different adjustments to the video to be displayed according to the display parameters of the first fuselage, so as to ensure that the video can be adapted to the display parameters of each first fuselage and achieve optimal display effect, improve user experience.

Further, in order to save power consumption, an embodiment of the present application also provides a device dormancy method. As shown in FIG. 32, the method may include the following steps:

Step S201, in the case that the first body and the second body have established a data connection through Wi-Fi and Bluetooth, if the first body does not obtain a user operation within the first preset time period, the first body Enter the first sleep state.

Wherein, in the first sleep state, the first body turns off the display screen and enters a lock screen state, but maintains a data connection with the second body through Wi-Fi and Bluetooth. In addition, in the first sleep state, the processor of the second body turns off part of the physical core cores, and only reserves a few physical cores with low power consumption for performing background tasks, so as to save power consumption.

In step S201-step S203, the "user operation" may include, for example, the user picks up the first body, presses a button of the first body, unlocks the first body, and displays on the display screen when the first body is unlocked Perform swipe and tap actions, etc. These user operations can be sensed through the sensors, buttons and touch panel of the first body, and transmitted to the microcontroller of the first body. If the microcontroller does not acquire the user operation within the first preset time period, the microcontroller The controller may control the first body to enter the first sleep state.

Step S202, after the first body enters the first sleep state, if the first body does not acquire a user operation within the second preset time period, the first body enters the second sleep state.

In a specific implementation, after the first body enters the first sleep state, if the microcontroller does not acquire a user operation within the second preset time period, the microcontroller may control the first body to enter the second sleep state.

In the second sleep state, the first body keeps the display screen off and the lock screen state, and disconnects the Wi-Fi data connection with the second body, or disconnects the Bluetooth data connection with the second body, so that the first body The first body and the second body only maintain data connection through one of Wi-Fi or Bluetooth, so as to further save power consumption.

Step S203, after the first body enters the second sleep state, if the first body does not acquire a user operation within the third preset time period, the first body enters the third sleep state.

In a specific implementation, after the first body enters the second sleep state, if the microcontroller does not acquire a user operation within a third preset time period, the microcontroller may control the first body to enter the third sleep state.

Among them, in the third sleep state, the first body keeps the display screen off and the lock screen state, and disconnects the Wi-Fi and Bluetooth data connection with the second body, so that the first body and the second body are connected to each other. The data connection is no longer maintained between, to further save power consumption.

In addition, it should be added that if the data connection between the first body and the second body is only established in one way before the first body enters the sleep state, then the device sleep method is shown in Figure 33 It can be reduced to step S301-step S302:

Step S301, in the case where a data connection is established between the first body and the second body through Wi-Fi or Bluetooth, if the first body does not obtain a user operation within a first preset time period, the first body Enter the first sleep state.

Wherein, in the second sleep state, the first body turns off the display screen and enters the lock screen state, but maintains the data connection with the second body.

Step S302, after the first body enters the first sleep state, if the first body does not acquire a user operation within the second preset time period, the first body enters the third sleep state.

Wherein, in the second sleep state, the first body keeps the display screen off and the lock screen state, and disconnects the data connection with the second body, so as to further save energy consumption.

Further, in order to improve the wake-up speed of the first body, an embodiment of the present application also provides a device wake-up method. As shown in FIG. 34 , the method may include the following steps:

Step S401 , when the first body detects that it is touched by the user in the sleep state, establishes a data connection with the second body.

In a specific implementation, the first body may be equipped with an ultrasonic sensor, a pressure sensor, a capacitive sensor, an inductive sensor, a millimeter-wave sensor, or other sensors and sensor arrays thereof to detect user touch. For example, an ultrasonic sensor can measure the distance of an object by emitting ultrasonic waves and receiving reflected echoes, so it can sense the behavior of the user's palm approaching or touching the first body; capacitive sensors will produce capacitance changes when an external conductor approaches , so the user's palm approaching or touching the first body can also be sensed; when an external conductor approaches, the electric sensor will produce an inductance change, so it can also sense the user's palm approaching or touching the first body. In this way, when the sensor detects that the first body is touched, the microcontroller can control the first body to establish a data connection with the second body.

FIG. 35 is a schematic diagram of sensor distribution of the first fuselage provided by an embodiment of the present application. As shown in FIG. 35 , in order to detect user touch, the first body 100 may include multiple sensors, such as sensor S1, sensor S2, sensor S3, sensor S4 to sensor SN, these sensors may be a sensor array composed of the same sensor, Different sensors are also possible. The sensors S1 to SN can be evenly distributed on both sides of the display screen of the first body, so that when the user approaches or touches the first body from any direction, they can be monitored by the sensors.

In addition, it should be supplemented that, according to different sleep states, step S401 can be implemented in different ways, for example:

When the first body is in the first sleep state, since the first body keeps establishing a data connection with the second body through Wi-Fi and Bluetooth, step S401 can be omitted.

When the first body is in the second sleep state, since the first body and the second body only maintain data connection through one of Wi-Fi or Bluetooth, if the first body is touched by the user, Then the microcontroller can enable another data connection method, so that the first body and the second body can establish a data connection through Wi-Fi and Bluetooth at the same time.

When the first body is in the third sleep state, if the first body is touched by the user, the microcontroller can enable the Wi-Fi or Bluetooth module, so that the first body and the second body pass through Wi-Fi at the same time Establish a data connection with Bluetooth.

Step S402, the second body acquires the display screen parameters of the first body, and generates image data according to the display screen parameters.

In an implementation manner, the processor of the second body may send a request message to the microcontroller of the first body after the first body and the second body establish a data connection to obtain the display screen of the display screen parameters, and generate image data based on display parameters.

In an implementation manner, the processor of the second fuselage may acquire the display screen parameters of the display screen from the beacon frame broadcast by the first fuselage during the process of establishing a data connection between the first fuselage and the second fuselage , and generate the first image data according to the parameters of the display screen.

Step S403, when the first body detects that it is lifted by the user, it sends a wake-up message to the second body.

In a specific implementation, the first body may include an acceleration sensor and/or a gyro sensor. The acceleration sensor may be used to measure the acceleration of the first body, and the gyro sensor may be used to measure the angular acceleration of the first body. The acceleration sensor and/or the gyroscope sensor can transmit the measured acceleration and/or angular acceleration to the microprocessor, so that the microprocessor can judge whether the first body is lifted by the user, and if the first body is lifted by the user , the microcontroller can send a wake-up message to the processor of the second body. In addition, when the microcontroller acquires that the button of the first body is pressed, it can also send a wake-up message to the processor of the second body.

Step S404, the second body lights up the display screen according to the wake-up message, and sends the image data to the display screen for display.

In specific implementation, after the processor of the second body receives the wake-up message, it can send a screen-on message and the generated image data to the microcontroller of the first sub-device; After the screen-on message and the image data are obtained, the display screen can be lighted according to the screen-on message, and the image data can be decoded and sent to the display screen for display.

Embodiments of the present application provide a chip system, where the chip system includes a microcontroller, which is used to support the above-mentioned first body to implement the functions involved in the above-mentioned embodiments, such as displaying image data on a display screen.

An embodiment of the present application provides a chip system, where the chip system includes a processor for supporting the second body to implement the functions involved in the foregoing embodiments, such as generating image data.

Embodiments of the present application also provide a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium runs on the microcontroller of the first body, the microcontroller can implement the above aspects and implementation thereof way involved in the function of the first fuselage.

Embodiments of the present application further provide a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium runs on the processor of the second body, the processor enables the processor to implement the above aspects and implementation manners. The function of the second fuselage involved.

The above specific embodiments further describe in detail the purposes, technical solutions and beneficial effects of the embodiments of the present application. It should be understood that the above are only specific implementations of the embodiments of the present application, and are not intended to limit the implementation of the present application. Any modification, equivalent replacement, improvement, etc. made on the basis of the technical solutions of the embodiments of the present application shall be included in the protection scope of the embodiments of the present application.

Claims

An electronic device, comprising:

Separately arranged first body and second body, processor, microcontroller and display screen;

The microcontroller and the display screen are arranged on the first body, and the processor is arranged on the second body;

establishing a data connection between the first body and the second body in a wired or wireless manner;

The processor is configured to generate first image data and send the first image data to the microcontroller;

The microcontroller is used for outputting the first image data to the display screen for display.
The electronic device according to claim 1, wherein,

the first body includes a touch panel for detecting a user's touch input on the display screen;

the microcontroller for sending the touch input to the processor;

The processor is configured to generate the first image data according to the touch input.
The electronic device according to claim 1 or 2, characterized in that,

The first body includes a button, and the button is used to detect a user's button input;

the microcontroller is configured to send the key input to the processor;

The processor is configured to generate the first image data according to the key input.
The electronic device according to any one of claims 1-3, wherein,

the first body includes a sensor module;

The microcontroller is configured to send sensor data collected by the sensor module to the processor;

The processor is configured to generate the first image data from the sensor data.
The electronic device according to any one of claims 1-4, wherein,

The first body includes a camera, and the camera is used to collect second image data;

The microcontroller is used for sending the second image data to the display screen for display;

The microcontroller is further configured to encode the second image data and send it to the second body.
The electronic device according to any one of claims 1-5, wherein,

The first body and the second body further include a wireless communication module;

The wireless communication module includes a Bluetooth module and/or a Wi-Fi module;

The first body and the second body establish a data connection through the Bluetooth module and/or the Wi-Fi module.
The electronic device according to any one of claims 1-5, wherein,

the first body and the second body further include external interfaces;

When a cable is used to connect the external interfaces of the first body and the second body, the first body and the second body establish a wired data connection.
The electronic device according to any one of claims 1-7, wherein,

The processor is configured to acquire display screen parameters of the display screen, and the display screen parameters include the resolution and/or refresh rate of the display screen;

The processor adjusts the first image data according to the display screen parameters, and the adjustment includes at least one of scaling, cropping, frame insertion, and compression on the first image data;

The processor sends the adjusted first image data to the microcontroller.
The electronic device according to claim 8, wherein,

The microcontroller is used for broadcasting a beacon frame, and the beacon frame includes the parameters of the display screen;

The processor is configured to obtain the display screen parameter from the beacon frame.
The electronic device according to claim 8, wherein,

The processor is configured to send a first request message to the microcontroller;

The microcontroller is configured to send the display screen parameter to the processor according to the first request message.
The electronic device according to claim 6, wherein, in the case that the first body and the second body establish a data connection through the Wi-Fi module and the Bluetooth module, if the first body and the second body establish a data connection through the Wi-Fi module and the Bluetooth module If the microcontroller does not obtain a user operation within a first preset time period, the microcontroller controls the first body to enter a first sleep state, wherein the first sleep state includes the first body The body turns off the display screen and locks the screen, and maintains a data connection with the second body through the Wi-Fi module and the Bluetooth module.
The electronic device according to claim 11, wherein after the first body enters the first sleep state, if the microcontroller does not acquire a user operation within a second preset time period, the The microcontroller controls the first body to enter a second sleep state, wherein the second sleep state includes the first body turning off the display screen and locking the screen, and passing through the second body The Wi-Fi module or the Bluetooth module maintains a data connection.
The electronic device according to claim 12, wherein after the first body enters the second sleep state, if the microcontroller does not acquire a user operation within a third preset time period, the The microcontroller controls the first body to enter a third sleep state, wherein the third sleep state includes that the first body turns off the display screen and locks the screen, and disconnects from the second body. Open data connection.
The electronic device according to claim 13, wherein,

A plurality of sensors are distributed on both sides of the display screen, and the plurality of sensors are used to detect whether the first body is touched by the user and whether it is picked up by the user;

The microcontroller is configured to control the first body to establish a data connection with the second body when the first body is touched by a user in the third sleep state;

The processor is configured to acquire display screen parameters of the display screen after the first body and the second body establish a data connection, and generate the first image data according to the display screen parameters;

The microcontroller is configured to send a first wake-up message to the processor when the first body is lifted by a user;

The processor is configured to light up the display screen according to the first wake-up message, and send the first image data to the microcontroller.
A distributed system, characterized by comprising: a plurality of the first bodies of the electronic equipment according to any one of claims 1-14, and one electronic equipment according to any one of claims 1-14 The second fuselage, a plurality of the first fuselage respectively establish a data connection with the second fuselage in a wired or wireless manner.