RU2801590C1 - Control method and control system for photography - Google Patents

Abstract

FIELD: computer vision.

SUBSTANCE: method includes: receiving, with the help of the first electronic device, the photographing instruction; determining the location information of the content to be photographed corresponding to the photographing instruction or the photographing mode according to the photographing instruction, and determining, based on the location information of the content to be photographed or the photographing mode, the cameras in the most suitable location for photographing the content to be photographed, from at least two cameras controlled by the first electronic device as the target camera, wherein said at least two cameras comprise a camera on the first electronic device and a camera on the second electronic device, and the first electronic device is different from the second electronic device; and controlling, with the first electronic device, the target camera to execute the photographing instruction to acquire image data acquired by the target camera.

EFFECT: improved quality of images obtained by the camera of the electronic device.

15 cl, 11 dwg, 2 tbl

Description

FIELD OF TECHNOLOGY TO WHICH THE INVENTION RELATES

[0001] This application relates to the field of the Internet of things and, in particular, to a control method, an electronic device, computer-readable information and a chip.

BACKGROUND OF THE INVENTION TO which THE INVENTION RELATES

[0002] Currently, various terminal devices that we use, such as mobile phones, tablet computers, surveillance cameras, TVs, car consoles and glasses, can only be controlled individually based on manual selection by users or remotely using mobile phones connected to cameras or smart home products.

[0003] In the prior art, many electronic devices include cameras, and users can manually select mobile phones, tablet computers, and surveillance cameras to take photographs and take photos or videos. However, due to the limitation of the angle and distance to the user, in some scenarios, there is a technical problem of poor photographic quality.

SUMMARY OF THE INVENTION

[0004] The present application provides a control method, an electronic device, a computer-readable storage medium, and a chip for performing joint photography with a camera of a second electronic device, thereby improving the quality of photography.

[0005] According to a first aspect, an embodiment of the present invention provides a control method including:

[0006] receiving, with the first electronic device, instructions for photographing;

[0007] determining location information of the content to be photographed corresponding to the photographing instruction according to the photographing instruction, and determining, based on the location information of the content to be photographed, a camera at the most suitable location for photographing the content to be photographed from at least two cameras, controlled by the first electronic device as the target camera; and/or

[0008] determining a photographing mode based on the content to be photographed and in accordance with the photographing instructions, and determining a camera including said photographing mode of at least two cameras controlled by the first electronic device as the target camera, wherein said at least two cameras include a first electronic device camera and a second electronic device camera, wherein the first electronic device is different from the second electronic device; And

[0009] controlling, by the first electronic device, the target camera to execute a photographing instruction to acquire image data acquired by the target camera.

[0010] Optionally, determining, based on the location information of the content to be photographed, the camera at the most suitable location for photographing the content to be photographed of at least two cameras controlled by the first electronic device as the target camera includes:

[0011] determining, based on the location information of the content to be photographed, a camera whose photographing range covers said location information from at least two cameras controlled by the first electronic device, and if only one camera is determined, determining this camera as target camera;

[0012] or

[0013] determining a photographing mode based on the content to be photographed, determining a camera including said photographing mode from at least two cameras controlled by the first electronic device, and if only one camera is determined, determining this camera as the target camera.

[0014] Optionally, determining, based on the location information of the content to be photographed, the camera at the most suitable location for photographing the content to be photographed of at least two cameras controlled by the first electronic device as the target camera includes:

[0015] determining, based on the location information of the content to be photographed, a camera whose photographing range covers said location information of said at least two cameras controlled by the first electronic device, and if a plurality of cameras is determined, controlling said plurality of cameras to obtaining photographs, for obtaining at least two photographs; and evaluating the at least two photographs according to the first predetermined rule and determining the camera corresponding to the highest rated photograph as the target camera; or

[0016] determining a photographing mode based on the content to be photographed, determining a camera including said photographing mode from said at least two cameras controlled by the first electronic device, and if a plurality of cameras are determined, controlling said plurality of cameras to take photographs, to take at least two photographs; and evaluating the at least two photographs according to the first predetermined rule and determining the camera corresponding to the highest rated photograph as the target camera.

[0017] Optionally, controlling the target camera by the first electronic device to execute the photographing instruction to obtain image data acquired by the target camera includes:

[0018] sending the first electronic device a photograph request to the electronic device where the target camera is located, and receiving image data sent by the electronic device where the target camera is located; or

[0019] calling the first electronic device of the target camera as a virtual camera of the first electronic device and receiving the image data obtained by the virtual camera.

[0020] Optionally, the first predefined rule includes:

[0021] at least one of a camera operating parameter, a distance between the camera and the content to be photographed, or an angle between the camera and the content to be photographed.

[0022] Optionally, before the first electronic device invokes the target camera as a virtual camera of the first electronic device, the method further includes: virtualizing the first electronic device's camera of the second electronic device as a virtual camera by using the first electronic device's distributed device virtualization module MSDP; and calling the first electronic device of the target camera as a virtual camera of the first electronic device, and obtaining the image data acquired by the virtual camera, further including:

[0023] calling the CaaS function by the first electronic device, wherein the CaaS function is called by the first electronic device via the CaaS service; And

[0024] querying by the CaaS MSDP service if a virtual camera exists, and if a virtual camera exists, receiving through the camera interface the image data received by the virtual camera.

[0025] According to a second aspect, an embodiment of the present invention provides an electronic device, including:

[0026] one or more processors;

[0027] memory;

[0028] many applications; And

[0029] one or more computer programs, wherein said one or more computer programs are stored in memory, said one or more computer programs including instructions, and when the instructions are executed by the first electronic device, the first electronic device performs a method according to with any embodiment of the present invention.

[0030] According to a third aspect, an embodiment of the present invention provides an electronic device, including:

[0031] a first acquisition module, configured to receive a photographing instruction;

[0032] the first determining module, configured to determine the position information of the content to be photographed corresponding to the photographing instruction in accordance with the photographing instruction, and determine, based on the location information of the content to be photographed, the camera at the most suitable location for photographing the content to be photographed at least two cameras controlled by the first electronic device as the target camera; and/or

[0033] determining a photographing mode based on the content to be photographed, and in accordance with the photographing instruction and determining a camera including said photographing mode, of at least two cameras controlled by the first electronic device, as a target camera, wherein said at least at least two cameras include a first electronic device camera and a second electronic device camera, the first electronic device being different from the second electronic device; And

[0034] a control module configured to control the target camera to execute a photographing instruction to acquire image data acquired by the target camera.

[0035] According to a fourth aspect, an embodiment of the present invention provides a control method including:

[0036] receiving, with the first electronic device, instructions for photographing;

[0037] controlling, in response to the photographing instruction, the first electronic device, at least two cameras controlled by the first electronic device, to execute the photographing instruction to obtain image data obtained by the target cameras, to obtain at least two photographs, wherein the at least two cameras include a camera on a first electronic device and a camera on a second electronic device, the first electronic device being different from the second electronic device;

[0038] calculating a score for each photograph according to at least one of a distance between a camera that acquires each photograph and an object to be photographed, a face angle, or an aesthetic composition parameter; And

[0039] using a photograph that satisfies a predetermined evaluation as a photographing result of the photographing instruction; and/or when the photographing instruction is a video acquisition instruction, perform video acquisition using the camera corresponding to the photograph that satisfies the predetermined evaluation.

[0040] Optionally, in case the photo includes a character, the photo score is calculated using the following formula:

[0041] E=αx+βy+γz, where

[0042] E is a photo score;

[0043] the distance parameter x uses the best photographing distance of 50 cm of physical distance as the maximum value, the gradient of which decreases in the farther or closer direction, and α is the weighted value of the x distance parameter and has a range of [0, 1];

[0044] the angle parameter y uses the angle facing the camera as the maximum value, the deviation gradient of which decreases to the angle along the three axes, and β is the weighted value of the angle parameter y and has a range of [0, 1]; And

[0045] The aesthetic composition parameter z uses the maximum score of the aesthetic composition evaluation model as the maximum value, the gradient of which decreases, and γ is the weighted value of the aesthetic composition parameter z and has a value range of [0, 1].

[0046] Optionally, if there is no user in the photo, the photo score is calculated using the following formula:

[0047] E=αx+γz, where

[0048] E is a photo score;

[0049] the distance parameter x uses the best photographing distance of 50 cm of physical distance as the maximum value, the gradient of which decreases in the farther or closer direction, and α is the weighted value of the x distance parameter and has a range of [0, 1]; And

[0050] The aesthetic composition parameter z uses the maximum score of the aesthetic composition evaluation model as the maximum value, the gradient of which decreases, and γ is the weight value of the aesthetic composition parameter z and has a range of [0, 1].

[0051] According to a fifth aspect, an embodiment of the present invention provides an electronic device including: one or more processors;

[0052] memory;

[0053] many applications; And

[0054] one or more computer programs, wherein said one or more computer programs are stored in memory, said one or more computer programs include instructions, and when the instructions are executed by the first electronic device, the first electronic device performs a method in accordance with any embodiment of the present invention.

[0055] According to a sixth aspect, an embodiment of the present invention provides an electronic device, including:

[0056] an acquisition module, configured to receive the photographing instruction;

[0057] a response module, configured to control the first electronic device in response to a photographing instruction of at least two cameras controlled by the first electronic device, to execute the photographing instruction to obtain image data obtained by the target cameras, to obtain at least two photographs, wherein said at least two cameras include a camera on a first electronic device and a camera on a second electronic device, wherein the first electronic device is different from the second electronic device;

[0058] a scoring module, configured to calculate a score for each photograph according to at least one of the following: a distance between a camera that acquires each photograph and an object to be photographed, a face angle, or an aesthetic composition parameter; And

[0059] a determining unit, configured to use a photograph that satisfies a predetermined evaluation as a photographing result of the photographing instruction; and/or when the photographing instruction is a video acquisition instruction, performing video acquisition using the camera corresponding to the photograph that satisfies the predetermined evaluation.

[0060] According to a seventh aspect, an embodiment of the present invention provides a computer-readable storage medium including instructions, where the instructions, when executed on an electronic device, cause the electronic device to perform a method according to any embodiment of the present invention.

[0061] According to an eighth aspect, an embodiment of the present invention provides a computer program product including a program code, wherein the program code is configured to perform a method according to any embodiment of the present invention.

[0062] According to a ninth aspect, an embodiment of the present invention provides a chip including instructions where the chip, when run on an electronic device, causes the electronic device to execute a method according to any embodiment of the present invention.

[0063] In embodiments of the present invention, after receiving the photographing instruction, the first electronic device can determine, based on the location information of the content to be photographed, the camera at the most suitable location for photographing the content to be photographed from at least two cameras controlled by the first electronic device as the target. cameras; or determining a photographing mode based on the content to be photographed, and determining a camera including said photographing mode of at least two cameras controlled by the first electronic device as the target camera, thereby controlling the target camera to execute the photographing instruction. The target cameras can be cameras on at least two electronic devices, so that different cameras can be selected based on the location information of the content to be photographed and the photographing mode, without being limited to the camera of the first electronic device, thereby achieving the technical effect of improving the quality of the acquired image data.

BRIEF DESCRIPTION OF THE DRAWINGS

[0064] FIG. 1 is a block diagram of an electronic device according to an embodiment of the present invention;

[0065] FIG. 2 is a software block diagram of an electronic device according to an embodiment of the present invention;

[0066] FIG. 3 is a block diagram of a smart home system according to an embodiment of the present invention;

[0067] FIG. 4 is a flowchart of a control method according to an embodiment of the present invention;

[0068] FIG. 5 is a block diagram of software that virtualizes the camera of another electronic device as the camera of the electronic device 100 according to an embodiment of the present invention;

[0069] FIG. 6 is an interaction diagram of a photo processing interface according to an embodiment of the present invention;

[0070] FIG. 7 is a flowchart of a control method according to an embodiment of the present invention;

[0071] FIG. 8 is a flowchart of a control method according to another embodiment of the present invention;

[0072] FIG. 9 is a flowchart of a control method according to another embodiment of the present invention;

[0073] FIG. 10 is a schematic diagram of photographs taken by various cameras in accordance with an embodiment of the present invention; And

[0074] FIG. 11 is a flowchart of a control method according to another embodiment of the present invention.

Description of Embodiments

[0075] The technical solutions in the embodiments of this application are described below with reference to the accompanying drawings in the embodiments of this application. In the descriptions of the embodiments of this application, "/" means "or", unless otherwise indicated. For example, A/B may represent A or B. "And/or" as used here only describes an association relation for describing associated objects, and means that three relations may exist. For example, A and/or B could represent the following three cases: Only A exists, both A and B exist, and only B exists.

[0076] The terms "first" and "second" mentioned below are for description purposes only and should not be understood as an indication or meaning of relative importance or an implicit indication of the number of specified technical characteristics. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of the embodiments of this application, unless otherwise indicated, "many" means two or more.

[0077] Application scenarios involved in embodiments of the present application are described below. An electronic device is equipped with devices such as a camera, a microphone, a global positioning system (GPS) chip, various sensors (such as a magnetic field sensor, a gravity sensor, and a gyroscope sensor) to sense the environment and the user's actions. In accordance with the perceived external environment and user actions, the electronic device provides the user with a personalized and contextual service experience. The camera can receive complete and accurate information so that the electronic device can perceive the external environment and the actions of the user. An embodiment of this application provides an electronic device. The electronic device may be implemented as any of the following devices, including a camera: a mobile phone, a tablet computer (tablet), a portable game console, a personal digital assistant (PDA), a laptop, an ultra mobile personal computer (ultra mobile personal computer). , UMPC), handheld computer, netbook, car media player, wearable electronic device, virtual reality (VR) terminal device, augmented reality (AR), terminal device or other digital display products.

[0078] First, an exemplary electronic device 100 provided in the following embodiment of this application will be described.

[0079] FIG. 1 is a block diagram of the electronic device 100.

[0080] This embodiment is described in detail below using the electronic device 100 as an example. It should be understood that the electronic device 100 shown in FIG. 1 is only an example, and the electronic device 100 may have more or fewer components than shown in FIG. 1 may combine two or more components, or may have a different component configuration. The components shown in the figure may be implemented in hardware, software, or a combination of hardware and software that includes one or more signal processing and/or application specific integrated circuits.

[0081] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge control module 140, a power management unit 141, a battery 142, an antenna 1 , antenna 2, mobile module 150, wireless module 160, audio module 170, speaker 170A, handset 170B, microphone 170C, headset jack 170D, sensor module 180, key 190, motor 191, indicator 192, camera 193, screen 194 a display, a subscriber identification module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an atmospheric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, an optical proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, and a touch sensor 180K, ambient light sensor 180L, bone conduction sensor 180M, and the like.

[0082] It can be understood that the schematic structure in this embodiment of the present invention imposes no particular restrictions on the electronic device 100. In some other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or some components may be combined, or some components may be separated, or a different arrangement of components may be used. The components in the figure may be implemented in hardware, software, or a combination of software and hardware. For a detailed structural description of the electronic device 100, see the previous patent application: CN201910430270.9.

[0083] FIG. 2 is a block diagram of the software structure of an electronic device 100 according to an embodiment of this application. In a layered architecture, software is divided into multiple layers, and each layer has a clear role and purpose. The levels interact with each other through a programming interface. In some embodiments, the Android system is divided into four layers, which are respectively the application layer, the application structure layer, the Android runtime and system library, and the kernel layer from top to bottom. The application layer may include a number of application packages. For a detailed description of the software features, see the previous patent application: CN201910430270.9.

[0084] An embodiment of the present invention provides a control method that can be applied to image photography and video photography. The method is applied to electronic device 100. Electronic device 100 is configured to use the capabilities of other electronic devices associated with the electronic device, especially camera functions, to use the camera functions of other electronic devices to acquire images. Other electronic devices are, for example, electronic devices linked to the same account as electronic device 100, electronic devices on the same local area network as electronic device 100, electronic devices owned by the same user as electronic device 100 , electronic devices (for example, when the user of electronic device 100 is a mother in a family, other electronic devices include electronic devices of mother, father, and children) belonging to the same household as electronic device 100, and other electronic devices that may control the electronic device 100, which are not listed in detail and are not limited to this embodiment of the present invention. For example, if each electronic device wants to share a function (for example, a camera), the electronic device can be registered in the cloud, and the cloud records the electronic device with the sharing function (for example, a shared camera, microphone, or display screen). Thus, when the electronic device 100 needs to take a photo, the current location and the photo request are sent to the cloud, and the cloud selects a suitable electronic device for taking a photo and provides the electronic device to the electronic device 100.

[0085] With the upgrade of smart home and smart life, and through the Internet connecting things, there will be an integrated life cycle in the future, in which a terminal such as a mobile phone or a cloud is used as a hub and many different terminals (for example, tablets , surveillance cameras, televisions, car consoles and glasses) are intelligently coordinated throughout the scenario. Electronic device 100 may be an electronic device included in a smart home scenario. Referring to FIG. 3, the smart home scenario includes the following devices: a desktop computer 30 (including a camera, where the camera ID is 30a), a smart TV 31 (including a camera, where the camera ID is 31a), PAD32 (including a camera where the camera ID is 32a), a smart watch 33 (including a camera, where the camera ID is 33a), a mobile phone 34 (including a front camera and a rear camera, where the front camera ID is 34a and the rear camera ID is 34b), vehicle 35 (including five cameras, where the camera IDs are 35a, 35b, 35c, 35d, and 35e).

[0086] The electronic device 100 is, for example, a mobile phone 34. The smart home scenario may further include other devices. Alternatively, the electronic device 100 may be another device in a smart home scenario, typically an electronic device with relatively high computing capability in a smart home scenario. The electronic device 100 may be identified as the main control device, and the electronic device whose capabilities (eg, camera, microphone, or display) are registered with the main control device (electronic device 100) may be identified as the control device. The control method provided in the embodiments of the present invention may alternatively be applied to the cloud. When the electronic device needs to take a photograph of a photo or video, for example, after the user has generated a photographing instruction, the photographing instruction is sent to the cloud, and the cloud selects the most suitable electronic device for photographing based on the capabilities of the electronic devices.

[0087] The control method is described below using the electronic device 100 as an example. Referring to FIG. 4, the method includes the following steps:

[0088] S400: The electronic device 100 receives the photographing instruction.

[0089] The photographing instruction is, for example, an instruction for photographing a photo, and the photographing instruction may be a voice instruction, an instruction for triggering a photographing button in a photographing application, a predetermined gesture, or the like. For example, a user of the electronic device 100 may give a voice instruction to the electronic device 100. A voice instruction such as "take a picture of me" or "take a picture of the interior of the car." The user may issue a voice instruction when the screen of the electronic device 100 is in a locked state, or may issue a voice instruction after the electronic device 100 is unlocked. The electronic device 100 may respond to the voice instruction in both cases. Alternatively, the user may launch the camera application of the electronic device 100 and instruct to take a photo through the camera application. Alternatively, the user may start the instant messaging application and initiate the photography instruction by clicking the camera button on the instant messaging application, or start the photography instruction by clicking the video communication button on the instant messaging application, or the like. Of course, the photographing instruction may alternatively be generated in other ways that are not specifically listed or limited in this embodiment of the present invention. The electronic device 100 is, for example, the mobile phone 34 shown in FIG. 3. In this embodiment, it is described as an example that the user takes a photograph with the photograph button of the camera application. In an optional embodiment, the photographing instruction is issued by the user of the electronic device 100. For example, user A picks up a mobile phone 34 and says, "Take a picture of the interior of the car." Then, the electronic device 100 directly receives the photographing instruction. In another example, user A picks up a mobile phone 34, opens a vehicle monitoring application, and starts the remote photography function; and the vehicle monitoring application of the electronic device 100 then generates a photographing instruction based on the user's operation, or the like. In another optional embodiment, the electronic device 100 receives a photograph instruction sent by another electronic device. For example, a user sends a voice instruction "take a picture of my kitchen" to a navigator in a vehicle. After receiving the photographing instruction, the navigator in the vehicle sends the photographing instruction to the electronic device 100, so that the photographing instruction is executed based on the powerful computing function of the electronic device 100.

[0090] Alternatively, upon detecting the photographing instruction, the navigator in the vehicle first determines whether the navigator in the vehicle has the capability to process the photographing instruction. If the navigator in the vehicle has the ability to process the photograph instruction, the navigator in the vehicle processes the photograph instruction; otherwise, the navigator in the vehicle sends a photographing instruction to the electronic device 100.

[0091] For example, upon detecting a photograph instruction, the navigator in the vehicle can determine whether the navigator in the vehicle can respond to the photograph instruction and obtain a photo or video corresponding to the photograph instruction. If the navigator in the vehicle can respond to the photograph instruction, the navigator in the vehicle can be considered to be able to process the photograph instruction; otherwise, the navigator in the vehicle is considered to be unable to process the photograph instruction.

[0092] S410: The electronic device 100 receives, in response to the photographing instruction, photographs respectively through at least two cameras of the electronic device 100 to take at least two photographs, said at least two cameras of the electronic device 100 including at least one of a physical camera or a virtual camera, there may be one or more physical cameras, and there may also be one or more virtual cameras.

[0093] In an optional implementation, the at least two cameras of the electronic device 100 include both a physical camera and a virtual camera such that the electronic device 100 can simultaneously respond to a photograph instruction through the cameras of the electronic device 100 and the camera of the other electronic device.

[0094] In a particular implementation process, the physical camera of electronic device 100 is an embedded camera of electronic device 100, such as the front camera or rear camera of electronic device 100. A virtual camera of electronic device 100 is a camera virtualized from another electronic device by electronic device 100. Electronic the device 100 may initiate the virtual camera registration operation in many cases. Two cases are listed below for description. In a specific implementation process, the present invention is not limited to the following two cases. Using the smart home system shown in FIG. 3, for example, mobile phone 34 has two physical cameras (a front camera and a rear camera, where the front camera ID is 34a and the rear camera ID is 34b) and nine virtual cameras (the camera IDs of which are 30a, 31a, 32a, 33a, 35a, respectively). , 35b, 35c, 35d and 35e).

[0095] Before calling the virtual camera function, the electronic device 100 first needs to register the data (image or video) received by the camera of the other electronic device as a virtual camera. The electronic device 100 may register the camera of another electronic device as a virtual camera in many cases, and two cases are listed below for description. Of course, in a specific implementation process, the present invention is not limited to the following two cases.

[0096] In the first case, after turning on the power of the electronic device 100 (used as the main control device) (or connecting to a router or turning on the Bluetooth function), the electronic device 100 sends broadcast information via short-range communication (for example, Bluetooth or WI-FI) to searching for other electronic devices in the communication range, and the device information is sent to the electronic device 100. The device information includes, for example, device characteristics (camera, microphone, display, etc.), device location, or device ID (document , proving identity: identification code). If the electronic device 100 wishes to register the camera of the corresponding electronic device as a virtual camera, the electronic device 100 sends request information to the corresponding electronic device. If the corresponding electronic device agrees to use the camera as a virtual camera of the electronic device 100, the electronic device generates confirmation information (eg, presses a predetermined button, generates a predefined voice instruction, or generates a voice gesture). After receiving the confirmation information, the electronic device 100 performs a virtualization operation to virtualize the camera of the corresponding electronic device as a local camera. Similarly, electronic device 100 may alternatively virtualize another function (eg, microphone or display) of another electronic device as a local device.

[0097] After another electronic device is turned on (or connected to a router), broadcast information may also be generated to search for the main control device (electronic device 100). Once electronic device 100 is located, electronic device 100 virtualizes the camera of the other electronic device as the camera of electronic device 100. Similarly, electronic device 100 may further virtualize other capabilities of the other electronic device as capabilities of electronic device 100.

[0098] In the second case, after registering with the server through an account, the electronic device 100 can search for another electronic device registered with the same account as the electronic device 100, register the camera of said other electronic device as the camera of the electronic device 100, and may further register another capability of another electronic device as a capability of electronic device 100. After another electronic device (managed device) is registered with the server through an account, the other electronic device may also search for a master control device registered with the same account that other electronic device, and register its function in the main control device.

[00099] In a specific implementation process, the camera is registered as a virtual camera of the system so that the electronic device 100 can call up data received by the camera of another electronic device. Electronic device 100 may invoke other capabilities of another electronic device in a similar manner.

[00100] Referring to FIG. 5, the software architecture to implement the solution includes:

[00101] Electronic device 100 may call a CaaS function (eg, CaaS Kit). CaaS (Communications-as-a-Service: Communications as a Service) refers to the encapsulation of the communication capabilities of the Internet, such as messaging, voice, video, conferencing, and collaborative communication, in an API (Application Programming Interface) or SDK (Software Development Kit, a software development kit) that are public and available for use by third parties. The CaaS feature includes a large amount of content such as call signaling, media transmission, and CaaS services. The CaaS function is invoked by the electronic device 100 via the CaaS service. When the trigger condition is satisfied, the electronic device 100 first informs the MSDP (Mobile Sensing development platform) to register the camera of the other electronic device as a hardware abstraction layer virtual camera.

[00102] The application structure layer includes: a camera structure configured to provide a camera function to the outside world. The camera interface is configured to receive data received by the cameras. The MSDP is capable of a virtual camera, that is, the virtualization of the camera of another electronic device as a virtual camera of the hardware abstraction layer.

[00103] The hardware abstraction layer includes cameras (physical cameras and virtual cameras). Through the camera interface, not only physical cameras (for example, front camera data and rear camera data) of the electronic device 100 can be accessed, but virtual cameras can also be accessed. The hardware abstraction layer is located between the system library and the kernel layer in the software system structure shown in FIG. 2.

[00104] When the electronic device 100 needs to invoke the CaaS camera function, the electronic device first registers the CaaS service with the system. The CaaS service queries MSDP if a virtual camera exists and, if a virtual camera exists, gets the video data of the virtual camera through the camera interface. The virtual camera and the physical camera have different tags, so the CaaS service can accurately retrieve virtual camera video data based on the virtual camera tag. Of course, other possibilities can be provided for the electronic device in a similar manner, which are not limited to this embodiment of the present invention.

[00105] When a camera of another electronic device is registered as a virtual camera of the electronic device 100, some information about the virtual camera may be recorded, such as location information, functions (for example, photographing mode, camera zoom, and camera resolution), and on which electronic device has a camera. In addition, each camera has a camera ID, which is used by the electronic device 100 to identify the identity of the camera.

[00106] In a particular implementation process, the electronic device 100 may control all of its cameras to take photographs, or may control some of its cameras to take photographs. The electronic device may select the target camera from all of its cameras in various ways. The two methods are listed below for description. Of course, in a specific implementation process, the present invention is not limited to the following two cases.

[00107] In the first case, after receiving the photographing instruction, the electronic device 100 may first determine the location information of the content to be photographed corresponding to the photographing instruction, and then determine the camera for photographing based on the location information. For example, the user is worried that the car window is not closed or a thief entered the car, so the user wants to check the situation in the car, and the following photographing instruction "check the situation in the car" is generated. After receiving the photographing instruction, the electronic device 100 determines that the content to be photographed is in the vehicle through semantic analysis. In this case, the electronic device 100 calls the cameras located in the car among the cameras (physical cameras and virtual cameras), that is, the cameras 35a, 35b, 35c, 35d and 35e, and then controls the cameras to perform image acquisition.

[00108] In another example, the photographing instruction is "Hey Baby E, take a picture for me" and the photographing instruction is received by the electronic device 100. The electronic device 100 may then determine the camera of the electronic device within a predetermined distance range as the camera to capture currently. For example, the electronic device 100 may first determine the area in which the electronic device 100 is located (for example, in a living room) using a positioning device (or by obtaining and analyzing an image of the environment), and then determine the camera, the electronic device in the area as cameras for purchase. For example, if the electronic devices currently in the living room include PAD32 and smart TV 31 (also include electronic device 100), electronic device 100 can determine that cameras 32a, 31a, 34a, and 34b are cameras for data collection.

[00109] After receiving the voice information generated by the user, the electronic device may match the voice information with a predefined user voice information to verify the identity of the user sending the voice information. After the sensor of the electronic device 100 receives the user's voice information, the voice information is transmitted to the CPU or NPU (Neural-network Processing Unit: Embedded Neural Network Processor) through the voice recognition main board and converted into a voice instruction recognized by the electronic device 100.

[00110] Alternatively, the electronic device 100 may first obtain location information of other electronic devices through the positioning device, and then use the electronic device camera, the distance from which to the electronic device 100 is within a predetermined distance range, as a camera for collecting data. The predetermined distance is, for example, 10 m or 20 m, which is not limited to this embodiment of the present invention.

[00111] In the second case, the electronic device 100 may determine the content to be photographed in the photographing instruction; determine the photographing mode based on the content to be photographed; and determine, based on the photographing mode, a camera including said photographing mode as the acquisition camera.

[00112] For example, if the photographing instruction is a voice instruction, the electronic device 100 may first recognize the voice instruction and then perform semantic analysis based on the recognized content, thereby determining that the content to be photographed is a person, landscape, still life, or something. similar. For example, if the photographing instruction is "take a photo for me", the content to be photographed includes a person; if the photography instructions say "take a picture of the bedroom", then the content to be photographed includes a still life; if the photographing instruction says "to photograph the scene in front of you", the content to be photographed is the landscape, etc.

[00113] If the content to be photographed includes a "person", the photographing mode of the camera is, for example, a portrait mode or a large aperture mode. If the content to be photographed is "landscape", the photographing mode of the camera is, for example, a landscape mode. If the determined photographing mode is portrait mode, the electronic device 100 may first detect cameras with portrait mode, and then control the cameras to perform image acquisition; and, if the determined photographing mode is landscape mode, the electronic device 100 may first detect cameras with landscape mode, and then control the cameras to acquire an image, and so on. Optionally, when the electronic device 100 controls the cameras to take pictures, the photographing instruction may include photographing modes. For example, if the content to be photographed corresponding to the photographing instruction includes a "person", the photographing mode is a portrait mode. The electronic devices that receive the photographing instruction use the portrait mode to acquire photographs and send the photographs to the electronic device 100. If the content to be photographed corresponding to the photographing instruction is a landscape, the photographing mode may be a landscape mode. The electronic devices that receive the photographing instruction use the landscape mode to take photographs and send the photographs to the electronic device 100.

[00114] In addition, if the electronic devices that receive the photographing instruction do not have a corresponding photographing mode, the photographing mode closest to the corresponding photographing mode or the favorite photographing mode of the user of the electronic device is used for photographing. 100 is used to take a photo (for example, the default photo mode or the most used photo mode in history).

[00115] When controlling the camera to take a photograph, the electronic device 100 may further inform about the photographing parameters of the camera, such as the photograph size, exposure, and photographing mode.

[00116] S420: The electronic device 100 receives a score for each of the at least two photographs.

[00117] Electronic device 100 may send said at least two photographs to a server, and after the server rates said at least two photographs, the ratings will be returned to electronic device 100. Alternatively, electronic device 100 may locally rate said at least at least two photographs, and the specific method for obtaining a score for each photograph is described below.

[00118] It is assumed that the cameras 35a, 35b, 35c, 35d and 35e are used for acquisition in step S320, and the evaluations of the obtained photographs are shown in Table 1:

Camera ID 35A 35B: 35c 35D 35E Grade 7.1 7.5 8.3 5.7 6.9

Table 1

[00119] Of course, based on different cases, the evaluation of the photos taken by each camera is also different, and the details are not re-described here.

[00120] S430: Based on the ratings of the at least two photographs, the electronic device 100 determines the photograph that is ultimately provided to the user.

[00121] In a specific implementation process, the electronic device 100 may directly provide the user with the highest-scoring photo (or the photo whose score ranks first in a predetermined position or exceeds a predetermined value). For example, a photo with a score of 8.3 in Table 1 is provided directly to the user. Alternatively, the electronic device 100 may determine the highest-scoring camera (or the photo whose score is in the first predetermined position or above the predetermined value) as the acquisition camera and reacquire the photo as a photo provided to the user.

[00122] When the photo is provided to the user, the photo taken by each camera may be provided to the user directly, or the photo may be processed first through, for example, cropping, image enhancement (e.g., skin retouching, face enhancement, leg slimming, etc.). ) or red-eye reduction), stitching or processing with special effects (such as portrait mode, night mode, or large aperture mode). The electronic device 100 may send the photo to a server for processing, may process the photo locally, or send the photo to another electronic device for processing. For example, the electronic device 100 wishes to use the image enhancement software to perform image enhancement processing on a photograph, but the image enhancement software is not installed on the electronic device 100, and the electronic device 100 detects that PAD32 has the image enhancement software. The electronic device 100 may then process the photograph via PAD32 and provide the processed photograph to the user.

[00123] Alternatively, after providing the photo to the user, when the user wishes to process the photo, the electronic device 100 may prompt the user to use image enhancement software of another electronic photo processing device. For example, as shown in FIG. 6, the user of the electronic device 100 clicks the edit button 60 (of course, the edit operation may alternatively be initiated in other ways). After the electronic device 100 responds to the operation, the selection menu 61 is displayed. The selection menu 61 displays a plurality of editing methods so that the user can select an editing method. The editing method may be the editing method possessed by the electronic device 100, such as "local editing" 61a shown in FIG. 6; or may be an editing method possessed by another electronic device, such as the "PAD Image Enhancement Software 1" 61b shown in FIG. 6, indicating that the photo can be processed by the image enhancement software 1 installed on the PAD, or "image enhancement software 2 on the desktop" 61c, indicating that the photo can be processed by the software 2 to improve the image installed on a desktop computer.

[00124] Upon detecting that the user selects the editing method of another photo processing electronic device, the electronic device 100 can control the corresponding electronic device to launch the corresponding application. For example, when the user selects "PAD image enhancement software 1" 61b, the electronic device 100 controls the PAD to control the image enhancement software 1 to be in the running state, and synchronously displays the image enhancement software 1 processing interface on electronic device 1. The electronic device 100 receives the photo processing instruction and sends the processing instruction to the PAD32, so that the photograph of the electronic device 100 can be processed on the electronic device 100 by the PAD image processing application. Alternatively, when the electronic device 100 detects that the user selects the editing method of another electronic device to process the photo, the electronic device 100 sends the photo to the corresponding electronic device and controls the corresponding electronic device to launch the application and open the photo in the application. For example, the electronic device 100 controls the PAD32 image enhancement software 1 to be in a running state, and opens a photograph in the image enhancement software 1. The user then processes the photo on the PAD32 and sends the processed photo to the electronic device 100.

[00125] In a specific implementation process, after receiving photos respectively through said at least two cameras of the electronic device 100 based on S410, the electronic device 100 can further display all the photos on the display interface of the electronic device 100, and the user can select a favorite photo.

[00126] In a specific implementation process, after obtaining said at least two photographs based on S310, the electronic device 100 may further stitch said at least two photographs and provide the stitched photograph to the user so that the user can take pictures from multiple angles at the same time.

[00127] In one embodiment, each electronic device in the smart home system can be used as a master control device such that upon receiving a photograph instruction, each electronic device may perform the above steps in response to the photograph instruction. In another embodiment, some electronic devices in the smart home system are master control devices and some other electronic devices are control devices. After receiving the photographing instruction, the main control devices directly respond to the photographing instruction and carry out the above steps. After receiving the photographing instruction, the controlled devices send the photographing instruction to the main control devices, so that the main control devices perform the above steps. The smart home system shown in Fig. 3 is used as an example. The mobile phone 34 is the main control device, and the smart watch is the control device. After receiving the photographing instruction, the mobile phone 34 directly responds to the photographing instruction. However, after receiving the photographing instruction, the smart watch sends the photographing instruction to the mobile phone 34, and the mobile phone receives the photographing instruction. After receiving the photo, the main control device may store the photo locally, or may send the photo to the managed device. Before sending the photo to the managed device, the master device may further adjust the display size of the photo so that the display size matches the display unit of the managed device.

[00128] In an embodiment, the above steps are performed by the electronic device 100. In another embodiment, after the electronic device 100 receives the photographing instruction, the electronic device 100 sends the photographing instruction to the server, and the server performs the steps performed by the electronic device 100 in the previous steps S400 -S430.

[00129] Based on the above solution, photographing is not limited to the current electronic device, thereby solving the technical problem of poor photographing effect caused by incorrect angles and distances selected in photographing when only the current electronic device is used. Based on the ratings of the photos taken by the cameras, you can select the most suitable camera for taking the image, thereby improving the quality of the photos taken. In addition, in this solution, selection is made directly based on the electronic device (or cloud server) without manual selection by the user, which improves selection efficiency. Furthermore, in this solution, when the thin terminal (electronic device with weak processing capability) receives the photographing instruction, the thin terminal can send the photographing instruction to the electronic device with strong processing capabilities for processing. The photographic effect of the thin terminal can be improved with a strong image algorithm and the advantage of electronic device photographing mode with powerful processing capabilities, so that the thin terminal can also take high-quality photographs.

[00130] In addition, in the above solution, the electronic device 100 may additionally use an application installed on another electronic device to process data on the current electronic device (for example, to enhance photographs). Therefore, it is possible to use the functions of various electronic devices, and even if the application is not installed on the electronic device, the electronic device can still use this application.

[00131] Another embodiment of the present invention provides a control method. Referring to FIG. 7, the method includes the following steps:

[00132] S700: The electronic device 100 receives the photographing instruction.

[00133] The photographing instruction is, for example, a video acquisition instruction, and the method for generating the photographing instruction is similar to that in step S400, and the details are not described again here. The photographing instruction may be used to receive a video, or may be used to make a video communication with another electronic device. For example, the user of the electronic device 100 generates a voice instruction "take a picture of a video of an event for me." In this case, the electronic device 100 photographs the video by means of the photographing instruction. In another example, the user of the electronic device 100 launches an instant messaging application and activates the video call feature. After detecting the operation, the electronic device 100 allows the camera to make a video call with another electronic device using the photographing instruction.

[00134] S710: The electronic device 100 receives, in response to the photographing instruction, photographs respectively through at least two cameras of the electronic device 100 to take at least two photographs, said at least two cameras of the electronic device 100 including at least one of a physical camera or a virtual camera, there may be one or more physical cameras, and there may also be one or more virtual cameras. This step is similar to step S410, and its details will not be described again here.

[00135] S720: The electronic device 100 determines the first camera based on the at least two photographs.

[00136] For example, the electronic device 100 may obtain ratings of the at least two photographs and then determine the first camera according to the ratings of the at least two photographs. The specific determination method is described in step S420, and the details are not described again here. Alternatively, the electronic device 100 may display photos taken by all cameras on the display unit of the electronic device 100, prompt the user to select the best photo for the user, and then use the camera corresponding to the photo selected by the user as the first camera. The first camera may be a single camera or multiple cameras. For example, a camera with the best photographic effect (with the highest score) may be selected as the first camera, or multiple cameras at different angles and with relatively good photographic effects (with scores higher than a predetermined value) may be selected as the first camera to take photographs. and receive multiple videos, thereby providing the user with videos from different angles and giving the user more options to choose from.

[00137] Optionally, at step S710, the electronic device 100 may alternatively control the cameras to receive video; and in step S720, the first camera may be determined from the scores (average video frame scores) of the video or video selected by the user.

[00138] S730: The electronic device 100 controls the first camera to receive video.

[00139] Similarly, after controlling the first camera to acquire video, the electronic device 100 may directly use the video as a result of photographing the photographing instruction, or may process the video. In addition, the electronic device 100 may further process video using applications included in other electronic devices, and the details will not be re-described here.

[00140] When controlling the first camera to perform video acquisition, the electronic device 100 can control other cameras to be in the on state or the off state, and this is not limited in this embodiment of the present invention.

[00141] In an embodiment, after determining the first camera in this photographing process, the electronic device 100 always uses the first camera to acquire video. In another optional embodiment, after the electronic device determines the first camera, if at least one of the location of the content to be photographed or the location of the first camera changes, i.e. the location of the content to be photographed changes relative to the first camera, the video acquisition camera may be re-determined. , which can be defined in various ways. The two methods are listed below for description. Of course, in a specific implementation process, the present invention is not limited to the following two cases.

[00142] In the first case, the other cameras are always on. Photos (or videos) are taken from the cameras every pre-set time interval (for example, 10 s, 20 s, or 1 min). Photos (or videos) taken by electronic devices and photos (or videos) taken by the first camera are evaluated accordingly. If the photo taken by the first camera still has the highest score (or still meets the conditions in steps S420 and S720), the first camera is still used as the video acquisition camera. If there is a photo taken by another camera that has a higher score than the photo taken by the first camera (or meets the conditions S420 and S720 better than the first camera), the corresponding electronic device is set as a new camera for receiving video.

[00143] An example is used for description in which the electronic device 100 controls the cameras 35a, 35b, 35c, 35d, and 35e to acquire an image. The camera initially selected by the electronic device 100 is the camera 35a. It is assumed that the estimates of the obtained images are shown in Table 3:

ELECTRONIC DEVICE 35a 35b: 35c 35d 35e Grades (after 1 min) 6.1 7.5 8.1 5.5 5 Estimates (after 2 minutes) 6.1 8.0 7.3 6 5

Table 3

[00144] Because the photo taken by camera 35c still has the highest score after 1 min, camera 35c is still used as a video camera. However, after 2 minutes, the photograph taken by the camera 35b has the highest score. In this case, the camera 35b is used as a camera for receiving video, and then the video data is collected by the camera 35b.

[00145] If the above solution is used to acquire video, the video data finally obtained by the electronic device 100 is the video obtained through at least two cameras. If the solution is used for a video call, at different times the videos received by the peer electronic device are videos taken from different cameras.

[00146] In the second case, cameras other than the first camera are controlled to be in a capture stop state. The amount of movement of the first camera and the amount of movement of the content to be photographed are detected every predetermined time interval (eg, 20 seconds or 1 minute). When the amount of movement of the first camera exceeds a predetermined amount of movement (for example, 5 m or 7 m), or the amount of movement of the content to be photographed exceeds the predetermined amount of movement, or the amount of relative movement of the content to be photographed for the first camera is greater than the predetermined amount of movement, said other cameras are controlled so that they are in a capture state to take photographs. In addition, the ratings of photos taken by the cameras are compared to determine if cameras need to be upgraded. The determination method is described above, and the details are not repeated here. For example, the user is first in the living room, and the first camera is the camera 31a of the smart TV 31. When the user enters the study room from the living room, the video camera switches from the camera of the smart TV 31 to the camera 30a of the desktop computer 30 in the study room.

[00147] In addition, when it is detected that the user moves from the first area (eg, the living room) to the second area (eg, the bedroom), in addition to switching the camera for taking pictures, other devices may additionally switch. For example, the display unit switches from the display unit (for example, the display screen of the smart TV 31) in the first area to the display unit (for example, the desktop computer 30 in the study room) in the second area, so that the content displayed by the display unit before switching is constantly displayed switchable display unit. The microphone also switches from the microphone in the first region to the microphone in the second region so that the user's voice is continuously picked up through the microphone in the second region. Alternatively, other components may be made that are not specifically listed and are not limited to this embodiment of the present invention.

[00148] The videos received by said plurality of cameras are sent to the electronic device 100, synthesized according to the timestamp, and then sent to a peer electronic device or stored locally on the electronic device 100. Videos received by at least two cameras can be optionally optimized by electronic device 100 for seamless switching.

[00149] The above video acquisition process may apply to video calls, or may apply to video photography and other scenarios where video acquisition is required. In this embodiment of this application, this is not limited. In a specific implementation process, the electronic device 100 may alternatively control a plurality of cameras for photographing video (the plurality of cameras may be determined based on user ratings or selection), so that video of the content to be photographed from a plurality of angles can be acquired simultaneously.

[00150] Similarly, in a smart home system, all electronic devices may be master control devices, or some electronic devices may be master control devices and some other electronic devices may be controllable devices. The above steps may be performed on the electronic device 100 or may be performed on a server.

[00151] In the prior art, if subsequent photography is required, the user is often required to hold the photographing device to track the movement of the object to be photographed, which easily causes the hand-held photographing device to shake, resulting in technical problems such as shaking and blurring of photographs. Based on the above solution, subsequent photographing with the hand-held photographing device is not required, and switching to another photographing device occurs when the object to be photographed is moved to another location, which solves the technical problem of poor photographic quality due to the need for the user to hold the photographing device for subsequent photographing.

[00152] Another embodiment of the present invention provides a method for photographing an image. The method can be applied to a server or electronic device 100. Electronic device 100 is an electronic device included in a smart home scenario. The smart home scenario is, for example, the smart home scenario shown in FIG. 3. Referring to FIG. 8, the image photographing method includes the following steps:

[00153] S800: The electronic device 100 receives the photographing instruction. The photographing instruction has been described in detail above, and the details are not repeated here.

[00154] S810: Electronic device 100 determines other electronic devices associated with electronic device 100. In a particular implementation process, electronic device 100 may determine electronic devices associated with electronic device 100 in various ways, three of which are listed below for description. Of course, in a specific implementation process, the present invention is not limited to the following three cases:

[00155] In the first case, the electronic device 100 queries the router connected to the electronic device 100 for other electronic devices connected to the router, and the electronic devices are electronic devices associated with the electronic device 100.

[00156] In the second case, the electronic device 100 queries the server for the electronic devices associated with the same account as the electronic device 100, and the electronic devices are electronic devices associated with the electronic device 100.

[00157] In the third case, the electronic device 100 sends broadcast information via short range communication (eg, Bluetooth or WI-FI direct connection). Other electronic devices generate response information based on the broadcast information. Electronic device 100 uses electronic devices that generate response information as electronic devices associated with electronic device 100.

[00158] S820: The electronic device 100 sends a photographing instruction to said other electronic devices associated with the electronic device 100; and upon receiving the photographing instruction, the electronic devices receive photographs of the content to be photographed, and then send the photographs to the electronic device 100.

[00159] The electronic device 100 may send the photographing instruction to said other electronic devices associated with the electronic device 100 remotely or via a local area network.

[00160] The electronic device 100 may send a photographing instruction to all or some of the electronic devices associated with the electronic device 100. Some electronic devices may be defined in various ways. Several methods are listed below for description. Of course, in a specific implementation process, the present invention is not limited to the following cases.

[00161] In the first case, after receiving the photographing instruction, the electronic device 100 can first determine the location information of the content to be photographed corresponding to the photographing instruction, and then determine the electronic device for photographing based on the location information. For example, the photography instruction is: "Take a picture of my living room." After receiving the photographing instruction, the electronic device 100 first determines that the object to be photographed is in the living room through semantic analysis. In this case, the electronic device 100 first determines the electronic devices located in the living room from the electronic devices associated with the electronic device 100, and then sends a photographing instruction to the electronic devices, thereby obtaining a photograph of the living room. In another example, the instruction to take a photo is: "Take a photo of me." The electronic device 100 may first obtain location information of other electronic devices through the positioning device, and then send the photographing instruction to the electronic devices whose distance from the electronic device 100 is within a predetermined distance range. The predetermined distance is, for example, 10 m or 20 m, which is not limited to this embodiment of the present invention.

[00162] In the second case, the electronic device 100 may determine the content to be photographed in the photographing instruction; determine the photographing mode based on the content to be photographed; and identify some electronic devices based on the photographing mode.

[00163] For example, if the photographing instruction is a voice instruction, the electronic device 100 may first recognize the voice instruction and then perform semantic analysis based on the recognized content, thereby determining that the content to be photographed is a person, landscape, still life, or something. similar. For example, if the photography instruction is "take a photo for me", the content to be photographed includes a person; if the photography instructions say "take a picture of the bedroom", then the content to be photographed includes a still life; if the photographing instruction says "to photograph the scene in front of you", the content to be photographed is the landscape, etc.

[00164] If the content to be photographed includes a "person", the specific photographing mode is, for example, a portrait mode or a large aperture mode. If the content to be photographed is "landscape", then the determined photographing mode is, for example, landscape mode. If the determined photographing mode is portrait mode, the electronic device 100 may query other electronic devices for portrait mode electronic devices to determine the electronic devices as photographic electronic devices; and, if the determined photographing mode is landscape mode, the electronic device 100 may request the electronic devices in landscape mode from other electronic devices, use the electronic devices as photographic electronic devices, and so on. Alternatively, the electronic device 100 stores the photographic modes of the electronic devices in advance, and then directly queries based on the previously stored photographic modes of the electronic devices to determine the electronic devices for photographing.

[00165] Optionally, when the electronic device 100 sends a photographing instruction to the selected electronic devices, the photographing instruction may comprise photographing modes. For example, if the content to be photographed corresponding to the photographing instruction includes a "person", the photographing mode is a portrait mode. The electronic devices that receive the photographing instruction use the portrait mode to acquire photographs and send the photographs to the electronic device 100. If the content to be photographed corresponding to the photographing instruction is a landscape, the photographing mode may be a landscape mode. The electronic devices that receive the photographing instruction use the landscape mode to take photographs and send the photographs to the electronic device 100. When the electronic device that receives the photographing instruction has a plurality of cameras, the electronic device may photograph images with some cameras, or may photograph images with all cameras. In this embodiment of this application, this is not limited.

[00166] In addition, if the electronic devices receiving the photographing instruction do not have a corresponding photographing mode, the photographing mode closest to the corresponding photographing mode is used for shooting (for example, when the photographing instruction stipulates that the photographing mode is portrait mode, but the electronic devices that receive photographing instructions do not have a portrait mode, a large aperture mode may be selected for photographing), or the favorite photographing mode of the user of the electronic device 100 is used for photographing (for example, the default photographing mode or the most frequently used photographing mode in history).

[00167] S830: After receiving the photographs sent by these devices, the electronic device 100 evaluates the photographs, selects the photograph with the highest rating among the photographs, and uses this photograph as the photographing result of the photographing instruction. If the electronic device 100 includes a camera, the electronic device 100 also receives a photo through the camera and then evaluates the photo along with photos taken by other electronic devices to obtain the highest rated photo. The specific method for determining photo ratings is described in detail below.

[00168] After determining the highest rated photo from the photos sent by said plurality of devices, the electronic device 100 can directly output the photo as a photographing result of the camera application. For example, the photo is stored in the photo album of the electronic device 100, or the photo is displayed in the photo preview interface of the photo application. Alternatively, the electronic device 100 may process the final photograph before outputting it. For example, a photograph is cropped to fit the size requirements of the electronic device 100, image enhancement processing (adjusting hue, saturation, or brightness, adding an image enhancement filter, etc.) is performed on the photograph, or various special effects are added to the photograph.

[00169] Alternatively, if the photograph instruction is a photograph instruction sent by another electronic device (eg, a navigator in a vehicle). After receiving the photo, the electronic device 100 may send the received photo to a navigator in the vehicle. Before sending the photo to the in-vehicle navigator, the electronic device 100 may further obtain the screen size or screen aspect ratio of the in-vehicle navigator to adaptively adjust the photo based on the screen size or screen aspect ratio.

[00170] Alternatively, after receiving the photos, other electronic devices perform image processing or add various special effects to the photos before sending the photos to the electronic device 100. In this embodiment of this application, this is not limited.

[00171] Alternatively, after determining the highest-scoring photo, the electronic device 100 may send the photo to another electronic device for enhancement processing. The electronic device sends the photo to the electronic device 100 after the enhancement processing. For example, although the mobile phone 38 has powerful computing functions, the mobile phone does not have an image enhancement application. After determining the highest rated photo, the electronic device 100 can further determine if said other electronic devices have an image enhancement application. If the electronic device (eg, PAD32) has an image enhancement application, the electronic device 100 may send a photo to PAD32 for image enhancement processing, and then receive the photo after image enhancement processing with PAD32. After obtaining the highest rated photo, the electronic device 100 may query each associated device whether an image enhancement application is installed, or may store the requested functions that the electronic devices have in advance. After receiving a photo with the highest rating, an electronic device with an image enhancement application is directly determined by the functions that electronic devices have.

[00172] In an optional embodiment, after the photos are rated and the highest rated photo is determined based on S830, the electronic device that photographed the photo can be controlled to continuously take photos, and other electronic devices can be controlled to be in queues. -off state. Alternatively, other electronic devices may remain on. In this embodiment of this application, this is not limited.

[00173] Another embodiment of the present invention provides a control method. Referring to FIG. 9, the method includes the following steps:

[00174] S900: The electronic device 100 receives the photographing instruction.

[00175] The photographing instruction is, for example, a video photographing instruction, and the method for generating the photographing instruction is similar to that of S800, and the details are not described again here.

[00176] S910: The electronic device 100 determines other electronic devices associated with the electronic device 100. This step is the same as step S810, and the details are not described here again.

[00177] S920: The electronic device 100 sends a photographing instruction to said other electronic devices associated with the electronic device 100. This step is the same as step S920, and details thereof will not be described again.

[00178] S930: The electronic device 100 receives photographs sent by said devices, evaluates the photographs, and determines the photographing device for the photograph with the highest rating among the photographs. This step is similar to step S930, and its details will not be described again here.

[00179] S940: The electronic device 100 receives, after determining the electronic device corresponding to the highest rated photo, the video of the current user through the electronic device, and sends the video to the peer electronic video communication device.

[00180] For example, a user of electronic device 100 launches an instant messaging application to communicate with a peer-to-peer end user and simultaneously presses a video call button. Upon detecting the operation of the user pressing the video call button, the electronic device 100 analyzes that the user of the electronic device 100 wishes to take a photo of a video and provide the video to the peer electronic device. The electronic device 100 searches for electronic devices within a predetermined distance range, acquires photos through the electronic devices and cameras of the electronic device 100, and then determines the electronic device corresponding to the highest rated photo as a video communication electronic device. The specific video communication electronic device may be the electronic device 100 or may be another electronic device.

[00181] For example, the electronic device 100 determines that the photo received by the smart TV 31 has the highest rating. In this case, the electronic device 100 determines that the IED 31 is a video communication electronic device, and when performing video communication with the peer electronic device, sends the video received by the smart TV 31 to the peer electronic device.

[00182] After determining the highest rated photo acquisition device, the electronic device 100 can control the acquisition device to be in an on state to receive video data and send the video data to the electronic device 100. The electronic device 100 then sends the video data to the peer electronic device for video communication. In addition, other electronic devices can be controlled to be on or off. In this embodiment of this application, this is not limited.

[00183] In an optional embodiment, after the electronic device determines the highest rated photo acquisition device, the acquisition device is always used to acquire video for video communication in that video communication process. In another optional embodiment, after the electronic device determines the highest rated photo acquisition device if the user or acquisition device is moved, the other electronic device may be re-determined as the acquisition device for video communication. The other electronic device may be defined in various ways. The two methods are listed below for description. Of course, in a specific implementation process, the present invention is not limited to the following two cases.

[00184] In the first case, other electronic devices are controlled so that they are always on. Photographs are taken by electronic devices at every predetermined interval of time (for example, 10 s, 20 s or 1 min). The photos taken by electronic devices and the photo taken by the receiving device are evaluated. If the photo taken by the capture device still has the highest score, the device is still used as the capture device. If there is a photo taken by another device that has a higher score than the photo taken by the acquisition device, the corresponding electronic device is set as the new acquisition device.

[00185] In the second case, electronic devices other than the acquisition device are controlled to be in the photographing stop state. The amount of movement of the capture device and the amount of movement of the object to be photographed are determined every predetermined time interval (eg, 20 seconds or 1 minute). When the amount of movement of the acquisition device exceeds a predetermined amount of movement (for example, 5 m or 7 m), or the amount of movement of the object to be photographed exceeds the predetermined amount of movement, or the amount of relative movement of the object to be photographed on the acquisition device is greater than the predetermined amount of movement, said other electronic devices are controlled to be in the photographing state to take photographs. In addition, the ratings of photographs taken by electronic devices are compared. When the photo taken by the capture device still has the highest score, the device is still used as the capture device. If there is a photo taken by another device that has a higher score than the photo taken by the acquisition device, the corresponding electronic device is used as the new acquisition device. For example, when a user walks from a living room to an office, the receiving device automatically switches from the smart TV 31 in the living room to the desktop computer 30 in the office.

[00186] The videos received by the smart TV 31 and the desktop computer 30 (or other receiving devices) are sent to the electronic device 100, synthesized according to the timestamp, and then sent to the peer electronic device. The videos received by the two video acquisition devices may be further optimized by the electronic device 100 for seamless switching.

[00187] The above video acquisition control process may be applied to video calls, or may be applied to video photography and other scenarios where video acquisition is required. In this embodiment of this application, this is not limited.

[00188] Methods for evaluating photographs photographed with electronic devices are described below.

[00189] In the first case, if the photo includes a character, the rating of the photo can be calculated by the following formula:

[00190] E=αx+ βy+ γz (1), where

[00191] E is a photo score;

[00192] The distance (x) parameter uses the best photographing distance of 50 cm of physical distance as the maximum value, the gradient of which decreases in the farther or closer direction, and α is the weighted value of the distance (x) parameter and has a range of values [0 , 1];

[00193] the angle parameter (γ) uses the angle facing the camera as the maximum value, the deviation gradient of which decreases to the angle along the three axes, and β is the weighted value of the angle parameter (γ) and has a range of values [0, 1]; And

[00194] The aesthetic composition parameter (z) uses the maximum score of the aesthetic composition evaluation model as the maximum value, the gradient of which decreases, and γ is the weighted value of the aesthetic composition parameter (z) and has a value range of [0, 1].

[00195] In accordance with the different photographed objects, the three parameters may alternatively be assigned different weights. For example, in the scenario mode of photographing a character, the angle parameter is assigned a slightly higher weight, for example, β=0.5, γ=0.3, α=0.2. For example, in the scenario of photographing an object, more attention is paid to the clarity of photographing, so the distance parameter is given more weight, for example, α=0.4, β=0.3 and γ=0.3. Of course, other weight values may be used as an alternative. In this embodiment of this application, this is not limited.

[00196] The distance between each electronic device and the object to be photographed can be calculated using computer vision technology. For example, in the case where the electronic device includes a binocular camera, the distance between the electronic device and the object to be photographed can be determined by the visual difference between the two cameras photographing the object to be photographed. Alternatively, in the case where the object to be photographed is the current user, the current user may be detected by the current user's portable electronic device, and said other electronic devices may be detected by the positioning devices of said other electronic devices. The distance between the electronic device and the object to be photographed can be determined based on the positioning. In addition, the distance between the other electronic device and the electronic device 100 can be further obtained based on Bluetooth indoor positioning technology, WI-FI wireless positioning technology, or infrared optical positioning technology.

[00197] Facial key points can be detected using a face key point detection technology (eg, Harris angle detection algorithm). After face key points are detected, the three-axis face angle is estimated based on face key points using a pose estimation algorithm. An angle parameter within the range of the user's face (eg, roll angle, roll angle, and pitch angle are between -30° and 30°) is the maximum value.

[00198] The aesthetic composition parameter (z) can be calculated using an aesthetic quality scoring algorithm, which typically includes two steps: (1) a feature extraction step, in which features can be manually developed, e.g., elements of a photograph can be manually marked by contrast of clarity, contrast of brightness, simplicity of color, harmony, or degree of compliance with the rule of thirds; or the aesthetic features of an image can be automatically extracted using a deep convolutional neural network; and (2) decision stage. The decision step refers to training the extracted aesthetic features of an image with a classifier or regression model to classify or regress the image. The trained model can differentiate images into high-quality aesthetic images and low-quality aesthetic images, and can also give aesthetic quality scores to the images. Commonly used methods include a naive bayes classifier, a support vector machine, a deep classifier, and the like. The aesthetics scoring system may be installed locally on the electronic device 100. The aesthetics scoring algorithm is built into the aesthetics scoring system, or the aesthetics scoring algorithm may be installed on a server. In this embodiment of this application, this is not limited.

[00199] FIG. 10 shows the scores of photographs taken using various cameras based on the above formula (1). As can be seen from FIG. 10, photos that include a face score higher than photos that do not include a face. In addition, in the case where both photos have a face, the photo closer to the camera has a higher score.

[00200] A "person" is included in the photographing instruction of the electronic device 100, and the electronic device 100 can determine whether the "person" is included in the photographs taken by the cameras through the posture recognition. If the photo includes a person, the photo can be evaluated based on the formula (1) above; otherwise, the photo may be removed directly without rating. Alternatively, the electronic device 100 may determine if a "person's" face is included in photographs taken by the cameras through face recognition. If the photo includes a face, the photo is judged based on the formula (1) above; otherwise, the photo may be removed directly without rating.

[00201] In the second method, if there is no user in the photo, the photo score is calculated by the following formula:

[00202] E=αx+γz (2), where

[00203] E, α, x, γ and z are described in the above formula (1), and the details are not repeated here.

[00204] The electronic device 100 may select any of the above methods for calculating default photo ratings. In another embodiment, the electronic device 100 may alternatively select different calculation methods based on different objects to be photographed. For example, if the object to be photographed includes a character, formula (1) is used to calculate the rating of the photo. If the object to be photographed does not contain a character, formula (2) is used to calculate the photo rating.

[00205] For other content, reference may be made to the descriptions of the above related content, and the details are not re-described here.

[00206] In a particular implementation process, photographs may alternatively be judged independently based on the above parameters, for example, photographs may be judged independently based on distances, angles, or aesthetic composition.

[00207] Another embodiment of the present invention further provides a control method. Referring to FIG. 11, the method includes the following steps:

[00208] S1100: The electronic device 100 receives the photographing instruction, and the photographing instruction is the same as the photographing instruction described above, and the details are not repeated here.

[00209] S1110: The electronic device 100 determines the first camera of at least two cameras in response to the photography instruction, wherein said at least two cameras include the physical camera of the electronic device 100 and cameras of other electronic devices, there may be one or more the physical cameras of the electronic device 100, and there may be one or more cameras of the other electronic devices mentioned.

[00210] In a particular implementation process, the electronic device 100 may determine the first camera in various ways. For example, the method for determining the first camera includes: (1) determining the location information of the content to be photographed corresponding to the photographing instruction and determining the camera to be photographed based on the location information; and (2) determining a photographing mode based on the content to be photographed, and determining, based on the photographing mode, a camera including said photographing mode as the first camera. The specific method for determining the first chamber has been described above, and the details are not re-described here.

[00211] S1120: Receiving data corresponding to the photographing instruction through the first camera, where the data may be video data or image data.

[00212] In the implementation of the camera (including the first camera) mentioned other electronic devices can be registered as virtual cameras of the electronic device 100 at the initial stage. Thus, in step S1220, the virtual camera corresponding to the first camera can be operated to acquire data corresponding to the photographing instruction. In another implementation, the electronic device 100 may send a photographing instruction to the electronic device corresponding to the first camera. After the first camera electronic device receives data in response to the photographing instruction, the data is returned to the electronic device 100.

[00213] In a specific implementation process, in addition to sharing cameras, said plurality of electronic devices may further share other functions, such as a microphone, display screen, input device, and application software. For example, after the electronic device has received the audio data, the audio data cannot be played back due to the microphone of the electronic device being damaged or the microphone missing. In this case, a microphone in a predetermined range of distances can be selected for playback. In another example, when it is detected that the user is selecting an editing method or a viewing method for a file, not only editing methods or viewing methods of the current device may be presented to the user, but also editing methods or viewing methods of other electronic devices associated with the current device may also be presented, and so on.

[00214] In the control method described in the embodiments of the present invention, the first electronic device may further use other functions of other electronic devices, for example, use software (for example, reader software, video playback software, or video processing software ) or hardware (such as a display or microphone) of a second electronic device. When other functions of other electronic devices are used, the method for detecting other electronic devices (or related equipment) is the same as for detecting cameras.

[00215] For example, the user of the first electronic device wants to play a video and is instructed to take a photo. In response to the photographing instruction, the first electronic device determines that the current location is the living room, detects that there is a smart TV (second electronic device) in the living room, and projects the video content to the smart TV for playback. When the first electronic device determines the second electronic device, the use of the display of the first electronic device or the display of the second electronic device can be comprehensively determined considering the distance and angle between the user and the first electronic device or the second electronic device and the dimensions of the displays

[00216] Based on the same concept of the invention, another embodiment of the present invention provides a control method including:

[00217] receiving, with the first electronic device, instructions for photographing;

[00218] determining location information of the content to be photographed corresponding to the photographing instruction in accordance with the photographing instruction, and determining, based on the location information of the content to be photographed, a camera in the most suitable location for photographing the content to be photographed from at least two cameras, controlled by the first electronic device as the target camera; and/or

[00219] determining a photographing mode based on the content to be photographed and in accordance with the photographing instructions, and determining a camera including said photographing mode of at least two cameras controlled by the first electronic device as the target camera, wherein said at least two cameras include a first electronic device camera and a second electronic device camera, wherein the first electronic device is different from the second electronic device; And

[00220] controlling by the first electronic device the target camera to execute the photographing instruction to obtain image data obtained by the target camera.

[00221] Optionally, determining, based on the location information of the content to be photographed, the camera at the most suitable location for photographing the content to be photographed of at least two cameras controlled by the first electronic device as the target camera includes:

[00222] determining, based on the location information of the content to be photographed, a camera whose photographing range covers said location information from at least two cameras controlled by the first electronic device, and if only one camera is determined, determining this camera as target camera;

[00223] or

[00224] determining a photographing mode based on the content to be photographed, determining a camera including said photographing mode from at least two cameras controlled by the first electronic device, and if only one camera is determined, determining this camera as the target camera.

[00225] Optionally, determining, based on the location information of the content to be photographed, the camera at the most suitable location for photographing the content to be photographed of at least two cameras controlled by the first electronic device as the target camera includes:

[00226] determining, based on the location information of the content to be photographed, a camera whose photographing range covers said location information from said at least two cameras controlled by the first electronic device, and if a plurality of cameras is determined, controlling said plurality of cameras to obtaining photographs, for obtaining at least two photographs; and evaluating the at least two photographs according to the first predetermined rule and determining the camera corresponding to the highest rated photograph as the target camera; or

[00227] determining a photographing mode based on the content to be photographed, determining a camera including said photographing mode from said at least two cameras controlled by the first electronic device, and if a plurality of cameras are determined, controlling said plurality of cameras to take photographs, to take at least two photographs; and evaluating the at least two photographs according to the first predetermined rule and determining the camera corresponding to the highest rated photograph as the target camera.

[00228] Optionally, controlling the target camera by the first electronic device to execute the photographing instruction to obtain image data acquired by the target camera includes:

[00229] sending the first electronic device a photograph request to the electronic device where the target camera is located, and receiving image data sent by the electronic device where the target camera is located; or

[00230] calling the first electronic device of the target camera as a virtual camera of the first electronic device and receiving the image data received by the virtual camera.

[00231] Optionally, the first predefined rule includes:

[00232] at least one of a camera operating parameter, a distance between the camera and the content to be photographed, or an angle between the camera and the content to be photographed.

[00233] Optionally, the software architecture of the first electronic device includes: an application structure layer including a camera structure configured to provide a camera function to the outside world; a camera interface configured to receive data received by the cameras, the cameras including physical cameras and virtual cameras; MSDP, configured to virtualize the camera of another electronic device as a hardware abstraction layer virtual camera; and a hardware abstraction layer including cameras, where cameras include physical cameras and virtual cameras, and virtual cameras and physical cameras have different tags. The first electronic device calling the target camera as a virtual camera of the first electronic device includes:

[00234] pre-virtualizing the target camera as a virtual camera of the first electronic device;

[00235] calling the CaaS function by the first electronic device, wherein the CaaS function is called by the first electronic device via the CaaS service;

[00236] informing the first electronic device, when the trigger condition is satisfied, to the distributed device virtualization module MSDP to register the camera of the other electronic device as a hardware abstraction layer virtual camera; And

[00237] registering by the first electronic device, when it is necessary to call the CaaS camera function, the CaaS services in the system, and querying, using the CaaS MSDP service, whether the virtual camera exists, and, when the virtual camera exists, receiving, through the camera interface, the video data of the virtual camera.

[00238] Based on the same concept of the invention, another embodiment of the present invention provides an electronic device including:

[00239] one or more processors;

[00240] memory;

[00241] many applications; And

[00242] one or more computer programs, wherein said one or more computer programs are stored in memory, said one or more computer programs include instructions, and when the instructions are executed by the first electronic device, the first electronic device performs a method in accordance with any from paragraphs. 1-7.

[00243] Based on the same concept of the invention, another embodiment of the present invention provides an electronic device including:

[00244] a first acquisition module, configured to receive a photographing instruction;

[00245] the first determination module, configured to determine location information of the content to be photographed corresponding to the photographing instruction according to the photographing instruction, and determining, based on the location information of the content to be photographed, a camera at the most suitable location for photographing the content to be photographed at least two cameras controlled by the first electronic device as the target camera; and/or

[00246] determining the photographing mode based on the content to be photographed and in accordance with the photographing instruction and determining the camera including said photographing mode, of at least two cameras controlled by the first electronic device, as the target camera, wherein said at least at least two cameras include a first electronic device camera and a second electronic device camera, the first electronic device being different from the second electronic device; And

[00247] a control module configured to control the target camera to execute a photographing instruction to obtain image data acquired by the target camera.

[00248] Optionally, the first definition module includes:

[00249] the first determination unit, configured to determine, based on the location information of the content to be photographed, a camera whose photographing range covers said location information, of at least two cameras controlled by the first electronic device, and if only one is determined camera, defining this camera as the target camera;

[00250] or

[00251] a second determination unit, configured to determine a photographing mode based on the content to be photographed; and a third determining unit configured to determine a camera including said photographing mode from at least two cameras controlled by the first electronic device, and if only one camera is determined, determining this camera as the target camera.

[00252] Optionally, the first definition module includes:

[00253] a fourth determination unit configured to determine, based on the location information, the content to be photographed of a camera whose photographing range covers said location information, of said at least two cameras controlled by the first electronic device, and if a plurality of cameras are determined, managing said plurality of photo cameras to take at least two photos; a fifth determination unit, configured to evaluate the at least two photographs according to the first predetermined rule and determine the camera corresponding to the highest rated photograph as the target camera; or

[00254] a sixth determining unit, configured to determine the photographing mode based on the content to be photographed; a seventh determining unit, configured to determine a camera including said photographing mode, from said at least two cameras controlled by the first electronic device, and if a plurality of cameras are determined, to control said plurality of cameras to take photographs, to obtain at least two photographs; and an eighth determination unit, configured to judge the at least two photographs according to the first predetermined rule and determine the camera corresponding to the highest rated photograph as the target camera.

[00255] Optionally, the control module is configured to:

[00256] sending the first electronic device a photograph request to the electronic device where the target camera is located, and receiving image data sent by the electronic device where the target camera is located; or

[00257] calling, with the first electronic device, the target camera as a virtual camera of the first electronic device, and obtaining the image data acquired by the virtual camera.

[00258] Optionally, the first predefined rule includes: at least one of a camera operating parameter, a distance between the camera and the content to be photographed, or an angle between the camera and the content to be photographed.

[00259] Optionally, the control module includes the following:

[00260] The software architecture of the first electronic device includes: an application structure layer including a camera structure configured to provide a camera function to the outside world; a camera interface configured to receive data received by the cameras, the cameras including physical cameras and virtual cameras; MSDP, configured to virtualize the camera of another electronic device as a hardware abstraction layer virtual camera; and a hardware abstraction layer including cameras, where cameras include physical cameras and virtual cameras, where virtual cameras and physical cameras have different tags. The control module includes:

[00261] a virtualization unit configured to pre-virtualize the target camera as a virtual camera of the first electronic device;

[00262] a call unit configured to call the CaaS function, wherein the CaaS function is called by the first electronic device via the CaaS service;

[00263] a launcher, configured to inform, when a trigger condition is satisfied, a distributed device virtualization module MSDP to register a camera of another electronic device as a hardware abstraction layer virtual camera; And

[00264] A receiving unit configured to register when a CaaS camera function needs to be called, a CaaS service in the system, and a CaaS MSDP service querying whether a virtual camera exists, and when a virtual camera exists, receiving, through the camera interface, video data of the virtual camera.

[00265] Based on the same concept of the invention, another embodiment of the present invention provides a control method including:

[00266] receiving, with the first electronic device, instructions for photographing;

[00267] controlling, in response to the photographing instruction, the first electronic device, at least two cameras controlled by the first electronic device, to execute the photographing instruction to obtain image data obtained by the target cameras, to obtain at least two photographs; And

[00268] Determining, by the first electronic device, the photographing result of the photographing instruction in accordance with a predetermined second rule and said at least two photographs.

[00269] Optionally, determining the result of photographing by the first electronic device in accordance with a predetermined second rule and said at least two photographs includes:

[00270] evaluating said at least two photographs in accordance with at least one operating parameter of the camera, the distance between the camera and the object to be photographed, or the angle between the camera and the object to be photographed; And

[00271] using a photograph that satisfies a predetermined score as a photographing result of the photographing instruction.

[00272] Optionally, determining the result of photographing by the first electronic device in accordance with a predetermined second rule and said at least two photographs includes:

[00273] stitching by the first electronic device said at least two photographs as a result of photographing the photographing instruction; or

[00274] outputting said at least two photographs and using the photograph selected by the user as a photograph result of the photographing instruction in response to the user selection operation.

[00275] Based on the same concept of the invention, another embodiment of the present invention provides an electronic device including:

[00276] one or more processors;

[00277] memory;

[00278] many applications; And

[00279] one or more computer programs, wherein said one or more computer programs are stored in memory, said one or more computer programs include instructions, and when the instructions are executed by the first electronic device, the first electronic device performs a method in accordance with any embodiment of the present invention.

[00280] Based on the same concept of the invention, another embodiment of the present invention provides an electronic device including:

[00281] a second acquisition module, configured to receive the photographing instruction;

[00282] a response module, configured to control, in response to the photographing instruction, at least two cameras controlled by the first electronic device to execute the photographing instruction to obtain image data acquired by the target cameras to obtain at least two photographs; And

[00283] A second determination module, configured to determine the photographing result of the photographing instruction in accordance with a predetermined second rule and said at least two photographs.

[00284] Optionally, the second definition module includes:

[00285] an evaluation unit configured to evaluate the at least two photographs in accordance with at least one camera operating parameter, the distance between the camera and the object to be photographed, or the angle between the camera and the object to be photographed; And

[00286] A ninth determination unit, configured to use a photograph that satisfies a predetermined evaluation as a photographing result of the photographing instruction.

[00287] Optionally, the second determination module is configured to:

[00288] stitching, by means of the first electronic device, said at least two photographs as a result of photographing the photographing instruction; or

[00289] outputting said at least two photographs and using the photograph selected by the user as the photographing result of the photographing instruction in response to the user selection operation.

[00290] Based on the same inventive concept, another embodiment of the present invention provides a computer-readable storage medium including instructions, where the instructions, when executed on an electronic device, cause the electronic device to perform a method in accordance with any embodiment of the present invention.

[00291] Based on the same inventive concept, another embodiment of the present invention provides a computer program product including a program code, wherein the program code is configured to perform a method according to any embodiment of the present invention.

[00292] Based on the same inventive concept, another embodiment of the present invention provides a chip including instructions where the chip, when operating on an electronic device, causes the electronic device to perform a method according to any embodiment of the present invention.

[00293] It can be understood that in order to implement the above functions, an electronic device or the like includes hardware structures and/or software modules for performing various related functions. Those skilled in the art will appreciate that, in combination with the blocks and flow steps of the examples described in the embodiments disclosed herein, the embodiments of the present application may be implemented in hardware or a combination of hardware and computer software. Whether the function is implemented by the hardware or the computer software that controls the hardware depends on the particular application and design constraints. A person skilled in the art may use different ways to implement the described functions for each particular application, but the implementation should not be considered outside the scope of the embodiments of the present invention.

[00294] In embodiments of this application, the separation of functional modules can be performed on an electronic device in accordance with exemplary methods. For example, different functional modules may be separated into respective functions, or two or more functions may be integrated into one processing module. The integrated module is implemented as hardware, or implemented as a software function module. It should be noted that in this embodiment of the present invention, the division of modules is merely an example, and is merely a division of logical functions. In an actual implementation, another way of dividing may take place. The following descriptions are made using an example in which function modules are divided according to functions.

[00295] The methods provided in the embodiments of this application may be fully or partially implemented using software, hardware, firmware, or any combination thereof. When software is used for implementation, all or some of the embodiments may be implemented as a computer program product. The computer program product includes one or more computer instructions. When the instructions of a computer program are downloaded and executed on a computer, the procedures or functions in accordance with the embodiments of this application are fully or partially generated. The computer may be a general purpose computer, a specialized computer, a computer network, a network device, an electronic device, or other programmable devices. The computer instructions may be stored on a computer-readable storage medium or transferred from one computer-readable storage medium to another computer-readable storage medium. For example, computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center over a wire (such as coaxial cable, fiber optic cable, or digital subscriber line). , DSL)) or wireless (such as infrared, wireless or microwave) method. A computer-readable storage medium can be any usable medium accessible to a computer, or a storage device, such as a server or data center, that combines one or more usable media. The available media may be magnetic media (eg, a floppy disk, hard disk, or magnetic tape), optical media (eg, digital video disc (DVD)), semiconductor media (eg, SSD), or the like.

[00296] One skilled in the art may appreciate that the exemplary blocks and steps of the algorithm described with reference to the embodiments disclosed herein may be implemented in electronic hardware or in a combination of computer software and electronic hardware. Whether the functions are executed in hardware or software mode depends on the specific applications and design constraints of the technical solutions. A person skilled in the art may use different methods to implement the described functions for each particular application, but the implementation should not be considered outside the scope of this application.

[00297] One skilled in the art can clearly understand that for a simple and clear description of the specific working processes of the above described system, device and unit, reference can be made to the corresponding processes in the above method embodiments, and the details are not described here again.

[00298] It should be understood that in the embodiments presented in this application, the disclosed system, apparatus, and method may be implemented in other ways. For example, the device embodiment described is merely illustrative. For example, a block division is simply a logical functional division and may be a different division during actual implementation. For example, many blocks or components may be combined or integrated into another system, or some features may be ignored or not performed. In addition, the interconnections or direct links or communication connections shown or described may be implemented using certain interfaces. Indirect connections or communication connections between devices or units may be implemented in electrical, mechanical or other forms.

[00299] Blocks described as separate parts may or may not be physically separate, and components displayed as blocks may or may not be physical blocks, i.e., may be located in the same location or may be distributed across multiple network blocks. Some or all of the blocks may be selected according to actual requirements to achieve the goals of the solutions of the embodiments.

[00300] In addition, the functional blocks in the embodiments of the present application may be integrated into one processing unit, or each of the units may exist physically separately, or two or more blocks may be integrated into one unit.

[00301] The above descriptions are merely specific implementations of this application, but are not intended to limit the scope of protection of embodiments of this application. Any variation or replacement readily calculated by one of ordinary skill in the art within the technical scope disclosed in the embodiments of this application should fall within the protection scope of the embodiments of this application. Therefore, the scope of protection of the embodiments of this application should be consistent with the scope of protection of the claims.

Claims (41)

1. A control method, comprising: registering, by the first electronic device, a camera of the second electronic device as a virtual camera, the first electronic device including at least one physical camera; receiving, by means of the first electronic device, photographing instructions; in response to the photographing instruction, receiving, by means of the first electronic device, photographs, respectively, through at least two cameras of the first electronic device, while said at least two cameras include said physical camera and said virtual camera, the physical camera is one or more , and the virtual camera is one or more; displaying, by means of the first electronic device, photographs taken by said at least two cameras; using, by means of the first electronic device, a plurality of cameras corresponding to said photographs selected by the user as the first camera; controlling, by means of the first electronic device, the first camera to receive video. 2. The method according to claim 1, wherein registering, by means of the first electronic device, the camera of the second electronic device as a virtual camera comprises: searching, by means of the first electronic device, of the second electronic device via short-range communication in the communication coverage area; sending, by means of the first electronic device, request information to the second electronic device; receiving, by the first electronic device, confirmation information from the second electronic device, the confirmation information indicating that the second electronic device agrees to use the camera as a virtual camera of the first electronic device; performing, by the first electronic device, a virtualization operation to virtualize the camera of the second electronic device as a local camera after receiving the acknowledgment information. 3. The method of claim 2, wherein the short range communication comprises Bluetooth and Wi-Fi. 4. The method according to claim 1, wherein the photographs selected by the user comprise: a photograph taken by the camera of the first electronic device. 5. The method according to claim 4, wherein the photographs selected by the user comprise: a photograph taken by the camera of the second electronic device. 6. The method according to any one of paragraphs. 1-5, in which the photo taken by the camera of the first electronic device and the photo taken by the camera of the second electronic device are stitched together. 7. The method according to any one of paragraphs. 1-6, wherein the method further comprises: synthesizing, by the first electronic device, the video obtained by the first camera according to the time stamp; and storing said video locally in the first electronic device. 8. The method according to any one of paragraphs. 1-7, in which the first electronic device is a mobile phone and the camera of the first electronic device is a front camera and/or a rear camera of the first electronic device; the second electronic device is a mobile phone, and the camera of the second electronic device is a front camera or a rear camera of the second electronic device. 9. The method according to any one of paragraphs. 1-7, wherein the method further comprises: re-determining, by means of the first electronic device, the first camera for receiving video. 10. The method of claim 9, wherein re-determining, by means of the first electronic device, the first video camera comprises: calculating, by the first electronic device, an evaluation value of the photo taken by each of said at least two cameras by the formula below; re-determining, by the first electronic device, the camera used to receive the video according to the evaluation value; while the formula contains: E=αx+γz, while E represents the photo score; the distance parameter x uses the best photographing distance of 50 cm of physical distance as the maximum value, the gradient of which decreases in the farther or closer direction, and α is the weighted value of the x distance parameter and has a value range of [0, 1]; And the aesthetic composition parameter z uses the maximum score of the aesthetic composition evaluation model as the maximum value, the gradient of which decreases, and γ is the weighted value of the aesthetic composition parameter z and has a value range of [0, 1]. 11. The method of claim 9, wherein the camera to receive the video is re-determined comprises: if at least one of the location of the content to be photographed or the location of the first camera changes, the video acquisition camera may be re-determined. 12. The method according to any one of paragraphs. 1-11, wherein the method further comprises: during control of the first camera to obtain video, the first electronic device controls cameras other than the first camera among said at least first two cameras so that they are in the on state or the off state. 13. The method according to any one of paragraphs. 1-12, wherein the method further comprises: at the time of controlling the first camera to acquire video, the first electronic device sends the photographing parameters to the first camera, the photographing parameters containing the photo size, exposure, or photographing mode. 14. The method according to any one of paragraphs. 1-13, in which in response to the photographing instruction, the first electronic device simultaneously receives photographs through at least two cameras of the first electronic device; the first electronic device simultaneously displays photographs taken by said at least two cameras on the display unit of the first electronic device. 15. A photography control system, comprising: a first electronic device and a second electronic device, wherein the first electronic device contains at least one camera and the second electronic device contains at least one camera, wherein: the first electronic device is configured to perform the method according to any one of paragraphs. 1-14.

Images