CN113438462B - Multi-device interconnection shooting method and device, electronic device and storage medium - Google Patents

Multi-device interconnection shooting method and device, electronic device and storage medium Download PDF

Info

Publication number
CN113438462B
CN113438462B CN202110627526.2A CN202110627526A CN113438462B CN 113438462 B CN113438462 B CN 113438462B CN 202110627526 A CN202110627526 A CN 202110627526A CN 113438462 B CN113438462 B CN 113438462B
Authority
CN
China
Prior art keywords
shooting
interconnection
information
equipment
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110627526.2A
Other languages
Chinese (zh)
Other versions
CN113438462A (en
Inventor
彭聪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN202110627526.2A priority Critical patent/CN113438462B/en
Publication of CN113438462A publication Critical patent/CN113438462A/en
Application granted granted Critical
Publication of CN113438462B publication Critical patent/CN113438462B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/243Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/296Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661Transmitting camera control signals through networks, e.g. control via the Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • H04W76/14Direct-mode setup

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

The disclosure relates to a multi-device interconnection shooting method and device, electronic equipment and a storage medium. The interconnection shooting method is applied to first equipment and comprises the following steps: sending an interconnection shooting request to the interconnection equipment based on the connection between the first equipment and at least one interconnection equipment; determining first shooting information shot by first equipment based on the response of the interconnected equipment to the interconnected shooting request; acquiring second shooting information shot by the interconnection equipment; and determining a first panoramic image according to the first shooting information and the second shooting information. The interconnection shooting method is applied to first interconnection equipment and comprises the following steps: based on the connection of at least one interconnection device with a first device, wherein the at least one interconnection device at least comprises: a first interconnect device and a second interconnect device; receiving an interconnection shooting request from first equipment; responding to the interconnection shooting request, and determining second shooting information shot by the interconnection equipment; sending second shooting information of the interconnection equipment; a first panoramic image is received from a first device and displayed. By the adoption of the method, the same shooting object can be shot through multiple devices, the images obtained by the interconnection and intercommunication devices are combined, the three-dimensional images are obtained, and meanwhile interestingness and experience of shooting of a user are improved.

Description

Multi-device interconnection shooting method and device, electronic device and storage medium
Technical Field
The present disclosure relates to the field of shooting technologies, and in particular, to a multi-device interconnection shooting method and apparatus, an electronic device, and a storage medium.
Background
Generally, the image captured by a single device is a single-dimensional image, or a single device can capture more images through a wide-angle function or a function of image frames with respect to time. However, the single-dimensional image is an image acquired by a single device at the same position of the device, or the image in the other form is an image synthesized by combining other images of the same device at the same position, which causes the image acquired by the single device to be inaccurate in representing the three-dimensional form of the object to be photographed to some extent.
In the technical field of interconnection and intercommunication, multiple devices can be adopted to shoot the same shooting object, images obtained by the interconnection and intercommunication devices are combined to obtain three-dimensional stereoscopic images, and meanwhile, the interestingness and experience of shooting by users are improved.
Disclosure of Invention
The disclosure provides a multi-device interconnection shooting method and device, electronic equipment and a storage medium.
A first aspect of the embodiments of the present disclosure provides a multi-device interconnection shooting method, which is applied to a first device, and the method includes:
sending an interconnection shooting request to the interconnection equipment based on the connection between the first equipment and at least one interconnection equipment;
determining first shooting information shot by the first equipment based on the response of the interconnection equipment to the interconnection shooting request;
acquiring second shooting information shot by the interconnection equipment;
and determining a first panoramic image according to the first shooting information and the second shooting information.
In some embodiments, the connection of the first device to at least one interconnect device includes at least: WIFI hotspot connection and Bluetooth connection.
In some embodiments, the method further comprises:
scanning for devices within a predetermined range based on a first position of the first device;
and determining that the equipment in the preset range and in the preset shooting position is the interconnection equipment, wherein the preset shooting position is a shooting position of the interconnection equipment for executing the interconnection shooting relative to the first position of the first equipment.
In some embodiments, the method further comprises:
the first equipment sends a connection request to the interconnection equipment;
and responding to the response of the interconnection equipment to the connection request, and establishing connection with the interconnection equipment.
In some embodiments, the determining, based on the response of the interconnected device to the shooting request, first shooting information shot by the first device includes:
receiving a response to the interconnection shooting request from the interconnection equipment;
determining a photographing object or a photographing area of the first device;
and when the shooting object or the shooting area of the first equipment and the shooting object or the shooting area of the interconnected equipment accord with preset conditions, responding to a first operation, and controlling the first equipment to carry out the interconnected shooting.
In some embodiments, the method further comprises:
synchronously displaying a shooting display interface of the first equipment and a shooting display interface of the interconnection equipment on a shooting interface of the first equipment;
responding to a second operation on a shooting display interface of the interconnected equipment on the first equipment, and controlling the interconnected equipment to carry out interconnected shooting;
and responding to a third operation on the shooting display interface of the interconnected equipment on the first equipment, and editing the shooting display interface of the interconnected equipment.
In some embodiments, the first photographing information includes at least: first position information of the first device, first image information of the first device, and first photographing time information of the first device; wherein the first image information is determined according to the first position information, the first image information including at least: the contour information corresponding to the first image;
the second photographing information includes at least: second position information of the interconnection equipment, second image information of the interconnection equipment and second shooting time information of the interconnection equipment; wherein the second image information is determined according to the second position information, the second image information including at least: the contour information corresponding to the second image;
the determining a first panoramic image according to the first photographing information and the second photographing information includes:
determining a three-dimensional contour of the interconnected shot images according to the contour information corresponding to the first image and/or the contour information corresponding to the second image;
determining an intermediate image frame according to the first image information and the second image information based on the three-dimensional contour of the interconnected shot images;
and determining the first panoramic image according to the three-dimensional outline of the interconnected shot images and the intermediate image frame.
In some embodiments, the method further comprises:
displaying images of different positions of the first panoramic image in response to a fourth operation on the first panoramic image;
synchronously connecting the first panoramic image to the interconnected device and a server for display and/or storage in the interconnected device and the server.
In some embodiments, the method further comprises:
sending the first shooting information to the interconnection equipment, wherein the interconnection equipment is used for determining a second panoramic image according to the first shooting information and the second shooting information;
or,
and sending the first shooting information to a server, wherein the server is used for determining a third panoramic image according to the first shooting information and the second shooting information which are shot by the first equipment in an interconnected mode.
A second aspect of the embodiments of the present disclosure provides a multi-device interconnection shooting method, which is applied to a first interconnection device, and the method includes:
based on the connection of at least one interconnection device with a first device, wherein the at least one interconnection device at least comprises: a first interconnect device and a second interconnect device;
receiving an interconnection shooting request from the first equipment;
responding to the interconnection shooting request, and determining second shooting information shot by the interconnection equipment;
sending second shooting information of the interconnection equipment;
receiving a first panoramic image from the first device and displaying the first panoramic image.
In some embodiments, the connection of the at least one interconnect device to the first device includes at least: WIFI hotspot connection and Bluetooth connection.
In some embodiments, the method further comprises:
receiving a connection request from the first device, establishing a connection with the first device, and sending a response to the connection request to the first device.
In some embodiments, the determining second shooting information shot by the first interconnection device includes:
determining a shooting object or a shooting area of the first interconnection equipment;
and when the shooting object or the shooting area of the interconnected equipment and the shooting object or the shooting area of the first equipment accord with a preset condition, responding to a fifth operation, and controlling the first interconnected equipment to carry out interconnected shooting.
In some embodiments, the method further comprises:
synchronously displaying shooting display interfaces of the first device and the second interconnection device on a shooting interface of the first interconnection device;
responding to a sixth operation on a shooting display interface of the first equipment or the second interconnected equipment, and controlling the first equipment or the second interconnected equipment to carry out interconnected shooting;
and responding to a seventh operation of the shooting display interface of the first equipment or the second interconnected equipment, and editing the shooting display interface of the first equipment or the second interconnected equipment.
In some embodiments, said displaying said first panoramic image comprises:
acquiring the first panoramic image from the first device, and displaying the first panoramic image on a shooting display interface of the first interconnection device, wherein the method comprises the following steps:
in response to an eighth operation on the panoramic image, displaying images of different positions of the panoramic image.
In some embodiments, the first photographing information includes at least: first position information of the first device, first image information of the first device, and first shooting time information of the first device; wherein the first image information is determined according to the first position information, the first image information including at least: the contour information corresponding to the first image;
the second photographing information at least includes: second position information of the interconnection equipment, second image information of the interconnection equipment and second shooting time information of the interconnection equipment; wherein the second image information is determined according to the second position information, the second image information including at least: the contour information corresponding to the second image;
the shooting information of the second interconnection device at least comprises: the position information corresponding to the second interconnection equipment, the image information corresponding to the second interconnection equipment and the shooting time information corresponding to the second interconnection equipment are obtained; the second interconnection device is determined according to the position information corresponding to the second interconnection device, and the image information corresponding to the second interconnection device at least includes: the outline information corresponding to the image of the second interconnection equipment;
the method further comprises the following steps:
acquiring first shooting information of the first equipment and shooting information of the second interconnection equipment;
determining a three-dimensional contour of the interconnected shot images according to the contour information, wherein the contour information is contour information corresponding to the first image, contour information corresponding to the second image and/or contour information corresponding to an image of the second interconnected device;
determining an intermediate image frame according to the first image information, the second image information and the image information of the second interconnection equipment based on the three-dimensional contour of the interconnection shooting image;
and determining the second panoramic image according to the three-dimensional outline of the interconnected shot images and the intermediate image frame.
In some embodiments, the acquiring the first shooting information and the shooting information of the second interconnection device includes:
acquiring the first shooting information and the shooting information of the second interconnected equipment from a server so as to determine a third panoramic image;
or,
and acquiring the first shooting information and the shooting information of the second interconnected equipment from the first equipment so as to be used for determining the second panoramic image.
A third aspect of the embodiments of the present disclosure provides a multi-device interconnection shooting device, which is applied to a first device, and includes:
the sending request module is configured to send an interconnection shooting request to the interconnection equipment based on the connection between the first equipment and at least one interconnection equipment;
the first shooting module is used for determining first shooting information shot by the first equipment based on the response of the interconnected equipment to the interconnected shooting request;
the first acquisition module is configured to acquire second shooting information shot by the interconnection equipment;
a first determination module configured to determine a first panoramic image from the first photographing information and the second photographing information.
A fourth aspect of the embodiments of the present disclosure provides a multi-device interconnection shooting device, which is applied to a first interconnection device, and includes:
based on the connection of at least one interconnection device with a first device, wherein the at least one interconnection device at least comprises: a first interconnect device and a second interconnect device;
the receiving request module is configured to receive an interconnection shooting request from the first equipment;
the second shooting module is configured to respond to the interconnection shooting request and determine second shooting information shot by the interconnection equipment;
the first sending module is configured to send second shooting information of the interconnection equipment;
a display module configured to receive a first panoramic image from the first device and display the first panoramic image.
A fifth aspect of an embodiment of the present disclosure provides an electronic device, including:
a memory for storing processor-executable instructions;
a processor coupled to the memory;
wherein the processor is configured to perform the multi-device interconnect photographing method as described above.
A sixth aspect of the embodiments of the present disclosure provides a non-transitory computer-readable storage medium, wherein instructions of the storage medium, when executed by a processor of a computer, enable the computer to perform the multi-device interconnection shooting method as described above.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
in the embodiment of the disclosure, based on the connection between the first device and the at least one interconnection device, after the first device requests to perform interconnection shooting, the first device and the interconnection device perform interconnection shooting according to the position of the device. And after the shooting information of the first equipment and the interconnection equipment is acquired, synthesizing the required panoramic image according to the acquired shooting information. By adopting the method, the multi-angle three-dimensional image can be acquired through the shooting behaviors of the multiple devices, and the interestingness and experience of shooting by the user are improved when the interaction of multi-device shooting is carried out.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flowchart illustrating a multi-device interconnection shooting method according to an exemplary embodiment;
fig. 2 is a flowchart illustrating a method of determining first photographing information according to an exemplary embodiment;
FIG. 3 is a flow diagram illustrating a method for determining a panoramic image for a multi-device interconnect shooting in accordance with an exemplary embodiment;
FIG. 4 is a flowchart illustrating a multi-device interconnect shooting method according to an exemplary embodiment;
FIG. 5 is a flowchart illustrating a method for determining a panoramic image for a multi-device interconnect shooting in accordance with an exemplary embodiment;
FIG. 6 is a schematic diagram of a configuration of a multi-device interconnected camera, according to an exemplary embodiment;
fig. 7 is a schematic structural diagram of a multi-device interconnected camera according to an exemplary embodiment;
fig. 8 is a schematic structural diagram of an electronic device shown in accordance with an example embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of devices consistent with certain aspects of the present disclosure, as detailed in the appended claims.
It should be noted that any device mentioned herein is a device with a shooting function, for example, a mobile terminal and/or a fixed terminal with a shooting function, and the mobile terminal includes but is not limited to: the mobile phone, the tablet personal computer and/or the wearable device and the like have shooting functions.
As shown in fig. 1, an embodiment of the present disclosure provides a multi-device interconnection shooting method, which is applied to a first device, and the method includes:
s110: and sending an interconnection shooting request to the interconnection equipment based on the connection between the first equipment and at least one interconnection equipment.
S120: and determining first shooting information shot by the first equipment based on the response of the interconnected equipment to the interconnected shooting request.
S130: and acquiring second shooting information shot by the interconnection equipment.
S140: the first panoramic image is determined according to the first shooting information and the second shooting information.
The first equipment is an equipment end which initiates a request for interconnection shooting; the interconnection equipment is an equipment end for receiving the interconnection shooting request; the server is a related server which performs data interaction with the first device or internet shooting, or a CDN server connected with other CDN servers. In this embodiment, the first device may be connected to a plurality of interconnected devices, and initiated by the first device, perform interconnected shooting together with the plurality of interconnected devices.
In step S110, the first device establishes a peer-to-peer connection with the interconnection device, and the first device may establish a connection with multiple interconnection devices, so that the first device performs information interaction with the interconnection devices based on the peer-to-peer connection. By adopting the method, the related requests of the first equipment end to the server or other remote storage nodes in a cost consumption mode such as a cellular mobile communication network can be reduced, the interaction effect of the first equipment end and the interconnection equipment is improved, and the cost generated by the interaction of the first equipment and the interconnection equipment is reduced.
Based on the connection between the first device and the interconnection device, the first device sends an interconnection shooting request to the interconnection device. The interconnection shooting request is that the first equipment requests to carry out shooting operation on a shooting object or an instant shooting interval meeting preset conditions together with the interconnection equipment which has established connection.
The interconnection shooting request at least carries position information of the first equipment and status information of the connection function of the first equipment, so that interconnection shooting can be carried out together with the interconnection equipment.
In steps S120 and S130, based on the response of the interconnection device to the shooting request, the first device and the interconnection device each perform a shooting operation on a shooting object or an instant shooting section meeting a preset condition, that is, the first device performs shooting based on the establishment of the interconnection shooting function, and the interconnection device also performs shooting based on the establishment of the interconnection shooting function. The shooting operation of the first device and the interconnection device depends on shooting operation users corresponding to the first device and the interconnection device, and the shooting operation users can be independent in time or synchronous in time, and only need to acquire corresponding shooting information on the basis of the first device and the interconnection device.
And the response of the shooting request is the response of the interconnection equipment receiving the interconnection shooting request.
After the first device shoots on the basis of establishing the interconnection shooting function, first shooting information for interconnection shooting based on the position information of the first device is determined. And the first device may further acquire second shooting information from the interconnected device for interconnected shooting based on the position information of the interconnected device.
In the S140 step, the first device may determine the first panoramic image according to the first photographing information and the second photographing information described above. The panoramic image is a three-dimensional stereoscopic image in which a photographic subject or a photographic area is determined based on first photographic information and second photographic information, and the first panoramic image is a three-dimensional stereoscopic image determined by the first device based on the first photographic information and the second photographic information.
Here, the actual image portion in the panoramic image is an image obtained from the first shooting information and the second shooting information, and the other image frames in the panoramic image are obtained by performing fitting calculation based on the image information obtained from the first shooting information and the second shooting information.
The first shooting information and the second shooting information at least comprise position information of corresponding equipment, namely first position information corresponding to the first equipment and second position information corresponding to the interconnection equipment.
For example, the first location information may be positioning information of a location where the first device is located. Illustratively, the first device obtains the positioning information via a positioning system. The positioning system includes but is not limited to: global Positioning System (GPS) and/or beidou systems, etc. As another example, the positioning information may be position information measured by a terrestrial communication system based on wireless communication such as cellular mobile communication. The information content of the location information includes, but is not limited to, longitude and latitude of the location where the device end corresponding to the location information is located.
The GPS information is one of the above-mentioned location information. For example, if the first device supports a point-to-point connection manner such as bluetooth connection, the bluetooth address of the first device may also be carried in the interconnection shooting request.
The interconnection shooting request of the first device has a position address of the first device, and the position address can be used for information interaction between the server and the first device and the like. And all the information of the interconnection shooting can be synchronously uploaded to the related server through the first equipment or the interconnection equipment
In summary, in the embodiments of the present disclosure, by establishing a connection between a plurality of devices, the first device and the interconnection device may form an interactive shooting behavior. Further, the first device obtains first shooting information of the first device and second shooting information of the interconnected devices, and synthesizes a corresponding first panoramic image based on the shooting information, so as to realize multi-dimensional shooting behaviors.
In some embodiments, the connection of the first device to the at least one interconnect device includes at least: WIFI hotspot connection and Bluetooth connection.
In the disclosed embodiment, for example, the bluetooth connection function may include: classic bluetooth connection function, can also be Low Energy (LE) bluetooth connection function.
In some embodiments, the peer-to-peer connection mode may include other peer-to-peer connection modes besides the bluetooth connection, and for example, the peer-to-peer connection mode may further include: WIFI direct connection based on a WIFI mechanism and the like.
In some embodiments, the multi-device interconnection shooting method further includes:
devices within a predetermined range are scanned based on a first position of a first device.
And determining the equipment in the preset range and at the preset shooting position as the interconnected equipment, wherein the preset shooting position is a shooting position at which the interconnected equipment executes interconnected shooting relative to the first position of the first equipment.
In this embodiment, a client supporting the same peer-to-peer connection mode as the first device is determined by combining the first location information of the first device, a device within a preset range may be determined by combining a location range corresponding to the strength of the connection signal sent by the first device, a device at a preset shooting location is determined by combining the first location information, and then a device meeting the above conditions is determined to be a connectable interconnection device.
For example, the first device has a function of performing bluetooth connection, and if a device located within a bluetooth connection range and at a preset shooting position is scanned, the first device requests to establish a peer-to-peer connection with the device (i.e., the interconnection device). At this time, after receiving the interconnection shooting request sent from the first device, the interconnection device determines to establish the point-to-point connection, and sends a response to the first device determining to establish the connection. Wherein, the interconnection device also needs to be equipped with the function of performing bluetooth connection.
In the embodiment of the disclosure, the preset range is a position range in which the first device can scan through the point-to-point connection based on the first position and preset the signal strength. The interconnection equipment can execute the position of interconnection shooting relative to the first position of the first equipment at the preset shooting position, and when the interconnection equipment is located at the preset shooting position, the shooting visual angle of the interconnection equipment and the visual angle of the first equipment located at the first position can form an interconnection shooting visual angle. That is, the shooting object and the shooting area shot when the first position and the interconnected device are located at the preset shooting position conform to the conditions of interconnected shooting, so that the panoramic image can be determined according to the shooting information acquired by the first device and the interconnected device.
In this embodiment, the multi-device interconnection shooting method further includes:
the first device sends a connection request to the interconnect device. After the interconnection equipment receives the connection request of the first equipment, the connection with the first equipment is determined.
The first device establishes a connection with the interconnect device in response to the interconnect device determining a connection with the first device.
In this embodiment, the connection request includes at least a location address of the first device and status information of the first device connection function. The status information of the first device connection function may include: a field carrying status information of the point-to-point connection. The field may include N bits, wherein two bit values of 1 bit indicate at least whether the first device supports a corresponding manner of point-to-point connection. Illustratively, the field may include at least: and 2 bits, wherein two bit values of one bit are used for indicating whether Bluetooth connection is supported, and two bit values of the other bit are used for indicating whether WIFI direct connection is supported. Of course, this is merely an example of a manner of carrying the usage status information of the peer-to-peer connection, and the specific implementation is not limited to this.
In this embodiment, the connection information further comprises authentication information for the point-to-point connection establishment. The verification information can be a password of WIFI direct connection and/or a pairing code of Bluetooth connection. When the first device establishes connection with the interconnection device, verification can be performed based on the verification information, and the security of connection establishment is ensured.
It can be understood that, after the first device scans the connection signal, if the scanned interconnection device also has the above peer-to-peer connection function and the function is in the off state, a prompt for starting the peer-to-peer connection function output by the relevant server may be used.
In some embodiments, as shown in fig. 2, determining the first photographing information photographed by the first device based on a response of the interconnected device to the photographing request includes:
s210: and receiving a response to the interconnection shooting request from the interconnection equipment.
S220: a photographic subject or a photographic area of the first device is determined.
S230: and when the shooting object or the shooting area of the first equipment and the shooting object or the shooting area of the interconnected equipment accord with the preset condition, responding to the first operation and controlling the first equipment to carry out interconnected shooting.
In this embodiment, the first device sends an interconnection shooting request to the interconnection device, and the interconnection device confirms that the interconnection shooting is executed together with the first device after receiving the interconnection shooting request.
Based on the response of the interconnection equipment to the interconnection shooting request, the first equipment and the interconnection equipment respectively execute shooting behaviors based on the establishment of the interconnection shooting request. The first device determines first shooting information after executing a shooting behavior of the interconnected shooting, and the interconnected device determines second shooting information after executing the shooting behavior of the interconnected shooting.
The corresponding device may determine the relative position of the first device and the interconnect device via a corresponding on-device sensor, such as a UBW, acceleration sensor, or the like. Further, the accuracy of the shooting area of the shooting object can be determined based on the relative position information, and on the basis of referring to the relative position, whether the shooting object and the shooting area accord with the preset condition or not is judged by identifying the shooting object and the shooting area of the first device and the interconnection device. Further, the subject and the photographing region of the corresponding device may be determined by manual frame selection.
By adopting the method, based on the establishment of the interconnection shooting request of the first equipment and the interconnection equipment, the first equipment and the interconnection equipment can independently shoot on the respective equipment and independently determine the respective shooting information, so that the first equipment and the interconnection equipment can determine more shooting information based on the position information of different positions.
In some embodiments, the multi-device interconnection shooting method further comprises:
and synchronously displaying the shooting display interface of the first equipment and the shooting display interface of the interconnection equipment on the shooting interface of the first equipment.
And responding to a second operation of the shooting display interface of the interconnected equipment on the first equipment, and controlling the interconnected equipment to carry out interconnected shooting.
And responding to a third operation of the shooting display interface of the interconnected equipment on the first equipment, and editing the shooting display interface of the interconnected equipment.
After the first device and the interconnection device establish connection of interconnection shooting, the first device and the interconnection device can independently execute shooting behaviors.
The shooting display interface of the first device and the shooting display interface of the interconnection device can be synchronously displayed on the shooting interface of the first device. The shooting interface of the first device may be an interface for executing a shooting function, and the shooting display interface of the first device and the shooting display interface of the interconnection device are display frames for displaying a shooting object or a shooting area based on the corresponding device.
The shooting display interface of the first device may be displayed in a combination form of the shooting display interface of the first device and the shooting display interface of the interconnection device, or the shooting display interface of the interconnection device may be displayed in a form of a movable floating window on the shooting display interface of the first device, and the specific display form is not limited.
In this embodiment, in response to a second operation on the shooting display interface of the interconnected device on the first device, the first device sends a signal for executing shooting to the interconnected device, so that the interconnected device performs interconnected shooting. The second operation corresponds to a control for executing the corresponding operation on the shooting interface of the first device or is a shortcut operation.
In this embodiment, in response to a third operation on the shooting display interface of the interconnected device on the first device, the user may perform an editing operation on the shooting display interface of the interconnected device on the shooting interface of the first device. The editing operation may be deleting, hiding, editing in a display form, and the like for a shooting display interface of the internet device.
In some embodiments, as shown in fig. 3, determining the first panoramic image from the first photographing information and the second photographing information includes:
s310: and determining the three-dimensional contour of the interconnected shot images according to the contour information corresponding to the first image and/or the contour information corresponding to the second image.
S320: an intermediate image frame is determined from the first image information and the second image information based on the three-dimensional contour of the interlinked captured images.
S330: a first panoramic image is determined from the three-dimensional profile of the interconnected captured images and the intermediate image frame.
After the first device determines the first shooting information and acquires the second shooting information of the interconnection device, the first panoramic image can be determined based on the shooting information. It should be noted that although the shooting information according to which the panoramic images are determined by the respective devices according to the acquired shooting information are consistent, the panoramic images determined by the respective devices may differ due to differences in the computing capabilities of the respective devices, and therefore, the first panoramic image is a panoramic image determined by the first device, and the second panoramic image is a panoramic image determined by the interconnected devices.
The first shooting information determined by the first device through interconnected shooting at least comprises: first position information of the first device, first image information of the first device, and first photographing time information of the first device; wherein the first image information is determined according to the first position information, the first image information at least including: and the outline information corresponding to the first image. The interconnection equipment at least comprises the following steps of determining second shooting information through interconnection shooting: second position information of the interconnection equipment, second image information of the interconnection equipment and second shooting time information of the interconnection equipment; wherein the second image information is determined according to the second position information, the second image information at least comprising: and the outline information corresponding to the second image.
In this embodiment, when the corresponding device performs the interconnected shooting, the corresponding device scans the shooting object or the shooting area through a depth sensor (TOF) sensor or a radar wave sensor on the device to determine the profile information of the shooting object or the shooting area based on different positions.
When the corresponding devices carry out the interconnection shooting, the first device carries out the shooting based on the first position to determine the first image information, and the interconnection device carries out the shooting based on the second position to determine the second image information. Further, the first device may calculate and acquire a three-dimensional contour of the photographic subject or the photographic area in combination with the contour information of the plurality of positions.
For example, when a cube is a subject, images of the subject acquired by the first device and the interconnection device based on respective positions are not all in a complete square representation, but are represented by the "cube" at a certain angle. The three-dimensional outline of the cube can be obtained by calculating the outline information in the image of the shooting object obtained by the first device and the interconnection device based on the respective positions. Of course, when the number of linked devices is more, the more the information of the shooting objects at different positions is acquired, the more accurate the three-dimensional contour of the shooting object determined finally is.
Then, an intermediate image frame may be calculated based on the three-dimensional contour of the above-mentioned interlinked captured images and by combining the first image information and the second image information. Further, the three-dimensional profile of the images taken in accordance with the above-described interlinking, and the final first panoramic image are determined by synthesizing the image frames of the respective angles (i.e., the intermediate image frames).
The intermediate image frame is an image frame which is determined by calculation of the interconnection shooting object or area based on the intermediate position of the first position and the second position, and is not an image frame actually acquired by interconnection shooting.
Based on the method in the embodiment, the image information of the shot objects or the shot areas at multiple angles can be obtained through the interconnected shooting of multiple devices, and the first panoramic image is further obtained according to the position information fitting of the corresponding devices, so that the multi-position shooting is realized, and the shot objects or the shot areas are more stereoscopic and accurate.
In some embodiments, the multi-device interconnection shooting method further includes:
in response to a fourth operation on the first panoramic image, images of different positions of the first panoramic image are displayed.
The first panoramic image is synchronously connected to the interconnected device and the server for display and/or storage in the interconnected device and the server.
In this embodiment, the first panoramic image obtained by the above method may be connected to an interconnection device in a point-to-point connection manner, or may be uploaded to a related server for storage and/or display.
The first panoramic image may be displayed on the first device, and images of different positions may be displayed on a display interface of the first device based on a user's movement operation (i.e., a fourth operation) of the orientation of the first panoramic image. The images at different positions are intermediate image frames obtained by calculation in the method, and may be images at different angle positions or images at different distances.
In some embodiments, the multi-device interconnection shooting method further includes:
in this embodiment, the first device may further transmit the determined first photographing information to the interconnection device, so that the interconnection device may determine the second panoramic image based on the first photographing information and the second photographing information. Alternatively, the first device may also transmit the determined first photographing information to the server, so that the server may determine the second panoramic image based on the first photographing information and the second photographing information.
As shown in fig. 5, the multi-device interconnection shooting method provided by the embodiment of the present disclosure may be applied to a first interconnection device, based on connection between at least one interconnection device and the first device, where the at least one interconnection device at least includes: the device comprises a first interconnection device and a second interconnection device, wherein the interconnection devices are used for receiving interconnection shooting requests. The method comprises the following steps:
s410: an interconnected photographing request from a first device is received.
S420: and in response to the interconnection shooting request, determining second shooting information shot by the interconnection equipment.
S430: and sending second shooting information of the interconnection equipment.
S440: a first panoramic image is received from a first device and displayed.
After the point-to-point connection is established between the first device and the interconnection device, the first interconnection device receives an interconnection shooting request from the first device. After determining to receive the interconnection shooting request, the first interconnection device determines to perform interconnection shooting together with the first device, and sends a response determining to perform interconnection shooting together to the first device.
In response to the interconnection shooting request, the first interconnection device and the first device respectively execute shooting operation on a shooting object or an instant shooting interval meeting preset conditions, namely the first interconnection device shoots on the basis of establishing an interconnection shooting function, and the first device shoots on the basis of establishing the interconnection shooting function.
Here, the interconnection device receives the interconnection shooting request in response to the interconnection shooting request, and sends a response of receiving the interconnection shooting to the first device.
After the first interconnection equipment shoots on the basis of establishing the interconnection shooting function, second shooting information for carrying out interconnection shooting on the basis of the position information of the first interconnection equipment is determined. And the first interconnection equipment sends second shooting information for interconnection shooting to the first equipment based on the position information of the first interconnection equipment.
Furthermore, the first device or the related server side can determine the panoramic image according to the first shooting information and the second shooting information. Then a first panoramic image may be received at the first interconnected device and displayed from the first device. The panoramic image is a three-dimensional stereoscopic image in which a photographic subject or a photographic area is determined based on first photographic information and second photographic information, and the first panoramic image is a three-dimensional stereoscopic image determined by the first device based on the first photographic information and the second photographic information.
Here, the actual image portion in the panoramic image is an image obtained from the first shooting information and the second shooting information, and the other image frames in the panoramic image are obtained by performing fitting calculation based on the image information obtained from the first shooting information and the second shooting information.
The first shooting information and the second shooting information at least comprise position information of corresponding equipment, namely first position information corresponding to the first equipment and second position information corresponding to the first interconnection equipment.
In summary, in the embodiments of the present disclosure, by establishing a connection between a plurality of devices, the first interconnection device and the first device may form an interactive shooting behavior. Further, the first interconnection device enables the first device to synthesize the corresponding first panoramic image based on the first shooting information determined by the first device and the acquired second shooting information through the second shooting information sent to the first device, so that multi-dimensional shooting behaviors are achieved.
In some embodiments, the connection of the first device to the at least one interconnect device includes at least: WIFI hotspot connection and Bluetooth connection.
In the disclosed embodiment, for example, the bluetooth connection function may include: classic bluetooth connection function, and Low Energy (LE) bluetooth connection function.
In some embodiments, the peer-to-peer connection mode may include other peer-to-peer connection modes besides the bluetooth connection mode, and for example, the peer-to-peer connection mode may further include: WIFI direct connection based on a WIFI mechanism and the like.
In this embodiment, the multi-device interconnection shooting method further includes:
the first device sends a connection request to the interconnection device, and the first interconnection device receives the connection request. After the first interconnection device determines to receive the connection request, connection is established with the first device, and a response for determining the connection request is sent to the first device.
Wherein, the connection request at least comprises the location address of the first device and the status information of the connection function of the first device. The status information of the first device connection function may include: a field carrying status information of the point-to-point connection. The field may include N bits, wherein two bit values of 1 bit indicate at least whether the first device supports a corresponding manner of point-to-point connection. Illustratively, the field may include at least: and 2 bits, wherein two bit values of one bit are used for indicating whether a Bluetooth connection is supported, and two bit values of the other bit are used for indicating whether a WIFI direct connection is supported. Of course, this is merely an example of a manner of carrying the usage status information of the peer-to-peer connection, and the specific implementation is not limited to this.
In this embodiment, the connection information also includes authentication information for the point-to-point connection establishment. The verification information can be a password of WIFI direct connection and/or a pairing code of Bluetooth connection. When the first device establishes connection with the interconnection device, verification can be performed based on the verification information, and the security of connection establishment is ensured.
It can be understood that, after the first device scans the connection signal, if the first interconnection device also has the above peer-to-peer connection function and the function is in the off state, the prompt for starting the peer-to-peer connection operation output by the server may be received.
In some embodiments, determining second shooting information shot by the interconnected device comprises:
and determining a shooting object or a shooting area of the first interconnection equipment.
And when the shooting object or the shooting area of the first interconnection equipment and the shooting object or the shooting area of the first equipment accord with a preset condition, responding to a fifth operation and controlling the first interconnection equipment to carry out interconnection shooting.
In this embodiment, after receiving the interconnection shooting request from the first device, the first interconnection device confirms that interconnection shooting is performed together with the first device.
Based on the response of the first interconnection device to the interconnection shooting request, the first device and the first interconnection device respectively execute shooting behaviors based on the establishment of the interconnection shooting request. The first equipment determines first shooting information after executing shooting behaviors of interconnection shooting, and the first interconnection equipment determines second shooting information after executing the shooting behaviors of the interconnection shooting.
The corresponding device may determine the relative position of the first device and the first interconnect device via a corresponding on-device sensor, such as a UBW, acceleration sensor, or the like. The accuracy of the shooting area of the shooting object can be further determined based on the relative position information, and on the basis of referring to the relative position, whether the shooting object and the shooting area accord with the preset condition or not is judged by identifying the shooting object and the shooting area of the first device and the first interconnection device. Further, the shooting object and the shooting area of the corresponding device can be determined by manual frame selection.
By adopting the method, based on the establishment of the first device and the interconnection device based on the interconnection shooting request, the corresponding devices can independently shoot on the respective devices and independently determine the respective shooting information, so that the first device and the interconnection device can determine more shooting information based on different position information.
In some embodiments, the multi-device interconnection shooting method further includes:
and synchronously displaying the shooting display interfaces of the first equipment and the second interconnected equipment on the shooting interface of the first interconnected equipment.
And responding to a sixth operation of the shooting display interface of the first equipment or the second interconnected equipment, and controlling the first interconnected equipment or the second interconnected equipment to carry out interconnected shooting.
And editing the shooting display interface of the interconnected equipment or the second interconnected equipment in response to a seventh operation on the shooting display interface of the first equipment or the second interconnected equipment.
After connection is established between the first device and the first interconnection device and interconnection shooting is confirmed to be carried out together, a shooting display interface of the interconnection device can be synchronously displayed on a shooting interface of the first device, and meanwhile, shooting display interfaces of the first device and the second interconnection device can also be displayed on the shooting interface of the first interconnection device. The shooting interface of the first device may be an interface for executing a shooting function, and the shooting display interface of the first device and the shooting display interface of the interconnection device are display frames for displaying a shooting object or a shooting area based on the corresponding device.
The shooting interface of the first interconnection device may be displayed in a combination form of the shooting display interfaces of the first device, the first interconnection device and the second interconnection device, or the shooting display interface of the first interconnection device may be displayed in a form of a movable floating window, and specific display forms of the shooting display interfaces of the first interconnection device and the second interconnection device are not limited.
In this embodiment, in response to a sixth operation on the photographing display interface of the first device or the second interconnected device displayed on the first interconnected device, the first interconnected device sends a signal to perform photographing to the first device, so that the first device requests all connected interconnected devices to perform a photographing operation. The sixth operation corresponds to a control for executing a corresponding operation on the shooting interface of the first interconnection device or is a shortcut operation.
In this embodiment, in response to a seventh operation on the shooting display interface of the first device or the second interconnected device displayed on the first interconnected device, the user may perform an editing operation on the shooting display interface of the first interconnected device on the shooting interface of the first interconnected device. The editing operation may be deleting, hiding, editing in a display form, and the like for a shooting display interface of the first device or the second device.
In some embodiments, the method of displaying a first panoramic image further comprises:
the method comprises the steps of acquiring a first panoramic image from a first device, displaying the first panoramic image on a shooting display interface of a first interconnection device, and comprising the following steps:
in response to an eighth operation on the panoramic image, images of different positions of the panoramic image are displayed.
In this embodiment, the first panoramic image is obtained through a point-to-point connection, so that the first panoramic image can be displayed on the first interconnection device. Further, based on the user's operation of moving the orientation of the first panoramic image (i.e., the fourth operation), images at different positions, which may be images at different angular positions, or images at different distances, may be displayed on the display interface of the first device.
In some embodiments, as shown in fig. 5, the multi-device interconnection shooting method further includes:
s510: and acquiring first shooting information of the first equipment and shooting information of the second interconnected equipment.
S520: and determining the three-dimensional contour of the interconnected shot images according to the contour information, wherein the contour information is the contour information corresponding to the first image, the contour information corresponding to the second image and/or the contour information corresponding to the image of the second interconnected equipment.
S530: and determining an intermediate image frame according to the first image information, the second image information and the image information of the second interconnection device based on the three-dimensional contour of the interconnection shooting image.
S540: a second panoramic image is determined from the three-dimensional contours of the interconnected captured images and the intermediate image frame.
The first shooting information determined by the first device through interconnected shooting at least comprises: first position information of the first device, first image information of the first device, and first photographing time information of the first device; wherein the first image information is determined according to the first position information, the first image information at least including: and the outline information corresponding to the first image. The first interconnection equipment at least comprises the following steps of determining second shooting information through interconnection shooting: second position information of the interconnection equipment, second image information of the interconnection equipment and second shooting time information of the interconnection equipment; wherein the second image information is determined according to the second position information, the second image information at least including: and the outline information corresponding to the second image. The shooting information determined by the second interconnection device through the corresponding device at least comprises: the position information corresponding to the second interconnection equipment, the image information corresponding to the second interconnection equipment and the shooting time information corresponding to the second interconnection equipment; the second interconnection device is determined according to the position information corresponding to the second interconnection device, wherein the image information corresponding to the second interconnection device at least comprises: and the outline information corresponding to the image of the second interconnection device.
In this embodiment, the first interconnection device may further determine the panoramic image by acquiring shooting information of each device and determining the panoramic image according to the shooting information. It should be noted that although the shooting information according to which the panoramic images are determined by the respective devices according to the acquired shooting information are consistent, the panoramic images determined by the respective devices may differ due to differences in the computing capabilities of the respective devices, and therefore, the first panoramic image is the panoramic image determined by the first device, and the second panoramic image is the panoramic image determined by the first interconnection device.
When the corresponding equipment performs interconnection shooting, the corresponding equipment scans a shooting object or a shooting area through a depth sensor (TOF) sensor or a radar wave sensor on the equipment to determine contour information of different positions.
When the corresponding devices carry out interconnection shooting, the first device carries out shooting based on a first position to determine first image information, the first interconnection device carries out shooting based on a second position to determine second image information, and the second interconnection device carries out shooting based on image information determined by the corresponding position. Further, the first interconnection device may calculate and acquire a three-dimensional contour of the photographic object or the photographic area in combination with the contour information of the plurality of positions.
For example, when a cube is a photographic subject, images of the photographic subject acquired by a single device based on respective positions are not all in the form of a complete square, but are presented in the form of a "cube" at a certain angle. The three-dimensional contour information of a cube can be acquired by calculating the contour information in the image of the shooting object acquired by the first device and the first interconnection device based on the respective positions. Of course, when the number of linked devices is more, the more the information of the shooting objects at different positions is acquired, the more accurate the three-dimensional contour of the shooting object determined finally is.
Then, based on the three-dimensional contour of the interconnected shot images and in combination with the first device, the image information acquired by the first interconnected device and the second interconnected device may calculate an intermediate image frame, and further determine a final second panoramic image by synthesizing the image frames of the respective angles. The intermediate image frame is an image frame which is determined by calculating the intermediate position of the corresponding positions of the first device, the first interconnection device and the second interconnection device and is not actually acquired by interconnection shooting.
Based on the method in the embodiment, the image information of the shot objects or the shot areas at multiple angles can be obtained through the interconnection shooting of multiple devices, and the second panoramic image is further obtained according to the position information fitting of the corresponding devices, so that the multi-position shooting is realized, and the shot objects or the shot areas are more three-dimensional and wider.
In this embodiment, the first device may further transmit the determined first photographing information to the interconnection device, so that the interconnection device may determine the second panoramic image based on the first photographing information and the second photographing information. Alternatively, the first device may also transmit the determined first photographing information to the server, so that the server may determine the second panoramic image based on the first photographing information and the second photographing information.
In some embodiments, the relevant server may acquire the first photographing information and the second photographing information through the first device and the interconnection device, and synthesize the third panoramic image based on the first photographing information and the second photographing information by the method designed in fig. 3 or fig. 5 described above. Further, the first device or the interconnected device may retrieve a third panoramic image from the associated interconnected device for display.
As shown in fig. 6, an embodiment of the present disclosure provides a multi-device interconnection shooting apparatus, applied to a first device, including:
a sending request module 610 configured to send an interconnection shooting request to an interconnection device for connection between the first device and at least one interconnection device.
The first photographing module 620 determines first photographing information photographed by the first device based on a response of the interconnected device to the interconnected photographing request.
The first obtaining module 630 is configured to obtain second shooting information shot by the interconnected device.
A first determination module 640 configured to determine the first panoramic image from the first photographing information and the second photographing information.
As shown in fig. 7, an embodiment of the present disclosure provides a multi-device interconnection shooting apparatus, applied to a first interconnection device, including:
a receive request module 710 configured to receive an interconnect shooting request from a first device.
And a second photographing module 720 configured to determine second photographing information photographed by the interconnected devices in response to the interconnected photographing request.
The first transmitting module 730 is configured to transmit the second photographing information of the interconnected device.
A display module 740 configured to receive the first panoramic image from the first device and display the first panoramic image.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
An embodiment of the present disclosure provides an electronic device, including:
a memory for storing processor-executable instructions;
a processor connected with the memory;
wherein the processor is configured to execute the file processing method provided by any of the foregoing technical solutions.
The processor may include various types of storage media, non-transitory computer storage media capable of continuing to remember to store the information thereon after a power loss to the communication device.
Here, the electronic device may be the aforementioned first device, the first interconnection device, or the server.
The processor may be connected to the memory via a bus or the like for reading the executable program stored on the memory, for example, capable of performing at least one of the methods as shown in any of fig. 1 and 4.
Fig. 8 is a block diagram illustrating an electronic device 800 in accordance with an example embodiment. For example, the electronic device 800 may be included in a terminal device such as a mobile phone or a mobile computer, or a device such as a server.
Referring to fig. 8, electronic device 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.
The processing component 802 generally controls overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operation at the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile and non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 806 provides power to the various components of the electronic device 800. Power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for electronic device 800.
The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operating state, such as a shooting state or a video state. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 800 is in an operational state, such as a call state, a recording state, and a voice recognition state. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
Sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for electronic device 800. For example, sensor assembly 814 may detect the open/closed status of device 800, the relative positioning of components, such as a display and keypad of device 800, sensor assembly 814 may also detect a change in position of device 800 or a component of device 800, the presence or absence of user contact with device 800, orientation or acceleration/deceleration of device 800, and a change in temperature of device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 may access a wireless network based on a communication standard, such as Wi-Fi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, communications component 816 further includes a Near Field Communications (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
The embodiment of the present disclosure provides a non-transitory computer readable storage medium, wherein when a processor of a UE executes instructions in the storage medium, the UE or a base station is enabled to execute the file processing method provided in any of the foregoing embodiments, and at least one of the methods illustrated in any of fig. 1 and/or fig. 4 can be executed. The file processing method executed by the server may include:
other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (19)

1. A multi-device interconnection shooting method is applied to a first device, and comprises the following steps:
sending an interconnection shooting request to the interconnection equipment based on the connection between the first equipment and at least one interconnection equipment;
determining first shooting information shot by the first equipment based on the response of the interconnection equipment to the interconnection shooting request;
acquiring second shooting information shot by the interconnection equipment;
determining a first panoramic image according to the first shooting information and the second shooting information;
the first photographing information at least includes: first position information of the first device, first image information of the first device, and first photographing time information of the first device; wherein the first image information is determined according to the first position information, the first image information including at least: the contour information corresponding to the first image;
the second photographing information at least includes: second position information of the interconnection equipment, second image information of the interconnection equipment and second shooting time information of the interconnection equipment; wherein the second image information is determined according to the second position information, the second image information at least including: contour information corresponding to the second image;
the determining a first panoramic image according to the first photographing information and the second photographing information includes:
determining a three-dimensional contour of the interconnected shot images according to the contour information corresponding to the first image and/or the contour information corresponding to the second image;
determining an intermediate image frame according to the first image information and the second image information based on the three-dimensional contour of the interconnected shot images;
and determining the first panoramic image according to the three-dimensional outline of the interconnected shot images and the intermediate image frame.
2. The multi-device interconnection shooting method according to claim 1, wherein the connection of the first device and at least one interconnection device at least comprises: WIFI hotspot connection and Bluetooth connection.
3. The multi-device interconnected shooting method according to claim 1, characterized in that the method further comprises:
scanning for devices within a predetermined range based on a first position of the first device;
and determining that the equipment in the preset range and in the preset shooting position is the interconnection equipment, wherein the preset shooting position is a shooting position of the interconnection equipment for executing the interconnection shooting relative to the first position of the first equipment.
4. The multi-device interconnected shooting method according to claim 3, characterized in that the method further comprises:
the first equipment sends a connection request to the interconnection equipment;
and responding to the response of the interconnection equipment to the connection request, and establishing connection with the interconnection equipment.
5. The multi-device interconnection shooting method according to claim 1, wherein the determining first shooting information shot by the first device based on the response of the interconnection device to the shooting request comprises:
receiving a response to the interconnection shooting request from the interconnection equipment;
determining a photographing object or a photographing area of the first device;
and when the shooting object or the shooting area of the first equipment and the shooting object or the shooting area of the interconnected equipment accord with preset conditions, responding to a first operation, and controlling the first equipment to carry out the interconnected shooting.
6. The multi-device interconnected shooting method according to claim 5, characterized in that the method further comprises:
synchronously displaying a shooting display interface of the first equipment and a shooting display interface of the interconnection equipment on a shooting interface of the first equipment;
responding to a second operation on a shooting display interface of the interconnected equipment on the first equipment, and controlling the interconnected equipment to carry out interconnected shooting;
and responding to a third operation on the shooting display interface of the interconnected equipment on the first equipment, and editing the shooting display interface of the interconnected equipment.
7. The multi-device interconnected shooting method according to claim 1, characterized in that the method further comprises:
displaying images of different positions of the first panoramic image in response to a fourth operation on the first panoramic image;
and synchronously connecting the first panoramic image to the interconnected equipment and the server so as to display and/or store in the interconnected equipment and the server.
8. The multi-device interconnected shooting method according to any one of claims 5 to 7, characterized in that the method further comprises:
sending the first shooting information to the interconnection equipment, wherein the interconnection equipment is used for determining a second panoramic image according to the first shooting information and the second shooting information;
or,
and sending the first shooting information to a server, wherein the server is used for determining a third panoramic image according to the first shooting information and the second shooting information which are shot by the first equipment in an interconnected mode.
9. A multi-device interconnection shooting method is applied to first interconnection devices and comprises the following steps:
based on the connection of at least one interconnection device with a first device, wherein the at least one interconnection device at least comprises: a first interconnect device and a second interconnect device;
receiving an interconnection shooting request from the first equipment;
responding to the interconnection shooting request, and determining second shooting information shot by the first interconnection equipment;
sending second shooting information of the interconnection equipment;
receiving a first panoramic image from the first device and displaying the first panoramic image;
the first panoramic image is determined by first photographing information and the second photographing information;
the first photographing information at least includes: first position information of the first device, first image information of the first device, and first photographing time information of the first device; wherein the first image information is determined according to the first position information, the first image information including at least: the contour information corresponding to the first image;
the second photographing information at least includes: second position information of the interconnection equipment, second image information of the interconnection equipment and second shooting time information of the interconnection equipment; wherein the second image information is determined according to the second position information, the second image information including at least: contour information corresponding to the second image;
the shooting information of the second interconnection device at least comprises: the position information corresponding to the second interconnection equipment, the image information corresponding to the second interconnection equipment and the shooting time information corresponding to the second interconnection equipment are obtained; the second interconnection device is determined according to the position information corresponding to the second interconnection device, and the image information corresponding to the second interconnection device at least includes: the outline information corresponding to the image of the second interconnection equipment;
the method further comprises the following steps:
acquiring first shooting information of the first equipment and shooting information of the second interconnection equipment;
determining a three-dimensional contour of the interconnected shot images according to the contour information, wherein the contour information is contour information corresponding to the first image, contour information corresponding to the second image and/or contour information corresponding to an image of the second interconnected device;
determining an intermediate image frame according to the first image information, the second image information and the image information of the second interconnection equipment based on the three-dimensional contour of the interconnection shooting image;
and determining the second panoramic image according to the three-dimensional outline of the interconnected shot images and the intermediate image frame.
10. The multi-device interconnection shooting method according to claim 9, wherein the connection of the at least one interconnection device with the first device at least comprises: a WIFI hotspot connection and a Bluetooth connection.
11. The multi-device interconnected photography method of claim 9, wherein the method further comprises:
receiving a connection request from the first device, establishing a connection with the first device, and sending a response to the connection request to the first device.
12. The multi-device interconnection shooting method according to claim 9, wherein the determining second shooting information shot by the first interconnection device comprises:
determining a shooting object or a shooting area of the first interconnection equipment;
and when the shooting object or the shooting area of the first interconnection equipment and the shooting object or the shooting area of the first equipment accord with preset conditions, responding to a fifth operation, and controlling the first interconnection equipment to carry out interconnection shooting.
13. The multi-device interconnected photography method of claim 12, wherein the method further comprises:
synchronously displaying shooting display interfaces of the first equipment and the second interconnected equipment on a shooting interface of the first interconnected equipment;
responding to a sixth operation on a shooting display interface of the first equipment or the second interconnected equipment, and controlling the first equipment or the second interconnected equipment to carry out interconnected shooting;
and responding to a seventh operation on a shooting display interface of the first equipment or the second interconnected equipment, and editing the shooting display interface of the first equipment or the second interconnected equipment.
14. The multi-device interconnected photography method of claim 9, wherein the displaying the first panoramic image comprises:
acquiring the first panoramic image from the first device, and displaying the first panoramic image on a shooting display interface of the first interconnection device, wherein the method comprises the following steps:
in response to an eighth operation on the panoramic image, displaying images of different positions of the panoramic image.
15. The multi-device interconnection shooting method according to claim 9, wherein the acquiring the first shooting information and the shooting information of the second interconnection device comprises:
acquiring the first shooting information and the shooting information of the second interconnection equipment from a server so as to determine a third panoramic image;
or,
and acquiring the first shooting information and the shooting information of the second interconnected equipment from the first equipment so as to be used for determining the second panoramic image.
16. The utility model provides a many equipment interconnection shooting device which characterized in that is applied to first equipment, the device includes:
the sending request module is configured to send an interconnection shooting request to the interconnection equipment based on the connection between the first equipment and at least one interconnection equipment;
the first shooting module is used for determining first shooting information shot by the first equipment based on the response of the interconnected equipment to the interconnected shooting request;
the first acquisition module is configured to acquire second shooting information shot by the interconnection equipment;
a first determination module configured to determine a first panoramic image from the first photographing information and the second photographing information;
the first photographing information at least includes: first position information of the first device, first image information of the first device, and first photographing time information of the first device; wherein the first image information is determined according to the first position information, the first image information including at least: the contour information corresponding to the first image;
the second photographing information at least includes: second position information of the interconnected equipment, second image information of the interconnected equipment and second shooting time information of the interconnected equipment; wherein the second image information is determined according to the second position information, the second image information at least including: contour information corresponding to the second image;
the determining a first panoramic image according to the first photographing information and the second photographing information includes:
determining a three-dimensional contour of the interconnected shot images according to the contour information corresponding to the first image and/or the contour information corresponding to the second image;
determining an intermediate image frame according to the first image information and the second image information based on the three-dimensional contour of the interconnected shot images;
and determining the first panoramic image according to the three-dimensional outline of the interconnected shot images and the intermediate image frame.
17. The utility model provides a device is shot in interconnection of multi-device which characterized in that is applied to first interconnection equipment, the device includes:
based on the connection of at least one interconnection device and a first device, wherein the at least one interconnection device at least comprises: a first interconnect device and a second interconnect device;
a receiving request module configured to receive an interconnection shooting request from the first device;
the second shooting module is configured to respond to the interconnection shooting request and determine second shooting information shot by the interconnection equipment;
the first sending module is configured to send second shooting information of the interconnection equipment;
a display module configured to receive a first panoramic image from the first device and display the first panoramic image;
the first panoramic image is determined by first photographing information and the second photographing information;
the first photographing information at least includes: first position information of the first device, first image information of the first device, and first photographing time information of the first device; wherein the first image information is determined according to the first position information, the first image information including at least: the contour information corresponding to the first image;
the second photographing information at least includes: second position information of the interconnection equipment, second image information of the interconnection equipment and second shooting time information of the interconnection equipment; wherein the second image information is determined according to the second position information, the second image information including at least: the contour information corresponding to the second image;
the shooting information of the second interconnection device at least comprises: the position information corresponding to the second interconnection equipment, the image information corresponding to the second interconnection equipment and the shooting time information corresponding to the second interconnection equipment are obtained; the second interconnection device is determined according to the position information corresponding to the second interconnection device, and the image information corresponding to the second interconnection device at least includes: the outline information corresponding to the image of the second interconnection equipment;
the apparatus is further configured to:
acquiring first shooting information of the first equipment and shooting information of the second interconnection equipment;
determining a three-dimensional contour of the interconnected shot images according to the contour information, wherein the contour information is contour information corresponding to the first image, contour information corresponding to the second image and/or contour information corresponding to an image of the second interconnected device;
determining an intermediate image frame according to the first image information, the second image information and the image information of the second interconnection equipment based on the three-dimensional contour of the interconnection shooting image;
and determining the second panoramic image according to the three-dimensional outline of the interconnected shot images and the intermediate image frame.
18. An electronic device, comprising:
a memory for storing processor-executable instructions;
a processor coupled to the memory;
wherein the processor is configured to perform the multi-device interconnect photographing method as provided in any one of claims 1 to 8 or 9 to 15.
19. A non-transitory computer-readable storage medium in which instructions, when executed by a processor of a computer, enable the computer to perform the multi-device interconnect photographing method provided in any one of claims 1 to 8 or 9 to 15.
CN202110627526.2A 2021-06-04 2021-06-04 Multi-device interconnection shooting method and device, electronic device and storage medium Active CN113438462B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110627526.2A CN113438462B (en) 2021-06-04 2021-06-04 Multi-device interconnection shooting method and device, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110627526.2A CN113438462B (en) 2021-06-04 2021-06-04 Multi-device interconnection shooting method and device, electronic device and storage medium

Publications (2)

Publication Number Publication Date
CN113438462A CN113438462A (en) 2021-09-24
CN113438462B true CN113438462B (en) 2022-09-02

Family

ID=77803802

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110627526.2A Active CN113438462B (en) 2021-06-04 2021-06-04 Multi-device interconnection shooting method and device, electronic device and storage medium

Country Status (1)

Country Link
CN (1) CN113438462B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104426588A (en) * 2013-08-21 2015-03-18 北京千橡网景科技发展有限公司 Method and device for mobile terminal synergistic shooting
CN104796610A (en) * 2015-04-20 2015-07-22 广东欧珀移动通信有限公司 Mobile terminal and camera sharing method, device and system thereof
CN104994369A (en) * 2013-12-04 2015-10-21 中兴通讯股份有限公司 Image processing method, user terminal, and image processing terminal and system
CN105049727A (en) * 2015-08-13 2015-11-11 小米科技有限责任公司 Method, device and system for shooting panoramic image
CN106412432A (en) * 2016-09-30 2017-02-15 维沃移动通信有限公司 Photographing method and mobile terminal
CN107431751A (en) * 2016-02-03 2017-12-01 华为技术有限公司 Gather the methods, devices and systems of image
CN108566514A (en) * 2018-04-20 2018-09-21 Oppo广东移动通信有限公司 Image combining method and device, equipment, computer readable storage medium
CN111107221A (en) * 2019-12-18 2020-05-05 联想(北京)有限公司 Processing method and device and electronic equipment

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102222073B1 (en) * 2014-08-29 2021-03-04 삼성전자주식회사 Method and electronic device for taking a photograph

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104426588A (en) * 2013-08-21 2015-03-18 北京千橡网景科技发展有限公司 Method and device for mobile terminal synergistic shooting
CN104994369A (en) * 2013-12-04 2015-10-21 中兴通讯股份有限公司 Image processing method, user terminal, and image processing terminal and system
CN104796610A (en) * 2015-04-20 2015-07-22 广东欧珀移动通信有限公司 Mobile terminal and camera sharing method, device and system thereof
CN105049727A (en) * 2015-08-13 2015-11-11 小米科技有限责任公司 Method, device and system for shooting panoramic image
CN107431751A (en) * 2016-02-03 2017-12-01 华为技术有限公司 Gather the methods, devices and systems of image
CN106412432A (en) * 2016-09-30 2017-02-15 维沃移动通信有限公司 Photographing method and mobile terminal
CN108566514A (en) * 2018-04-20 2018-09-21 Oppo广东移动通信有限公司 Image combining method and device, equipment, computer readable storage medium
CN111107221A (en) * 2019-12-18 2020-05-05 联想(北京)有限公司 Processing method and device and electronic equipment

Also Published As

Publication number Publication date
CN113438462A (en) 2021-09-24

Similar Documents

Publication Publication Date Title
KR102194094B1 (en) Synthesis method, apparatus, program and recording medium of virtual and real objects
US9654942B2 (en) System for and method of transmitting communication information
EP3076716A1 (en) Method and apparatus for network access
US10102505B2 (en) Server-implemented method, terminal-implemented method and device for acquiring business card information
EP2953347A1 (en) Photographing control method and apparatus
US10110800B2 (en) Method and apparatus for setting image capturing parameters
EP3264774B1 (en) Live broadcasting method and device for live broadcasting
KR20170037868A (en) Method and device for shooting control
US11221634B2 (en) Unmanned aerial vehicle control method and device, unmanned aerial vehicle and remote control device
US10313537B2 (en) Method, apparatus and medium for sharing photo
US10191708B2 (en) Method, apparatrus and computer-readable medium for displaying image data
CN114009003A (en) Image acquisition method, device, equipment and storage medium
CN104219038A (en) Method and device for synchronizing data
CN103997519A (en) Method and device for transmitting image
EP3829224A1 (en) Network configuration method and apparatus, electronic device and storage medium
CN110928466A (en) Control interface display method, device, equipment and storage medium
CN105120301A (en) Video processing method and apparatus, and intelligent equipment
CN113364965A (en) Shooting method and device based on multiple cameras and electronic equipment
CN112188089A (en) Distance acquisition method and device, focal length adjustment method and device, and distance measurement assembly
EP4161054A1 (en) Anchor point information processing method, apparatus and device and storage medium
CN105577521B (en) Good friend's group technology, apparatus and system
CN110121148B (en) Interphone team method and device
CN108924529B (en) Image display control method and device
CN113438462B (en) Multi-device interconnection shooting method and device, electronic device and storage medium
CN110673732A (en) Scene sharing method, device, system, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant