WO2020057661A1 - 一种拍照方法、装置与设备 - Google Patents

一种拍照方法、装置与设备 Download PDF

Info

Publication number
WO2020057661A1
WO2020057661A1 PCT/CN2019/107131 CN2019107131W WO2020057661A1 WO 2020057661 A1 WO2020057661 A1 WO 2020057661A1 CN 2019107131 W CN2019107131 W CN 2019107131W WO 2020057661 A1 WO2020057661 A1 WO 2020057661A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
image
video stream
scene
adjustment parameter
Prior art date
Application number
PCT/CN2019/107131
Other languages
English (en)
French (fr)
Inventor
宋巍
赖昌材
王威
王提政
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2020057661A1 publication Critical patent/WO2020057661A1/zh
Priority to US17/205,816 priority Critical patent/US11218649B2/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing

Definitions

  • the present invention relates to the technical field of terminals, and in particular, to a photographing method, device, and device.
  • An embodiment of the present invention provides a photographing method. Specifically, a remote group photo method for real-time video preview can be provided.
  • the WYSIWYG group photo effect is achieved during the shooting process. Problems such as remote inability to interact can improve the user's photo experience.
  • an embodiment of the present invention provides a photographing method.
  • the method specifically includes: a first terminal obtaining a first video stream and a second video stream; wherein the first video stream corresponds to the first scene obtained by the first terminal Preview video stream, the second video stream corresponds to the preview video stream of the second scene obtained by the second terminal; the first video stream and the second video stream are presented in the display interface of the first terminal according to a preset template;
  • the template includes a first area and a second area. The first area is used to present the first video stream, and the second area is used to present the second video stream.
  • the first terminal captures the first scene to obtain the first image.
  • the resolution is higher than the resolution of the first video stream; the first terminal acquires the second image; wherein the second image is obtained by shooting the second scene by the second terminal; the resolution of the second image is higher than that of the second video stream Obtain a first picture adjustment parameter when the first terminal takes a first image; obtain a second picture adjustment parameter when the second terminal takes a second image; wherein the first picture adjustment parameter and / or The second picture adjustment parameters include at least one of a zoom ratio, a rotation angle, a translation displacement, and a flip angle; the first terminal according to the first image, the first picture adjustment parameter, the second image, the second picture adjustment parameter, and a preset template. Generate group photos.
  • an embodiment of the present invention provides a photographing device, and the device further includes:
  • An obtaining module configured to obtain a first video stream and a second video stream; wherein the first video stream corresponds to a preview video stream of a first scene obtained by a first terminal, and the second video stream corresponds to a second video stream obtained by a second terminal A preview video stream of a scene; a display module, configured to present a first video stream and a second video stream according to a preset template in a display interface of a first terminal; wherein the preset template includes a first region and a second region, and the first The area is used to present the first video stream, and the second area is used to present the second video stream; the acquisition module is used to capture the first scene to obtain a first image; the resolution of the first image is higher than the resolution of the first video stream A receiving module for obtaining a second image; wherein the second image is obtained by shooting the second scene by the second terminal; the resolution of the second image is higher than the resolution of the second video stream; the adjusting module uses Acquiring a first picture adjustment parameter when the first terminal shoots a
  • remote group photos can be implemented and high-definition group photos can be formed.
  • the attitude can be freely adjusted by both parties, and what you see is what you get; the user experience is improved.
  • the first terminal controls the display interface of the second terminal to present the first video stream and the second video stream according to a preset template; and the second terminal presents the first video
  • the way of streaming and the second video stream is the same as that of the first terminal.
  • the above device may further include a control module, and the method may be executed by the control module.
  • the first terminal photographing the first scene to obtain the first image includes: the first terminal receiving the first capture instruction, and obtaining the first image obtained by photographing the first scene.
  • An image; the first terminal acquiring the second image includes: the first terminal forwarding the first capture instruction to the second terminal, so that the second terminal captures the second scene to obtain a second image, and sends the second image to the first terminal
  • a first terminal receives a second image sent by a second terminal.
  • the method can be executed cooperatively by the acquisition module and the receiving module. This is a synchronous snapshot method that allows the initiator of the group photo to have absolute control over the group photo and facilitate operation.
  • the first terminal shooting the first scene to obtain the first image includes: the first terminal receives the first capture instruction, and shooting the first scene to obtain the first image
  • the first terminal acquires the second image.
  • the second terminal receives the second capture instruction, captures the second scene to obtain the second image, and sends the second image to the first terminal.
  • the first terminal receives the second image.
  • the method can be executed cooperatively by the acquisition module and the receiving module.
  • the second snapshot instruction can be controlled by the user of the second terminal. This is an asynchronous snapshot method, which can allow the photo participants to have free control of the photo, give full play to the subjective wishes of the participants, and have good interaction. .
  • the first image obtained by the first terminal after receiving the first capture instruction and shooting the first scene includes: the first terminal calls a photographing function, and Take a picture at the moment of the first capture instruction to obtain a first image; or the first terminal finds a buffered image of the uncoded first scene corresponding to the moment of the first capture instruction in the video capture buffer as the first image.
  • This method can be executed by the acquisition module. This is a method for obtaining high-definition images, which aims to generate high-definition images that are different from screenshots or low-resolution video frames in the prior art, so that subsequent high-definition photos can be generated.
  • the second image has the same resolution as the first image.
  • the aspect ratio of the second image to the first image is the same. This technical solution can unify the shooting parameters of each group photo terminal, which is more convenient for cropping.
  • generating, by the first terminal according to the first image, the first picture adjustment parameter, the second image, the second picture adjustment parameter, and a preset template, a group image includes: A terminal determines a first sub-image according to a first image, a first picture adjustment parameter, and a first area; a first terminal determines a second sub-image according to a second image, a second picture adjustment parameter, and a second area; the first terminal Generate a grouped image according to the first and second sub-images and a preset template.
  • This method can be executed by an image processing module.
  • video communication signaling protocols such as SIP or XMPP are used to complete the operations of calling, authentication, hanging up, and holding of two or more photo groups, and through the signaling protocol Pass real-time preview control commands and data.
  • the terminal also manages the preview picture. It is necessary to ensure that all terminals participating in the group photo are consistent in the picture displayed on each terminal when establishing a communication and taking a group photo (such as but not only Limited to screen content, relative position / size, etc.).
  • any terminal participating in the group photo can switch the front and rear cameras to obtain different perspectives; the screen content switching caused by the switching of the camera can be synchronized among the terminals participating in the group photo; each terminal participating in the group photo can be maintained The screens shown above are consistent.
  • the terminal that initiates the group photo may transmit the capture command to other group members by using the RTP extension field or signaling of the video stream.
  • the capture command includes the resolution and Aspect ratio and other information to ensure that all photo parties use the same parameters to capture.
  • the captured high-resolution photo needs to be transmitted back to the group photo initiator, and the group photo is generated locally on the initiator, optional
  • the initiator sends the photo to the photo group; or the photo group exchanges the captured high-resolution photos with each other and generates a photo group locally; or each photo group sends the captured high-resolution photo to the server,
  • the server generates a group photo and sends it back to each group party.
  • the size of the preview window of the group photo is smaller than the size of the image captured by the camera.
  • the user can adjust the preview window in three ways: "default, manual, and intelligent."
  • the system automatically selects the central area of the captured image as the preview screen; in the manual mode, the user adjusts his own preview screen (panning / rotation / zooming) through gestures or menus; in the smart mode, the system passes the interest Area recognition, face detection and other technologies automatically select preview images from camera captures.
  • the picture of each group photo is refreshed and adjusted synchronously to ensure that what you see is what you get until the user is satisfied.
  • the above-mentioned possible technical implementation can be executed by the processor to call the programs and instructions in the memory for corresponding processing, such as enabling the camera, controlling the camera to collect images, and performing certain algorithmic processing on the acquired images to generate the final high-definition photo. image.
  • an embodiment of the present invention provides a terminal device including a memory, a processor, a bus, a camera, and a transceiver; the memory, the camera, the transceiver, and the processor are connected through a bus; the camera is configured to collect data under the control of the processor.
  • the terminal device further includes an antenna system, and the antenna system sends and receives wireless communication signals to realize wireless communication with the mobile communication network under the control of the processor;
  • the mobile communication network includes one of the following Or more: GSM network, CDMA network, 3G network, 4G network, 5G network, FDMA, TDMA, PDC, TACS, AMPS, WCDMA, TDSCDMA, WIFI and LTE networks.
  • the above methods, devices, and devices can be applied to scenes where shooting software provided by the terminal is used for shooting, or scenes where a third-party camera software is run on the terminal for shooting.
  • the same software can integrate all the co-shooting functions of each shooting party.
  • FIG. 1 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
  • FIG. 2 is a system architecture diagram of a remote group photo according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a client component of a terminal according to an embodiment of the present invention.
  • FIG. 4 is a flowchart of an example method of a remote group photo in an embodiment of the present invention.
  • FIG. 5 is a signal flow diagram between terminals in a remote group photo according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a display interface of each terminal in a remote group photo according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of roles distribution of participants in a remote group photo according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of a user adjusting a preview screen in a remote group photo according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of a group photo effect in a remote group photo smart mode according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a snap command according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of an example of a remote group photo according to an embodiment of the present invention.
  • FIG. 12 is a flowchart of a method for remote photo taking according to an embodiment of the present invention.
  • FIG. 13 is a schematic diagram of a device for remote photo taking according to an embodiment of the present invention.
  • the terminal may be a device that provides users with photographing and / or data connectivity, a handheld device with a wireless connection function, or other processing devices connected to a wireless modem, such as a digital camera, a SLR camera, Cameras, mobile phones (or “cellular” phones), smartphones, which can be portable, compact, handheld, wearable devices (such as smart watches, etc.), tablet computers, personal computers (PC, Personal Computer), PDAs (Personal Digital Assistant), vehicle computer, drone, aerial camera, etc.
  • a wireless modem such as a digital camera, a SLR camera, Cameras, mobile phones (or “cellular" phones), smartphones, which can be portable, compact, handheld, wearable devices (such as smart watches, etc.), tablet computers, personal computers (PC, Personal Computer), PDAs (Personal Digital Assistant), vehicle computer, drone, aerial camera, etc.
  • FIG. 1 shows a schematic diagram of an optional hardware structure of the terminal 100.
  • the terminal 100 may include radio frequency unit 110, memory 120, input unit 130, display unit 140, camera 150, audio circuit 160, speaker 161, microphone 162, processor 170, external interface 180, power supply 190, and other components. .
  • FIG. 1 is only an example of a portable multifunctional device, and does not constitute a limitation on the portable multifunctional device. It may include more or fewer components than shown in the figure, or some components may be combined or different. Of parts.
  • the camera 150 is used to capture an image or a video, and can be triggered to be turned on by an application program instruction to implement a photo or video function.
  • the camera may include components such as an imaging lens, a filter, and an image sensor.
  • the light emitted or reflected by the object enters the imaging lens, passes through the filter, and finally converges on the image sensor.
  • the imaging lens is mainly used for condensing and imaging the light emitted or reflected by all objects in the perspective of the photo (also referred to as the scene to be shot, the subject to be shot, the target scene, or the target object, which can also be understood as the scene image that the user expects to take).
  • the filter is mainly used to filter out excess light waves (such as light waves other than visible light, such as infrared); the image sensor is mainly used to photoelectrically convert the received light signal into electrical signals, and Input to the processor 170 for subsequent processing.
  • the cameras may be located at the front of the terminal device or at the back of the terminal device. The number and specific arrangement of the cameras may be flexibly determined according to the requirements of the designer or manufacturer ’s strategy, which is not limited in this application.
  • the input unit 130 may be configured to receive inputted numeric or character information, and generate key signal inputs related to user settings and function control of the portable multifunction device.
  • the input unit 130 may include a touch screen 131 and other input devices 132.
  • the touch screen 131 can collect user's touch operations on or near the user (such as the operation of the user using fingers, joints, stylus, etc. on the touch screen or near the touch screen), and drive corresponding operations according to a preset program. Connection device.
  • the touch screen can detect a user's touch action on the touch screen, convert the touch action into a touch signal and send it to the processor 170, and can receive and execute a command sent by the processor 170; the touch signal includes at least a touch Point coordinate information.
  • the touch screen 131 may provide an input interface and an output interface between the terminal 100 and a user.
  • various types such as resistive, capacitive, infrared, and surface acoustic wave can be used to implement the touch screen.
  • the input unit 130 may include other input devices.
  • the other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control button 132, a switch button 133, etc.), a trackball, a mouse, a joystick, and the like.
  • the display unit 140 may be configured to display information input by the user or information provided to the user and various menus of the terminal 100.
  • the display unit is further configured to display an image obtained by the device using the camera 150, and may include a preview image in some shooting modes, an initial image taken, and a target image processed by a certain algorithm after shooting.
  • the touch screen 131 may cover the display panel 141.
  • the touch screen 131 detects a touch operation on or near the touch screen 131, the touch screen 131 is transmitted to the processor 170 to determine the type of the touch event, and the processor 170 then displays the touch event on the display panel according to the type of the touch event.
  • Corresponding visual output is provided on the 141.
  • the touch screen and the display unit may be integrated into one component to implement the input, output, and display functions of the terminal 100.
  • the embodiment of the present invention uses the touch display screen to represent the function set of the touch screen and the display unit; In some embodiments, the touch screen and the display unit can also be used as two separate components.
  • the memory 120 may be used to store instructions and data.
  • the memory 120 may mainly include a storage instruction area and a storage data area, and the storage data area may store data such as media files and text.
  • the storage instruction area may store an operating system, an application, and at least one functional place.
  • Software units such as required instructions, or a subset or extension of them. It may also include non-volatile random access memory; the processor 170 is provided with management hardware, software, and data resources in the computing processing device, supports control software and applications, is also used for storage of multimedia files, and storage for running programs and applications .
  • the processor 170 is the control center of the terminal 100, and uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing instructions stored in the memory 120 and calling data stored in the memory 120, various operations of the terminal 100 are performed. Functions and process data for overall monitoring of the phone.
  • the processor 170 may include one or more processing units; preferably, the processor 170 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and an application program, etc.
  • the modem processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 170.
  • the processor and the memory may be implemented on a single chip.
  • the processor 170 may also be used to generate corresponding operation control signals, send to the corresponding components of the computing processing device, read and process the data in the software, especially read and process the data and programs in the memory 120, so that the Each function module executes the corresponding function, thereby controlling the corresponding component to act according to the requirements of the instruction.
  • the radio frequency unit 110 may be used to receive and transmit information or to receive and send signals during a call.
  • the downlink information of the base station is received and processed by the processor 170.
  • the design uplink data is transmitted to the base station.
  • the RF circuit includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like.
  • the radio frequency unit 110 can also communicate with network devices and other devices through wireless communication.
  • the wireless communication can use any communication standard or protocol, including but not limited to Global System (GSM), General Packet Radio Service (GPRS), and Code Division Multiple Access (Code) Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), etc.
  • GSM Global System
  • GPRS General Packet Radio Service
  • CDMA Code Division Multiple Access
  • WCDMA Wideband Code Division Multiple Access
  • LTE Long Term Evolution
  • E-mail Short Messaging Service
  • the audio circuit 160, the speaker 161, and the microphone 162 may provide an audio interface between the user and the terminal 100.
  • the audio circuit 160 can transmit the received electrical data converted electrical signals to the speaker 161, and the speaker 161 converts them into sound signals for output.
  • the microphone 162 is used to collect sound signals and can also convert the collected sound signals. It is an electric signal, which is converted into audio data after being received by the audio circuit 160, and then processed by the audio data output processor 170, and then sent to, for example, another terminal via the radio frequency unit 110, or the audio data is output to the memory 120 for further processing.
  • the audio circuit may also include a headphone jack 163 for providing a connection interface between the audio circuit and the headphones.
  • the terminal 100 further includes a power source 190 (such as a battery) for supplying power to various components.
  • a power source 190 such as a battery
  • the power source can be logically connected to the processor 170 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system.
  • the terminal 100 also includes an external interface 180.
  • the external interface can be a standard Micro USB interface or a multi-pin connector. It can be used to connect the terminal 100 to communicate with other devices, and it can also be used to connect a charger to the terminal 100. Charging.
  • the terminal 100 may further include a flash, a wireless fidelity (WiFi) module, a Bluetooth module, sensors with different functions, and the like, and details are not described herein again. Some or all of the methods described below can be applied to the terminal shown in FIG. 1.
  • WiFi wireless fidelity
  • Bluetooth Bluetooth
  • the application scenario of the present invention is a user's request for social, emotional, entertainment, and other reasons.
  • a group photo of two or more people is an application scenario, but it cannot be achieved if the group photo does not appear at the same place or at the same time.
  • the present invention proposes to realize remote interactive group photo creative photo taking among smart terminal (mobile phone / tablet) users and home camera (set-top box / IPC / smart speaker) users. When the festival is approaching, they cannot be reunited. Couples cannot meet for thousands of miles, and they can meet the demands of entertainment and socializing through remote interactive group photos.
  • the present invention can be applied to a remote collaborative photo scene.
  • the system architecture is shown in FIG. 2.
  • the system consists of at least two intelligent terminals (such as a first terminal and a second terminal).
  • the specific implementation may be a mobile phone, a camera, a PAD, a computer, Wearable devices, such as photographic and communicable devices) and servers (such as video communication networking).
  • the user initiates a group photo request to a friend through a smart terminal.
  • the first terminal and the second terminal establish communication through the server, the first terminal and the second terminal can exchange data, such as image files, instructions, etc., through the server, which can achieve real-time Image or video preview, display adjustment, camera control, photo backhaul, group photo generation, etc. Improve the usability and ease of remote group photo.
  • the floor product form of the present invention may be a smart terminal (mobile phone / tablet / portable computer) or a home camera (smart camera / visual set-top box / smart speaker). Specifically, it may be an application or software therein.
  • the present invention is deployed on a terminal device
  • the terminal may contain some necessary client components, as shown in Figure 3, on the hardware platform (processor / memory / RF unit / touch screen / camera) and software operating system (task management / hardware driver). With support, you can run an application for remote group photo.
  • This program can include the following modules: group photo user authentication and management 101, preview template management 102, snapshot control 103, file back 104, group photo generation 105, video communication engine 106 (collection / Encoding / transmitting / displaying), preview screen editing 107 and so on. The functions of each module are described below.
  • Group photo user authentication and management 101 SIP or XMPP and other video communication signaling protocols complete the call, authentication, hang up, hold and other operations of the group photo party or multiple parties, and transmit real-time preview control commands and data through the signaling protocol.
  • SIP or XMPP and other video communication signaling protocols complete the call, authentication, hang up, hold and other operations of the group photo party or multiple parties, and transmit real-time preview control commands and data through the signaling protocol.
  • Preview template management 102 Allows the user to select the preview template and theme.
  • the template refers to the split mode of the group picture (such as but not limited to equal division, picture-in-picture, diagonal lines, puzzles, etc .. It should be understood that the puzzle contains different numbers of sub-pictures. And different arrangements of sub-pictures), the theme refers to the template and filter style of the picture (such as, but not limited to, birthday style, holiday style, user-designed themes, online themes, etc.).
  • This module also manages the preview images. It is necessary to ensure that all the terminals participating in the group photo are consistent when the communication is established for group photos (such as but not limited to the screen content, relative position / size, etc.).
  • any terminal participating in the group photo can switch the front and rear cameras to obtain different shooting angles; the preview template management 102 can synchronize the switching of the screen content caused by the switching of the camera in each terminal participating in the group photo; The picture displayed on each terminal during the photo session is the same.
  • Snapshot control 103 Receive a user's snapshot operation (including but not limited to buttons / voice control / gestures, etc.), and trigger the capture of high-resolution photos.
  • the terminal that initiates the group photo can transmit the capture command to other group members by means of RTP extension fields or signaling of the video stream.
  • the capture command contains information such as resolution and aspect ratio to ensure each group photo. Fang uses the same parameters to capture. There are two ways to take photos synchronously and asynchronously. Synchronous capture means that when a unified capture command is issued to all group photos at the same time, no user response is required. All group photos are synchronized to take high-resolution photos of their respective scenes, which is usually done by the master.
  • Asynchronous capture refers to the release of triggering instructions for capture. For all photo groups, and each photo group needs to respond to confirmation, the photo group that has confirmed the capture can complete the capture of its own picture. When a photo group completes the capture, the corresponding preview screen of the user is immediately frozen, other The user can continue to adjust the attitude until all the photo parties respond to the snapshot, all the preview pictures are frozen and the photo is complete.
  • the snapshot here may be an uncoded high-definition image captured when the terminal captures a video stream; it may also be a high-definition image captured by directly calling the camera. The resolution of these captured images is higher than that of the video stream transmitted between the terminals; these captured high-definition images are the "original materials" that generate the final photo, so the high definition of the photo is guaranteed.
  • File return 104 It should be understood that during real-time video preview, the image transmission needs to consider traffic bandwidth and processing power consumption, so the picture clarity of the preview image will be lower than that when the user calls the camera alone to take a picture.
  • the typical scene of real-time video is high-definition 1280x720, 15 frames @ 768kbps, and the resolution of mobile phone camera can reach 3264x1840.
  • the present invention needs to return the captured high-definition photos to the group initiator, and generate a group photo locally on the initiator, optionally, the initiator then sends it to the group members; or Each group exchanges the captured high-resolution photos with each other and generates a group photo locally at each group; or each group sends the captured high-resolution photos to the server, and the server generates a group photo and sends it back to each group.
  • ultra-high-definition real-time preview streams can also be used, and video preview data can be used to generate group photos without returning photos.
  • This module is responsible for receiving, sending and accessing the captured photos.
  • Group photo generation 105 Obtain the returned photos of the file back 104, and crop and stitch according to the saved preview screen editing parameters (rotation / zoom, etc.) provided by the preview screen editor 107 to obtain ultra-high-definition group photos consistent with the preview of the group photo parties .
  • Video communication engine 106 This module is mainly responsible for real-time processing of the camera's collection, encoding, transmission, decoding, and display of the preview screen of the scene, and is the basic component of video communication.
  • the video communication engine 106 receives the IP address and port number information of the photo group negotiated by the photo group user authentication and management 101, and is responsible for capturing control data of the capture control 103, file back 104, and capture control 105, image file, preview video stream The data is transmitted to each group through the corresponding IP address and port number.
  • the preview screen editing 107 the user adjusts the screen through the preview screen editing 107 preview screen editing module, and the video communication engine 106 is also used for screen adjustment processing and display rendering.
  • different intelligent terminals can also implement data transmission between the terminals through the video communication engine 106.
  • Preview screen editing 107 Because the size of the preview window of the group photo is smaller than the size of the image captured by the camera, the user can adjust the preview window in three ways: "default, manual, and intelligent." In the default mode, the system automatically selects the central area of the captured image as the preview screen; in the manual mode, the user adjusts his own preview screen (panning / rotation / zooming) through gestures or menus; in the smart mode, the system passes the interest Area recognition, face detection and other technologies automatically select preview images from camera captures. In these three modes, the picture of each group photo is refreshed and adjusted synchronously to ensure that what you see is what you get until the user is satisfied.
  • all terminals participating in group photos may be referred to as group participants, and the first party that initiates group photos may be referred to as the group initiator (may be referred to as the initiator), and any party responding is referred to as The photo responder (may be referred to as the responder or the photo taker for short).
  • the photo responder may be one or more.
  • the embodiment of the present invention does not limit the number of photo participants.
  • an example of an optional off-site photo is as follows:
  • Step 201 The user selects a friend to initiate a group photo request; for example, the first terminal (initiator) initiates a group photo request to a second terminal (responder).
  • Step 202 The group user authentication and management 101 initiates a negotiation to detect the IP address and port number.
  • the group user authentication and management 101 of the first terminal and the group user authentication and management 101 of the second terminal establish a connection and handshake.
  • the group photo user authentication and management 101 of the first terminal initiates a call to the group photo user authentication and management 101 of the second terminal, covering firewall traversal, and finally obtaining the communication IP address and port number of the second terminal.
  • Step 203 If the second terminal accepts the group photo request, proceed to step 204; if the second terminal does not accept the group photo request, the group photo creation fails, and the process ends.
  • Step 204 The video communication engine 106 establishes a multi-party real-time preview video stream according to the communication address provided by the group user authentication and management 101; for example, but not limited to establishing a video call.
  • the shooting functions of the first terminal and the second terminal are both turned on, and real-time image acquisition is started.
  • the preview video stream is transmitted to the server and then forwarded to other terminals.
  • the first terminal can encode the scene preview image in the camera of the first terminal into a first video stream for transmission, and can further forward it to the second terminal through the server; similarly, the second terminal can preview the scene in the camera of the second terminal.
  • the image is encoded as a second video stream for transmission, and can further be forwarded to the first terminal by the server.
  • the first terminal collects scene images in the camera of the first terminal, collects video frame buffer, and performs video downsampling, pre-processing, and video encoding.
  • the video message is sent on the network, forwarded by the server, and the second terminal receives the video message on the network, and then performs video decoding, post-processing, video upsampling and other operations, and finally the decoded Smooth video; in this way, the second terminal can acquire and display the video stream collected by the first terminal.
  • the subsequent capturing action (such as step 207) occurs before capturing the video frame buffer to ensure that the captured image is a high-definition image or a lossless image.
  • Step 205 The preview template management 102 allows the user to select a template and scene / theme, and the preview screen editor 107 is responsible for rendering and display.
  • the first terminal user may select a favorite theme and display mode of the screen picture through the preview template management 102, for example, selecting a template of a bipartite map (left half area + right half area) and a common frame theme.
  • the preview screen editing 107 in the first terminal displays the real-time preview video stream (part of the first video stream) of the shooting scene (first scene) of the first terminal in the left half area by default, and displays it in the right half area.
  • the shooting scene where the first terminal is actually displayed in the left half region is smaller than the shooting scene where the first terminal is actually framing
  • the shooting scene where the second terminal is actually displayed in the right half is smaller than the shooting scene where the second terminal is actually framing.
  • the preview template management 102 passed by the first terminal performs communication negotiation and data transmission with the preview template management 102 of the second terminal, and sends the template and scene / theme used by the first terminal to the second terminal, so that the first terminal and the second terminal
  • the displayed picture is the same.
  • An example is shown in Figure 6.
  • the selection of the template or theme may also be determined by the second terminal, so that the principle of making the first terminal and the second terminal display the same preview screen is the same, which is not repeated here.
  • the video call often displays the screen layout according to the calling and called parties, and mainly displays the other party's screen.
  • the screens seen by the two parties are inconsistent, so they cannot be directly used for remote collaborative photo shooting.
  • the second terminal needs to render and display the group preview picture according to the same rules.
  • the first terminal can be used as a reference, and the preview layout can be performed from left to right and top to bottom in the order of adding photos. An example is shown in FIG. Individual users are added on the right, and the third user is arranged from top to bottom when the third user joins.
  • the initiator of the group photo can adjust the position of each user, such as placing the most important person on the most A conspicuous location or the largest area.
  • the first terminal has the right to adjust the display layout of the second terminal synchronously, and the preview images of the first terminal and the second terminal synchronize the adjustment results in real time.
  • the shooting scenes of the embodiments of the present invention are not limited to people, but also include any other photographable scenes.
  • first terminal and the second terminal can also switch the front and rear cameras and shoot with different perspectives.
  • the use of a front camera or a rear camera by each terminal is freely determined by each end user.
  • any screen change is displayed synchronously in the first terminal and the second terminal.
  • the preview template management 102 passed by the first terminal communicates and negotiates with the preview template management 102 of the second terminal and transmits data.
  • the second terminal uses a unified template and specifies the usage strategy of each area of the template. For example, the left half area is used to display the first scene preview video stream of the first terminal, and the right half area is used to display the second terminal's first Two scene preview video streams; in addition, the preview screen can be divided into several areas according to the number of photo parties, the order of joining, and / or the screen size of the user's mobile phone.
  • first scene preview video stream displayed in the first terminal is acquired by the first terminal, and the second scene preview video stream displayed in the first terminal is forwarded by the second terminal to the first terminal through the server;
  • the displayed second scene preview video stream is obtained by the second terminal, and the first scene preview video stream displayed in the second terminal is forwarded by the first terminal to the second terminal through the server.
  • Step 206 Edit the preview screen 107.
  • the user adjusts his screen (pan / zoom / rotate) until satisfied, and records the screen adjustment parameters, and each group party adjusts the preview screen synchronously.
  • the user can adjust the posture, screen size, and presentation mode in real time according to the pictures they see, until the users determine each other's satisfactory pictures and take snapshots (the The action is completed by step 207).
  • the first terminal will record all operations of the first end user in this step, that is, the first picture adjustment parameters; optionally, the second terminal may also record the second end user in this step All operations in the second picture adjustment parameters. These operations or picture adjustment parameters can be recorded and transmitted in text form.
  • the differences in the height, arm length, and field of view of the mobile phone lens of the photo parties often lead to the mismatch in size or position of the preview images of the two parties, which does not show good results.
  • Position and fit for example, but not limited to, people previewed in the first terminal, people previewed in the second terminal are much smaller, or faces previewed in the first terminal are much larger than faces previewed in the second terminal, or The person previewed in one terminal is severely misaligned with the person previewed in the second terminal. Therefore, it is necessary to manually or automatically adjust the corresponding picture in the respective terminal.
  • the embodiment of the present invention proposes three methods of "default, manual, and intelligent" to adjust the picture of the preview window.
  • the system automatically selects the central area of the captured image as the preview screen; in the manual mode, the user adjusts the preview screen of the terminal (translation / rotation / zoom) through gestures or menus; in the intelligent mode, the system passes the interest Area recognition, face detection and other technologies automatically select the preview image area from the camera capture frame.
  • the system passes the interest Area recognition, face detection and other technologies automatically select the preview image area from the camera capture frame. The following description focuses on the manual mode and the intelligent mode.
  • the user can adjust his own preview screen by gestures, including panning, zooming, rotating, flipping, etc .; record the pixel value (X, Y) of the panning gesture, and the zoom ratio R, rotation angle A, flip angle B, and save relevant parameters locally for subsequent photo generation.
  • the video communication engine sends the adjusted preview picture to each group party through the video stream, keeping the group party's preview picture consistent.
  • the area of interest such as the face and the background is displayed in the display window.
  • the face area is automatically matched with the preview window by identifying the face area and the proportion of the face area.
  • the user can select the portrait segmentation target by clicking to drag the other person's portrait to the background of his or her own side, and realize the off-site photo with the background. The effect is shown in FIG. 9.
  • the first picture adjustment parameter can be understood as at least one of the corresponding zoom ratio, rotation angle, translation displacement, or flip angle when the first terminal captures the image;
  • the second picture adjustment parameter can be understood as the second terminal capture At least one of a zoom ratio, a rotation angle, a translation displacement, or a flip angle corresponding to the image.
  • the first picture adjustment parameter can be understood as the sum of all the picture adjustment parameters in the process from the start of the first terminal to the capture, that is, the change of at least one of the zoom ratio, rotation angle, translation displacement, or flip angle in the process.
  • the second picture adjustment parameter can be understood as the sum of all the picture adjustment parameters in the process of the second terminal from participating in the photo until the capture, that is, at least one of the zoom ratio, rotation angle, translation displacement, or flip angle in the process The amount of change.
  • the picture zoom ratio is 2x
  • the rotation angle is 30 °
  • the translation displacement is (128,128)
  • the flip angle is 180 °.
  • Step 207 The capture control 103 captures a high-resolution photo through synchronous or asynchronous capture.
  • the capture instruction / photographing instruction can be triggered through the capture control 103, and the photographing instruction will be transmitted to the capture control 103 of the second terminal in real time, for example, in During the user's attitude adjustment process, when the first terminal triggers the camera, the first terminal will shoot the first scene to obtain the first image, and synchronously, the second terminal will shoot the second scene to obtain the second image to achieve synchronous capture;
  • the first image and the second image have not been compression-encoded, so the resolution is higher than the images in the first video stream and the second video stream.
  • the shooting instruction is controlled by the capture control 103 of the first terminal and the second terminal, that is, the user of the first terminal can only control whether the first terminal takes a picture, and the user of the second terminal can only control the second Whether the terminal takes a picture and realizes asynchronous capture; for example, during the user's adjustment of the posture, when the first terminal triggers a picture first, the first terminal will shoot the first scene to obtain a first image, and the first terminal and the second terminal display The first scene area in the interface will freeze; and because the second terminal has not yet triggered the camera, the second scene area in the display interface of the first terminal and the second terminal is still a real-time preview video stream of the second scene until the second When the terminal triggers photographing, the second terminal captures the second scene to obtain a second image, and the second scene area in the display interface of the first terminal and the second terminal is also frozen. At this time, the first terminal and the second terminal The picture displayed on the display interface is the picture of the group photo, which can also be called the
  • a synchronous snapping method may be that when the photo party (initiator) issues a synchronous snap command through buttons / voice control / gesture, etc., after each photo party receives the snap command, each terminal synchronizes Snap shots to get what you see is what you get.
  • the specific process is as follows:
  • the user issues synchronous capture commands through buttons / voice control / gestures.
  • the commands can be carried in the form of an RTP extension header of the video stream.
  • the repeat transmission method is used, and the number of repeats is marked. Until the photo-shooting party successfully returns an ACK message; the participating photo-shooting party immediately executes the snap-shot and receives high-resolution photos as required by the command. If the snap-up command is a repeated command, it is ignored.
  • Each group photo can only take snapshots of their own previews.
  • the group photo send buttons, voice control, gestures, etc.
  • the group that initiated the command immediately captures high-resolution photos.
  • the group that initiated the order immediately sends asynchronous capture notifications to other group members, and can send the time stamp TS of the captured high-resolution photos to other group members through the video communication engine; other group members receive the asynchronous capture notification and time stamp. , Freeze the picture corresponding to the group photo in the display interface of the local terminal, until all the pictures of the group photo participants are snapped and frozen to complete the group photo.
  • a specific snapshot command structure can be referred to as shown in FIG. 10.
  • the snap command can include user ID, resolution ID, command number, and command repetition times. Optionally, it can also include asynchronous snap frame timestamps.
  • the user ID is used for the corresponding IP address and port number when the video communication engine establishes a connection and negotiates. .
  • the resolution identifier is used to unify the resolution of each terminal when capturing high-definition images. For example, a value of 0 in the field indicates 4k, a value of 1 in the field indicates 1080p, and a value of 2 in the field indicates 720P.
  • the command number is used to indicate the type of snapshot.
  • Asynchronous snapshot frame time stamp is used to save the time stamp for asynchronous snapshot capture to obtain high-resolution photos. It is used for each group to freeze the preview picture corresponding to the high-definition photos, and to visually and intuitively feedback the user's captured image.
  • the first terminal and the second terminal can set the field of the capture command to capture images with the same resolution or screen aspect ratio or shooting scene or other shooting parameters. , Making the quality of the final composite photo more harmonious and unified.
  • Step 208 The file return 104 returns the captured HD photos and corresponding operations to the group photo initiator.
  • the file return 104 of the second terminal returns the captured second image to the first terminal.
  • step 208 may also be the first terminal and the second terminal transmitting the first image and the second image to each other.
  • step 208 may also be that the file return 104 of the first terminal returns the captured first image to the second terminal.
  • the first terminal may also forward the first picture adjustment parameter to the second terminal
  • the second terminal may also forward the second picture adjustment parameter to the first terminal.
  • the captured images of each group are stored in the terminal file system of each group by non-destructive encoding.
  • the file return module of the group participant determines the IP address and port number through negotiation.
  • the high-definition photos are transmitted and summarized to the group photo initiator for group photo generation.
  • Step 209 Group photo generation 105 edits the adjustment parameters recorded in 107 according to the preview image, crops and stitches to generate a group photo, and produces a WYSIWYG effect.
  • the group photo generation 105 of the first terminal obtains the first sub-image according to the first screen adjustment parameters and the first image recorded by the preview screen editing 107, so that the first image actually taken by the first terminal becomes the first sub-image after complex adjustment by the user.
  • the first sub-image contains the part of the first scene in the final group picture; similarly, the group photo generation of the first terminal 105 edits the second picture adjustment parameters recorded in the second terminal according to the preview picture editing 107 (can be returned at the second terminal When transmitting the second image, forward it to the first terminal together) and the second image to obtain the second sub-image, so that the second image actually taken by the second terminal becomes the second sub-image and the second sub-image after the user has undergone complex adjustments.
  • the high-resolution photo is the same as the preview photo displayed on the terminal when the user triggers the photo.
  • the high-resolution photo image is replaced by the original preview photo image on the display screen of the first terminal and presented to the user.
  • the user of the first terminal may send a high-resolution photo to the user of the second terminal or other users.
  • a photo generation process can be as follows:
  • the group photo initiator obtains the high-resolution photos captured by each group photo and the corresponding edited preview picture editing parameters (that is, picture adjustment parameters); the group photo is decoded into YUV data, and the group photo corresponds to the adjustment parameters one by one; Edit and adjust the HD photos of each group according to the adjustment parameters (at least one of the display window size, position, zoom ratio, rotation angle, pan pixel, or flip angle); stitch and encode the edited group photos into JPEG Format the photo, and present the photo result on the display interface of the terminal of the photo initiator.
  • the group photo is decoded into YUV data, and the group photo corresponds to the adjustment parameters one by one
  • Edit and adjust the HD photos of each group according to the adjustment parameters at least one of the display window size, position, zoom ratio, rotation angle, pan pixel, or flip angle
  • stitch and encode the edited group photos into JPEG Format the photo and present the photo result on the display interface of the terminal of the photo initiator.
  • FIG. 11 An example can be seen in FIG. 11. Assume that the group photo initiator 1 receives the images returned by group photo participant 2 and group photo participant 3 to decode and obtain a high-definition image.
  • the content of the high-definition image from group photo participant 2 includes D1, E1, and F1.
  • the content of the high-definition image of group photo participant 3 includes G1, H1 and I1. Since the high-definition image captured by the group photo initiator is stored locally, there is no need to transmit it back.
  • the content of the high-definition image of group photo initiator 1 includes A1, B1, and C1.
  • D1, E1, and F1 correspond to D2, E2, and F2;
  • G1, H1, I1 correspondingly become G2, H2, I2;
  • group sponsor 1 such as rotation angle, zooming factor, or translational displacement, etc.
  • D2, H2, and C2 local areas are cut out.
  • D2, H2, and C2 and the template theme the high-resolution photos are stitched together and encoded into different formats Images, such as JPEG.
  • the first terminal and the second terminal are both a photo participant, the first terminal is a photo initiator, and the second terminal is a photo responder as an example, an optional embodiment of the present invention is developed.
  • An embodiment of the present invention provides a photographing method. The method is applied to a photographing terminal. The method includes the following steps:
  • Step 31 The first terminal obtains a first video stream and a second video stream; wherein the first video stream corresponds to a preview video stream of the first scene obtained by the first terminal, and the second video stream corresponds to the first video stream obtained by the second terminal.
  • Preview video stream for two scenes That is, the first video stream is a preview video stream generated locally by the first terminal after the group photo is turned on, and the second video stream is a preview video stream generated and sent by the second terminal after participating in the group photo.
  • the second terminal can also acquire the first video stream and the second video stream at the same time.
  • step 31 For specific implementation of step 31, reference may be made to part or all of the description of step 204.
  • Step 32 Presenting the first video stream and the second video stream according to a preset template in the display interface of the first terminal; wherein the preset template includes a first region and a second region, and the first region is used to present the first video stream. , The second area is used to present a second video stream;
  • the first region and the second region may display part or all of the content of the first video stream and the second video stream; specifically, the first region The displayed content may be less than the content of the first scene displayed completely by the first terminal; the displayed content of the second area may be less than the content of the second scene displayed completely by the second terminal.
  • the first terminal can negotiate and communicate with the second terminal, adopt the same template, and uniformly layout the first video stream and the second video stream, so that the preview screen content displayed on the display interface of the first terminal and the second terminal is completely Consistent, that is, the content of the photo area is consistent.
  • the consistency of the preview picture can be maintained until the photo is completed.
  • step 32 For specific implementation of step 32, reference may be made to part or all of step 205.
  • Step 33 The first terminal captures the first scene to obtain a first image; the resolution of the first image is higher than the resolution of the first video stream;
  • Step 34 The first terminal acquires a second image; wherein the second image is obtained by shooting the second scene by the second terminal; the resolution of the second image is higher than that of the second video stream;
  • step 33 and step 34 For specific implementation of step 33 and step 34, reference may be made to part or all of step 207 and step 208.
  • Step 35 Obtain a first picture adjustment parameter when the first terminal takes a first image; obtain a second picture adjustment parameter when the second terminal takes a second image; wherein the first picture adjustment parameter and the second picture adjustment parameter include scaling At least one of a scale, a rotation angle, a translation displacement, or a flip angle;
  • the user when previewing the shooting scene, the user can adjust the scene, such as zooming, panning, rotating, and flipping. Of course, it can also include any adjustment technology in PS technology to achieve the desired effect. All the operation effects of the user before adjusting the snap shot are recorded by the terminal in the embodiment of the present invention.
  • the first terminal records the first picture adjustment parameter
  • the second terminal can record the second picture adjustment parameter and transmit it to the first terminal.
  • the first terminal and the second terminal can communicate, and the first picture adjustment parameter and the second picture adjustment parameter can be sent in two directions or unidirectionally in the form of text.
  • step 35 For specific implementation of step 35, reference may be made to part or all of step 206.
  • Step 36 The first terminal generates a grouped image according to the first image, the first picture adjustment parameter, the second image, the second picture adjustment parameter, and a preset template.
  • the first terminal determines a first sub-image according to a first image, a first picture adjustment parameter, and a first region. Specifically, the first image actually captured by the first terminal is changed into an image state when the user captures the image according to the first screen adjustment parameter, and further cropped according to the first region to obtain the first region in the display interface of the terminal when the image is captured. Submap.
  • the first terminal determines a second sub-image according to a second image, a second picture adjustment parameter, and the second region. Specifically, the second image actually captured by the second terminal is changed into an image state when the user captures the image according to the second screen adjustment parameter, and further cropped according to the second region to obtain the second region in the display interface of the terminal when the image is captured.
  • the first terminal generates a grouped image according to the first sub image and the second sub image and the preset template. Specifically, the first terminal stitches the sub-pictures of the first region and the sub-pictures of the second region into a template, generates a final photo, and generates a picture format.
  • step 36 reference may be made to part or all of step 209.
  • the invention proposes a group photo solution based on remote collaboration (interaction).
  • the group photo solution provided by the embodiment of the present invention is close to the real scene, and a management method for real-time preview templates is proposed, so that the preview pictures of the group photo participants can be consistent and simulate the local Preview effect;
  • a preview screen editing method and synchronization method are proposed, and a synchronous snapshot method and asynchronous snapshot method are also proposed, which improves the interactivity and fun of the photo parties;
  • the way to capture high-definition images, and Makes the image quality close to a single local group photo much higher than the quality of video screenshots; in particular, the invention proposes a method for editing preview screens and corresponding photo generation, which needs to record the picture adjustment parameters when the user captures the image, and edit related parameters.
  • an embodiment of the present invention provides a photographing device 40.
  • the device 40 can be applied to various photographing devices. As shown in FIG. 13, the device 40 includes an obtaining module 41, a display module 42, The acquisition module 43, the receiving module 44, the adjustment module 45, and the image processing module 46.
  • the obtaining module 41 is configured to obtain a first video stream and a second video stream.
  • the first video stream corresponds to a preview video stream of a first scene acquired by a first terminal
  • the second video stream corresponds to a first video stream obtained by a second terminal.
  • the obtaining module 41 may be implemented by a processor invoking a corresponding program instruction to obtain local data and network transmission data.
  • the display module 42 is configured to present the first video stream and the second video stream according to a preset template in a display interface of the first terminal; wherein the preset template includes a first region and a second region, and the first region is used to present the first region and the second region. A video stream, and the second area is used to present the second video stream.
  • the display module 42 may be implemented by the processor calling program instructions in the memory to lay out display data.
  • An acquisition module 43 is configured to capture a first scene to obtain a first image; a resolution of the first image is higher than a resolution of the first video stream.
  • the acquisition module 43 may be implemented by a processor calling a sensor and shooting by a camera, and storing the acquired images in a memory.
  • the receiving module 44 is configured to acquire a second image.
  • the second image is obtained by shooting the second scene by the second terminal.
  • the resolution of the second image is higher than the resolution of the second video stream.
  • the receiving module 44 may be implemented by a processor invoking a corresponding program instruction to obtain network transmission data.
  • the adjustment module 45 is configured to obtain a first picture adjustment parameter when the first terminal shoots the first image; it is also used to obtain a second picture adjustment parameter when the second terminal shoots the second image; wherein the first picture adjustment parameter and the first picture adjustment parameter
  • the two picture adjustment parameters include at least one of a zoom ratio, a rotation angle, a translation displacement, or a flip angle.
  • the adjustment module 45 may be implemented by a processor invoking a corresponding program instruction to obtain local data and network transmission data.
  • the image processing module 46 is configured to generate a grouped image according to the first image, the first picture adjustment parameter, the second image, the second picture adjustment parameter, and a preset template.
  • the image processing module 46 may call data and algorithms in a local memory or a cloud server by a processor, perform corresponding calculations, and output a picture of a target scene expected by an end user.
  • the device may further include a control module 47 for controlling a display interface of the second terminal to present the first video stream and the second video stream according to the preset template; and the second terminal presents the first video stream And the second video stream are the same as the first terminal.
  • the video streams in the two terminals are displayed in real time before the snap photo is completed. In order to facilitate the group photo participants to clearly perceive the posture of each user participant, to achieve what you see is what you get.
  • the obtaining module 41 is specifically configured to execute the method mentioned in step 31 and the equivalent replacement method; the display module 42 is specifically used to execute the method mentioned in step 32 and the equivalent replacement method;
  • the collecting module 43 is specifically configured to execute the method mentioned in step 33 and methods that can be equivalently replaced;
  • the receiving module 44 is specifically configured to execute the method mentioned in step 34 and methods that can be equivalently replaced;
  • the adjustment module 45 is specifically used to The method mentioned in step 35 and the equivalent replacement method are executed;
  • the image processing module 46 is specifically configured to execute the method mentioned in step 36 and the equivalent replacement method.
  • each module in the above device 40 is only a division of logical functions. In actual implementation, it may be fully or partially integrated into a physical entity, or may be physically separated.
  • each of the above modules can be a separately established processing element, or it can be integrated in a certain chip of the terminal to implement, in addition, it can also be stored in the form of program code in the storage element of the controller and processed by a certain processor.
  • the components call and execute the functions of the above modules.
  • each module can be integrated together or can be implemented independently.
  • the processing element described herein may be an integrated circuit chip with signal processing capabilities.
  • each step of the above method or each of the above modules may be completed by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.
  • the processing element may be a general-purpose processor, such as a central processing unit (English: central processing unit, CPU), or one or more integrated circuits configured to implement the above methods, such as one or more specific integrations. Circuit (English: application-specific integrated circuit, ASIC for short), or one or more microprocessors (English: digital signal processor, dsp), or one or more field programmable gate arrays (English: field-programmable gate array (abbreviated as FPGA).
  • the embodiments of the present invention may be provided as a method, a system, or a computer program product. Therefore, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
  • computer-usable storage media including, but not limited to, disk storage, CD-ROM, optical storage, etc.
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to work in a particular manner such that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device, the instructions
  • the device implements the functions specified in one or more flowcharts and / or one or more blocks of the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing device, so that a series of steps can be performed on the computer or other programmable device to produce a computer-implemented process, which can be executed on the computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)

Abstract

本发明提出了一种拍照方法，该方法基于两地终端的视频通话，各终端在预设模板中预览双方的实时预览视频流，双方可以各自调整本地预览流的画面，并在满意预览合影图像时进行抓拍得到各自的高清图像，通过文件回传，使得一个终端可以根据抓拍到的各端的高清图像，以及抓拍时的画面调整参数以及上述预设模板生成高分辨率的远程合影。解决远程合影无法实时预览，远程合影交互性差、表情姿态无法对齐、画面质量低等体验问题，从易用性及可用性角度提出完整的远程高清合影的解决方案。

Description

一种拍照方法、装置与设备 技术领域
本发明涉及终端技术领域，尤其涉及一种拍照方法、装置与设备。
背景技术
随着通信技术和终端硬件的不断发展，手机摄像头的性能越来越好，拍照也越来越流行，用户可以通过拍照随时随地记录自己的生活状态，留住身边美丽的事物，非常方便。
与亲人相聚是非常美好的事情，当用户与好友在同一地点需要合照时，可以借助三脚架或者邀请第三者来拍摄用户与好友的合照。但现代快节奏的工作与生活，使人经常与亲人、好友相隔两地，物理位置隔离，使得彼此无法完成合影。
有人通过后期处理，如PS，产生异地合影效果，该方式不但需要专业的裁剪与修图技巧且会耗费大量时间，这种合照的获取方法操作繁琐，同时因无法实时取景预览，双方的动作与表情往往无法匹配出好的视觉效果，难以满足广大用户自由拍摄的要求，局限性强。
发明内容
随着现代网络与终端技术的发展与演进(如：5G低时延高带宽、高质量图像传感器、高清视频通信)，将给用户带来更好的视频互联体验，也为多机互联的远程合影带来了更多的想象空间。
本发明实施例提供了一种拍照方法，具体地，可以提供一种实时视频预览的远程合影方法，拍摄过程中达到所见即所得的合影效果，解决了后期修图裁剪带来的耗时及远程无法互动等问题，提高用户的拍照体验。
本发明实施例提供的具体技术方案如下：
第一方面，本发明实施例提供一种拍照方法，该方法具体包括：第一终端获取第一视频流和第二视频流；其中，第一视频流对应于第一终端获取的第一场景的预览视频流，第二视频流对应于第二终端获取的第二场景的预览视频流；在第一终端的显示界面中根据预设模板呈现第一视频流和第二视频流；其中，预设模板包含第一区域和第二区域，第一区域用于呈现第一视频流，第二区域用于呈现第二视频流；第一终端对第一场景进行拍摄得到第一图像；第一图像的分辨率高于第一视频流的分辨率；第一终端获取第二图像；其中，第二图像是由第二终端对第二场景拍摄得到的；第二图像的分辨率高于第二视频流的分辨率；获取第一终端拍摄第一图像时的第一画面调整参数；获取第二终端拍摄第二图像时的第二画面调整参数；其中，第一画面调整参数和/或第二画面调整参数分别包括缩放比例、旋转角度、平移位移、翻转角度中的至少一个；第一终端根据第一图像、第一画面调整参数、第二图像、第二画面调整参数以 及预设模板生成合照图像。
第二方面，本发明实施例提供一种拍照装置，该装置还包括：
获取模块，用于获取第一视频流和第二视频流；其中，第一视频流对应于第一终端获取的第一场景的预览视频流，第二视频流对应于第二终端获取的第二场景的预览视频流；显示模块，用于在第一终端的显示界面中根据预设模板呈现第一视频流和第二视频流；其中，预设模板包含第一区域和第二区域，第一区域用于呈现第一视频流，第二区域用于呈现第二视频流；采集模块，用于对第一场景进行拍摄得到第一图像；第一图像的分辨率高于第一视频流的分辨率；接收模块，用于获取第二图像；其中，第二图像是由第二终端对第二场景拍摄得到的；第二图像的分辨率高于第二视频流的分辨率；调整模块，用于获取第一终端拍摄第一图像时的第一画面调整参数；还用于获取第二终端拍摄第二图像时的第二画面调整参数；其中，第一画面调整参数和/或第二画面调整参数分别可以包括缩放比例、旋转角度、平移位移、翻转角度中的至少一个；图像处理模块，用于根据第一图像、第一画面调整参数、第二图像、第二画面调整参数以及预设模板生成合照图像。
根据本发明实施例提供的上述方法和装置的技术方案，可以实现远程合影，并形成高清的合影图像，同时姿态可以由双方自由调控，所见即所得；提升用户的使用体验。
根据第一方面或者第二方面，在一种可能的设计中，第一终端控制第二终端的显示界面根据预设模板呈现第一视频流和第二视频流；且第二终端呈现第一视频流和第二视频流的方式与第一终端相同。对应地，上述装置中还可以包含控制模块，该方法可以由控制模块执行。该方案保证多个终端显示预览画面的排布方式一致，使得各终端用户能够对合照结果有一致的感知，进而更好地调整自己的姿态和画面。
根据第一方面或者第二方面，在一种可能的设计中，第一终端对第一场景进行拍摄得到第一图像包括：第一终端接收第一抓拍指令，对第一场景进行拍摄得到的第一图像；第一终端获取第二图像包括：第一终端向第二终端转发第一抓拍指令，使得第二终端对第二场景进行拍摄得到第二图像，并将第二图像发送给第一终端；第一终端接收第二终端发送的第二图像。该方法可以由采集模块和接收模块协作执行。这是一种同步抓拍的方式，能够让合照发起方具有合照的绝对掌控权，方便操作。
根据第一方面或者第二方面，在一种可能的设计中，第一终端对第一场景进行拍摄得到第一图像包括：第一终端接收第一抓拍指令，对第一场景进行拍摄得到第一图像；第一终端获取第二图像包括：第二终端接收第二抓拍指令，对第二场景进行拍摄得到第二图像，并将第二图像发送给第一终端；第一终端接收第二图像。该方法可以由采集模块和接收模块协作执行。第二抓拍指令可以是第二终端的用户进行控制的，这是一种异步抓拍的方式，能够让合照参与方具有合照的自由控制权，充分发挥各参与方的主观意愿，具有良好的互动性。
根据第一方面或者第二方面，在一种可能的设计中，第一终端接收第一抓拍指令，对第一场景进行拍摄得到的第一图像包括:第一终端调用拍照功能，对第一场景在第一抓拍指令时刻进行拍照得到第一图像；或第一终端在视频采集缓冲区中找到与第一抓拍指令的时刻对应的未编码的第一场景的缓存图像作为第一图像。该方法可以由采集 模块执行。这是获取高清图像的方法，旨在生成不同于现有技术的截图或者低分辨率视频帧的高清图像，以便于后续能够生成高清合照。
根据第一方面或者第二方面，在一种可能的设计中，第二图像与第一图像的分辨率相同。该技术方案可以统一各个合影终端的拍摄参数，融合画面时更加协调。
根据第一方面或者第二方面，在一种可能的设计中，第二图像与第一图像的长宽比相同。该技术方案可以统一各个合影终端的拍摄参数，更加方便裁剪。
根据第一方面或者第二方面，在一种可能的设计中，第一终端根据第一图像、第一画面调整参数、第二图像、第二画面调整参数以及预设模板生成合照图像包括：第一终端根据第一图像、第一画面调整参数以及第一区域确定出第一子图像；第一终端根据第二图像、第二画面调整参数以及第二区域确定出第二子图像；第一终端根据第一子图像和第二子图像以及预设模板生成合照图像。该方法可以由图像处理模块执行。
根据第一方面或者第二方面，在一种可能的设计中，由SIP或XMPP等视频通信信令协议完成合影双方或多方的呼叫、鉴权、挂断、保持等操作，并通过信令协议传递实时预览控制命令及数据。
根据第一方面或者第二方面，在一种可能的设计中，终端还对预览画面进行管理，需确保所有参与合影的终端在建立通信进行合影时，各终端上显示的画面一致(例如但不仅限于画面内容、相对位置/尺寸等)。另外，参与合影的任一终端可对前后摄像头进行切换，以获得不同的视角；可以将因摄像头的切换而引起的画面内容的切换同步在参与合影的各个终端中；保持在合影过程中各终端上显示的画面一致。
根据第一方面或者第二方面，在一种可能的设计中，发起合影的终端可以通过对视频流RTP扩展字段或信令等方式将抓拍命令传达给其它合影方，抓拍命令中包含分辨率与长宽比等信息，确保各合影方采用相同的参数抓拍。
根据第一方面或者第二方面，在一种可能的设计中，为保障合影的高清晰度，需将抓拍的高清晰度照片回传至合影发起方，在发起方的本地生成合影，可选地，发起方再下发给各合影方；或者各合影方将抓拍的高清晰度照片彼此交换，并在各合影方本地生成合影；或者各合影方将抓拍的高清晰度照片发送到服务器，由服务器生成合影并回传到各合影方。
根据第一方面或者第二方面，在一种可能的设计中，合影的预览窗口尺寸小于摄像头采集图像尺寸，用户可通过“默认、手工、智能”三种方式对预览窗口进行画面调节。在默认模式下，系统自动选择采集图像中央区域作为预览画面；手动模式下，用户通过手势或菜单等方式对本方的预览画面进行调整(平移/旋转/缩放)；智能模式下，系统通过感兴趣区域识别、人脸检测等技术，自动从摄像头采集画面中选取预览画面。在这三种模式下，各合影方画面同步刷新调整结果，保证所见即所得效果直至用户满意。
更具体地，上述可能的技术实现可以由处理器调用存储器中的程序与指令进行相应的处理，如使能摄像头，控制摄像头采集图像，对采集的图像进行一定的算法处理，生成最终的高清合影图像。
第三方面，本发明实施例提供一种终端设备，包含存储器、处理器、总线、摄像头、收发器；存储器、摄像头、收发器以及处理器通过总线相连；摄像头用于在处理 器的控制下采集图像信号；收发器用于收发指令和数据；存储器用于存储计算机程序和指令；处理器用于调用存储器中存储的计算机程序和指令控制摄像头和收发器，还具体用于使终端设备执行如上述任何一种可能的设计方法。
根据第三方面，在一种可能的设计中，终端设备还包括天线系统、天线系统在处理器的控制下，收发无线通信信号实现与移动通信网络的无线通信；移动通信网络包括以下的一种或多种：GSM网络、CDMA网络、3G网络、4G网络、5G网络、FDMA、TDMA、PDC、TACS、AMPS、WCDMA、TDSCDMA、WIFI以及LTE网络。
上述方法、装置与设备既可以应用于终端自带的拍照软件进行拍摄的场景；也可以应用于终端中运行第三方拍照软件进行拍摄的场景。同一个软件可以集成各拍摄方的所有合拍功能。
附图说明
图1为本发明实施例中一种终端的结构示意图；
图2为本发明实施例中一种远程合影的系统架构图；
图3为本发明实施例中一种终端的客户端组件示意图；
图4为本发明实施例中一种远程合影实例方法流程图；
图5为本发明实施例中一种远程合影中终端之间的信号流图；
图6为本发明实施例中一种远程合影中各终端显示界面示意图；
图7为本发明实施例中一种远程合影中各参与方的角色分布示意图；
图8为本发明实施例中一种远程合影中用户调整预览画面示意图；
图9为本发明实施例中一种远程合影智能模式下的合影效果示意图；
图10为本发明实施例中的一种抓拍命令的示意图；
图11为本发明实施例中一种远程合影的示例示意图；
图12为本发明实施例中一种远程合影的方法流程图；
图13为本发明实施例中一种远程合影的装置示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，并不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
本发明实施例中，终端，可以是向用户提供拍照和/或数据连通性的设备，具有无线连接功能的手持式设备、或连接到无线调制解调器的其他处理设备，比如：数码相机、单反相机、摄像机、移动电话(或称为“蜂窝”电话)、智能手机，可以是便携式、袖珍式、手持式、可穿戴设备(如智能手表等)、平板电脑、个人电脑(PC，Personal Computer)、PDA(Personal Digital Assistant，个人数字助理)、车载电脑、无人 机、航拍器等。
图1示出了终端100的一种可选的硬件结构示意图。
参考图1所示，终端100可以包括射频单元110、存储器120、输入单元130、显示单元140、摄像头150、音频电路160、扬声器161、麦克风162、处理器170、外部接口180、电源190等部件。本领域技术人员可以理解，图1仅仅是便携式多功能装置的举例，并不构成对便携式多功能装置的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件。
摄像头150用于采集图像或视频，可以通过应用程序指令触发开启，实现拍照或者摄像功能。摄像头可以包括成像镜头，滤光片，图像传感器等部件。物体发出或反射的光线进入成像镜头，通过滤光片，最终汇聚在图像传感器上。成像镜头主要是用于对拍照视角中的所有物体(也可称为待拍摄场景、待拍摄对象、目标场景或目标对象，也可以理解为用户期待拍摄的场景图像)发出或反射的光汇聚成像；滤光片主要是用于将光线中的多余光波(例如除可见光外的光波，如红外)滤去；图像传感器主要是用于对接收到的光信号进行光电转换，转换成电信号，并输入到处理器170进行后续处理。其中，摄像头可以位于终端设备的前面，也可以位于终端设备的背面，它们个个数以及具体的排布方式可以根据设计者或厂商策略的需求灵活确定，本申请不做限定。
所述输入单元130可用于接收输入的数字或字符信息，以及产生与所述便携式多功能装置的用户设置以及功能控制有关的键信号输入。具体地，输入单元130可包括触摸屏131以及其他输入设备132。所述触摸屏131可收集用户在其上或附近的触摸操作(比如用户使用手指、关节、触笔等任何适合的物体在触摸屏上或在触摸屏附近的操作)，并根据预先设定的程序驱动相应的连接装置。触摸屏可以检测用户对触摸屏的触摸动作，将所述触摸动作转换为触摸信号发送给所述处理器170，并能接收所述处理器170发来的命令并加以执行；所述触摸信号至少包括触点坐标信息。所述触摸屏131可以提供所述终端100和用户之间的输入界面和输出界面。此外，可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触摸屏。除了触摸屏131，输入单元130还可以包括其他输入设备。具体地，其他输入设备132可以包括但不限于物理键盘、功能键(比如音量控制按键132、开关按键133等)、轨迹球、鼠标、操作杆等中的一种或多种。
所述显示单元140可用于显示由用户输入的信息或提供给用户的信息以及终端100的各种菜单。在本发明实施例中，显示单元还用于显示设备利用摄像头150获取到的图像，可以包括某些拍摄模式下的预览图像、拍摄的初始图像以及拍摄后经过一定算法处理后的目标图像。
进一步的，触摸屏131可覆盖显示面板141，当触摸屏131检测到在其上或附近的触摸操作后，传送给处理器170以确定触摸事件的类型，随后处理器170根据触摸事件的类型在显示面板141上提供相应的视觉输出。在本实施例中，触摸屏与显示单元可以集成为一个部件而实现终端100的输入、输出、显示功能；为便于描述，本发明实施例以触摸显示屏代表触摸屏和显示单元的功能集合；在某些实施例中，触摸屏与显示单元也可以作为两个独立的部件。
所述存储器120可用于存储指令和数据，存储器120可主要包括存储指令区和存储数据区，存储数据区可存储媒体文件和文本等数据；存储指令区可存储操作系统、应用、至少一个功能所需的指令等软件单元，或者他们的子集、扩展集。还可以包括非易失性随机存储器；向处理器170提供包括管理计算处理设备中的硬件、软件以及数据资源，支持控制软件和应用，还用于多媒体文件的存储，以及运行程序和应用的存储。
处理器170是终端100的控制中心，利用各种接口和线路连接整个手机的各个部分，通过运行或执行存储在存储器120内的指令以及调用存储在存储器120内的数据，执行终端100的各种功能和处理数据，从而对手机进行整体监控。可选的，处理器170可包括一个或多个处理单元；优选的，处理器170可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器170中。在一些实施例中，处理器、存储器、可以在单一芯片上实现，在一些实施例中，他们也可以在独立的芯片上分别实现。处理器170还可以用于产生相应的操作控制信号，发给计算处理设备相应的部件，读取以及处理软件中的数据，尤其是读取和处理存储器120中的数据和程序，以使其中的各个功能模块执行相应的功能，从而控制相应的部件按指令的要求进行动作。
所述射频单元110可用于收发信息或通话过程中信号的接收和发送，特别地，将基站的下行信息接收后，给处理器170处理；另外，将设计上行的数据发送给基站。通常，RF电路包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(Low Noise Amplifier，LNA)、双工器等。此外，射频单元110还可以通过无线通信与网络设备和其他设备通信。所述无线通信可以使用任一通信标准或协议，包括但不限于全球移动通讯系统(Global System of Mobile communication，GSM)、通用分组无线服务(General Packet Radio Service，GPRS)、码分多址(Code Division Multiple Access，CDMA)、宽带码分多址(Wideband Code Division Multiple Access，WCDMA)、长期演进(Long Term Evolution，LTE)、电子邮件、短消息服务(Short Messaging Service，SMS)等。
音频电路160、扬声器161、麦克风162可提供用户与终端100之间的音频接口。音频电路160可将接收到的音频数据转换后的电信号，传输到扬声器161，由扬声器161转换为声音信号输出；另一方面，麦克风162用于收集声音信号，还可以将收集的声音信号转换为电信号，由音频电路160接收后转换为音频数据，再将音频数据输出处理器170处理后，经射频单元110以发送给比如另一终端，或者将音频数据输出至存储器120以便进一步处理，音频电路也可以包括耳机插孔163，用于提供音频电路和耳机之间的连接接口。
终端100还包括给各个部件供电的电源190(比如电池)，优选的，电源可以通过电源管理系统与处理器170逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。
终端100还包括外部接口180，所述外部接口可以是标准的Micro USB接口，也可以是多针连接器，可以用于连接终端100与其他装置进行通信，也可以用于连接充 电器为终端100充电。
尽管未示出，终端100还可以包括闪光灯、无线保真(wireless fidelity，WiFi)模块、蓝牙模块、不同功能的传感器等，在此不再赘述。下文中描述的部分或全部方法均可以应用在如图1所示的终端中。
本发明应用场景为用户出于社交、情感、娱乐等方面诉求，两人或多人合影是一种应用场景，但若合影的人不在同一地点或同一时间出现，则无法实现。针对该诉求，本发明提出了在智能终端(手机/平板)用户之间、家庭摄像头(机顶盒/IPC/智能音箱)用户之间，实现远程互动合影创意合影拍照。当节日来临却无法团聚，情侣相隔千里无法见面，通过远程互动合影满足达到娱乐和社交的诉求目的。当前用户一般采用拼图软件进行后期拼接实现合影效果，缺少时间的对齐(所见即所得的意思，时间对齐指可以在同一时刻出现在画面中进行彼此互动)，姿态上的互动不足，合影分辨率和整体的姿态呈现均无法满足用户诉求。
本发明可以应用于远程协同合影场景，系统架构如图2所示，系统由至少两个智能终端(如第一终端和第二终端，进一步地，具体实现可如手机、相机、PAD、电脑、可穿戴设备等等可拍照且可通信设备)以及服务器(如视频通信组网)组成。用户通过智能终端向好友发起合影请求，一旦第一终端和第二终端通过服务器建立通信，则第一终端和第二终端可以通过服务器互传数据，如图像文件、指令等，进而可以实现实时的图像或视频预览、显示画面的调整、拍照控制、照片回传、合影生成等。提升远程合影的可用性易用性。
本发明的落地产品形态可以是智能终端(手机/平板/便携电脑)或家庭摄像头(智能摄像头/可视机顶盒/智能音箱)，具体的可以是其中的应用程序或软件，本发明部署在终端设备上，通过软件安装或升级，通过硬件的调用配合，可给用户提供远程协同合影的功能。在具体实现过程中，终端可以包含一些必要的客户端组件，如图3所示，在硬件平台(处理器/存储器/射频单元/触摸屏/摄像头)和软件操作系统(任务管理/硬件驱动)的支持下，可以运行远程合影的应用程序，该程序可以包含以下模块：合影用户鉴权与管理101、预览模板管理102、抓拍控制103、文件回传104、合影生成105、视频通信引擎106(采集/编码/传输/显示)、预览画面编辑107等组成。其中，各个模块的功能描述如下。
合影用户鉴权与管理101：由SIP或XMPP等视频通信信令协议完成合影双方或多方的呼叫、鉴权、挂断、保持等操作，并通过信令协议传递实时预览控制命令及数据。
预览模板管理102：可供用户选择预览模板与主题，模板是指合影画面的分割模式(例如但不限于等分、画中画、斜线、拼图等，应理解拼图包含了不同的子图数量和不同的子图的排布方式)，主题是指画面的模板和滤镜风格(例如但不限于生日风格，节日风格，用户自主设计的主题、在线主题等)。该模块还对预览画面进行管理，需确保所有参与合影的终端在建立通信进行合影时，各终端上显示的画面一致(例如但不仅限于画面内容、相对位置/尺寸等)。另外，参与合影的任一终端可对前后摄像头进行切换，以获得不同的拍摄视角；预览模板管理102可以将因摄像头的切换而引起 的画面内容的切换同步在参与合影的各个终端中；保持在合影过程中各终端上显示的画面一致。
抓拍控制103：接收用户的抓拍操作(包括但不限于按键/声控/手势等)，触发对高清照片的捕获。在一种具体实现过程中，发起合影的终端可以通过对视频流RTP扩展字段或信令等方式将抓拍命令传达给其它合影方，抓拍命令中包含分辨率与长宽比等信息，确保各合影方采用相同的参数抓拍。合影时可以有同步抓拍和异步抓拍两种方式。同步抓拍是指统一的抓拍命令同时下达给所有合影方时，无需用户响应，同步完成所有合影方对各自场景拍摄高清照片，通常由主控方来完成；异步抓拍是指将抓拍的触发指令下达给所有合影方，并需要每个合影方进行响应确认，进行了抓拍确认的合影方可单独完成自己画面的抓拍，当某一合影方完成抓拍后，该用户对应的预览画面即刻被冻结，其他用户可继续调整姿态，直到所有合影方响应抓拍，所有的预览画面全部定格，合影完成。应理解，这里的抓拍即可以是终端拍摄视频流时所拍摄到的未编码的高清图像；也可以是直接调用相机拍摄到的高清图像。这些抓拍到的图像的分辨率要比终端之间传输的视频流的图像的分辨率要高；这些抓拍的高清图像是生成最终合影的“原始材料”，因此保证了合影的高清晰度。
文件回传104：应理解，在实时视频预览时，图像传输需考虑流量带宽及处理功耗问题，因此预览图像的画面清晰度会低于用户单独调用相机进行拍照时的清晰度。例如，实时视频典型的场景是高清1280x720，15帧@768kbps，而手机拍照分辨率可达3264x1840。因此，本发明为保障合影的高清晰度，需将抓拍的高清晰度照片回传至合影发起方，在发起方的本地生成合影，可选地，发起方再下发给各合影方；或者各合影方将抓拍的高清晰度照片彼此交换，并在各合影方本地生成合影；或者各合影方将抓拍的高清晰度照片发送到服务器，由服务器生成合影并回传到各合影方。随着终端性能及5G网络技术的发展，也可采用超高清的实时预览流，使用视频预览数据生成合影不用再回传照片。本模块负责对抓拍后的照片进行收发和存取。
合影生成105：获取文件回传104的回传照片，根据预览画面编辑107提供的保存的预览画面编辑参数(旋转/缩放等)进行裁剪与拼接，得到与各合影方预览一致的超高清合影照片。
视频通信引擎106：该模块主要负责摄像头对场景的预览画面的采集、编码、传输、解码、显示等实时处理，为视频通信的基础组件。视频通信引擎106接收合影用户鉴权与管理101协商得到的合影方IP地址及端口号信息，并负责将抓拍控制103、文件回传104、合影生成105的抓拍控制数据、图像文件、预览视频流等数据通过对应的IP地址与端口号传输到各合影方。并与预览画面编辑107进行交互，用户通过预览画面编辑107预览画面编辑模块对画面进行调整，视频通信引擎106还用于画面调整处理及显示渲染。此外，不同的智能终端之间还可以通过视频通信引擎106实现终端与终端之间的数据传输。
预览画面编辑107：因合影的预览窗口尺寸小于摄像头采集图像尺寸，用户可通过“默认、手工、智能”三种方式对预览窗口进行画面调节。在默认模式下，系统自动选择采集图像中央区域作为预览画面；手动模式下，用户通过手势或菜单等方式对本方的预览画面进行调整(平移/旋转/缩放)；智能模式下，系统通过感兴趣区域识 别、人脸检测等技术，自动从摄像头采集画面中选取预览画面。在这三种模式下，各合影方画面同步刷新调整结果，保证所见即所得效果直至用户满意。
应理解，上述组件的名称和描述不构成对终端软件实现的限制，一些组件功能可以存在部分交叉；在合影过程中因终端角色不同发挥的作用也可能不同。
应理解，本发明实施例中，所有参与合照的终端均可称为合照参与方，第一个主动发起合照的一方可以称为合照发起方(可简称发起方)，任何进行响应的一方称为合照响应方(可简称响应方，或合影方)，合照响应方可以是一个或者多个，本发明实施例并不对合照参与方的数量进行限定。
如图4所示，一种可选的异地合照实例如下：
步骤201：用户选择好友发起合影请求；如第一终端(发起方)向第二终端(响应方)发起合影请求。
步骤202：由合影用户鉴权与管理101发起协商，探测IP地址与端口号。如第一终端的合影用户鉴权与管理101和第二终端的合影用户鉴权与管理101建立连接和握手。具体地，如第一终端的合影用户鉴权与管理101向第二终端的合影用户鉴权与管理101发起呼叫，涵盖防火墙穿越，最终获得第二终端的通信IP地址与端口号。
步骤203：第二终端若接受合影请求，则继续执行步骤204；第二终端若不接受合影请求，则合影建立失败，流程结束。
步骤204：视频通信引擎106按照合影用户鉴权与管理101提供的通信地址建立多方实时预览视频流；例如但不仅限于建立视频通话。此时，第一终端和第二终端的拍摄功能均已开启，开始实时图像采集，经过编码、网络传输，将预览视频流传输到服务器，再转发给其他终端。如第一终端可以将第一终端摄像头内的场景预览图像编码为第一视频流进行传输，进一步地可以通过服务器转发给第二终端；同理第二终端可以将第二终端摄像头内的场景预览图像编码为第二视频流进行传输，进一步地可以通过服务器转发给第一终端。
在一种具体实现过程中，请参阅图5所示，以第一终端为例，第一终端采集第一终端摄像头内的场景图像，采集视频帧缓存，通过视频下采样、前处理、视频编码，将视频报文网络发送，经由服务器的转发，又第二终端进行视频报文网络接收，接下来进行视频解码、后处理、视频上采样等操作，最终在第二终端中呈现出解码后的流畅视频；这样第二终端的可以获取并显示第一终端采集的视频流。值得说明的是，在一些实例中，后续的抓拍动作(如步骤207)发生在采集视频帧缓存之前，以保证抓拍的到的是高清图像或者是无损图像。
步骤205：预览模板管理102供用户选择模板及场景/主题，由预览画面编辑107负责渲染与显示。如，第一终端用户可以通过预览模板管理102选择出自己喜欢的主题和屏幕画面的展示方式，例如选择2等分图的模板(左半区域+右半区域)和普通边框主题。第一终端中的预览画面编辑107按照默认方式，在左半区域中显示第一终端的拍摄场景(第一场景)的实时预览视频流(第一视频流的部分)，在右半区域中显示第二终端的拍摄场景(第二场景)的实时预览视频流(第二视频流的部分)。应理解，左半区域中实际显示第一终端的拍摄场景要比第一终端实际取景的拍摄场景要小，右半区域中实际显示第二终端的拍摄场景要比第二终端实际取景的拍摄场景要小。第 一终端通过的预览模板管理102与第二终端的预览模板管理102进行通信协商和数据传输，将第一终端使用的模板和场景/主题发送给第二终端，使得第一终端和第二终端的显示的画面一致。一种实例如图6所示。另一种实现过程中，模板或主题的选择也可以由第二终端来确定，使得第一终端和第二终端显示预览画面一致的原理类似，此处不再赘述。
在具体实现过程中，视频通话常按主被叫对画面进行布局显示，以显示对方画面为主，双方看到的画面不一致，因此无法直接用于远程协同合影。第二终端需按照相同规则，对合影预览画面进行渲染显示。本实施例中可以以第一终端为基准，按照加入合影先后顺序，至左向右、至上向下进行预览布局，一种示例如图7所示，第一用户加入在最左侧，第二个用户加在右侧，第三个用户加入的时候由上到下排布，对于多人参与的时候，合影的发起方可以对各个用户的位置进行调整，如将最重要的人放在最显眼的位置或者面积最大的区域等。同时第一终端有权对第二终端的显示布局进行同步调整，第一终端和第二终端预览画面实时同步调整结果。应理解，本发明实施例的拍摄场景不仅限于人，也包括其他任意可拍照场景。
此外，第一终端和第二终端也可切换前后摄像头，采用不同的视角拍摄。各个终端使用前置摄像头或后置摄像头由各终端用户自由决定。
总之，任何画面的改变都同步显示在第一终端和第二终端中，第一终端通过的预览模板管理102与第二终端的预览模板管理102进行通信协商和数据传输，确定好第一终端和第二终端使用统一的模板，并对模板的各个区域的使用策略给出规定，如左半区域用于显示第一终端的第一场景预览视频流，右半区域用于显示第二终端的第二场景预览视频流；此外，还可以按合影方数量、加入顺序和/或用户手机屏幕大小，将预览画面划分成若干区域。
另外，第一终端中显示的第一场景预览视频流是第一终端获取的，第一终端中显示的第二场景预览视频流是第二终端通过服务器转发给第一终端的；第二终端中显示的第二场景预览视频流是第二终端获取的，第二终端中显示的第一场景预览视频流是第一终端通过服务器转发给第二终端的。
步骤206：预览画面编辑107用户调整自己画面(平移/缩放/旋转)直至满意，并记录画面调整参数，各合影方同步调整预览画面。例如，在第一终端和第二终端建立实时视频流之后，用户可以根据自己看到的画面进行实时调整姿态和画面大小以及呈现的方式，直到用户彼此确定好自己满意的画面并进行抓拍(该动作由步骤207完成)。在这一过程中，第一终端将会记载第一终端用户在这一步骤中的所有操作，即第一画面调整参数；可选的，第二终端也可以记录第二终端用户在这一步骤中的所有操作，即第二画面调整参数。这些操作或者画面调整参数可以以文本的形式记录和传输。
在一种具体实现过程中，以双方合影为例，合影双方的身高、臂长、手机镜头视场角的差异，往往导致双方各自的预览画面大小不匹配或者位置不匹配，没有呈现出很好的位姿和配合；例如但不仅限于第一终端中预览的人第二终端中预览的人小很多，或第一终端中预览的人脸比第二终端中预览的人脸大很多，或第一终端中预览的人与第二终端中预览的人严重错位等。因此需要对各自终端中对应的画面进行手动或自动 调整，本发明实施例提出“默认、手动、智能”三种方式对预览窗口进行画面调节。在默认模式下，系统自动选择采集图像中央区域作为预览画面；手动模式下，用户通过手势或菜单等方式对本终端的预览画面进行调整(平移/旋转/缩放)；智能模式下，系统通过感兴趣区域识别、人脸检测等技术，自动从摄像头采集画面中选取预览画面区域。下面重点描述手动模式和智能模式。
1)手动画面调整详细描述：
如图8所示，因显示窗口小于视频预览画面，用户可通过手势对自己的预览画面进行调整，含平移、缩放、旋转、翻转等方式；记录手势平移像素值(X，Y)，缩放比例R，旋转角度A，翻转角度B，并将相关参数保存在本地，用于后续合影生成。同时，视频通信引擎将调整后的预览画面通过视频流发送给各合影方，保持各合影方预览画面一致。
2)智能画面调整详细描述：
通过图像感兴趣区域识别，将人脸、背景等感兴趣区域呈现在显示窗口中，比如在人像合影时，通过识别人脸区域及人脸区域占比，自动将人脸画面与预览窗口相匹配，达到自动编辑裁剪的目的。另外，在智能画面调整模式下，用户通过点击选取人像分割目标，可将对方合影人像拖动到本方背景中，实现同背景的异地合影，效果如图9所示。
应理解，第一画面调整参数可以理解为第一终端抓拍到图像时对应的缩放比例、旋转角度、平移位移、或翻转角度中的至少一个；第二画面调整参数可以理解为第二终端抓拍到图像时对应的缩放比例、旋转角度、平移位移、或翻转角度中的至少一个。第一画面调整参数可以理解为第一终端从启动合影开始，直到抓拍这一过程中所有画面调整参数的总和，即该过程中缩放比例、旋转角度、平移位移、或翻转角度中至少一个的变化量；第二画面调整参数可以理解为第二终端从参与合影开始，直到抓拍这一过程中所有画面调整参数的总和，即该过程中缩放比例、旋转角度、平移位移、或翻转角度中至少一个的变化量。
例如第一终端抓拍时，画面缩放比例为2x，旋转角度为30°，平移位移为(128,128)，翻转角度为180°，可将这些参数记录为第一画面调整参数。这些参数可以通过本文形式传输。
步骤207：抓拍控制103通过同步或异步抓拍捕获高清照片。一种具体实现过程中，当第一终端的用户已经满意当前合照画面时，可以通过抓拍控制103触发抓拍指令/拍照指令，该拍照指令将实时传达给第二终端的抓拍控制103，如，在用户调整姿态的过程中，第一终端触发拍照时，第一终端将对第一场景拍摄得到第一图像，同步地，第二终端将对第二场景拍摄得到第二图像，实现同步抓拍；其中第一图像和第二图像还没有经过压缩编码，因此分辨率高于第一视频流和第二视频流中的图像。另外一种具体实现过程中，拍摄指令由第一终端和第二终端的抓拍控制103各自掌控，即第一终端的用户只能控制第一终端是否拍照，第二终端的用户只能控制第二终端是否拍照，实现异步抓拍；如，在用户调整姿态的过程中，第一终端先触发拍照时，第一终端将对第一场景拍摄得到第一图像，并且第一终端和第二终端的显示界面中第一场景区域会冻结；而第二终端由于还没有触发拍照，因此第一终端和第二终端的显示界 面中第二场景区域依旧是实时的第二场景的预览视频流，直到第二终端触发拍照时，第二终端将对第二场景拍摄得到第二图像，并且第一终端和第二终端的显示界面中第二场景区域也被冻结，此时，第一终端和第二终端的显示界面中显示的就是合照的画面，也可以称为合照预览图。
一种具体实现过程中，一种同步抓拍方法可以是，当合影方(发起方)通过按钮/声控/手势等方式，发出同步抓拍命令后，各合影方收到抓拍命令后，各终端进行同步抓拍，获得所见即所得的合影效果。具体流程如下：
用户通过按钮/声控/手势等方式，发出同步抓拍命令；命令可以以视频流RTP扩展头的方式携带，为防止命令在传输过程中丢包导致合拍失败，采用重复发送方式，并标记重复次数，直到合影方抓拍成功返回ACK消息为止；参与合影方接收到抓拍命令后，立即执行抓拍，按命令要求捕获高清照片，若抓拍命令为重复命令则忽略。
一种具体实现过程中，一种异步抓拍方法流程如下：
各合影方只能对自己的预览画面进行抓拍，合影方发以按钮/声控/手势等方式，发出异步抓拍命令时，发起命令的合影方立即抓拍高清照片。照片获取后，发起命令的合影方立即向其他合影方发出异步抓拍通知，同时可以将抓拍高清照片的时戳TS通过视频通信引擎发送给其它合影方；其它合影方收到异步抓拍通知及时戳后，在本地终端显示界面中冻结该合影方对应的画面，直至所有合影参与方的画面全部完成抓拍冻结，完成合影。
在具体实现过程中，一种具体的抓拍命令结构可以参照如图10所示。抓拍命令可以包含用户ID、分辨率标识、命令号、命令重复次数，可选的，还可以包含异步抓拍帧时戳；其中用户ID用于视频通信引擎建立连接和协商时对应IP地址和端口号。分辨率标识用来统一各终端抓拍高清图像时的分辨率，如字段的数值为0表示4k，字段的数值为1表示1080p，字段的数值为2表示720P。命令号用来表示抓拍的类型，如字段的数值为1表示同步抓拍，字段的数值为2表示异步抓拍。命令重复次数：如取值可以包括0～128的任意次数，表示命令重复次数，重传的目的是为了防止丢包。异步抓拍帧时戳，用于保存异步抓拍获取高清照片的时戳，用于各个合影方冻结所述高清照片对应的预览画面，视觉上直观反馈用户抓拍的图像。
在具体实现过程中，在同步抓拍和异步抓拍的过程中，第一终端和第二终端可以通过抓拍命令的字段设置，采用相同的分辨率或画面长宽比或拍摄场景或其他拍摄参数拍摄图像，使得最后合成合影图像的画质更和谐统一。
步骤208：文件回传104将捕获的高清照片和相应操作回传至合影发起方。例如第二终端的文件回传104将拍摄到的第二图像回传给第一终端。可选的，步骤208还可以是第一终端和第二终端互传第一图像和第二图像。可选的，步骤208还可以是第一终端的文件回传104将拍摄到的第一图像回传给第二终端。此外，第一终端还可以将第一画面调整参数与转发给第二终端，第二终端也可以将第二画面调整参数转发给第一终端。
通过同步或异步方式完成合影后，各合影方抓拍的图像通过无损编码的方式保存在各合影方的终端文件系统中，合影参与方的文件回传模块通过协商确定的IP地址与端口号，将高清照片传输并汇总到合影发起方，用于合照生成。
步骤209：合影生成105按预览画面编辑107记录的调整参数，裁剪拼接生成合照，产生所见即所得的效果。例如第一终端的合影生成105根据预览画面编辑107记录的第一画面调整参数和第一图像得到第一子图像，使得第一终端实际拍摄的第一图像变为经过用户复杂调整后第一子图像，第一子图像包含最终合照画面中第一场景的部分；同理，第一终端的合影生成105根据第二终端中预览画面编辑107记录的第二画面调整参数(可以在第二终端回传第二图像的时候一起转发给第一终端)和第二图像得到第二子图像，使得第二终端实际拍摄的第二图像变为经过用户经过复杂调整后第二子图像，第二子图像包含最终合照画面中第二场景的部分；最后根据第一子图像和第二子图像以及预设的模板生成高清的合照图。该高清的合照图与用户触发合照时终端显示的预览合照图相同。可选的，第一终端的显示屏中将高清的合照图替换掉原来的预览合照图，呈现给用户。进一步的，第一终端的用户可以将高清的合照图发送给第二终端的用户或者其他用户。
在具体实现过程中，一种合照生成的流程可以如下：
合影发起方获取各合影方抓拍到的高清照片以及抓拍时相应记录的预览画面编辑参数(即画面调整参数)；将合影方照片解码成YUV数据，将合影方照片与调整参数一一对应；按照调整参数(显示窗口大小、位置、缩放比例、旋转角度、平移像素、或翻转角度中的至少一个)对各合影方高清照片进行编辑调整；对编辑后各合影方照片进行拼接并编码成JPEG格式照片，将合影结果呈现在合影发起方的终端的显示界面上。
一种例子可以参见图11，假设合影发起方1接收合影参与方2和合影参与方3回传回来的图像进行解码得到高清图像，来自合影参与方2的高清图像的内容包含D1 E1 F1，来自合影参与方3的高清图像的内容包含G1 H1 I1，由于合影发起方抓拍的高清图像存储于本地，因此不需要回传，合影发起方1的高清图像的内容包含A1 B1 C1。根据来自合影参与方2的一系列画面调整参数，如旋转角度、缩放倍数、或平移位移等，D1 E1 F1对应变为D2 E2 F2；根据来自合影参与方3的一系列画面调整参数，如旋转角度、缩放倍数、或平移位移等，G1 H1 I1对应变为G2 H2 I2；根据来自合影发起方1的一系列画面调整参数，如旋转角度、缩放倍数、或平移位移等，A1 B1 C1对应变为A2 B2 C2。根据模板中的主题以及各合影方画面的布局，对应裁剪出D2，H2，和C2这几个局部区域，最后根据D2，H2，和C2以及模板主题拼接成高清合影，并编码成为不同格式的图像，如JPEG。
以图2为例，第一终端与第二终端均为合照参与方，以第一终端为合照发起方，以第二终端为合照响应方为例，对本发明一种可选的实施例进行展开说明。本发明实施例提供一种拍照方法，该方法应用于一种拍摄终端，该方法包括如下步骤：
步骤31：第一终端获取第一视频流和第二视频流；其中，第一视频流对应于第一终端获取的第一场景的预览视频流，第二视频流对应于第二终端获取的第二场景的预览视频流。即第一视频流为合影开启后，第一终端本地产生的预览视频流，第二视频流为参与合影后，第二终端产生并发送过来的预览视频流。
此外，第二终端同时也可以获取第一视频流和第二视频流。
步骤31的具体实现可以参照步骤204的部分或全部描述。
步骤32：在第一终端的显示界面中根据预设模板呈现第一视频流和第二视频流；其中，预设模板包含第一区域和第二区域，第一区域用于呈现第一视频流，第二区域用于呈现第二视频流；
应理解，由于第一区域和第二区域通常小于显示界面，因此第一区域和第二区域显示的可以是第一视频流和第二视频流的部分内容或全部内容；具体地，第一区域显示的内容可以比第一终端完整显示第一场景的内容要少；第二区域显示的内容可以比第二终端完整显示第二场景的内容要少。
此外，第一终端可以与第二终端协商通信，采用相同的模板，以及统一对第一视频流和第二视频流的布局，使得第一终端和第二终端的显示界面显示的预览画面内容完全一致，即合影区域的内容一致。可选的，预览画面的一致性可以在合影完成之前一直保持。
步骤32的具体实现可以参照步骤205的部分或全部描述。
步骤33：第一终端对第一场景进行拍摄得到第一图像；第一图像的分辨率高于第一视频流的分辨率；
步骤34：第一终端获取第二图像；其中，第二图像是由第二终端对第二场景拍摄得到的；第二图像的分辨率高于第二视频流的分辨率；
步骤33和步骤34的具体实现可以参照步骤207以及步骤208的部分或全部描述。
步骤35：获取第一终端拍摄第一图像时的第一画面调整参数；获取第二终端拍摄第二图像时的第二画面调整参数；其中，第一画面调整参数和第二画面调整参数包括缩放比例、旋转角度、平移位移、或翻转角度中的至少一个；
具体实现过程中，用户在预览拍摄场景时，可以对场景进行调整，如缩放、平移、旋转、翻转等操作，当然还可以包含PS技术中的任意一种调整技术，以达到自己期待的效果。用户在调整抓拍之前所有的操作效果，本发明实施例中终端都会记录。对应上述实施例，第一终端记录第一画面调整参数，第二终端可以记录第二画面调整参数，并将其传送给第一终端。具体实现过程中，第一终端和第二终端可以进行通信，将第一画面调整参数和第二画面调整参数以文本的形式可以双向发送或者单向发送。
步骤35的具体实现可以参照步骤206的部分或全部描述。
步骤36：第一终端根据第一图像、第一画面调整参数、第二图像、第二画面调整参数以及预设模板生成合照图像。
具体实现过程中，第一终端根据第一图像、第一画面调整参数以及第一区域确定出第一子图像。具体的，根据第一画面调整参数将第一终端实际拍摄到的第一图像变成用户抓拍时的图像状态，进一步地根据第一区域进行裁剪，得到抓拍时终端显示界面中的第一区域的子图。第一终端根据第二图像、第二画面调整参数以及所述第二区域确定出第二子图像。具体的，根据第二画面调整参数将第二终端实际拍摄到的第二图像变成用户抓拍时的图像状态，进一步地根据第二区域进行裁剪，得到抓拍时终端显示界面中的第二区域的子图。第一终端根据第一子图像和第二子图像以及所述预设模板生成合照图像。具体的，第一终端将第一区域的子图和第二区域的子图拼接到模板中，生成最终合照，并生成图片格式。
步骤36具体实现可以参照步骤209的部分或全部描述。
本发明提出了基于远程协同(互动)的合影方案，通过本发明实施例提供的合影方案，贴近真实场景，提出了实时预览模板的管理方法，使各合影参与方预览画面可保持一致，模拟本地预览效果；同时提出了一种预览画面编辑方法与同步方法，还提出了一种同步抓拍与异步抓拍的方法，提升了各合影方的互动性及趣味性；另外，抓拍高清图像的方式，并使得图像质量接近单机本地合影，远比视频截图质量要高得多；特别地，本发明提出了预览画面编辑与合影生成对应的方法，需要记录用户抓拍图像时的画面调整参数，编辑相关参数用于后期合影生成；确保合影生成画面与抓拍时的预览合影画面一致，增加用户对摆拍姿态的调整灵活性和趣味性，增加操作空间更大程度发挥用户的想象。解决了现有技术中无法实时预览，表情取景难对齐合影质量低的问题，达到所见即所得的用户体验。当前手机拍照及视频录制质量已得到极大提升，通过业务创新更容易吸引用户眼球，提升用户粘性，随着终端性能及5G技术的演进，不同于以往的远程合影方式成为可能。
基于上述实施例提供的拍照方法，本发明实施例提供一种拍照装置40，所述装置40可以应用于各类拍照设备，如图13所示，该装置40包括获取模块41、显示模块42、采集模块43、接收模块44、调整模块45、以及图像处理模块46。
获取模块41，用于获取第一视频流和第二视频流；其中，第一视频流对应于第一终端获取的第一场景的预览视频流，第二视频流对应于第二终端获取的第二场景的预览视频流。该获取模块41可以由处理器调用相应的程序指令获取本地数据以及网络传输数据来实现。
显示模块42，用于在第一终端的显示界面中根据预设模板呈现第一视频流和第二视频流；其中，预设模板包含第一区域和第二区域，第一区域用于呈现第一视频流，第二区域用于呈现第二视频流。该显示模块42可以由处理器调用存储器中的程序指令对显示数据进行布局来实现。
采集模块43，用于对第一场景进行拍摄得到第一图像；第一图像的分辨率高于第一视频流的分辨率。该采集模块43可以由处理器调用传感器以及摄像头拍摄来实现，并将采集到的图像存储在存储器中。
接收模块44，用于获取第二图像；其中，第二图像是由第二终端对第二场景拍摄得到的；第二图像的分辨率高于第二视频流的分辨率。该接收模块44可以由处理器调用相应的程序指令获取网络传输数据来实现。
调整模块45，用于获取第一终端拍摄第一图像时的第一画面调整参数；还用于获取第二终端拍摄第二图像时的第二画面调整参数；其中，第一画面调整参数和第二画面调整参数包括缩放比例、旋转角度、平移位移、或翻转角度中的至少一个。该调整模块45可以由处理器调用相应的程序指令获取本地数据以及网络传输数据来实现。
图像处理模块46，用于根据第一图像、第一画面调整参数、第二图像、第二画面调整参数以及预设模板生成合照图像。该图像处理模块46可以由处理器调用本地存储器或云端服务器中的数据以及算法，进行相应计算实现，并输出最终用户期待得到的目标场景的图片。
该装置还可以包括控制模块47，用于控制第二终端的显示界面根据所述预设模板呈现所述第一视频流和所述第二视频流；且第二终端呈现所述第一视频流和所述第二 视频流的方式与所述第一终端相同。在完成抓拍合影之前，两个终端中的视频流实时显示。以便于合影参与方能够清晰地感知到各用户参与方的姿态，实现所见即所得。
在具体实现过程中，获取模块41具体用于执行步骤31中所提到的方法以及可以等同替换的方法；显示模块42具体用于执行步骤32中所提到的方法以及可以等同替换的方法；采集模块43具体用于执行步骤33中所提到的方法以及可以等同替换的方法；接收模块44具体用于执行步骤34中所提到的方法以及可以等同替换的方法；调整模块45具体用于执行步骤35中所提到的方法以及可以等同替换的方法；图像处理模块46具体用于执行步骤36中所提到的方法以及可以等同替换的方法。
其中，上述具体的方法实施例以及实施例中技术特征的解释、表述、以及多种实现形式的扩展也适用于装置中的方法执行，装置实施例中不予以赘述。
应理解以上装置40中的各个模块的划分仅仅是一种逻辑功能的划分，实际实现时可以全部或部分集成到一个物理实体上，也可以物理上分开。例如，以上各个模块可以为单独设立的处理元件，也可以集成在终端的某一个芯片中实现，此外，也可以以程序代码的形式存储于控制器的存储元件中，由处理器的某一个处理元件调用并执行以上各个模块的功能。此外各个模块可以集成在一起，也可以独立实现。这里所述的处理元件可以是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法的各步骤或以上各个模块可以通过处理器元件中的硬件的集成逻辑电路或者软件形式的指令完成。该处理元件可以是通用处理器，例如中央处理器(英文：central processing unit，简称：CPU)，还可以是被配置成实施以上方法的一个或多个集成电路，例如：一个或多个特定集成电路(英文：application-specific integrated circuit，简称：ASIC)，或，一个或多个微处理器(英文：digital signal processor，简称：DSP)，或，一个或者多个现场可编程门阵列(英文：field-programmable gate array，简称：FPGA)等。
应理解本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的实施例能够以除了在这里图示或描述的内容以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或模块的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或模块，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或模块。
本领域内的技术人员应明白，本发明的实施例可提供为方法、系统、或计算机程序产品。因此，本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据 处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本发明的部分实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例作出另外的变更和修改。所以，所附权利要求意欲解释为包括已列举实施例以及落入本发明范围的所有变更和修改。显然，本领域的技术人员可以对本发明实施例进行各种改动和变型而不脱离本发明实施例的精神和范围。倘若本发明实施例的这些修改和变型属于本发明权利要求及其等同技术的范围之内，则本发明也包含这些改动和变型在内。

Claims (16)

  1. 一种拍照方法，其特征在于，所述方法包括：
    第一终端获取第一视频流和第二视频流；其中，所述第一视频流对应于所述第一终端获取的第一场景的预览视频流，所述第二视频流对应于第二终端获取的第二场景的预览视频流；
    在所述第一终端的显示界面中根据预设模板呈现所述第一视频流和所述第二视频流；其中，所述预设模板包含第一区域和第二区域，所述第一区域用于呈现所述第一视频流，所述第二区域用于呈现所述第二视频流；
    所述第一终端对所述第一场景进行拍摄得到第一图像；所述第一图像的分辨率高于所述第一视频流的分辨率；
    所述第一终端获取第二图像；其中，所述第二图像是由所述第二终端对所述第二场景拍摄得到的；所述第二图像的分辨率高于所述第二视频流的分辨率；
    所述第一终端获取所述第一终端拍摄所述第一图像时的第一画面调整参数；
    所述第一终端获取所述第二终端拍摄所述第二图像时的第二画面调整参数；其中，所述第一画面调整参数和所述第二画面调整参数包括缩放比例、旋转角度、平移位移、或翻转角度中的至少一个；
    所述第一终端根据所述第一图像、所述第一画面调整参数、所述第二图像、所述第二画面调整参数以及所述预设模板生成合照图像。
  2. 如权利要求1所述方法，其特征在于，在所述第一终端的显示界面中根据预设模板呈现所述第一视频流和所述第二视频流时，所述方法还包括：
    所述第一终端控制所述第二终端的显示界面根据所述预设模板呈现所述第一视频流和所述第二视频流；且所述第二终端呈现所述第一视频流和所述第二视频流的方式与所述第一终端相同。
  3. 如权利要求1所述方法，其特征在于，所述第一终端对所述第一场景进行拍摄得到第一图像包括：
    所述第一终端接收第一抓拍指令，对所述第一场景进行拍摄得到第一图像；
    所述第一终端获取第二图像包括：
    所述第一终端向所述第二终端转发所述第一抓拍指令，使得所述第二终端对所述第二场景进行拍摄得到第二图像，并将所述第二图像发送给所述第一终端；
    第一终端接收第二终端发送的第二图像。
  4. 如权利要求1所述方法，其特征在于，所述第一终端对所述第一场景进行拍摄得到第一图像包括：
    所述第一终端接收第一抓拍指令，对所述第一场景进行拍摄得到第一图像；
    所述第一终端获取第二图像包括：
    所述第二终端接收第二抓拍指令，对所述第二场景进行拍摄得到第二图像，并将所述第二图像发送给所述第一终端；
    所述第一终端接收所述第二图像。
  5. 如权利要求3或4所述方法，其特征在于，所述第一终端接收第一抓拍指令， 对所述第一场景进行拍摄得到的第一图像包括:
    所述第一终端调用拍照功能，对所述第一场景在第一抓拍指令时刻进行拍照得到第一图像；或
    所述第一终端在视频采集缓冲区中找到与所述第一抓拍指令的时刻对应的未编码的第一场景的缓存图像作为第一图像。
  6. 如权利要求1-5中任一项所述方法，其特征在于，所述第二图像与所述第一图像的分辨率和画面长宽比相同。
  7. 如权利要求1-6中任一项所述方法，其特征在于，所述第一终端根据所述第一图像、所述第一画面调整参数、所述第二图像、所述第二画面调整参数以及所述预设模板生成合照图像包括：
    所述第一终端根据所述第一图像、所述第一画面调整参数以及所述第一区域确定出第一子图像；
    所述第一终端根据所述第二图像、所述第二画面调整参数以及所述第二区域确定出第二子图像；
    所述第一终端根据所述第一子图像和所述第二子图像以及所述预设模板生成合照图像。
  8. 一种拍照装置，所述拍照装置位于第一终端中，其特征在于，所述装置包括：
    获取模块，用于获取第一视频流和第二视频流；其中，所述第一视频流对应于所述第一终端获取的第一场景的预览视频流，所述第二视频流对应于第二终端获取的第二场景的预览视频流；
    显示模块，用于在所述第一终端的显示界面中根据预设模板呈现所述第一视频流和所述第二视频流；其中，所述预设模板包含第一区域和第二区域，所述第一区域用于呈现所述第一视频流，所述第二区域用于呈现所述第二视频流；
    采集模块，用于对所述第一场景进行拍摄得到第一图像；所述第一图像的分辨率高于所述第一视频流的分辨率；
    接收模块，用于获取第二图像；其中，所述第二图像是由所述第二终端对所述第二场景拍摄得到的；所述第二图像的分辨率高于所述第二视频流的分辨率；
    调整模块，用于获取所述第一终端拍摄所述第一图像时的第一画面调整参数；还用于获取所述第二终端拍摄所述第二图像时的第二画面调整参数；其中，所述第一画面调整参数和所述第二画面调整参数包括缩放比例、旋转角度、平移位移、或翻转角度中的至少一个；
    图像处理模块，用于根据所述第一图像、所述第一画面调整参数、所述第二图像、所述第二画面调整参数以及所述预设模板生成合照图像。
  9. 如权利要求8所述装置，其特征在于，所述装置还包括控制模块，用于控制所述第二终端的显示界面根据所述预设模板呈现所述第一视频流和所述第二视频流；且所述第二终端呈现所述第一视频流和所述第二视频流的方式与所述第一终端相同。
  10. 如权利要求8所述装置，其特征在于，所述采集模块具体用于：接收第一抓拍指令，对所述第一场景进行拍摄得到第一图像；
    所述接收模块具体用于：向所述第二终端转发所述第一抓拍指令，使得所述第二 终端对所述第二场景进行拍摄得到第二图像，并将所述第二图像发送给所述第一终端；
    接收第二终端发送的第二图像。
  11. 如权利要求8所述装置，其特征在于，所述采集模块具体用于：接收第一抓拍指令，对所述第一场景进行拍摄得到第一图像；
    所述接收模块具体用于：所述第二终端接收第二抓拍指令，对所述第二场景进行拍摄得到第二图像，并将所述第二图像发送给所述第一终端；
    接收所述第二图像。
  12. 如权利要求10或11所述装置，其特征在于，所述采集模块具体用于：
    调用拍照功能，对所述第一场景在第一抓拍指令时刻进行拍照得到第一图像；或
    在视频采集缓冲区中找到与所述第一抓拍指令的时刻对应的未编码的第一场景的缓存图像作为第一图像。
  13. 如权利要求8-12中任一项所述装置，其特征在于，所述第二图像与所述第一图像的分辨率和画面长宽比相同。
  14. 如权利要求8-13中任一项所述装置，其特征在于，所述图像处理模块具体用于：
    根据所述第一图像、所述第一画面调整参数以及所述第一区域确定出第一子图像；
    根据所述第二图像、所述第二画面调整参数以及所述第二区域确定出第二子图像；
    根据所述第一子图像和所述第二子图像以及所述预设模板生成合照图像。
  15. 一种终端设备，其特征在于，所述终端设备包含存储器、处理器、总线、摄像头、收发器；所述存储器、所述摄像头、所述收发器以及所述处理器通过所述总线相连；
    所述摄像头用于在所述处理器的控制下采集图像信号；
    所述收发器用于收发指令和数据；
    所述存储器用于存储计算机程序和指令；
    所述处理器用于调用所述存储器中存储的所述计算机程序和指令控制所述摄像头和所述收发器，还具体用于使所述终端设备执行如权利要求1～7中任一项所述方法。
  16. 如权利要求15所述的终端设备，所述终端设备还包括天线系统、所述天线系统在处理器的控制下，收发无线通信信号实现与移动通信网络的无线通信；所述移动通信网络包括以下的一种或多种：GSM网络、CDMA网络、3G网络、4G网络、5G网络、FDMA、TDMA、PDC、TACS、AMPS、WCDMA、TDSCDMA、WIFI以及LTE网络。
PCT/CN2019/107131 2018-09-21 2019-09-21 一种拍照方法、装置与设备 WO2020057661A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/205,816 US11218649B2 (en) 2018-09-21 2021-03-18 Photographing method, apparatus, and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811105629.7 2018-09-21
CN201811105629.7A CN110944109B (zh) 2018-09-21 2018-09-21 一种拍照方法、装置与设备

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/205,816 Continuation US11218649B2 (en) 2018-09-21 2021-03-18 Photographing method, apparatus, and device

Publications (1)

Publication Number Publication Date
WO2020057661A1 true WO2020057661A1 (zh) 2020-03-26

Family

ID=69888334

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/107131 WO2020057661A1 (zh) 2018-09-21 2019-09-21 一种拍照方法、装置与设备

Country Status (3)

Country Link
US (1) US11218649B2 (zh)
CN (1) CN110944109B (zh)
WO (1) WO2020057661A1 (zh)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112036242A (zh) * 2020-07-28 2020-12-04 重庆锐云科技有限公司 人脸图片采集方法、装置、计算机设备及存储介质
CN112947756A (zh) * 2021-03-03 2021-06-11 上海商汤智能科技有限公司 内容导览方法、装置、系统、计算机设备及存储介质
CN114697555A (zh) * 2022-04-06 2022-07-01 百富计算机技术（深圳）有限公司 一种图像处理方法、装置、设备及存储介质
CN114845035A (zh) * 2021-01-30 2022-08-02 华为技术有限公司 一种分布式拍摄方法，电子设备及介质
CN116708751A (zh) * 2022-09-30 2023-09-05 荣耀终端有限公司 一种拍照时长的确定方法、装置和电子设备

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020150979A1 (zh) * 2019-01-24 2020-07-30 华为技术有限公司 一种分享图像方法和移动设备
US10523900B1 (en) * 2019-03-20 2019-12-31 Zoom Video Communications, Inc. Method and apparatus for capturing a group photograph during a video conferencing session
CN111654676B (zh) * 2020-06-10 2021-11-19 上海趣人文化传播有限公司 一种协作拍摄系统及其拍摄方法
CN111667590B (zh) * 2020-06-12 2024-03-22 上海商汤智能科技有限公司 一种互动合影方法、装置、电子设备及存储介质
CN111968199A (zh) * 2020-08-31 2020-11-20 深圳传音控股股份有限公司 图片的处理方法、终端设备和存储介质
CN118158521A (zh) * 2020-10-30 2024-06-07 华为技术有限公司 一种拍摄方法和终端设备
CN115514881B (zh) * 2020-11-11 2023-07-11 华为技术有限公司 控制相机的方法与电子设备
CN114827098B (zh) * 2021-01-28 2024-10-18 华为技术有限公司 合拍的方法、装置、电子设备和可读存储介质
CN115134506A (zh) * 2021-03-26 2022-09-30 阿里巴巴新加坡控股有限公司 摄像画面调整方法、视频画面处理方法以及装置和系统
CN113158893A (zh) * 2021-04-20 2021-07-23 北京嘀嘀无限科技发展有限公司 一种目标识别的方法和系统
US11653047B2 (en) * 2021-07-29 2023-05-16 International Business Machines Corporation Context based adaptive resolution modulation countering network latency fluctuation
CN115706765B (zh) * 2021-08-12 2023-10-27 荣耀终端有限公司 视频处理方法、装置、电子设备和存储介质
CN113628292B (zh) * 2021-08-16 2023-07-25 上海云轴信息科技有限公司 一种在目标终端中预览图片的方法及设备
CN118264896A (zh) * 2021-09-07 2024-06-28 荣耀终端有限公司 一种获取图像的方法及电子设备
CN113973178A (zh) * 2021-10-24 2022-01-25 云景文旅科技有限公司 一种旅游过程中交互拍照处理方法和装置

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101431613A (zh) * 2007-11-09 2009-05-13 陆云昆 网络合影的实现方法
CN102665026A (zh) * 2012-05-03 2012-09-12 华为技术有限公司 一种利用视频会议实现远程合影的方法、设备及系统
US20130329124A1 (en) * 2012-06-08 2013-12-12 Canon Kabushiki Kaisha Image processing apparatus and image processing method
CN104333693A (zh) * 2014-11-03 2015-02-04 深圳市中兴移动通信有限公司 拍摄方法、拍摄系统和拍摄装置
CN106331529A (zh) * 2016-10-27 2017-01-11 广东小天才科技有限公司 一种图像拍摄方法及装置
CN106331528A (zh) * 2016-10-24 2017-01-11 宇龙计算机通信科技(深圳)有限公司 一种拍摄处理方法及图像拍摄设备
CN106657791A (zh) * 2017-01-03 2017-05-10 广东欧珀移动通信有限公司 一种合成图像的生成方法及装置
CN107404617A (zh) * 2017-07-21 2017-11-28 努比亚技术有限公司 一种拍摄方法及终端、计算机存储介质
CN108495032A (zh) * 2018-03-26 2018-09-04 广东欧珀移动通信有限公司 图像处理方法、装置、存储介质及电子设备
CN109769087A (zh) * 2017-11-09 2019-05-17 中兴通讯股份有限公司 远程合照的拍摄方法、装置及移动终端

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2005749A2 (en) * 2006-04-05 2008-12-24 Graco Children's Products Inc. Video baby monitor system
JP2008092228A (ja) * 2006-09-29 2008-04-17 Toshiba Corp ビデオ会議システムおよびビデオ会議方法
US8633962B2 (en) * 2007-06-22 2014-01-21 Lifesize Communications, Inc. Video decoder which processes multiple video streams
CN101521754A (zh) * 2008-02-25 2009-09-02 方大晟 异地双人大头贴
CN101562682A (zh) * 2008-04-14 2009-10-21 鸿富锦精密工业（深圳）有限公司 视频图像处理系统及其服务器、用户端和视频图像处理方法
US8587653B1 (en) * 2009-04-30 2013-11-19 Verint Systems, Inc. Modifying the resolution of video before transferring to a display system
GB2473429B (en) * 2009-09-07 2013-12-11 Snow Leopard Invest Ltd A video-collaboration apparatus and method
US8537195B2 (en) * 2011-02-09 2013-09-17 Polycom, Inc. Automatic video layouts for multi-stream multi-site telepresence conferencing system
CN102158681A (zh) * 2011-02-16 2011-08-17 中兴通讯股份有限公司 一种可视电话中协同拍照的方法及移动终端
US9445052B2 (en) * 2011-08-31 2016-09-13 Hewlett-Packard Development Company, L.P. Defining a layout for displaying images
WO2012103820A2 (zh) * 2012-03-08 2012-08-09 华为技术有限公司 视频会议中突显关注者的方法、设备及系统
CN102821253B (zh) * 2012-07-18 2016-10-19 上海量明科技发展有限公司 即时通信工具实现合影功能的方法及系统
WO2014021004A1 (ja) * 2012-07-31 2014-02-06 日本電気株式会社 画像処理システム、画像処理方法、及びプログラム
CN104580930B (zh) * 2013-10-28 2019-09-27 腾讯科技（深圳）有限公司 合影方法及系统
CN103716537B (zh) * 2013-12-18 2017-03-15 宇龙计算机通信科技(深圳)有限公司 照片合成方法和终端
KR101576130B1 (ko) * 2015-07-22 2015-12-09 (주)씨프로 고해상도용 cctv 파노라마 카메라 장치
CN106488106B (zh) 2015-08-31 2019-04-26 杭州华为数字技术有限公司 一种图像处理方法及装置
KR20170082349A (ko) * 2016-01-06 2017-07-14 삼성전자주식회사 디스플레이 장치 및 그 제어 방법
US9807341B2 (en) * 2016-02-19 2017-10-31 Microsoft Technology Licensing, Llc Communication event
EP3249928A1 (en) * 2016-05-23 2017-11-29 Thomson Licensing Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices
CN106375193A (zh) 2016-09-09 2017-02-01 四川长虹电器股份有限公司 远程合照方法
US9798933B1 (en) * 2016-12-12 2017-10-24 Logitech Europe, S.A. Video conferencing system and related methods

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101431613A (zh) * 2007-11-09 2009-05-13 陆云昆 网络合影的实现方法
CN102665026A (zh) * 2012-05-03 2012-09-12 华为技术有限公司 一种利用视频会议实现远程合影的方法、设备及系统
US20130329124A1 (en) * 2012-06-08 2013-12-12 Canon Kabushiki Kaisha Image processing apparatus and image processing method
CN104333693A (zh) * 2014-11-03 2015-02-04 深圳市中兴移动通信有限公司 拍摄方法、拍摄系统和拍摄装置
CN106331528A (zh) * 2016-10-24 2017-01-11 宇龙计算机通信科技(深圳)有限公司 一种拍摄处理方法及图像拍摄设备
CN106331529A (zh) * 2016-10-27 2017-01-11 广东小天才科技有限公司 一种图像拍摄方法及装置
CN106657791A (zh) * 2017-01-03 2017-05-10 广东欧珀移动通信有限公司 一种合成图像的生成方法及装置
CN107404617A (zh) * 2017-07-21 2017-11-28 努比亚技术有限公司 一种拍摄方法及终端、计算机存储介质
CN109769087A (zh) * 2017-11-09 2019-05-17 中兴通讯股份有限公司 远程合照的拍摄方法、装置及移动终端
CN108495032A (zh) * 2018-03-26 2018-09-04 广东欧珀移动通信有限公司 图像处理方法、装置、存储介质及电子设备

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112036242A (zh) * 2020-07-28 2020-12-04 重庆锐云科技有限公司 人脸图片采集方法、装置、计算机设备及存储介质
CN112036242B (zh) * 2020-07-28 2023-07-21 重庆锐云科技有限公司 人脸图片采集方法、装置、计算机设备及存储介质
CN114845035A (zh) * 2021-01-30 2022-08-02 华为技术有限公司 一种分布式拍摄方法，电子设备及介质
CN114845035B (zh) * 2021-01-30 2024-04-26 华为技术有限公司 一种分布式拍摄方法，电子设备及介质
CN112947756A (zh) * 2021-03-03 2021-06-11 上海商汤智能科技有限公司 内容导览方法、装置、系统、计算机设备及存储介质
CN114697555A (zh) * 2022-04-06 2022-07-01 百富计算机技术（深圳）有限公司 一种图像处理方法、装置、设备及存储介质
CN114697555B (zh) * 2022-04-06 2023-10-27 深圳市兆珑科技有限公司 一种图像处理方法、装置、设备及存储介质
CN116708751A (zh) * 2022-09-30 2023-09-05 荣耀终端有限公司 一种拍照时长的确定方法、装置和电子设备
CN116708751B (zh) * 2022-09-30 2024-02-27 荣耀终端有限公司 一种拍照时长的确定方法、装置和电子设备

Also Published As

Publication number Publication date
CN110944109A (zh) 2020-03-31
US11218649B2 (en) 2022-01-04
CN110944109B (zh) 2022-01-14
US20210227151A1 (en) 2021-07-22

Similar Documents

Publication Publication Date Title
WO2020057661A1 (zh) 一种拍照方法、装置与设备
WO2022042674A1 (zh) 拍摄方法、装置、电子设备及计算机可读存储介质
US10021302B2 (en) Video recording method and device
TW201143348A (en) Switching cameras during a video conference of a multi-camera mobile device
WO2010118611A1 (zh) 一种截取动态图像的方法、系统及设备
US9947366B2 (en) Group portraits composed using video chat systems
KR100889367B1 (ko) 네트워크를 통한 가상 스튜디오 구현 시스템 및 그 방법
CN103905741A (zh) 超高清全景视频实时生成与多通道同步播放系统
CN102694980A (zh) 移动终端、移动终端摄像头的远程控制系统及方法
CN105190511A (zh) 图像处理方法、图像处理装置和图像处理程序
WO2022048651A1 (zh) 合拍方法、装置、电子设备及计算机可读存储介质
WO2015070558A1 (zh) 一种控制视频拍摄的方法和装置
WO2012109831A1 (zh) 一种可视电话中拍照的方法及移动终端
WO2015117513A1 (zh) 视频会议控制方法和系统
WO2015078336A1 (zh) 一种媒体拍摄方法及终端
CN114610253A (zh) 一种投屏方法及设备
CN104471952B (zh) 从远程视角感测的媒体内容的消费和捕获
WO2014075413A1 (zh) 一种确定待共享的终端的方法、装置和系统
WO2020001610A1 (zh) 一种视频拼接方法及装置
WO2016187947A1 (zh) 远程拍摄方法、主控拍摄终端、被控拍摄终端及拍摄系统
US20180241785A1 (en) Systems and Methods for Recording and Storing Media Content
EP2482549A1 (en) Apparatus and method for synchronizing media capture in a wireless device
RU105102U1 (ru) Автоматизированная система для создания, обработки и монтажа видеороликов
WO2022262536A1 (zh) 一种视频处理方法及电子设备
WO2022088926A1 (zh) 一种拍摄方法和终端设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19862799

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19862799

Country of ref document: EP

Kind code of ref document: A1