WO2017067520A1

WO2017067520A1 - Mobile terminal having binocular cameras and photographing method therefor

Info

Publication number: WO2017067520A1
Application number: PCT/CN2016/103015
Authority: WO
Inventors: 谢书勋
Original assignee: 努比亚技术有限公司
Priority date: 2015-10-22
Filing date: 2016-10-24
Publication date: 2017-04-27
Also published as: CN105262951A

Abstract

A mobile terminal having binocular cameras. The mobile terminal comprises: a photographing module, configured to control a first camera and a second camera to photograph by using the same photographing parameter when a wide-angle photographing command is received, wherein the sum of an angle between the first camera after rotating and the plane where an automatic rotating axis of the first camera is located and an angle between the second camera after rotating and the plane where an automatic rotating axis of the second camera is greater than zero, and is smaller than a half of the field angle sum of the first camera and the second camera; a photo acquiring module, configured to acquire a first photo photographed by the first camera and a second photo photographed by the second camera; and a photo combining module, configured to splice and combine the first photo and the second photo into a wide-angle photo. The technical solution is able to conveniently and quickly photograph a wide-angle photo with good imaging quality.

Description

Mobile terminal with binocular camera and photographing method thereof

Technical field

This document relates to, but is not limited to, the field of mobile terminal technologies, and in particular, to a mobile terminal having a binocular camera and a photographing method thereof.

Background technique

At present, the camera used in mobile terminals such as mobile phones and tablet computers has an equivalent focal length of substantially 35 mm to 28 mm, and the corresponding maximum field of view angle is between 63° and 75°. Due to the lens process, the ultra-wide-angle lens module is used on the mobile phone, that is, the lens module with a horizontal viewing angle of 80° or more, and the photo will have a relatively large distortion when photographed. Therefore, if the user wants to take a wide-angle photo, he can synthesize a wide-angle photo on the mobile phone after taking a photo with a rotating mobile phone. However, when the camera is rotated, the hand is liable to sway during the process of rotating the mobile phone, and the entire rotation process is not on the same horizontal line, resulting in poor image quality.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The embodiment of the invention provides a mobile terminal with a binocular camera and a photographing method thereof, which can realize a wide-angle photograph with good imaging quality conveniently and quickly.

An embodiment of the present invention provides a mobile terminal having a binocular camera, the mobile terminal includes a first camera and a second camera, and the first camera and the second camera are disposed to rotate relative to the mobile terminal. The rotation axes of the first camera and the second camera are respectively perpendicular to the connection between the first camera and the second camera, and the mobile terminal having the binocular camera includes:

The photographing module is configured to control the first camera and the second camera to take a photo with the same photographing parameter when receiving the wide-angle photographing instruction, wherein the first camera after the rotation a sum of an angle between a head and a plane in which the own rotation axis is located and an angle between the rotated second camera and a plane in which the rotation axis thereof is located is greater than zero, and smaller than the first camera and the second One-half of the sum of the field of view of the camera;

a photo acquisition module, configured to acquire a first photo taken by the first camera and a second photo taken by the second camera;

The photo synthesis module is configured to splicing and synthesizing the first photo and the second photo to obtain a wide-angle photo.

Optionally, the camera module includes:

The angle adjustment unit is configured to control the first camera and the second camera to rotate to a first preset angle and a second preset angle respectively when receiving the wide-angle photographing instruction, and turn on the first camera and the second camera Wherein the sum of the first preset angle and the second preset angle is greater than zero and less than one-half of a sum of field angles of the first camera and the second camera;

The photographing unit is configured to set the first camera and the second camera to the same photographing parameter, and perform photographing according to the photographing parameter.

Optionally, the photographing unit is configured to set the first camera and the second camera to the same photographing parameter by adjusting the photographing parameter of the second camera to The first camera is consistent.

Optionally, the photo synthesis module includes:

The area dividing unit is configured to uniformly divide the first preset area of the first photo and the second preset area of the second photo into a preset number of sub-areas, respectively, and acquire each of the sub-areas Gray value

a sum determination unit configured to acquire a sum of grayscale differences of overlapping portions of each of the sub-regions of the first photo and each of the sub-regions of the second photo, and determine the grayscale difference Whether the sum is less than or equal to the preset value;

a photo synthesizing unit configured to: if the sum of the gradation difference values is less than or equal to the preset value, the first preset area of the first photo and the second pre-preparation of the second photo The region is fused to obtain the wide-angle photograph.

Optionally, the photo synthesis module further includes:

The area adjustment unit is configured to adjust a position of the first preset area on the first photo and/or the second preset area if the sum of the grayscale difference values is greater than the preset value At a position on the second photo, until the sum of the acquired gradation difference values is less than or equal to the preset value.

Optionally, the photographing parameters include: exposure value, exposure time, sensitivity, and aperture size.

Optionally, the photo synthesis module is configured to perform splicing and synthesizing the first photo and the second photo to obtain a wide-angle photo by:

Using pixel matching to determine the overlapping area of the two photos;

Gray scale adjustment using a histogram matching method;

Seamless splicing of images is done using a weighted smoothing algorithm.

Optionally, the sum determination unit is configured to superimpose the preset regions of the first photo and the second photo, calculate a sum of grayscale differences of the sub-regions corresponding to each of the two photos, and determine Whether the sum of the gradation difference values is less than or equal to a preset value.

Optionally, the photographing unit is configured to set the first camera and the second camera to the same photographing parameter by:

Adjusting the photographing parameter of the first camera to be consistent with the second camera.

Optionally, the first preset area and the second preset area are respectively an area having overlapping portions in the first photo and the second photo.

In addition, an embodiment of the present invention further provides a photographing method of a mobile terminal having a binocular camera, the mobile terminal includes a first camera and a second camera, and the first camera and the second camera are disposed opposite to each other. Rotating the mobile terminal, the rotation axes of the first camera and the second camera are perpendicular to the connection between the first camera and the second camera, respectively, and the photographing method of the mobile terminal with the binocular camera include:

When receiving the wide-angle photographing instruction, controlling the first camera and the second camera to take a photograph with the same photographing parameter, wherein an angle between the rotated first camera and a plane where the rotation axis of the rotation is located a sum of angles between the rotated second camera and a plane in which the own rotation axis is located is greater than zero, and smaller than the views of the first camera and the second camera One-half of the sum of the field angles;

Obtaining a first photo taken by the first camera and a second photo taken by the second camera;

The first photo and the second photo are spliced and combined to obtain a wide-angle photograph.

Optionally, the step of controlling the first camera and the second camera to take a photo with the same camera parameter when receiving the wide-angle camera instruction comprises:

When receiving the wide-angle photographing instruction, controlling the first camera and the second camera to respectively rotate to a first preset angle and a second preset angle, and turn on the first camera and the second camera, wherein the first a sum of a preset angle and the second preset angle is greater than zero and less than one-half of a sum of field angles of the first camera and the second camera;

The first camera and the second camera are set to the same photographing parameter, and photographing is performed according to the photographing parameter.

Optionally, the step of setting the first camera and the second camera to the same camera parameter comprises:

Adjusting the photographing parameter of the second camera to be consistent with the first camera.

Optionally, the step of splicing and synthesizing the first photo and the second photo to obtain a wide-angle photo includes:

Separating the first preset area of the first photo and the second preset area of the second photo into a preset number of sub-areas, respectively, and acquiring gray values of each of the sub-areas;

Obtaining a sum of overlapping partial gradation differences of each of the sub-regions of the first photo and each of the sub-regions of the second photo, and determining whether a sum of the gradation differences is less than or equal to default value;

If the sum of the grayscale differences is less than or equal to the preset value, the first preset area of the first photo and the second preset area of the second photo are merged to obtain a A wide-angle photo.

Optionally, the step of splicing and synthesizing the first photo and the second photo to obtain a wide-angle photo further comprises: acquiring each of the sub-regions and the second photo of the first photo a sum of grayscale differences of overlapping portions of each of said sub-regions, and determining a sum of said grayscale differences After the step of being less than or equal to the preset value,

Adjusting a position of the first preset area on the first photo and/or the second preset area in the second photo if the sum of the grayscale differences is greater than the preset value The upper position until the sum of the acquired gradation difference values is less than or equal to the preset value.

Optionally, the splicing and synthesizing the first photo and the second photo to obtain a wide-angle photo includes:

Using pixel matching to determine the overlapping area of the two photos;

Gray scale adjustment using a histogram matching method;

Seamless splicing of images is done using a weighted smoothing algorithm.

Optionally, the sum of the gradation difference values of the overlapping portions of each of the sub-regions of the first photo and each of the sub-regions of the second photo is:

The preset areas of the first photo and the second photo are superimposed, and the sum of the gradation differences of the sub-regions corresponding to each of the two photos is calculated.

The mobile terminal with binocular camera and the photographing method thereof according to the embodiment of the present invention rotates the first camera and the second camera to a certain angle when the wide-angle photographing is performed, so that part of the field of view of the two cameras overlaps, and the first The camera and the second camera simultaneously take a picture, and the obtained two photos are spliced and combined to obtain a wide-angle photo. The mobile terminal and the photographing method thereof in the embodiment of the invention do not need to use an external lens module, and do not need to rotate the mobile phone when taking a photo. You can take wide-angle photos with good image quality quickly and easily.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a schematic structural diagram of hardware of a mobile terminal that implements various embodiments of the present invention;

Figure 2 is a block diagram showing the electrical structure of the camera of Figure 1;

3 is a schematic diagram of functional modules of a first embodiment of a mobile terminal having a binocular camera according to the present invention;

4 is a schematic structural diagram of a first embodiment of a mobile terminal having a binocular camera according to the present invention;

5 is a schematic view showing a field of view of a camera of a first embodiment of a mobile terminal having a binocular camera;

6 is a schematic diagram of a refinement function module of a camera module in a second embodiment of a mobile terminal having a binocular camera according to the present invention;

7 is a schematic diagram of a refinement function module of a photo synthesizing module in a third embodiment of a mobile terminal having a binocular camera according to the present invention;

8 is a schematic diagram of a photo area division manner in a third embodiment of a mobile terminal having a binocular camera according to the present invention;

9 is a flowchart of a first embodiment of a photographing method of a mobile terminal having a binocular camera according to the present invention;

FIG. 10 is a schematic flowchart showing a refinement of a photographing step of a second embodiment of a photographing method for a mobile terminal having a binocular camera;

FIG. 11 is a refinement flow diagram of a photo synthesizing step of a third embodiment of a photographing method for a mobile terminal having a binocular camera according to the present invention.

Embodiments of the invention

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, the suffixes such as "module", "part" or "unit" set to represent elements are only used. The description that facilitates the embodiments of the present invention does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

The mobile terminal can be implemented in various forms. For example, the terminal described in the embodiments of the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device Mobile terminals of the like and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that the configuration of an embodiment in accordance with an embodiment of the present invention can be applied to a fixed type of terminal, in addition to elements that are specifically for mobile purposes.

FIG. 1 is a schematic diagram showing the hardware structure of a mobile terminal embodying various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190. and many more. Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication device or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel can include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to the terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Moreover, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of Digital Multimedia Broadcasting (DMB) Electronic Program Guide (EPG), Digital Video Broadcasting Handheld (DVB-H) Electronic Service Guide (ESG), and the like. . The broadcast receiving module 111 can receive a signal broadcast by using various types of broadcast apparatuses. In particular, the broadcast receiving module 111 can use forward link media (MediaFLO) by using, for example, multimedia broadcast-terrestrial (DMB-T), digital multimedia broadcast-satellite (DMB-S), digital video broadcast-handheld (DVB-H) The digital broadcasting device of the ^@ ) data broadcasting device, the terrestrial digital broadcasting integrated service (ISDB-T), and the like receives the digital broadcasting. The broadcast receiving module 111 can be constructed as various broadcast apparatuses suitable for providing broadcast signals as well as the above-described digital broadcast apparatuses. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module can be internally or externally coupled to the terminal. The wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .

The short range communication module 114 is a module that is configured to support short range communication. Some examples of short-range communication technology include Bluetooth ^TM, a radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. ^TM.

The location information module 115 is a module configured to check or acquire location information of the mobile terminal. A typical example of a location information module is a GPS (Global Positioning Device). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate three-dimensional current position information based on longitude, latitude, and altitude. Currently, the method for calculating position and time information uses three satellites and corrects the calculated position and time information errors by using another satellite. Further, the GPS module 115 is capable of calculating speed information by continuously calculating current position information in real time.

The A/V input unit 120 is arranged to receive an audio or video signal. The A/V input unit 120 may include a camera 121 and a microphone 122 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode. The processed image frame can be displayed on the display unit 151. Image frames processed by camera 121 can be stored in storage The transmitter 160 (or other storage medium) transmits or transmits via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal. The microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data. The processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode. The microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal. The user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc. In particular, when the touch panel is superimposed on the display unit 151 in the form of a layer, a touch screen can be formed.

The sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal. The orientation of 100, the acceleration of the mobile terminal 100 or the speed of movement and direction, and the like, and generates a command or signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide type mobile phone, the sensing unit 140 can sense whether the slide type phone is turned on or off. In addition, the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device. Sensing unit 140 may include proximity sensor 1410 which will be described below in connection with a touch screen.

The interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port configured to connect a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The identification module may be stored to verify various information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter referred to as "identification device") may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device. The interface unit 170 can be configured to receive input (eg, data information, power, etc.) from an external device and And the received input is transmitted to one or more components within the mobile terminal 100 or may be arranged to transfer data between the mobile terminal and an external device.

In addition, when the mobile terminal 100 is connected to the external base, the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a transmission of various command signals allowing input from the base to the mobile terminal 100 The path to the terminal. Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base. Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch panel are superposed on each other in the form of a layer to form a touch screen, the display unit 151 can function as an input device and an output device. The display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. According to a particular desired embodiment, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) . The touch screen can be set to detect touch input pressure as well as touch input position and touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like. The audio signal is output as sound. Moreover, the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100. Audio output module 152 It may include a pickup, a buzzer, and the like.

The alarm unit 153 can provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alert unit 153 can provide an output in a different manner to notify of the occurrence of an event. For example, the alarm unit 153 can provide an output in the form of vibrations, and when a call, message, or some other incoming communication is received, the alarm unit 153 can provide a tactile output (ie, vibration) to notify the user of it. By providing such a tactile output, the user is able to recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 can also provide an output of the notification event occurrence via the display unit 151 or the audio output module 152.

The memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. Moreover, the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 configured to reproduce (or play back) multimedia data, which may be constructed within the controller 180 or may be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.

The various embodiments described herein can be used, for example, in computer software, hardware, or any group thereof. The computer readable medium is implemented. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.

So far, the mobile terminal has been described in terms of its function. Hereinafter, for the sake of brevity, a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the embodiment of the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

2, FIG. 2 is a block diagram of the electrical structure of the camera of FIG. 1.

The photographic lens 1211 is composed of a plurality of optical lenses provided to form a subject image, and is a single focus lens or a zoom lens. The photographic lens 1211 is movable in the optical axis direction under the control of the lens driver 1221, and the lens driver 1221 controls the focus position of the photographic lens 1211 in accordance with a control signal from the lens driving control circuit 1222, and can also be controlled in the case of the zoom lens. Focus distance. The lens drive control circuit 1222 performs drive control of the lens driver 1221 in accordance with a control command from the microcomputer 1217.

An imaging element 1212 is disposed on the optical axis of the photographic lens 1211 near the position of the subject image formed by the photographic lens 1211. The imaging element 1212 is provided to image the subject image and acquire captured image data. Photodiodes constituting each pixel are arranged two-dimensionally and in a matrix on the imaging element 1212. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, which is subjected to charge accumulation by a capacitor connected to each photodiode. The front surface of each pixel is provided with a Bayer-arranged red, green and blue RGB color filter.

The imaging element 1212 is connected to the imaging circuit 1213. The imaging circuit 1213 performs charge accumulation control and image signal readout control in the imaging element 1212, and performs waveform shaping after reducing the reset noise of the read image signal (analog image signal). Further, gain improvement, etc., to become an appropriate signal power level.

The imaging circuit 1213 is connected to an A/D converter 1214 that performs analog-to-digital conversion on the analog image signal and outputs a digital image signal (hereinafter referred to as image data) to the bus 1227.

The bus 1227 is a transmission path set to transfer a variety of data read or generated inside the camera. The A/D converter 1214 is connected to the bus 1227, and an image processor 1215, a JPEG processor 1216, a microcomputer 1217, a Synchronous Dynamic Random Access Memory (SDRAM) 1218, and a memory interface are also connected. (hereinafter referred to as a memory I/F) 1219, a liquid crystal display (LCD) driver 1220.

The image processor 1215 performs optical black (OB) subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, and simultaneous processing on the image data based on the output of the imaging element 1212. Various image processing such as edge processing. The JPEG processor 1216 compresses the image data read out from the SDRAM 1218 in accordance with the JPEG compression method when the image data is recorded on the recording medium 1225. Further, the JPEG processor 1216 performs decompression of JPEG image data for image reproduction display. At the time of decompression, the file recorded on the recording medium 1225 is read, and after the compression processing is performed in the JPEG processor 1216, the decompressed image data is temporarily stored in the SDRAM 1218 and displayed on the LCD 1226. Further, in the present embodiment, the JPEG method is adopted as the image compression/decompression method. However, the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.

The microcomputer 1217 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 1217 is connected to the operation unit 1223 and the flash memory 1224.

The operating unit 1223 includes, but is not limited to, a physical button or a virtual button, and the entity or virtual button may be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, an enlarge button The operation controls such as various input buttons and various input keys detect the operational state of these operation controls.

The detection result is output to the microcomputer 1217. Further, a touch panel is provided on the front surface of the LCD 1226 as a display, and the touch position of the user is detected, and the touch position is output to the microcomputer 1217. The microcomputer 1217 executes various processing sequences corresponding to the user's operation in accordance with the detection result from the operation position of the operation unit 1223.

The flash memory 1224 stores programs for executing various processing sequences of the microcomputer 1217. The microcomputer 1217 performs overall control of the camera in accordance with the program. Further, the flash memory 1224 stores various adjustment values of the camera, and the microcomputer 1217 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.

The SDRAM 1218 is an electrically rewritable volatile memory that is set to temporarily store image data or the like. The SDRAM 1218 temporarily stores image data output from the A/D converter 1214 and image data processed in the image processor 1215, the JPEG processor 1216, and the like.

The memory interface 1219 is connected to the recording medium 1225, and performs control for writing image data and a file header attached to the image data to the recording medium 1225 and reading out from the recording medium 1225. The recording medium 1225 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body. However, the recording medium 1225 is not limited thereto, and may be a hard disk or the like built in the camera body.

The LCD driver 1210 is connected to the LCD 1226, and stores image data processed by the image processor 1215 in the SDRAM 1218. When display is required, the image data stored in the SDRAM 1218 is read and displayed on the LCD 1226, or the image data stored in the JPEG processor 1216 is compressed. In the SDRAM 1218, when display is required, the JPEG processor 1216 reads the compressed image data of the SDRAM 1218, decompresses it, and displays the decompressed image data through the LCD 1226.

The LCD 1226 is configured to display an image on the back of the camera body. The LCD 1226 LCD) is not limited thereto, and various display panels (LCD 1226) such as an organic EL may be used. However, the present invention is not limited thereto, and various display panels such as an organic EL may be used.

Based on the hardware structure of the above mobile terminal and the electrical structure diagram of the camera, various embodiments of the method of the present invention are proposed.

Embodiments of the present invention provide a mobile terminal having a binocular camera.

Referring to FIG. 3, it is a schematic diagram of a first embodiment of a mobile terminal having a binocular camera of the present invention.

In the first embodiment, the mobile terminal having a binocular camera includes:

The photographing module 10 is configured to control the first camera and the second camera to take photos with the same photographing parameter when receiving the wide-angle photographing instruction, wherein the rotated first camera and the plane where the rotating shaft is located Angle and rotation of the second camera and its own rotation The sum of the angles between the planes in which the axes are located is greater than zero and less than one-half the sum of the field of view angles of the first camera and the second camera.

It should be noted that the mobile terminal includes a first camera and a second camera, and the first camera and the second camera are rotatable relative to the mobile terminal, and the first camera and the second camera are The rotation axes are respectively perpendicular to a line connecting the first camera and the second camera.

Referring to FIG. 4, which is a schematic diagram of an embodiment of a mobile terminal according to the embodiment, the first camera and the second camera are located on the left and right sides of the back of the mobile terminal, and are rotatable relative to the mobile terminal. In this embodiment, The field of view of the camera and the second camera are equal, and the natural coordinate system built in the mobile terminal is used as the reference coordinate system, and the rotation axis of the first camera and the rotation axis of the second camera are arranged in parallel on the same horizontal line or vertical line, and When shooting a wide-angle photo, the maximum adjustable angle of the first camera is one-third of its field of view angle, and when the first camera and the second camera are both rotated to the maximum adjustable angle, their horizontal view There must be at least one-third of the coincident area between the field angle or the vertical field of view.

Wherein, the camera can be automatically rotated or manually rotated. When the camera is manually rotated, a limit mechanism can be set to limit the maximum adjustable angle of the first camera and the second camera, or when the user performs manual adjustment according to the display. The shooting screen adjusts the rotation angle of the camera; when the camera is automatically rotated, the user can preset the rotation angle. When the camera module 10 starts the camera according to the wide-angle camera command, the two cameras automatically rotate to the set angle, and the user can also Adjust the rotation angle of the camera according to the displayed shooting screen. It should be noted that when the camera is rotated, the rotation angles of the first camera and the second camera may be different, and may be set by the user.

In other embodiments, the maximum adjustable angle of the camera can be set according to requirements, and the rotation axis of the first camera and the rotation axis of the second camera are arranged in parallel and perpendicular to the connection between the two cameras. Referring to FIG. 5, it is a schematic diagram of the field of view of the camera of the mobile terminal in the embodiment. The angle between L2 and L5 is the angle of view of the initial positions of the two cameras, that is, the camera is parallel to the terminal surface and is not rotated. The angle of view of the time; the angle between L1 and L4 is the angle of view of the left camera (first camera) rotated to the left by a certain angle, and the angle between L3 and L6 is the right camera (second camera) ) The angle of view after rotating a certain angle to the right, the angle between L3 and L4 is the first The portion where the angle of view overlaps after the camera and the second camera rotate, and the angle between L1 and L6 is the total angle of view formed after the rotation of the first camera and the second camera.

It should be noted that, in other embodiments, the positions of the first camera and the second camera may be set as needed, and the angles of view of the first camera and the second camera may also be different. For example, the first camera adopts an equivalent focal length. The camera with a 35 mm field of view and a viewing angle of 63°, the second camera uses a camera with an equivalent focal length of 28 mm and an angle of view of 75°. When the user does not need to take a wide-angle photo, he can choose to use the camera instead of the camera. Take a photo. If the first camera and the second camera have the same angle of view, the equivalent focal lengths are also equal, and the resulting wide-angle photograph has a better imaging effect.

When the user uses the mobile terminal to take a wide-angle photo, the first camera and the second camera are rotated as needed, and adjusted to an appropriate angle for photographing. If the user only needs to take a general photo shooting, the camera does not need to be rotated. One of the first camera and the second camera is selected for taking a picture. When the user takes a wide-angle photo, the preset control on the mobile terminal can be triggered to issue a wide-angle camera instruction, and after receiving the wide-angle camera instruction, the mobile terminal turns on the first camera and the second camera to take a photo, because the user performs the photo before taking the photo. The adjustment of the angle of one camera and the second camera, if the two cameras are adjusted to the maximum adjustable angle, then the wide angle photo of the maximum angle is finally obtained. If the user does not adjust the angles of the first camera and the second camera, at this time, The fields of view of the first camera and the second camera substantially coincide, and the resulting first photo and second photo are substantially identical.

It should be noted that in order to ensure that the two parts of the stitched photo are consistent, a wide-angle photo with natural transition is obtained, and the photographing module 10 is set to set the photographing parameters of the two cameras to be the same, such as exposure value, exposure time, sensitivity. And aperture size and other parameters. When the camera parameters of the first camera and/or the second camera are adjusted, there may be multiple implementation manners. The following two methods are described: if the user adjusts the camera parameters of the second camera, And controlling the camera parameter of the first camera to be adjusted to be consistent with the second camera; in other embodiments, the default parameter value of the wide-angle camera may be preset, and after receiving the wide-angle camera command, the first The camera and the second camera directly adjust the camera parameters of the two cameras to the above default parameter values.

The photo acquisition module 20 is configured to acquire the first photo taken by the first camera and the first a second photo taken by two cameras;

The photo synthesizing module 30 is configured to splicing and synthesizing the first photo and the second photo to obtain a wide-angle photo.

The photo synthesizing module 30 is configured to splicing and synthesizing the first photo taken by the first camera and the second photo taken by the second camera to obtain a wide-angle photo. There may be multiple implementations of the stitching synthesis. Two of the following are listed: In an embodiment, the photo composition module 30 is configured to determine the overlapping area of the two photos using the pixel matching method; and then the histogram matching method is adopted. Perform grayscale adjustment; finally, use the weighted smoothing algorithm to complete seamless stitching of images. In another embodiment, the photo synthesizing module 30 is configured to splicing and merging two photos using an image splicing algorithm based on gradation difference, optionally dividing the two photos into a plurality of sub-regions uniformly, and then two The preset area of the photo is superimposed, and the sum of the gray difference values of the corresponding sub-areas of each of the two photos is calculated, and when the value of the sum is greater than the preset value, the preset area is adjusted on the photo. Position, when the sum of the gradation difference values of the corresponding sub-areas on the upper and lower two photos is less than or equal to the preset value, the preset areas of the two photos are spliced and merged, wherein the sub-area can be divided by the user according to the camera The pixels are adjusted, and the more the number of sub-regions, the higher the stitching precision, and the finer the overlapping portion of the stitched composite photograph obtained. In other embodiments, other stitching synthesis methods may also be used, which are not exemplified herein.

The photographing device of the mobile terminal with the binocular camera proposed in the embodiment rotates the first camera and the second camera to a certain angle when the wide-angle photographing is performed, so that part of the fields of view of the two cameras overlap, using the first camera and The second camera simultaneously performs photographing, and the obtained two photographs are stitched and combined to obtain a wide-angle photograph. In the embodiment of the invention, the external lens module is not needed, and the image quality can be conveniently and quickly photographed without rotating the mobile phone. Wide angle photo.

Referring to Fig. 6, a first embodiment of a photographing apparatus of a mobile terminal having a binocular camera according to the present invention proposes a second embodiment of a photographing apparatus of a mobile terminal having a binocular camera of the present invention. In this embodiment, the device is different from the first embodiment in that the camera module 10 includes the following units:

The angle adjusting unit 11 is configured to, when receiving the wide-angle photographing instruction, control the first camera and the second camera to rotate to the first preset angle and the second preset angle, respectively, and turn on the first a camera and a second camera, wherein a sum of the first preset angle and the second preset angle is greater than zero and less than a dichotomy of a sum of field angles of the first camera and the second camera One.

The photographing unit 12 is configured to set the first camera and the second camera to the same photographing parameter, and perform photographing according to the photographing parameter.

In this embodiment, the first camera and the second camera of the mobile terminal can control the rotation angle thereof through the terminal. When the user needs to take a wide-angle photo, the preset control on the mobile terminal can be triggered to issue a wide-angle camera command, and the angle adjusting unit 11 The first camera and the second camera are rotated to corresponding positions according to the rotation angle parameter preset by the user after receiving the wide-angle photographing instruction. If the user needs to adjust the first camera and the second camera, the terminal can be passed through the terminal. The corresponding control is adjusted, and the photographing unit 12 is set to set the first camera and the second camera to the same photographing parameter. In other embodiments, the photographing unit 12 is further configured to adjust the photographing parameter of the second camera to be consistent with the first camera, or adjust the photographing parameter of the first camera to the second camera. Consistent. For example, if the user adjusts the photographing parameters of the first camera, the photographing unit 12 is configured to adjust the photographing parameters of the second camera to be consistent with the first camera, and similarly, if the user makes the photographing parameters of the second camera. Adjusting, the photographing unit 12 adjusts the photographing parameters of the first camera to be consistent with the second camera.

The photographing device of the mobile terminal with the binocular camera proposed in the embodiment automatically controls the rotation angles of the two cameras when photographing, and can conveniently and accurately adjust the angle of the photographed wide-angle photograph when photographing.

Referring to Fig. 7, a first embodiment of a photographing apparatus of a mobile terminal having a binocular camera according to the present invention proposes a third embodiment of a photographing apparatus of a mobile terminal having a binocular camera of the present invention. In the present embodiment, the device is different from the first embodiment in that the photo synthesizing module 20 includes the following units:

The area dividing unit 21 is configured to uniformly divide the first preset area of the first photo and the second preset area of the second photo into a preset number of sub-areas, respectively, and acquire each of the sub-areas The gray value of the area.

And dividing the obtained first preset area and the second preset area of the second photo into a preset number of sub-areas, for example, may be divided into M*N squares, referring to the gray part in FIG. In the other embodiments, the entire area of the first photo and the second photo may also be divided. The larger the value of M and N is, the higher the splicing precision is. When each sub-region corresponds to one pixel, the splicing precision is the highest, wherein the first preset area and the second preset area are respectively the first photo and In the second photograph, there is an area of the overlapping portion, and in this embodiment, a partial area of one third of the edge adjacent to the photo may be selected.

a sum determining unit 22, configured to acquire a sum of gradation differences of each of the sub-regions of the first photo and each of the sub-regions of the second photo, and determine the grayscale difference Whether the sum of the values is less than or equal to the preset value.

The photo synthesizing unit 23 is configured to set the first preset area of the first photo and the second photo of the second photo if a sum of the gradation difference values is less than or equal to the preset value The preset area is fused to obtain the wide-angle photo.

Optionally, the sum determination unit 22 is configured to superimpose the first preset area and the second preset area, and calculate a sum of gradation difference values of each of the upper and lower corresponding sub-areas of the two photos, and determine the obtained Whether the sum is less than or equal to the preset value; the photo synthesizing unit 23 is configured to perform the preset areas of the two photos when the sum of the gradation difference values of the corresponding sub-areas on the upper and lower two photos is less than or equal to the preset value Splicing fusion.

Optionally, the mobile terminal with the binocular camera further includes:

When the sum of the gradation difference values of the corresponding sub-areas on the upper and lower two photos is greater than the preset value, the area adjustment unit is set to adjust the position of the preset area on the photo, and calculate the sum of the adjusted gradation difference values. Until the sum of the acquired gradation difference values is less than or equal to the preset value. Since the two photographs taken are on the same horizontal line, when the positions of the first preset area and/or the second preset area are adjusted, only the horizontal direction or the vertical direction needs to be adjusted, according to the direction of the photographed photograph. Deciding, for example, that the position of the first preset area on the first photo and/or the position of the second preset area on the second photo may be adjusted with reference to the adjustment direction in FIG. 8 or opposite to the direction shown in the figure The direction.

In other embodiments, when the photo is synthesized, the first preset area and the second preset area are all or partially superimposed, and the positions of the first preset area and/or the second preset area are adjusted, so that The sub-region of a photo corresponds to the next sub-region of the second photo, and the sum of the gray-scale differences of the sub-regions corresponding to each of the two photos is calculated, and the gray of the corresponding sub-regions on the upper and lower photos is calculated. When the sum of the differences is the smallest, the matching positions of the two photos are overlapped, and the overlapping portions of the first photo and the second photo are merged according to the matching position to obtain a wide-angle photo.

The photographing device of the mobile terminal with the binocular camera proposed in the embodiment uses the image stitching algorithm based on the gray scale difference to splicing and merging the two photos. The algorithm combines the speed of stitching and combining, has high stitching precision, and can obtain good image quality. Wide angle photo.

The embodiment of the invention further provides a photographing method for a mobile terminal with a binocular camera.

FIG. 9 is a flowchart of a first embodiment of a photographing method of a mobile terminal having a binocular camera according to the present invention.

In the first embodiment, the photographing method of the mobile terminal having the binocular camera includes:

Step S10, when receiving the wide-angle photographing instruction, controlling the first camera and the second camera to take a photograph with the same photographing parameter, wherein the rotated first camera and the plane where the rotation axis of the rotation is located The angle between the angle and the angle between the rotated second camera and the plane in which the rotation axis of the rotation is located is greater than zero, and is smaller than the sum of the angles of the fields of view of the first camera and the second camera. one.

It should be noted that the mobile terminal includes a first camera and a second camera, and the first camera and the second camera are rotatable relative to the mobile terminal, and the first camera and the second camera are The axis of rotation is perpendicular to a line between the first camera and the second camera.

Referring to FIG. 4, which is a schematic diagram of an embodiment of a mobile terminal according to the embodiment, the first camera and the second camera are located on the left and right sides of the back of the mobile terminal, and are rotatable relative to the mobile terminal. In this embodiment, The field of view of the camera and the second camera are equal, and the natural coordinate system built in the mobile terminal is used as the reference coordinate system, and the rotation axis of the first camera and the rotation axis of the second camera are arranged in parallel on the same horizontal line or vertical line, and When shooting a wide-angle photo, the maximum adjustable angle of the first camera is one-third of its field of view, when the first camera and the first When both cameras are rotated to the maximum adjustable angle, there must be at least one-third of the overlap between their horizontal or vertical field of view.

Wherein, the camera can be automatically rotated or manually rotated. When the camera is manually rotated, a limit mechanism can be set to limit the maximum adjustable angle of the first camera and the second camera, or when the user performs manual adjustment according to the display. The shooting screen adjusts the rotation angle of the camera; when the camera is automatically rotated, the user can preset the rotation angle. When the camera is activated according to the wide-angle camera command, the two cameras automatically rotate to the set angle, and the user can also display according to the The shooting screen adjusts the rotation angle of the camera. It should be noted that when the camera is rotated, the rotation angles of the first camera and the second camera may be different, and may be set by the user.

In other embodiments, the maximum adjustable angle of the camera can be set according to requirements, and the rotation axis of the first camera and the rotation axis of the second camera are arranged in parallel and perpendicular to the connection between the two cameras. Referring to FIG. 5, it is a schematic diagram of the field of view of the camera of the mobile terminal in the embodiment. The angle between L2 and L5 is the angle of view of the initial positions of the two cameras, that is, the camera is parallel to the terminal surface and is not rotated. The angle of view of the time; the angle between L1 and L4 is the angle of view of the left camera (first camera) rotated to the left by a certain angle, and the angle between L3 and L6 is the right camera (second camera) The angle of view after rotating to the right by a certain angle, the angle between L3 and L4 is the portion where the field of view overlaps after the first camera and the second camera rotate, and the angle between L1 and L6 is the first camera and The total field of view angle formed after the second camera is rotated.

It should be noted that, in other embodiments, the positions of the first camera and the second camera may be set as needed, and the angles of view of the first camera and the second camera may also be different. For example, the first camera adopts an equivalent focal length. 35mm camera with a viewing angle of 63°, the second camera has an equivalent focal length of 28 mm and an angle of view of 75° The camera, when the user does not need to take a wide-angle photo, you can choose to use the camera without using the camera as needed. If the first camera and the second camera have the same angle of view, the equivalent focal lengths are also equal, and the resulting wide-angle photograph has a better imaging effect.

When the user uses the mobile terminal to take a wide-angle photo, the first camera and the second camera are rotated as needed, and adjusted to an appropriate angle for photographing. If the user only needs to take a general photo shooting, the camera does not need to be rotated. Select one of the first camera and the second camera Take a photo. When the user takes a wide-angle photo, the preset control on the mobile terminal can be triggered to issue a wide-angle camera instruction, and after receiving the wide-angle camera instruction, the mobile terminal turns on the first camera and the second camera to take a photo, because the user performs the photo before taking the photo. The adjustment of the angle of one camera and the second camera, if the two cameras are adjusted to the maximum adjustable angle, then the wide angle photo of the maximum angle is finally obtained. If the user does not adjust the angles of the first camera and the second camera, at this time, The fields of view of the first camera and the second camera substantially coincide, and the resulting first photo and second photo are substantially identical.

It should be noted that in order to ensure that the two parts of the stitched photo are consistent, a wide-angle photo with natural transition is obtained, and the photographing parameters of the two cameras are set to be the same when photographing, such as exposure value, exposure time, sensitivity and aperture. Parameters such as size. When the camera parameters of the first camera and/or the second camera are adjusted, there may be multiple implementation manners. The following two methods are described: if the user adjusts the camera parameters of the second camera, And controlling the camera parameter of the first camera to be adjusted to be consistent with the second camera; in other embodiments, the default parameter value of the wide-angle camera may be preset, and after receiving the wide-angle camera command, the first The camera and the second camera directly adjust the camera parameters of the two cameras to the above default parameter values.

Step S20, acquiring a first photo taken by the first camera and a second photo taken by the second camera;

Step S30, the first photo and the second photo are spliced and combined to obtain a wide-angle photo.

The first photo taken by the first camera and the second photo taken by the second camera are stitched and combined to obtain a wide-angle photo. There may be multiple implementations of the stitching synthesis. Two ways are listed below: in one embodiment, the pixel matching method is used to determine the overlapping area of the two photos; then the histogram matching method is used for gray scale adjustment; Seamless splicing of images is done using a weighted smoothing algorithm. In another embodiment, the two photos are spliced and merged using an image mosaic algorithm based on gray scale difference. Optionally, the two photos are evenly divided into a plurality of sub-regions, and then the preset regions of the two photos are respectively divided. Perform superposition, and calculate the sum of the gradation differences of the corresponding sub-regions of the two photos. When the value of the sum is greater than the preset value, adjust the position of the preset region on the photo, when the upper and lower two When the sum of the gradation differences of the corresponding sub-areas on the photo is less than or equal to the preset value, the preset areas of the two photos are spliced and fused, wherein the division of the sub-areas can be adjusted by the user according to the pixels of the camera. The more the number of regions, the higher the stitching accuracy. The finer the overlapping portion of the stitched composite photo is. In other embodiments, other stitching synthesis methods may also be used, which are not exemplified herein.

The photographing method of the mobile terminal with the binocular camera proposed in this embodiment rotates the first camera and the second camera to a certain angle when the wide-angle photographing is performed, so that part of the fields of view of the two cameras overlap, using the first camera and The second camera simultaneously performs photographing, and the obtained two photographs are stitched and combined to obtain a wide-angle photograph. The mobile terminal and the photographing method thereof in the embodiment of the invention do not need to use an external lens module, and the mobile phone does not need to be rotated when photographing. Take wide-angle photos with good image quality quickly and easily.

Referring to FIG. 10, a first embodiment of a photographing method of a mobile terminal having a binocular camera according to the present invention proposes a second embodiment of a photographing method of a mobile terminal having a binocular camera of the present invention. In this embodiment, the method differs from the first embodiment in that step S10 includes the following refinement steps:

In step S11, when the wide-angle photographing instruction is received, the first camera and the second camera are respectively rotated to a first preset angle and a second preset angle, and the first camera and the second camera are turned on, wherein The sum of the first preset angle and the second preset angle is greater than zero and less than one-half of a sum of field angles of the first camera and the second camera.

Step S12: The first camera and the second camera are set to the same camera parameter, and the camera is taken according to the camera parameter.

In this embodiment, the first camera and the second camera of the mobile terminal can control the rotation angle of the terminal through the terminal. When the user needs to take a wide-angle photo, the preset control on the mobile terminal can be triggered to issue a wide-angle camera instruction, and the mobile terminal is receiving. After the wide-angle photographing instruction, the first camera and the second camera can be rotated to corresponding positions according to the rotation angle parameter preset by the user. If the user needs to adjust the first camera and the second camera, the corresponding control on the terminal can be performed. Adjustment.

The photographing method of the mobile terminal with the binocular camera proposed in the embodiment automatically controls the rotation angles of the two cameras when photographing, and can conveniently and accurately adjust the angle of the photographed wide-angle photograph when photographing.

Referring to Fig. 11, a first embodiment of a photographing method of a mobile terminal having a binocular camera according to the present invention proposes a third embodiment of a photographing method of a mobile terminal having a binocular camera of the present invention. In this embodiment, the method differs from the first embodiment in that step S20 includes the following refinement steps:

Step S21, uniformly dividing the first preset area of the first photo and the second preset area of the second photo into a preset number of sub-areas, respectively, and acquiring gray levels of each of the sub-areas value.

And dividing the obtained first preset area and the second preset area of the second photo into a preset number of sub-areas, for example, may be divided into M*N squares, as shown in the gray part of FIG. In other embodiments, the entire area of the first photo and the second photo may also be divided. Wherein, the values of M and N can be adjusted according to the pixels of the camera, and the gray value of each sub-region is an average value of the gray values of each pixel included in the region. The larger the value of M and N is, the higher the splicing precision is. When each sub-region corresponds to one pixel, the splicing precision is the highest, wherein the first preset area and the second preset area are respectively the first photo and In the second photograph, there is an area of the overlapping portion, and in this embodiment, a partial area of one third of the edge adjacent to the photo may be selected.

Step S22, acquiring a sum of grayscale differences of overlapping portions of each of the sub-regions of the first photo and each of the sub-regions of the second photo, and determining whether the sum of the grayscale differences is Less than or equal to the preset value.

Step S23, if the sum of the gradation difference values is less than or equal to the preset value, performing the first preset area of the first photo and the second preset area of the second photo The wide angle photograph is obtained by fusion.

Superimposing the first preset area and the second preset area, and calculating the sum of the gray difference values of the corresponding sub-areas of the two photos, and the gray difference of the corresponding sub-areas on the upper and lower two photos When the sum of the values is less than or equal to the preset value, the preset areas of the two photos are spliced and fused.

Optionally, after step S22, the method further includes:

When the sum of the grayscale differences of the corresponding sub-regions on the upper and lower photos is greater than the preset value, the position of the preset region on the photo is adjusted, and the sum of the adjusted grayscale differences is calculated until the obtained The sum of the gradation differences is less than or equal to the preset value. Since the two photographs taken are on the same horizontal line, when the positions of the first preset area and/or the second preset area are adjusted, only the horizontal direction or the vertical direction needs to be adjusted, according to the direction of the photographed photograph. Deciding, for example, that the position of the first preset area on the first photo and/or the position of the second preset area on the second photo may be adjusted with reference to the adjustment direction in FIG. 8 or opposite to the direction shown in the figure The direction.

The photographing method of the mobile terminal with the binocular camera proposed in this embodiment uses the image stitching algorithm based on the gray scale difference to splicing and merging two photos. The algorithm combines the speed of stitching and combining, has high stitching precision, and can obtain good image quality. Wide angle photo.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present invention in essence or the contribution to the related art can be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM). The instructions include a number of instructions for causing a terminal device (which may be a cell phone, computer, server, air conditioner, or network device, etc.) to perform the methods described in various embodiments of the present invention.

The above is only an alternative embodiment of the present invention, and thus does not limit the scope of the invention, and the equivalent structure or equivalent process transformation made by using the specification and the drawings of the present invention, or directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.

Industrial applicability

The above technical solution does not need to use an external lens module, and can take a wide-angle photo with good image quality conveniently and quickly without rotating the mobile phone when taking a photo.

Claims

A mobile terminal having a binocular camera, the mobile terminal comprising:

a first camera and a second camera, the first camera and the second camera are arranged to rotate relative to the mobile terminal, and the rotation axes of the first camera and the second camera are perpendicular to the first a connection between the camera and the second camera;

The photographing module is configured to, when receiving the wide-angle photographing instruction, control the first camera and the second camera to take photographs with the same photographing parameter, wherein the rotated first plane of the first camera and its own rotating axis The sum of the angle between the angle and the angle between the rotated second camera and the plane in which the own rotation axis is located is greater than zero, and is smaller than the sum of the angles of view of the first camera and the second camera. Half;

a photo acquisition module, configured to acquire a first photo taken by the first camera and a second photo taken by the second camera;

The photo synthesis module is configured to splicing and synthesizing the first photo and the second photo to obtain a wide-angle photo.
The mobile terminal with a binocular camera according to claim 1, wherein the camera module comprises:

The angle adjustment unit is configured to control the first camera and the second camera to rotate to a first preset angle and a second preset angle respectively when receiving the wide-angle photographing instruction, and turn on the first camera and the second camera Wherein the sum of the first preset angle and the second preset angle is greater than zero and less than one-half of a sum of field angles of the first camera and the second camera;

The photographing unit is configured to set the first camera and the second camera to the same photographing parameter, and perform photographing according to the photographing parameter.
The mobile terminal with a binocular camera according to claim 2, wherein the photographing unit is configured to set the first camera and the second camera to the same photographing parameter by:

Adjusting the photographing parameter of the second camera to be consistent with the first camera.
The mobile terminal with a binocular camera according to claim 1, wherein the photo synthesizing module comprises:

The area dividing unit is configured to uniformly divide the first preset area of the first photo and the second preset area of the second photo into a preset number of sub-areas, respectively, and acquire each of the sub-areas Gray value

a sum determination unit configured to acquire a sum of grayscale differences of overlapping portions of each of the sub-regions of the first photo and each of the sub-regions of the second photo, and determine the grayscale difference Whether the sum is less than or equal to the preset value;

a photo synthesizing unit configured to: if the sum of the gradation difference values is less than or equal to the preset value, the first preset area of the first photo and the second pre-preparation of the second photo The region is fused to obtain the wide-angle photograph.
The mobile terminal with a binocular camera according to claim 4, the photo synthesizing module further comprising:

The area adjustment unit is configured to adjust a position of the first preset area on the first photo and/or the second preset area if the sum of the grayscale difference values is greater than the preset value At a position on the second photo, until the sum of the acquired gradation difference values is less than or equal to the preset value.
A mobile terminal having a binocular camera according to claim 1, wherein

Photographing parameters include: exposure value, exposure time, sensitivity and aperture size.
The mobile terminal with a binocular camera according to claim 1, wherein the photo synthesizing module is configured to perform splicing and synthesizing the first photo and the second photo to obtain a wide-angle photo by:

Using pixel matching to determine the overlapping area of the two photos;

Gray scale adjustment using a histogram matching method;

Seamless splicing of images is done using a weighted smoothing algorithm.
A mobile terminal having a binocular camera according to claim 4, wherein

The sum determination unit is configured to superimpose the preset areas of the first photo and the second photo, calculate a sum of gradation difference values of each of the upper and lower corresponding sub-regions of the two photos, and determine the gray scale Whether the sum of the differences is less than or equal to the preset value.
The mobile terminal with a binocular camera according to claim 2, wherein the photographing unit is configured to set the first camera and the second camera to the same photographing parameter by:

Adjusting the photographing parameter of the first camera to be consistent with the second camera.
A mobile terminal having a binocular camera according to claim 4, wherein

The first preset area, and the second preset area are respectively an area having overlapping portions in the first photo and the second photo.
A photographing method for a mobile terminal having a binocular camera, the mobile terminal comprising a first camera and a second camera, the first camera and the second camera being arranged to rotate relative to the mobile terminal, the first The rotation axes of a camera and the second camera are respectively perpendicular to the connection between the first camera and the second camera, and the photographing method of the mobile terminal with the binocular camera includes:

When receiving the wide-angle photographing instruction, controlling the first camera and the second camera to take a photograph with the same photographing parameter, wherein an angle between the rotated first camera and a plane where the rotation axis of the rotation is located a sum of angles between the rotated second camera and a plane in which the own rotation axis is located is greater than zero, and smaller than the views of the first camera and the second camera One-half of the sum of the field angles;

Obtaining a first photo taken by the first camera and a second photo taken by the second camera;

The first photo and the second photo are spliced and combined to obtain a wide-angle photograph.
The photographing method of a mobile terminal with a binocular camera according to claim 11, wherein when the wide-angle photographing instruction is received, the first camera and the second camera are controlled to take photographs with the same photographing parameter. The steps include:

When receiving the wide-angle photographing instruction, controlling the first camera and the second camera to respectively rotate to a first preset angle and a second preset angle, and turn on the first camera and the second camera, wherein the first a sum of a preset angle and the second preset angle is greater than zero and less than one-half of a sum of field angles of the first camera and the second camera;

The first camera and the second camera are set to the same photographing parameter, and photographing is performed according to the photographing parameter.
The photographing method of a mobile terminal with a binocular camera according to claim 12, wherein the step of setting the first camera and the second camera to the same photographing parameter comprises:

Adjusting the photographing parameter of the second camera to be consistent with the first camera.
The photographing method of a mobile terminal with a binocular camera according to claim 11, wherein the step of splicing and synthesizing the first photo and the second photo to obtain a wide-angle photo comprises:

Separating the first preset area of the first photo and the second preset area of the second photo into a preset number of sub-areas, respectively, and acquiring gray values of each of the sub-areas;

Obtaining a sum of overlapping partial gradation differences of each of the sub-regions of the first photo and each of the sub-regions of the second photo, and determining whether a sum of the gradation differences is less than or equal to default value;

If the sum of the grayscale differences is less than or equal to the preset value, the first preset area of the first photo and the second preset area of the second photo are merged to obtain a A wide-angle photo.
The method for photographing a mobile terminal with a binocular camera according to claim 14, wherein the step of splicing and synthesizing the first photo and the second photo to obtain a wide-angle photo further comprises:

And acquiring, by the sum of the gradation difference values of the overlapping portions of each of the sub-regions of the first photo and each of the sub-regions of the second photo, and determining whether the sum of the gradation differences is smaller than Or after the step of being equal to the preset value, if the sum of the grayscale differences is greater than the preset value, adjusting a position of the first preset area on the first photo and/or the second a position of the preset area on the second photo until the sum of the acquired gradation difference values is less than or equal to the preset value.
A photographing method of a mobile terminal having a binocular camera according to claim 11, wherein

Photographing parameters include: exposure value, exposure time, sensitivity and aperture size.
The method for photographing a mobile terminal with a binocular camera according to claim 11, wherein the splicing and combining the first photo and the second photo to obtain a wide-angle photo comprises:

Using pixel matching to determine the overlapping area of the two photos;

Gray scale adjustment using a histogram matching method;

Seamless splicing of images is done using a weighted smoothing algorithm.
The photographing method of a mobile terminal having a binocular camera according to claim 15, wherein said acquiring said each of said sub-area of said first photograph and said second photograph The sum of the grayscale differences of the overlapping portions of the subregions includes:

The preset areas of the first photo and the second photo are superimposed, and the sum of the gradation differences of the sub-regions corresponding to each of the two photos is calculated.
The photographing method of a mobile terminal with a binocular camera according to claim 12, wherein the step of setting the first camera and the second camera to the same photographing parameter comprises:

Adjusting the photographing parameter of the first camera to be consistent with the second camera.
A mobile terminal having a binocular camera according to claim 14, wherein

The first preset area, and the second preset area are respectively an area having overlapping portions in the first photo and the second photo.