WO2017107629A1

WO2017107629A1 - Mobile terminal, data transmission system and shooting method of mobile terminal

Info

Publication number: WO2017107629A1
Application number: PCT/CN2016/102389
Authority: WO
Inventors: 康雄
Original assignee: 努比亚技术有限公司
Priority date: 2015-12-24
Filing date: 2016-10-18
Publication date: 2017-06-29
Also published as: CN105516423A

Abstract

A mobile terminal comprises an image processing module, a storage module, a first data transmission port and a shooting control module communicatively connected to one another. The shooting control module is configured to control, upon detecting an add-on camera connected to a mobile terminal, the add-on camera on the basis of a received shooting command to collect raw image data with shooting parameters corresponding to the shooting command. The first data transmission port is configured to receive the raw image data transmitted by the add-on camera and transmit the raw image data to the image processing module. The image processing module is configured to perform a corresponding process on the raw image data on the basis of a received image processing command. The storage module is configured to store the raw image data processed by the image processing module. The above described solution allows an add-on camera to be light-weighted and easy to mount and carry, thereby enabling more convenient fitting and use of the add-on camera with a mobile terminal.

Description

Mobile terminal, data transmission system and mobile terminal shooting method

Technical field

The present application relates to, but is not limited to, the field of data transmission technologies, and in particular, to a mobile terminal, a data transmission system, and a mobile terminal photographing method.

Background technique

The camera of a mobile terminal (such as a smart phone) is generally fixed in the internal chip. When the user is not satisfied with the parameters of the camera of the mobile terminal, the upgrade and replacement cannot be performed. At present, people generally connect the external camera directly to the mobile terminal, but when the mobile terminal uses the external camera to shoot, the image storage and image processing are completed in the image processing module of the external camera, and then the external camera returns the processed image. To the mobile terminal, the external camera has a large size and weight due to the image processing module and the image storage module, so that the external camera and the mobile terminal are inconvenient to use together.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The main purpose of the present application is to provide a mobile terminal, a data transmission system, and a mobile terminal shooting method, which are intended to solve the technical problem that the external camera and the mobile terminal are inconvenient to use together.

An embodiment of the present invention provides a mobile terminal, where the mobile terminal includes an image processing module, a storage module, a first data transmission interface, and a shooting control module that are connected to each other, and the shooting control module is configured to detect that there is a plug-in camera. When the mobile terminal is connected, the external camera is controlled to collect the original image data according to the shooting parameters corresponding to the shooting instruction based on the received shooting instruction; the first data transmission interface is configured to receive the original image data sent by the external camera, and The original image data is sent to the image processing module, and the image processing module is configured to perform corresponding processing on the original image data based on the received image processing instruction; the storage module is configured to store the original image processed by the image processing module data.

Optionally, the shooting control module includes:

The detecting unit is configured to detect an optical parameter type of the external camera when detecting that the external camera is connected to the mobile terminal;

The shooting control unit is configured to, when the mobile terminal supports the optical parameter type of the external camera, control the external camera to collect the original image data according to the shooting parameter corresponding to the shooting instruction based on the received operation instruction.

Optionally, the image processing module is further configured to perform corresponding processing on the original image data to form inactive image data based on the received image processing instruction and an optical parameter type of the external camera;

The storage module is further configured to save the to-be-used image data into its memory.

Optionally, the optical parameter types include: aperture type, filter type, focus type, and lens type.

Optionally, the mobile terminal further includes:

a display module configured to synchronously display the processed original image data on a display device of the mobile terminal;

The instruction detection module is configured to detect image processing instructions input by the user in real time.

Optionally, the first data transmission interface is a wireless transmission interface or a USB interface.

Optionally, the image processing module includes an automatic white balance processing algorithm, an automatic exposure processing algorithm, and an auto focus processing algorithm.

The embodiment of the present invention further provides a data transmission system, where the data transmission system includes a mobile terminal and an external camera, the external camera is connected to the mobile terminal, and the mobile terminal includes an image processing module, a storage module, and a communication module. a data transmission interface and a shooting control module,

The photographing control module is configured to, when detecting that a plug-in camera is connected to the mobile terminal, to control the plug-in camera to collect original image data according to the photographing parameter corresponding to the photographing instruction, based on the received photographing instruction;

The first data transmission interface is configured to receive original image data sent by the external camera, and send the original image data to the image processing module;

The image processing module is configured to perform corresponding processing on the original image data based on the received image processing instruction;

The storage module is configured to store original image data processed by the image processing module;

The external camera includes a camera module and a second data transmission interface.

The camera module is configured to capture a scene according to a shooting instruction corresponding to the shooting instruction according to a control instruction sent by the shooting control module to generate original image data;

The second data transmission interface is configured to transmit the generated original image data to the mobile terminal.

Optionally, the external camera further includes a power supply module and a control module, the power supply module is configured to supply power to the external camera, and the control module is configured to receive a control command sent by the mobile terminal based on the second data transmission interface, and control the camera module. The group collects raw image data with different shooting parameters.

Optionally, the second data transmission interface is adapted to the first data transmission interface.

Optionally, the first data transmission interface and the second data transmission interface are wireless transmission interfaces, or the first data transmission interface and the second data transmission interface are USB interfaces.

Optionally, the camera module includes an aperture, a focus, a lens, and a filter.

Optionally, the shooting control module includes:

Optionally, the mobile terminal further includes:

a display module configured to synchronously display the processed original on a display device of the mobile terminal Image data

An embodiment of the present invention further provides a method for photographing a mobile terminal, where the method for photographing the mobile terminal includes:

When detecting that an external camera is connected to the mobile terminal, the mobile terminal controls the external camera connected thereto to collect the original image data according to the shooting parameters corresponding to the shooting instruction, based on the received operation instruction;

Receiving, by the mobile terminal, original image data sent by the external camera;

The mobile terminal performs corresponding processing on the original image data based on the received image processing instruction, and stores the processed original image data.

Optionally, when detecting that the external camera is connected to the mobile terminal, the step of the mobile terminal controlling the external camera connected thereto to collect the original image data according to the shooting parameters corresponding to the shooting instruction, based on the received operation instruction, includes:

When detecting that an external camera is connected to the mobile terminal, detecting an optical parameter type of the external camera;

When the mobile terminal supports the optical parameter type of the external camera, the mobile terminal controls the external camera connected thereto to collect the original image data according to the shooting parameters corresponding to the shooting instruction based on the received operation instruction.

Optionally, the step of the mobile terminal performing corresponding processing on the original image data based on the received image processing instruction, and storing the processed original image data includes:

The mobile terminal performs corresponding processing on the original image data to form standby image data based on the received image processing instruction and the optical parameter type of the external camera;

The mobile terminal saves the inactive image data into its memory.

Optionally, after the step of performing the corresponding processing on the original image data by the mobile terminal based on the received image processing instruction, and storing the processed original image data, the method for photographing the mobile terminal further includes:

The mobile terminal synchronously displays the processed original image data on its display device, and real time The image processing instruction input by the user is detected.

Optionally, the receiving, by the mobile terminal, the original image data sent by the external camera includes:

The mobile terminal receives original image data sent by the plug-in camera through a wireless transmission interface or a USB interface.

The embodiment of the invention further provides a computer readable storage medium storing computer executable instructions, which are implemented when the computer executable instructions are executed.

In the embodiment of the present invention, when the external camera is connected to the mobile terminal, the shooting control module controls the external camera to collect the original image data according to the shooting parameter corresponding to the shooting instruction, and the first data transmission interface receives the external camera transmission. The original image data is sent to the image processing module; the image processing module performs corresponding processing on the original image data based on the received image processing instruction; the storage module stores the original image data processed by the image processing module, thereby externally attaching the camera After being connected to the mobile terminal of the embodiment of the present invention, the external camera can fully utilize the ISP and the storage space of the mobile terminal, so that the external camera does not need to bring an ISP and a storage device, thereby reducing the volume and weight of the external camera, thereby making the plug-in The camera becomes lightweight, easy to install and carry, making it easy to use the external camera with the mobile terminal.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a schematic structural diagram of hardware of an optional mobile terminal implementing various embodiments of the present application;

Figure 2 is a block diagram showing the electrical structure of the camera of Figure 1;

3 is a schematic diagram of data flow of an embodiment of a plug-in camera of the present application;

4 is a schematic diagram of data flow direction of an embodiment of a mobile terminal according to the present application;

5 is a schematic diagram of functional modules of a first embodiment of a mobile terminal according to the present application;

6 is a schematic diagram of a refinement function module of a shooting control module in a second embodiment of the mobile terminal of the present application;

7 is a schematic diagram of functional modules of a third embodiment of a mobile terminal according to the present application;

8 is a schematic flowchart of a first embodiment of a method for photographing a mobile terminal according to the present application;

In the first embodiment of the present invention, when the external camera is detected to be connected to the mobile terminal, the mobile terminal controls the external camera connected thereto to collect the original image according to the shooting parameter corresponding to the shooting instruction. Schematic diagram of the refinement of the data;

FIG. 10 is a schematic flowchart diagram of a third embodiment of a method for photographing a mobile terminal of the present application.

The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings.

Embodiments of the invention

It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.

A mobile terminal implementing various embodiments of the present application will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present application, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

The mobile terminal can be implemented in various forms. For example, the terminals described in this application may include, for example, mobile phones, smart phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablets), PMPs (Portable Multimedia Players), navigation devices, and the like. Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present application can be applied to fixed type terminals in addition to elements that are specifically for mobile purposes.

FIG. 1 is a schematic structural diagram of hardware of an optional mobile terminal implementing various embodiments of the present application.

The mobile terminal 100 may include a wireless communication unit 110, an A/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190. The shooting control module 10, the first data transmission interface 20, the image processing module 30, the storage module 40, and the like. Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that allow mobile terminal 100 to be Radio communication between line communication devices or networks.

The A/V input unit 120 is for receiving an audio or video signal. The A/V input unit 120 may include a camera 121 that processes image data of still pictures or video obtained by an image capturing device in a video capturing mode or an image capturing mode. The processed image frame can be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal.

The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal. The user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure values, capacitance, etc. due to contact), Roller, rocker, etc. In particular, when the touch panel is superimposed on the display unit 151 in the form of a layer, a touch screen can be formed.

The sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal. The orientation of 100, the direction of movement and the tilt angle of the mobile terminal 100, and the like, and generates commands or signals for controlling the operation of the mobile terminal 100.

The interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The identification module may be stored to verify various information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter referred to as "identification device") may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device. The interface unit 170 can be configured to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal 100 or can be used at the mobile terminal and external device Transfer data between.

Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151 and many more.

The display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch panel are superposed on each other in the form of a layer to form a touch screen, the display unit 151 can function as an input device and an output device. The display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. According to a particular desired embodiment, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) . The touch screen can be used to detect touch input pressure values as well as touch input positions and touch input areas.

The memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. Moreover, the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, such as the multimedia module 181. The long-exposure panoramic image that can be generated in real time can be displayed in real time, and the multimedia module 181 can be constructed within the controller 180 or can be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.

The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.

The shooting control module 10 is configured to, when detecting that the external camera is connected to the mobile terminal, control the external camera to collect the original image data according to the shooting parameter corresponding to the shooting instruction based on the received shooting instruction;

The first data transmission interface 20 is configured to receive the original image data sent by the external camera, and send the original image data to the image processing module 30;

The image processing module 30 is configured to perform corresponding processing on the original image data based on the received image processing instruction;

The storage module 40 is configured to store original image data processed by the image processing module 30.

In addition, since the present invention mainly relates to a mobile terminal, a data transmission system, and a mobile terminal photographing method, the electrical structure of the camera 121 in the hardware structure of the mobile terminal 100 in FIG. 1 is described in detail. Referring to FIG. 2, FIG. 2 is the camera of FIG. Electrical block diagram.

The photographic lens 1211 is composed of a plurality of optical lenses for forming a subject image, and is a single focus lens. Or a zoom lens. The photographic lens 1211 is movable in the optical axis direction under the control of the lens driver 1221, and the lens driver 1221 controls the focus position of the photographic lens 1211 in accordance with a control signal from the lens driving control circuit 1222, and can also be controlled in the case of the zoom lens. Focus distance. The lens drive control circuit 1222 performs drive control of the lens driver 1221 in accordance with a control command from the microcomputer 1217.

An imaging element 1212 is disposed on the optical axis of the photographic lens 1211 near the position of the subject image formed by the photographic lens 1211. The imaging element 1212 is for capturing an image of a subject and acquiring captured image data. Photodiodes constituting each pixel are arranged two-dimensionally and in a matrix on the imaging element 1212. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, which is subjected to charge accumulation by a capacitor connected to each photodiode. The front surface of each pixel is provided with a Bayer array of RGB color filters.

The imaging element 1212 is connected to the imaging circuit 1213. The imaging circuit 1213 performs charge accumulation control and image signal readout control in the imaging element 1212, and performs waveform shaping after reducing the reset noise of the read image signal (analog image signal). Further, gain improvement or the like is performed to obtain an appropriate signal level.

The imaging circuit 1213 is connected to an A/D converter 1214 that performs analog-to-digital conversion on the analog image signal and outputs a digital image signal (hereinafter referred to as image data) to the bus 1227.

The bus 1227 is a transmission path for transmitting various data read or generated inside the camera. The A/D converter 1214 is connected to the bus 1227, and an image processor 1215, a JPEG processor 1216, a microcomputer 1217, a SDRAM (Synchronous Dynamic Random Access Memory) 1218, and a memory interface are also connected. (hereinafter referred to as memory I/F) 1219, LCD (Liquid Crystal Display) driver 1220.

The image processor 1215 performs various kinds of images such as OB subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, simultaneous processing, edge processing, and the like on the image data based on the output of the imaging element 1212. deal with. The JPEG processor 1216 compresses the image data read out from the SDRAM 1218 in accordance with the JPEG compression method when the image data is recorded on the recording medium 1225. Further, the JPEG processor 1216 performs decompression of JPEG image data for image reproduction display. When the decompression is performed, the file recorded in the recording medium 1225 is read, and after the compression processing is performed in the JPEG processor 1216, the decompressed image data is temporarily stored in the file. The SDRAM 1218 is displayed on the LCD 1226. Further, in the present embodiment, the JPEG method is adopted as the image compression/decompression method. However, the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.

The microcomputer 1217 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 1217 is connected to the operation unit 1223 and the flash memory 1224.

The operating unit 1223 includes, but is not limited to, a physical button or a virtual button, and the entity or virtual button may be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, an enlarge button An operation control such as various input buttons and various input keys detects an operation state of these operation controls, and outputs the detection result to the microcomputer 1217. Further, a touch panel is provided on the front surface of the LCD 1226 as a display, and the touch position of the user is detected, and the touch position is output to the microcomputer 1217. The microcomputer 1217 executes various processing sequences corresponding to the user's operation in accordance with the detection result from the operation position of the operation unit 1223.

The flash memory 1224 stores programs for executing various processing sequences of the microcomputer 1217. The microcomputer 1217 performs overall control of the camera in accordance with the program. Further, the flash memory 1224 stores various adjustment values of the camera, and the microcomputer 1217 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.

The SDRAM 1218 is an electrically rewritable volatile memory for temporarily storing image data or the like. The SDRAM 1218 temporarily stores image data output from the A/D converter 1214 and image data processed in the image processor 1215, the JPEG processor 1216, and the like.

The memory interface 1219 is connected to the recording medium 1225, and performs control for writing image data and a file header attached to the image data to the recording medium 1225 and reading out from the recording medium 1225. The recording medium 1225 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body. However, the recording medium 1225 is not limited thereto, and may be a hard disk or the like built in the camera body.

The LCD driver 1220 is connected to the LCD 1226, and stores image data processed by the image processor 1215 in the SDRAM 1218. When display is required, the image data stored in the SDRAM 1218 is read and displayed on the LCD 1226, or the image data stored in the JPEG processor 1216 is compressed. In the SDRAM 1218, when display is required, the JPEG processor 1216 reads the compressed image data of the SDRAM 1218, decompresses it, and displays the decompressed image data through the LCD 1226.

The LCD 1226 is configured to display an image on the back of the camera body. However, it is not limited to this, it can also Various display panels (LCD 1226) such as an organic EL are used.

An embodiment of the mobile terminal of the present application is proposed based on the hardware structure of the mobile terminal and the electrical structure diagram of the camera.

Referring to FIG. 5, an embodiment of the present invention provides a mobile terminal. In a first embodiment of a mobile terminal, the mobile terminal includes an image processing module 30, a storage module 40, a first data transmission interface 20, and a shooting control module that are communicably connected to each other. 10,

When the external camera is connected to the mobile terminal, for example, the first data transmission interface 20 of the mobile terminal is a high speed wifi (WIreless-Fidelity) interface, a USB 3.0 interface, etc., that is, the first data transmission interface 20 of the mobile terminal is externally connected to the camera. The second data transmission interface establishes a connection (for example, a wifi connection is established between the mobile terminal and the external camera), and the mobile terminal detects whether the first data transmission interface 20 is connected to the external camera, and detects whether the user inputs the shooting instruction. When receiving a shooting instruction input by the user (for example, the touch screen of the mobile terminal senses that the user clicks in the shooting button area to form a shooting instruction), the mobile terminal sends a control instruction to the camera based on the received shooting instruction to control the plug-in. The camera captures the original image data with the shooting parameters corresponding to the shooting instruction.

When the shooting instruction input by the user does not adjust the shooting parameters of the external camera (such as the focus parameter, the exposure parameter, etc.), the external camera is controlled to framing the preset shooting parameters and collecting the original image data; when the user inputs the shooting instruction has the adjustment plug-in The shooting parameters of the camera control the external camera to capture the original image data with the shooting parameters corresponding to the shooting instruction; wherein the original image data is collected by the camera module of the external camera and is not processed and compressed (ie, RAW format) Image data.

Referring to FIG. 3 and FIG. 4, the external camera 200 includes a camera module 210 and a second data transmission interface 220. The camera module 210 includes an aperture, a focus, a lens, a filter, and the like. The camera module 210 is configured to collect the frame therein. Scene and generate raw image data in RAW format; second The data transmission interface 220 is arranged to transmit the generated raw image data to the mobile terminal 100. The second data transmission interface 220 is adapted to the first data transmission interface 20 of the mobile terminal 100. When the first data transmission interface 20 is a wifi interface, the second data transmission interface 220 is also a wifi interface. When the first data transmission interface 20 is used. When it is a USB 3.0 interface, the second data transmission interface 220 is also a USB 3.0 interface.

In addition, the external camera 200 further includes a power supply module 230 and a control module 240. The power supply module 230 is configured to supply power to the external camera 200, so that the external camera 200 can be powered without relying on the mobile terminal 100, thereby preventing the external camera 200 from being restricted due to power supply. The connection mode between the mobile terminals 100 (for example, the mobile terminal and the external camera 200 are connected by wifi, and the mobile terminal 100 cannot supply power to the external camera 200); the control module 240 receives the control command sent by the mobile terminal 100 based on the second data transmission interface 220. The camera module 210 sends a control signal that can control the camera module 210 to acquire raw image data with different shooting parameters. The original image data is transmitted to the second data transmission interface 220 (such as USB 3.0 or high-speed wifi) through the MIPI (Mobile Industry Processor Interface), so that the first data transmission interface 20 of the mobile terminal 100 receives the plug-in. The raw image data transmitted by the camera 200 is transmitted to the image processing module 30.

After receiving the original image data sent by the external camera, the mobile terminal processes the original image data by using the image processing module 30 (ie, Image Signal Processing, ISP), for example, automatic white balance (AWB) processing, automatic The processing of the automatic exposure (AE) processing, the automatic focus (AF), the face recognition, and the like, that is, the image processing module 30 of the mobile terminal includes a common image processing algorithm such as AWB, AE, and AF. The image processing module 30 transmits the processed raw image data to the storage module 40.

The storage module 40 of the mobile terminal stores the original image data processed by the image processing module 30. Optionally, the storage module 40 saves the processed original image data in the memory of the mobile terminal for convenient calling and processing.

In this embodiment, by detecting that an external camera is connected to the mobile terminal, the shooting control is performed. The module 10 controls the external camera to acquire the original image data according to the shooting parameters corresponding to the shooting instruction based on the received shooting instruction; the first data transmission interface 20 receives the original image data sent by the external camera, and sends the original image data to the image processing module. The image processing module 30 performs corresponding processing on the original image data based on the received image processing instruction; the storage module 40 stores the original image data processed by the image processing module 30, so that the external camera is connected to the mobile terminal of the embodiment, the plug-in The camera can make full use of the ISP of the mobile terminal (ie, the image processing module 30) and the storage space (the storage module 40), so that the external camera does not need to bring its own ISP and storage device, which reduces the size and weight of the external camera, thereby making the external camera It is light, easy to install and carry, making it easy to use the external camera with the mobile terminal.

At the same time, users can implement specific functions according to the ISP characteristics of their mobile terminals. For example, manual white balance, manual focus, electronic aperture and other functions developed by mobile terminal manufacturers can also be realized by the external camera, which reduces the cost of the external camera. Under the premise, it also indirectly expands the function of the external camera. In addition, compared to a camera fixed in the internal chip of the mobile terminal, the external camera has the advantages of being convenient to carry and replace, as long as the mobile terminal supports the data transmission mode of the first data transmission interface 20 (for example, high speed wifi or usb3.0), and The ISP processing parameters of the built-in lens in the mobile terminal can be used. When the user is dissatisfied with the camera of his mobile terminal, he can directly purchase the external camera for upgrading.

Further, based on the first embodiment of the mobile terminal of the present application, a second embodiment of the mobile terminal is proposed. In the second embodiment, referring to FIG. 6, the shooting control module 10 includes:

The detecting unit 11 is configured to detect an optical parameter type of the external camera when detecting that the external camera is connected to the mobile terminal;

The shooting control unit 12 is configured to, when the mobile terminal supports the optical parameter type of the external camera, control the external camera to collect the original image data according to the shooting parameter corresponding to the shooting instruction based on the received operation instruction.

In this embodiment, when the mobile terminal detects that the external camera is accessed, the detecting unit 11 of the mobile terminal detects the optical parameter type of the external camera, and the optical parameter type includes the aperture type, the filter type, and the filter type of the external camera. Focusing type, lens type, etc.; the shooting control unit 12 of the mobile terminal selects a corresponding image processing algorithm in the mobile terminal ISP based on the optical parameter type of the external camera, and then controls the external camera to shoot according to the shooting instruction according to the received operation instruction. The parameter collects the original image data, so that before controlling the external camera to collect the original image data, the optical parameter type of the plug-in camera is determined to invoke the corresponding image processing algorithm in the mobile terminal ISP, thereby ensuring that the mobile terminal receives the original image sent by the plug-in camera. The data can then be processed by calling the correct image processing algorithm.

Optionally, the image processing module 30 is further configured to perform corresponding processing on the original image data to form the to-be-used image data based on the received image processing instruction and the optical parameter type of the external camera;

The storage module 40 is further configured to save the inactive image data into its memory.

After obtaining the optical parameter type of the external camera, the image processing module 30 first determines the optical parameter type of the external camera to invoke a corresponding image processing algorithm in the mobile terminal ISP, and then the image processing module 30 inputs the image according to the correct image processing algorithm and the user. The image processing instruction performs corresponding processing on the received original image data to form inactive image data; then the storage module 40 saves the inactive image data into the memory of the mobile terminal to facilitate the calling and using by the mobile terminal.

Further, on the basis of the first embodiment of the mobile terminal of the present application, a third embodiment of the mobile terminal is proposed. Referring to FIG. 7, in the third embodiment, the mobile terminal further includes:

The display module 50 is configured to synchronously display the processed original image data on the display device of the mobile terminal;

The instruction detection module 60 is configured to detect an image processing instruction input by the user in real time.

After the mobile terminal obtains the processed original image data, in order to facilitate the user to view whether the processed original image data is satisfactory, the display module 50 synchronously displays the processed original image data on a display device (such as a display screen) of the mobile terminal. Therefore, the user performs subsequent supplementary modification processing according to the display effect; at the same time, the instruction detection module 60 detects the image processing instruction input by the user in real time in the touch area of the mobile terminal, and sends the detected image processing instruction to the image processing module 30, thereby Interact with users to take better photos or videos.

The embodiment of the present invention further provides a data transmission system. Referring to FIG. 3, FIG. 4 and FIG. 5, the data transmission system includes a mobile terminal 100 and an external camera 200. The external camera 200 is connected to the mobile terminal 100, and the mobile terminal 100 includes a communication connection. Image processing module 30, storage module 40, first data transmission interface 20 and shooting control module 10,

The shooting control module 10 is configured to detect when a plug-in camera is connected to the mobile terminal. Receiving, by the received shooting instruction, the external camera to acquire original image data according to the shooting parameters corresponding to the shooting instruction;

The storage module 40 is configured to store original image data processed by the image processing module 30;

The external camera 200 includes a camera module 210 and a second data transmission interface 220.

The camera module 210 is configured to capture a scene according to a shooting instruction corresponding to the shooting instruction according to a control command sent by the shooting control module 10 to generate original image data;

The second data transmission interface 220 is configured to transmit the generated raw image data to the mobile terminal 100.

The external camera 200 includes a camera module 210 and a second data transmission interface 220. The camera module 210 includes an aperture, a focus, a lens, a filter, and the like. The camera module 210 is configured to collect scenes in the frame and generate a RAW format. Raw image data; the second data transmission interface 220 is arranged to transmit the generated raw image data to the mobile terminal 100. The second data transmission interface 220 is adapted to the first data transmission interface 20 of the mobile terminal 100. When the first data transmission interface 20 is a wifi interface, the second data transmission interface 220 is also a wifi interface. When the first data transmission interface 20 is used. When it is a USB 3.0 interface, the second data transmission interface 220 is also a USB 3.0 interface.

In addition, the external camera 200 further includes a power supply module 230 and a control module 240. The power supply module 230 is configured to supply power to the external camera 200, so that the external camera 200 can be powered without relying on the mobile terminal 100, thereby preventing the external camera 200 from being restricted due to power supply. The connection mode between the mobile terminals 100 (for example, the mobile terminal and the external camera 200 are connected by wifi, and the mobile terminal 100 cannot supply power to the external camera 200); the control module 240 receives the control command sent by the mobile terminal 100 based on the second data transmission interface 220. The camera module 210 sends a control signal that can control the camera module 210 to acquire raw image data with different shooting parameters. The original image data is transmitted by the MIPI (Mobile Industry Processor Interface) to the second data transmission interface 220 (such as USB 3.0 or high speed wifi), thereby moving The first data transmission interface 20 of the terminal 100 receives the original image data transmitted by the external camera 200 and transmits the original image data to the image processing module 30.

In the present embodiment, when the external camera 200 is detected to be connected to the mobile terminal 100, that is, when the first data transmission interface 20 is connected to the second data transmission interface 220. The camera control module 10 controls the camera module 210 of the external camera 200 to capture the original image data according to the shooting parameters corresponding to the shooting instruction; the first data transmission interface 20 receives the original image data sent by the external camera 200, and the The original image data is sent to the image processing module 30; the image processing module 30 performs corresponding processing on the original image data based on the received image processing instruction; the storage module 40 stores the original image data processed by the image processing module 30, thereby the external camera 200 and the implementation. After the mobile terminal 100 is connected, the external camera 200 can fully utilize the ISP (ie, the image processing module 30) and the storage space (the storage module 40) of the mobile terminal 100, so that the external camera 200 does not need to bring its own ISP and storage device. The size and weight of the external camera 200 are reduced, so that the external camera 200 is light, easy to install and carry, and the external camera 200 is conveniently used in conjunction with the mobile terminal 100.

The embodiment of the present invention further provides a method for photographing a mobile terminal. In the first embodiment of the method for photographing a mobile terminal, referring to FIG. 5 and FIG. 8, the method includes:

Step S10: When it is detected that the external camera is connected to the mobile terminal, the mobile terminal controls the external camera connected thereto to collect the original image data according to the shooting parameters corresponding to the shooting instruction, based on the received operation instruction;

When the user-entered shooting command does not adjust the shooting parameters of the external camera (such as focus parameters, The exposure parameter, etc., controls the external camera to take the preset shooting parameters and capture the original image data; when the shooting instruction input by the user adjusts the shooting parameters of the external camera, the external camera is controlled to take the shooting parameter corresponding to the shooting instruction. And acquiring original image data; wherein the original image data is image data collected by the camera module of the external camera and not processed and compressed (ie, RAW format).

Step S20, the mobile terminal receives the original image data sent by the external camera;

Step S30, the mobile terminal performs corresponding processing on the original image data based on the received image processing instruction, and stores the processed original image data.

The external camera includes a camera module and a second data transmission interface. The camera module includes an aperture, a focus, a lens, a filter, and the like. The camera module is configured to collect a scene in the finder frame and generate original image data in a RAW format; The two data transmission interfaces are used to transmit the generated original image data to the mobile terminal. The second data transmission interface is adapted to the first data transmission interface of the mobile terminal. When the first data transmission interface is a wifi interface, the second data transmission interface is also a wifi interface. When the first data transmission interface is a USB 3.0 interface, Then the second data transmission interface is also a USB 3.0 interface.

In addition, the external camera further includes a power supply module and a control module, and the power supply module is used for powering the external camera, so that the external camera can be powered without relying on the mobile terminal, thereby avoiding the limitation of the connection between the external camera and the mobile terminal due to the power supply; The control module sends a control signal to the camera module based on the second data transmission interface receiving the control command sent by the mobile terminal, and the control signal can control the camera module to collect the original image data with different shooting parameters. The original image data is transmitted through a MIPI (Mobile Industry Processor Interface) to a second data transmission interface (such as USB 3.0 or high-speed wifi), so that the first data transmission interface 20 of the mobile terminal receives the external camera transmission. The raw image data is sent to the image processing module 30.

In this embodiment, when detecting that an external camera is connected to the mobile terminal, the shooting control module 10 controls the external camera to collect the original image data according to the shooting parameters corresponding to the shooting instruction based on the received shooting instruction; the first data transmission interface 20 Receiving the original image data sent by the external camera and transmitting the original image data to the image processing module; the image processing module 30 performs corresponding processing on the original image data based on the received image processing instruction; the storage module 40 stores the processed image processing module The original image data, so that the external camera is connected to the mobile terminal of the embodiment, the external camera can fully utilize the ISP (ie, the image processing module 30) and the storage space (the storage module 40) of the mobile terminal, so that the external camera does not need to bring its own The ISP and storage device reduce the size and weight of the external camera, making the external camera light, easy to install and carry, making it convenient to use the external camera with the mobile terminal.

Further, based on the first embodiment of the mobile terminal photographing method of the present application, a second embodiment of the mobile terminal photographing method is proposed. Referring to FIG. 9, in the second embodiment,

Step S10 includes:

Step S11, detecting that an external camera is connected to the mobile terminal, detecting an optical parameter type of the external camera;

Step S12: When the mobile terminal supports the optical parameter type of the external camera, the mobile terminal controls the external camera connected thereto to collect the original image data according to the shooting parameters corresponding to the shooting instruction, based on the received operation instruction.

In this embodiment, when the mobile terminal detects that the external camera is accessed, the mobile terminal detects the optical parameter type of the external camera, and the optical parameter type includes the aperture type, the filter type, the focus type, and the lens of the external camera. Type: The mobile terminal selects a corresponding image processing algorithm in the mobile terminal ISP based on the optical parameter type of the external camera, and then controls the external camera to collect the original image data according to the shooting parameters corresponding to the shooting instruction according to the received operation instruction, thereby controlling the external camera. Before collecting the original image data, determining the optical parameter type of the external camera to invoke the corresponding image processing algorithm in the mobile terminal ISP, ensuring that the mobile terminal can call the correct image processing algorithm after receiving the original image data sent by the external camera. Process it.

Optionally, step S30 includes:

Step S31, the mobile terminal performs corresponding processing on the original image data to form the to-be-used image data based on the received image processing instruction and the optical parameter type of the external camera;

In step S32, the mobile terminal saves the inactive image data into its memory.

After obtaining the optical parameter type of the external camera, the mobile terminal first determines the optical parameter type of the external camera to invoke the corresponding image processing algorithm in the mobile terminal ISP, and then the mobile terminal according to the correct image processing algorithm and the image processing instruction input by the user, The received original image data is subjected to corresponding processing to form inactive image data; then the mobile terminal saves the inactive image data to the memory of the mobile terminal, facilitating the calling and using by the mobile terminal.

Further, based on the first embodiment of the mobile terminal photographing method of the present application, a third embodiment of the method for photographing the mobile terminal is proposed. Referring to FIG. 10, in the third embodiment, after the step S30, the method further includes:

In step S40, the mobile terminal synchronously displays the processed original image data on its display device, and detects the image processing instruction input by the user in real time.

After the mobile terminal obtains the processed original image data, in order to facilitate the user to view whether the processed original image data is satisfactory, the processed original image data is synchronously displayed on the display device (such as a display screen) of the mobile terminal, so that the user can The display effect is subjected to subsequent supplementary modification processing; at the same time, the image processing instruction input by the user is detected in real time in the touch area of the mobile terminal, and the detected image processing instruction is sent to the image processing module, thereby interacting with the user to shoot more Good photo or video.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present application, which is essential or contributes to the related art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM). The instructions include a number of instructions for causing a terminal device (which may be a cell phone, computer, server, air conditioner, or network device, etc.) to perform the methods described in various embodiments of the present application.

The above is only a preferred embodiment of the present application, and is not intended to limit the scope of the patent application, and the equivalent structure or equivalent process transformations made by the specification and the drawings of the present application, or directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of this application.

Industrial applicability

The embodiment of the present invention provides a mobile terminal, a data transmission system, and a mobile terminal shooting method. After the external camera is connected to the mobile terminal of the present application, the external camera can fully utilize the ISP and the storage space of the mobile terminal, so that the external camera does not need to be self-contained. With ISP and storage device, the size and weight of the external camera are reduced, so that the external camera becomes light, easy to install and carry, and the external camera is convenient to use with the mobile terminal.

Claims

A mobile terminal includes an image processing module, a storage module, a first data transmission interface, and a shooting control module that are communicably connected to each other,

The photographing control module is configured to, when detecting that a plug-in camera is connected to the mobile terminal, to control the plug-in camera to collect original image data according to the photographing parameter corresponding to the photographing instruction, based on the received photographing instruction;

The first data transmission interface is configured to receive original image data sent by the external camera, and send the original image data to the image processing module;

The image processing module is configured to perform corresponding processing on the original image data based on the received image processing instruction;

The storage module is configured to store original image data processed by the image processing module.
The mobile terminal of claim 1, wherein the photographing control module comprises:

The detecting unit is configured to detect an optical parameter type of the external camera when detecting that the external camera is connected to the mobile terminal;

The shooting control unit is configured to, when the mobile terminal supports the optical parameter type of the external camera, control the external camera to collect the original image data according to the shooting parameter corresponding to the shooting instruction based on the received operation instruction.
The mobile terminal of claim 2, wherein

The image processing module is further configured to perform corresponding processing on the original image data to form inactive image data based on the received image processing instruction and an optical parameter type of the external camera;

The storage module is further configured to save the to-be-used image data into its memory.
The mobile terminal of claim 1, further comprising:

a display module configured to synchronously display the processed original image data on a display device of the mobile terminal;

The instruction detection module is configured to detect image processing instructions input by the user in real time.
The mobile terminal of claim 1, wherein the first data transmission interface is a wireless transmission interface or a USB interface.
The mobile terminal of claim 1, wherein the image processing module comprises an automatic white balance processing algorithm, an automatic exposure processing algorithm, and an auto focus processing algorithm.
The mobile terminal of claim 3, wherein the optical parameter type comprises: an aperture type, a filter type, a focus type, and a lens type.
A data transmission system includes a mobile terminal and an external camera. The external camera is connected to a mobile terminal, and the mobile terminal includes an image processing module, a storage module, a first data transmission interface, and a shooting control module.

The photographing control module is configured to, when detecting that a plug-in camera is connected to the mobile terminal, to control the plug-in camera to collect original image data according to the photographing parameter corresponding to the photographing instruction, based on the received photographing instruction;

The first data transmission interface is configured to receive original image data sent by the external camera, and send the original image data to the image processing module;

The image processing module is configured to perform corresponding processing on the original image data based on the received image processing instruction;

The storage module is configured to store original image data processed by the image processing module;

The external camera includes a camera module and a second data transmission interface.

The camera module is configured to capture a scene according to a shooting instruction corresponding to the shooting instruction according to a control instruction sent by the shooting control module to generate original image data;

The second data transmission interface is configured to transmit the generated original image data to the mobile terminal.
The data transmission system according to claim 8, wherein said external camera further comprises a power supply module and a control module, said power supply module being configured to supply power to the external camera, said control module being configured to receive the movement based on the second data transmission interface The control command sent by the terminal controls the camera module to collect the original image data with different shooting parameters.
The data transmission system of claim 8 wherein said second data transmission interface is adapted to said first data transmission interface.
The data transmission system according to claim 10, wherein said first data transmission interface and said second data transmission interface are wireless transmission interfaces, or said first data transmission interface and said second data transmission interface For the USB interface.
The data transmission system of claim 8 wherein said camera module comprises an aperture, a focus, a lens, and a filter.
The data transmission system of claim 8 wherein said photographing control module comprises:

The detecting unit is configured to detect an optical parameter type of the external camera when detecting that the external camera is connected to the mobile terminal;

The shooting control unit is configured to, when the mobile terminal supports the optical parameter type of the external camera, control the external camera to collect the original image data according to the shooting parameter corresponding to the shooting instruction based on the received operation instruction.
The data transmission system according to claim 8, wherein

The image processing module is further configured to perform corresponding processing on the original image data to form inactive image data based on the received image processing instruction and an optical parameter type of the external camera;

The storage module is further configured to save the to-be-used image data into its memory.
The data transmission system of claim 8, wherein the mobile terminal further comprises:

a display module configured to synchronously display the processed original image data on a display device of the mobile terminal;

The instruction detection module is configured to detect image processing instructions input by the user in real time.
A mobile terminal shooting method includes:

When detecting that an external camera is connected to the mobile terminal, the mobile terminal controls the external camera connected thereto to collect the original image data according to the shooting parameters corresponding to the shooting instruction, based on the received operation instruction;

Receiving, by the mobile terminal, original image data sent by the external camera;

The mobile terminal performs corresponding processing on the original image data based on the received image processing instruction, and stores the processed original image data.
The mobile terminal photographing method according to claim 16, wherein when the external camera is detected to be connected to the mobile terminal, the mobile terminal controls the external camera connected thereto to collect the photographing parameters corresponding to the photographing instruction based on the received operation instruction. The steps of the raw image data include:

Detecting the optical parameter of the external camera when detecting that the external camera is connected to the mobile terminal Number type

When the mobile terminal supports the optical parameter type of the external camera, the mobile terminal controls the external camera connected thereto to collect the original image data according to the shooting parameters corresponding to the shooting instruction based on the received operation instruction.
The mobile terminal photographing method according to claim 17, wherein the step of the mobile terminal performing corresponding processing on the original image data based on the received image processing instruction and storing the processed original image data comprises:

The mobile terminal performs corresponding processing on the original image data to form standby image data based on the received image processing instruction and the optical parameter type of the external camera;

The mobile terminal saves the inactive image data into its memory.
The mobile terminal photographing method according to claim 16, wherein the mobile terminal photographs the original image data based on the received image processing instruction and stores the processed original image data, the mobile terminal photographing The method also includes:

The mobile terminal synchronously displays the processed original image data on its display device, and detects an image processing instruction input by the user in real time.
The mobile terminal photographing method of claim 16, wherein the receiving, by the mobile terminal, raw image data sent by the external camera comprises:

The mobile terminal receives original image data sent by the plug-in camera through a wireless transmission interface or a USB interface.