WO2023016059A1

WO2023016059A1 - Data transmission control method and related apparatus

Info

Publication number: WO2023016059A1
Application number: PCT/CN2022/095793
Authority: WO
Inventors: 朱文波
Original assignee: 哲库科技(上海)有限公司
Priority date: 2021-08-09
Filing date: 2022-05-28
Publication date: 2023-02-16
Also published as: CN115706769A

Abstract

Disclosed in the present application are a data transmission control method and a related apparatus, which are used for testing an electronic device. The method comprises: setting a virtual video device, wherein the virtual video device is configured to encapsulate operation data of a front-end module of an electronic device at a first frame rate; packing the operation data at a second frame rate by using the virtual video device, so as to obtain a target data packet; sending the target data packet to a processor; and at least partially on the basis of adjusting the value of the first frame rate and/or the second frame rate, determining whether the front-end module is abnormal. By means of the embodiments of the present application, operation information of a front-end module can be efficiently captured for a developer to analyze.

Description

Data transmission control method and related device

technical field

The present application relates to the field of electronic technology, and in particular to a data transmission control method and a related device.

Background technique

With the popularization and application of electronic devices (such as mobile phones, tablet computers, smart watches, etc.), electronic devices can support more and more applications, and their functions are becoming more and more powerful. Electronic devices are developing in a diversified and personalized direction. Become an indispensable electronic product in the life of users.

At present, taking mobile phones as an example, the debugging methods of chips are all in the development stage, which is not suitable for the environment after productization. The detection of the front-end working status is still based on direct connection to the debugging line, which requires a special Hardware interface, of course, due to changes in the hardware environment after productization, it is impossible to capture relevant front-end module work information for developers to analyze. Therefore, how to efficiently capture relevant front-end module work information for developers to analyze problem needs to be resolved urgently.

Contents of the invention

The embodiments of the present application provide a data transmission control method and a related device, which can efficiently capture the work information of the front-end module for analysis by developers.

In the first aspect, the embodiment of the present application provides a data transmission control method for testing electronic equipment, the method comprising:

Setting a virtual video device, the virtual video device is configured to encapsulate the operating data of the front-end module of the electronic device at a first frame rate;

Using the virtual video device to pack the running data at a second frame rate to obtain a target data packet;

sending the target data packet to a processor;

Determining whether the front-end module is abnormal is based at least in part on adjusting values of the first frame rate and/or the second frame rate.

In the second aspect, the embodiment of the present application provides an electronic device, including a front-end module and a processor, wherein,

The front-end module is configured to:

Setting a virtual video device to encapsulate the operation data of the front-end module at a first frame rate;

Packing the running data at a second frame rate by using the virtual video device to obtain a target data packet; and

sending the target data packet to the processor;

The processor is configured to:

In a third aspect, an embodiment of the present application provides a data transmission control method, which is applied to an electronic device, where the electronic device includes a front-end module and a processor, and the method includes:

The front-end module sets a virtual video device to encapsulate the operation data of the front-end module at a first frame rate;

sending the target data packet to the processor;

The processor is configured to:

In a fourth aspect, the embodiment of the present application provides a data transmission control device, which is applied to electronic equipment, where the electronic equipment includes a front-end module and a processor, and the device includes: a setting unit, a packaging unit, a sending unit, and an abnormality detection unit, in,

The setting unit is configured to set a virtual video device, and the virtual video device is configured to encapsulate the operation data of the front-end module of the electronic device at a first frame rate;

The packaging unit is configured to use the virtual video device to package the running data at a second frame rate to obtain a target data package;

The sending unit is configured to send the target data packet to a processor;

The abnormality detection unit is configured to determine whether there is an abnormality in the front-end module based at least in part on adjusting the value of the first frame rate and/or the second frame rate.

In the fifth aspect, the embodiment of the present application provides an electronic device, the electronic device includes a front-end module, a processor, and a memory, the memory is used to store one or more programs, and is configured by the processor or the The front-end module executes, and the program includes instructions for executing the steps in the method according to any one of the first aspect or the third aspect.

In a sixth aspect, the embodiment of the present application provides a computer-readable storage medium, wherein the above-mentioned computer-readable storage medium stores a computer program for electronic data exchange, wherein the above-mentioned computer program enables the computer to execute Part or all of the steps described in the first aspect or the third aspect.

In a seventh aspect, the embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable the computer to execute the program as implemented in the present application. For example, part or all of the steps described in the first aspect or the third aspect. The computer program product may be a software installation package.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

FIG. 2 is a schematic diagram of a software structure of an electronic device provided by an embodiment of the present application;

FIG. 3A is a schematic flowchart of a data transmission control method provided in an embodiment of the present application;

Fig. 3B is a schematic diagram illustrating the data transmission between the front-end module and the application processor provided by the embodiment of the present application;

FIG. 3C is a schematic structural diagram of a data packet provided by an embodiment of the present application;

FIG. 3D is a schematic diagram illustrating another data transmission between the front-end module and the application processor provided by the embodiment of the present application;

FIG. 4 is a schematic flowchart of another data transmission control method provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

Fig. 6 is a block diagram of functional units of a device for controlling data transmission provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

In order to better understand the solutions of the embodiments of the present application, the following first introduces related terms and concepts that may be involved in the embodiments of the present application.

Electronic devices can include a variety of devices with communication capabilities, such as smartphones, in-vehicle devices, wearable devices, charging devices (such as power banks), smart watches, smart glasses, wireless Bluetooth headsets, computing devices, or connected to a wireless modem. Other processing equipment, as well as various forms of user equipment (User Equipment, UE), mobile station (Mobile Station, MS), virtual reality/augmented reality equipment, terminal equipment (terminal device), etc., electronic equipment can also be a base station or The server, and the electronic device may also be a test module composed of a front-end module and a processor (for example, an application processor).

The first part, the software and hardware operating environment of the technical solution disclosed in this application is introduced as follows.

As shown in the figure, FIG. 1 shows a schematic structural diagram of an electronic device 100 . The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, compass 190, motor 191, indicator 192, camera 193, display screen 194 and user An identification module (subscriber identification module, SIM) card interface 195 and the like.

It can be understood that, the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor AP, a modem processor, a graphics processor GPU, an image signal processor (image signal processor, ISP), a controller, Video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor NPU, etc. Wherein, different processing units may be independent components, or may be integrated in one or more processors. In some embodiments, the electronic device 100 may also include one or more processors 110 . Wherein, the controller can generate an operation control signal according to the instruction operation code and the timing signal, and complete the control of fetching and executing the instruction. In some other embodiments, a memory may also be set in the processor 110 for storing instructions and data. Exemplarily, the memory in the processor 110 may be a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. In this way, repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the electronic device 100 in processing data or executing instructions. The processor can also include an image processor, and the image processor can be an image preprocessor (preprocess image signal processor, Pre-ISP), which can be understood as a simplified ISP, and can also perform some image processing operations.

In some embodiments, processor 110 may include one or more interfaces. The interface may include inter-integrated circuit (I2C) interface, inter-integrated circuit sound (I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous transceiver (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input/output (general-purpose input/output, GPIO) interface, SIM card interface and/or USB interface, etc. Wherein, the USB interface 130 is an interface conforming to the USB standard specification, specifically, it may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100 , and can also be used to transmit data between the electronic device 100 and peripheral devices. The USB interface 130 can also be used to connect earphones to play audio through the earphones.

It can be understood that the interface connection relationship between the modules shown in the embodiment of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.

The charging management module 140 is configured to receive a charging input from a charger. Wherein, the charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger through the USB interface 130 . In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100 . While the charging management module 140 is charging the battery 142 , it can also provide power for electronic devices through the power management module 141 .

The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives the input of the battery 142 and/or the charging management module 140, and supplies power for the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193 and the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 may also be disposed in the processor 110 . In some other embodiments, the power management module 141 and the charging management module 140 may also be set in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G/6G applied on the electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (blue tooth, BT), global navigation Satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

The electronic device 100 realizes the display function through the GPU, the display screen 194 , and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel can adopt liquid crystal display (liquid crystal display, LCD), organic light-emitting diode (organic light-emitting diode, OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), mini light-emitting diode (mini light-emitting diode, miniled), MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the electronic device 100 may include one or more display screens 194 .

The electronic device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 , and the application processor.

The ISP is used for processing the data fed back by the camera 193 . For example, when taking a picture, open the shutter, the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be located in the camera 193 .

Camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other image signals. In some embodiments, the electronic device 100 may include one or more cameras 193 .

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a neural-network (NN) computing processor. By referring to the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and continuously learn by itself. Applications such as intelligent cognition of the electronic device 100 can be realized through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video and other files in the external memory card.

The internal memory 121 may be used to store one or more computer programs including instructions. The processor 110 may execute the above-mentioned instructions stored in the internal memory 121, so that the electronic device 100 executes the method for displaying page elements provided in some embodiments of the present application, as well as various applications and data processing. The internal memory 121 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system; the stored program area can also store one or more applications (such as a gallery, contacts, etc.) and the like. The data storage area can store data (such as photos, contacts, etc.) created during the use of the electronic device 100 . In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage components, flash memory components, universal flash storage (universal flash storage, UFS) and the like. In some embodiments, the processor 110 may execute the instructions stored in the internal memory 121 and/or the instructions stored in the memory provided in the processor 110, so that the electronic device 100 executes the instructions provided in the embodiments of the present application. Methods for displaying page elements, and other applications and data processing. The electronic device 100 can implement audio functions through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.

The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.

Wherein, the pressure sensor 180A is used for sensing pressure signals, and can convert the pressure signals into electrical signals. In some embodiments, pressure sensor 180A may be disposed on display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may be comprised of at least two parallel plates with conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view short messages is executed. When a touch operation whose intensity is greater than or equal to the first pressure threshold acts on the icon of the short message application, the instruction of creating a new short message is executed.

The gyro sensor 180B can be used to determine the motion posture of the electronic device 100 . In some embodiments, the angular velocity of the electronic device 100 around three axes (ie, X, Y and Z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 180B detects the shaking angle of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to counteract the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

The acceleration sensor 180E can detect the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.

The ambient light sensor 180L is used for sensing ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket, so as to prevent accidental touch.

The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access to application locks, take pictures with fingerprints, answer incoming calls with fingerprints, and the like.

The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to implement a temperature treatment strategy. For example, when the temperature reported by the temperature sensor 180J exceeds the threshold, the electronic device 100 may reduce the performance of the processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to prevent the electronic device 100 from being shut down abnormally due to the low temperature. In some other embodiments, when the temperature is lower than another threshold, the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

Touch sensor 180K, also known as "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 , which is different from the position of the display screen 194 .

Exemplarily, FIG. 2 shows a software structural block diagram of the electronic device 100 . The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the Android system is divided into four layers, which are respectively the application program layer, the application program framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer from top to bottom. The application layer can consist of a series of application packages.

As shown in Figure 2, the application layer may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 2, the application framework layer can include window managers, content providers, view systems, phone managers, resource managers, notification managers, and so on.

A window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.

Content providers are used to store and retrieve data and make it accessible to applications. Data can include videos, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. The view system can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide communication functions of the electronic device 100 . For example, the management of call status (including connected, hung up, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, issuing a prompt sound, vibrating the electronic device, and flashing the indicator light, etc.

Android Runtime includes core library and virtual machine. Android Runtime is responsible for the scheduling and management of the Android system.

The core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application program layer and the application program framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

A system library can include multiple function modules. For example: surface manager (surface manager), media library (media libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.

The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.

2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.

Based on the electronic device described in FIG. 1 or FIG. 2 above, the electronic device includes a front-end module and a processor, which can be used to implement the following functions:

The front-end module is configured to:

sending the target data packet to the processor;

The processor is configured to:

It can be seen that the electronic device described in the embodiment of the present application is used to test the electronic device and set up a virtual video device, and the virtual video device is configured to encapsulate the operating data of the front-end module of the electronic device at the first frame rate , use the virtual video device to pack the running data according to the second frame rate to obtain the target data packet, and send the target data packet to the processor, at least partly based on adjusting the value of the first frame rate and/or the second frame rate Determine whether there is an abnormality in the front-end module. Since the virtual video device can perform virtual video recording processing on the running data, the running data can be output to the external device according to a certain frame rate and size, and then the working information of the front-end module can be efficiently captured for development. personnel to analyze.

Optionally, the front-end module is further configured to: acquire target pipeline configuration parameters;

Wherein, in terms of using the virtual video device to pack the running data according to the second frame rate to obtain the target data packet, the front-end module is specifically configured as:

According to the preset mapping relationship between the pipeline configuration parameters and the packaging processing parameters, determine the target packaging processing parameters corresponding to the target pipeline configuration parameters, and the target packaging processing parameters include at least the second frame rate;

The virtual video device packs the running data by using the target packing processing parameters to obtain the target data package.

Optionally, the target data packet includes at least one data packet, and the data size of each data packet is less than or equal to the size of each cache register in a plurality of cache registers allocated by the USB service, and the cache register is used for A data packet of the at least one data packet is accommodated.

Optionally, in terms of obtaining target pipeline configuration parameters, the front-end module is specifically configured as:

Determine the target debugging content;

Obtain attribute information corresponding to the target debugging content;

The target pipeline configuration parameters corresponding to the attribute information of the target debugging content are determined according to the preset mapping relationship between the attribute information of the debugging content and the pipeline configuration parameters.

Optionally, the processor is also specifically configured to:

The processor receives the target data packet, unpacks the target data packet to obtain the operation data, and the operation data is used for data analysis.

Optionally, in terms of unpacking the target data packet to obtain the running data, the processor is further specifically configured to:

Copying the target data packet frame by frame into the target buffer register allocated by the USB service;

Unpacking the data in the target cache register to obtain the running data.

Optionally, after the target data packet is unpacked to obtain the running data, the processor is further specifically configured to:

calling the USB service to upload the running data to the external device through the target buffer register, so that the external device can analyze the running data.

Optionally, the processor is also specifically configured to:

A rotation operation is performed on the target cache register, so that the target cache register after rotation continues to be used for accommodating data packets received by the processor.

Optionally, before the setting of the virtual video device, the processor is further specifically configured to:

Enabling the camera of the electronic device to call a hardware abstraction module, wherein the hardware abstraction module is configured to: perform the function of unpacking the target data packet to obtain the running data.

In the second part, the data transmission control method and device disclosed in the embodiments of the present application are introduced as follows.

This application provides please refer to FIG. 3A. FIG. 3A is a schematic flowchart of a data transmission control method provided by an embodiment of this application, which is applied to an electronic device, and the electronic device includes a front-end module and a processor. For example, the processor can be Application processor AP, the data transmission control method can be used to test electronic equipment, as shown in the figure, the data transmission control method includes:

301. Set a virtual video device, where the virtual video device is configured to encapsulate running data of a front-end module of the electronic device at a first frame rate.

Wherein, the running data may be at least one of the following: working status data, image data, voice data, debugging log data, video data, etc. of each chip in the front-end module, which is not limited herein. The working status data of each chip in the front-end module can be at least one of the following: working level, waveform, working voltage, working current, working power, working clock, etc., which are not limited here, and the above-mentioned running data can be raw data or For the preprocessed raw data, the preprocessing can be at least one of the following: sampling, compression, screening, etc., which is not limited here.

Wherein, as shown in FIG. 3B, in the embodiment of the present application, the front-end module may include: an image signal processor (ISP), a neural network processor (NPU), a memory (DDR), a master control module (TOP), a selector ( MUX), MIPI, etc., are not limited here. The selector is used to realize the selection operation of the running data. For example, only the running data of the ISP is selected. MIPI samples and packs the running data, and sends the packed data to the AP through the camera serial interface (CSI). The AP transmits the running data to the external device through the USB service. The front-end module can be an image preprocessor.

Optionally, the above step 301, setting up a virtual video device, can be implemented in the following manner:

The virtual video device is set through the MIPI of the front-end module.

In the specific implementation, a virtual video device can be set through MIPI, specifically, a virtual video device can be set through a camera serial interface (CSI) of MIPI, and the above-mentioned virtual video device can be called a virtualized video recording (video) equipment.

Optionally, before the above step 301, before setting the virtual video device, the following steps may also be included:

A1. Obtain target pipeline configuration parameters;

In step 301, using the virtual video device to pack the running data according to the second frame rate to obtain the target data package may include the following steps:

31. According to the preset mapping relationship between the pipeline configuration parameters and the packaging processing parameters, determine the target packaging processing parameters corresponding to the target pipeline configuration parameters, and the target packaging processing parameters include at least the second frame rate;

32. Pack the running data through the virtual video device using the target packing processing parameters to obtain the target data package.

Among them, in the embodiment of the present application, the pipeline configuration parameters may include at least one of the following: pipeline type, pipeline serial number, frame rate, resolution, etc., which are not limited here, and the pipeline type can be understood as used to process data of a certain data type For example, the image data corresponds to the image data pipeline type, and for example, the voice data corresponds to the voice data pipeline type, etc. The pipeline serial number can be understood as the serial number of the pipeline, and the pipeline serial number can be pre-defined, and the functions of the pipelines with different serial numbers are different. The packaging processing parameters include at least the frame rate, and the packaging processing parameters may also include at least one of the following: data packet size, packet header, packet trailer, etc., which are not limited here. The electronic device may pre-store a mapping relationship between preset pipeline configuration parameters and packaging processing parameters, that is, different pipeline configuration parameters may correspond to different packaging processing parameters.

In the specific implementation, the target pipeline configuration parameters can be pre-configured, and the electronic device can obtain the target pipeline configuration parameters from the hardware abstraction module (camera hal), and then determine the target pipeline according to the mapping relationship between the preset pipeline configuration parameters and the packaging processing parameters Configure the target packaging processing parameters corresponding to the parameters, and use the target packaging processing parameters to pack the running data through the virtual video device to obtain a target data packet. The target data packet can be at least one data packet, and the target packaging processing parameters include at least the second frame rate.

As an example, if the running data is packaged at fixed intervals, the amount of information generated by the front-end module may be small within a certain period of time, resulting in insufficient filling of the cache registers, resulting in waste of cache registers and transmission bandwidth. Data can be packaged based on the principle of sending when it is full, and the packaged data and the next frame of data can be sent to the AP for processing, or the packaged data can be stamped with a time stamp and sent to the AP for processing separately. This saves transmission bandwidth.

Wherein, the target data packet may include at least one data packet, and the data size of each data packet is less than or equal to the size of each cache register in a plurality of buffer registers allocated by the USB service, and the cache register is used to accommodate at least one data packet The data packet in, thus, facilitates the cache register to be able to hold the data packet.

Optionally, the above step A1, obtaining target pipeline configuration parameters, may include the following steps:

A11. Determine the target debugging content corresponding to the engineering mode;

A12. Obtain attribute information corresponding to the target debugging content;

A13. Determine the target pipeline configuration parameter corresponding to the attribute information of the target debugging content according to the preset mapping relationship between the attribute information of the debugging content and the pipeline configuration parameter.

Among them, in the embodiment of the present application, the attribute information of the debugging content may be at least one of the following: data type, debugging purpose, parameter type of debugging parameters, foreground application, etc., which are not limited here, and pre-stored The mapping relationship between the attribute information of the debugging content and the pipeline configuration parameters.

In specific implementation, the electronic device can determine the target debugging content corresponding to the engineering mode in the engineering mode, and the debugging content can be set by the user, or the debugging content can be determined based on the user's operation, and then the attributes corresponding to the target debugging content can be obtained information, furthermore, according to the preset mapping relationship between the attribute information of the debugging content and the pipeline configuration parameters, the target pipeline configuration parameters corresponding to the attribute information of the target debugging content can be determined, so that the corresponding Pipeline configuration parameters, in turn, can make the depth of pipeline configuration parameters meet the debugging requirements.

Optionally, in step 301, before setting the virtual video device, the following steps may also be included:

B1. Detecting whether the electronic device is in engineering mode;

B2. When the electronic device is in the engineering mode, perform the step of setting a virtual video device.

In a specific implementation, the electronic device can detect whether it is in the engineering mode. When the electronic device is in the engineering mode, step 301 can be executed; otherwise, step 301 may not be executed. In the embodiment of the present application, the engineering mode can also be called the debugging mode (debug mode). The engineering mode can be set by the user, or automatically enter the engineering mode when an abnormality occurs in the electronic device.

Among them, in the embodiment of this application, it is only to start the camera function, not to start the camera. After the camera function is turned on, because the hardware abstraction module needs to be called later, it is necessary to turn on the camera function so as to smoothly call the hardware abstraction module. The evacuation module can be used to implement unpacking operations to obtain operating data.

302. Use the virtual video device to package the running data at a second frame rate to obtain a target data package.

In a specific implementation, the electronic device can obtain the operating data of at least one module in the front-end module, and pack the operating data at the second frame rate through the virtual video device to obtain the target data packet, that is, the target data packet can be obtained according to a certain frequency. and size output the run data. Wherein, the first frame rate and the second frame rate may be the same or different.

303. Send the target data packet to a processor.

Specifically, the electronic device can virtualize the operating data through the virtual video device, so that it can transmit the operating data at a certain interval and size. After the front-end module packs and processes the obtained operating data according to certain rules, that is It can be placed in the cache register allocated by the backend (for the driver to store data in the front-end module), and further transmit the packaged data to the application processor AP (backend) through MIPI, and can also allocate multiple The buffer register (buffer register), and then, realizes the buffer register rotation operation. The number of cache registers can be set by the user, or determined by the bandwidth and/or the speed at which the running data is generated.

304. Determine whether there is an abnormality in the front-end module based at least in part on adjusting the value of the first frame rate and/or the second frame rate.

In a specific implementation, the operating data can be sent to an external device for data analysis, or the electronic device can also perform data analysis on the operating data to realize anomaly detection or detection of the working status of each chip in the front-end module. The above-mentioned external device can be Other electronic equipment, such as a host computer (PC). The data analysis may be at least one of the following functions: abnormality detection, status detection of each chip in the front-end module, debugging data analysis, etc., which are not limited herein. Electronic equipment can also display operating data through the display screen. In the embodiment of the present application, the first frame rate and/or the second frame rate may be dynamically adjusted, thereby ensuring effective packaging and packet transmission of the running data.

Specifically, it may be at least partly based on adjusting the value of the first frame rate to determine whether there is an abnormality in the front-end module, or at least partly based on adjusting the value of the second frame rate to determine whether there is an abnormality in the front-end module, or, Determine whether there is an abnormality in the front-end module based at least in part on adjusting the values of the first frame rate and the second frame rate. Adjustment is convenient for the front-end to transmit transportation data in a rhythmic and efficient manner, and to facilitate the back-end to quickly extract operating data in a rhythmic manner. During the adjustment process, the target data packet can be analyzed to obtain the operating data of the front-end module. Through the operating data to Determine if the front-end module is abnormal.

As an example, in the embodiment of this application, the electronic device processes the virtual video device of the abnormal information collection module in the front-end module so that the abnormal information (including the detection information at runtime) of different modules can be processed in a certain rhythm and size at the front end. Collect and package for real-time output to the PC side. When developers need to debug, they can get the cause of the problem by analyzing the received monitoring data.

Further, as an example, in the embodiment of the present application, when the running data is image data, for example, by comparing the processing effect of each frame (for example, the effect of certain areas) with the pre-stored standard rendering, it can be obtained The judgment result of the processing effect of the current frame, and then adaptively adjust the processing parameters of the relevant algorithm according to the judgment result so that the image processing of the camera system can perform image processing stably.

Optionally, after step 304, the following steps may also be included:

C1. Perform feature extraction on the operating data to obtain a target feature set;

C2. Input the target feature set into the preset neural network model to obtain the target operation result;

C3. Determine target abnormality information according to the target calculation result.

Wherein, the preset neural network model may be at least one of the following: a convolutional neural network model, a fully connected neural network model, a recurrent neural network model, etc., which are not limited herein.

In the embodiment of the present application, steps C1-C3 may be implemented by an electronic device, or may also be implemented by an external device, for example, a host computer PC. The target feature set may include at least one feature, or the target feature set may include at least one type of feature. When the running data is image data, the features may be at least one of the following: feature points, feature vectors, colors, pixels, feature lines, etc., which are not limited here. When the running data is sound data, the feature may be at least one of the following: frequency, amplitude, waveform, timbre, pitch, wavelength, etc., which is not limited here. When the running data is debugging data, the feature may be at least one of the following: level, waveform, voltage, current, power, log data, etc., which is not limited here.

Before executing step 301 in the embodiment of the present application, the neural network model can be trained through a large amount of sample data and labels corresponding to the samples, and after the neural network model converges, a preset neural network model can be obtained.

In the specific implementation, the electronic device can perform feature extraction on the operating data to obtain the target feature set, and then input the target feature set into the preset neural network model to obtain the target calculation result, which can be at least one label and the corresponding probability value , and then generate an abnormality analysis report according to the target calculation result, and use the abnormality analysis report as the target abnormality information, or the electronic device can also pre-store the mapping relationship between the calculation result and the abnormality information, and then determine the target calculation according to the mapping relationship The target abnormality information corresponding to the result, the abnormality information may be at least one of the following: abnormality cause, abnormality location, abnormality duration, etc., which are not limited here.

As an example, in the embodiment of this application, the front-end module can actively initiate anomaly detection on the system and images. When an anomaly occurs, it can detect the anomaly in advance and obtain relevant anomaly information, and then can without affecting the upper layer, that is, In the case of user experience and the call of the image preprocessor by the upper layer, the adaptive processing corresponding to the abnormality can be quickly performed, and the processed result and abnormal information can be reported, so that the upper layer can timely respond to the adaptive processing result and abnormality The information is further judged and processed, so that the embodiment of the present application can better improve the robustness of the system, and at the same time reduce the impact of abnormalities on the user experience and improve the user experience.

Wherein, as shown in Figure 3C, any data packet in the target data packet can include packet header PH, running data and packet tail PF, and packet header can be used to mark the start position of a data packet, and packet tail can be used to represent the data packet end position.

Further, the packet header may include: packet header mark, index packet mark and packet data length, the packet header mark is used to represent the data type of the current data packet, the index packet mark is used to represent the independent index of the current data packet, and the packet data length is used to represent The data length of the current data packet, the specific structure is shown in the following table:

包头结构Baotou structure	字节长度byte length
包头标记Baotou mark	Byte3Byte3
索引包标记index pack tag	Byte2Byte2
包数据长度packet data length	Byte1+Byte0Byte1+Byte0

Further, the packet tail can include: packet tail mark, data packet count and frame count, the packet tail mark is used to represent the position of the packet tail, the data packet count is used to represent the count (number) of data packets, and the frame count represents the Which frame the packet comes from, as shown in the following table:

包尾结构Packet structure	字节长度byte length
包尾标记end-of-packet marker	Byte3Byte3
数据包计数packet count	Byte2Byte2

Optionally, the following steps may also be included:

The target data packet is received by the AP, and the target data packet is unpacked to obtain the operation data, and the operation data is used for data analysis.

Among them, the AP can receive the target data packet, and unpack the target data packet according to the first frame rate and/or the second frame rate to obtain the operation data, and can also implement data analysis through the operation data to achieve the purpose of abnormal detection .

Optionally, the above step 302, unpacking the target data packet to obtain the operation data, may be implemented in the following manner:

The target data packet is unpacked by a hardware abstraction module to obtain the running data.

Among them, unpacking is the reverse operation of packing action. The hardware abstraction module can analyze the target data packet according to the flag bits or pre-agreed rules, and then process the parsed data. For example, the order of storage can be changed. adjustment or pack the abnormal information into the image data of the sub-camera when there are multiple channels of image data (the size of the image data of the sub-camera is small, and there is space and bandwidth to transmit debugging information), while the cache register of the main camera is Only image data is transferred.

For example, as shown in Figure 3D, taking debugging data as an example, the internal signal of the front-end module can be forwarded from the MIPI of the front-end module to the DDR on the AP side, and the AP side triggers an interrupt after receiving the data. Since the front-end module packs the debugging data as a virtual camera device (virtual video device), it is necessary to start a special pipeline (pipeline) in the hardware abstraction module to serve the virtual video device. Moreover, the USB service needs to allocate relevant cache registers and give the cache registers to the hardware abstraction module. The hardware abstraction module needs to copy the obtained debugging data to the cache registers allocated by the USB service in a frame-by-frame manner. It should be noted that, The data in the cache register does not need to be processed by the relevant algorithm of the ISP module on the AP side. Therefore, the ISP-related algorithm module needs to be closed, so as to ensure that the data transmitted to the external device (PC) is original data. For the rotation of the buffer registers, the USB service side can implement the rotation of the buffer registers by means of a callback function (callback).

In the embodiment of this application, for the customization of the engineering mode and pipeline configuration parameters of the AP, since it is necessary to ensure the integrity and distinguishability of the monitoring information of the front-end module, it is necessary to selectively access the data processing module of the AP during customization For example, some modules that will affect the data content cannot be accessed, such as the noise reduction function module, etc., so as to avoid tampering with the data. Furthermore, the processing of the buffer register by the pipeline is different from the traditional camera processing module. When the monitoring data and image data are packaged and transmitted, the data needs to be split and processed. Therefore, the buffer register of the original data will be parsed in the pipeline. Reorganization, data analysis and reorganization can be analyzed according to flag bits or agreed rules, and then the analyzed data can be processed separately.

Optionally, the above step, 302, unpacking the target data packet to obtain the operation data may include the following steps:

31. Copy the target data packet frame by frame into the target buffer register allocated by the USB service;

32. Unpack the data in the target cache register to obtain the running data.

In the specific implementation, the electronic device can copy the target data packet frame by frame to the target cache register allocated by the USB service through the hardware abstraction module, unpack the data in the target cache register through the hardware abstraction module, and obtain the running data. After the target cache register is occupied, the cache register rotation can be performed so as to provide the next cache register for storing the data copied by the hardware abstraction module. Of course, after the running data is uploaded to the host computer PC, the host computer can also Implement data analysis.

Optionally, the above-mentioned step 302, after unpacking the target data packet and obtaining the operating data, may also include the following steps:

calling the USB service to upload the running data to the external device through the target cache register, so that the external device can analyze the running data.

Further, optionally, the following steps may also be included:

A rotation operation is performed on the target cache register, so that the target cache register after rotation continues to be used for accommodating data packets received by the AP.

As an example, when the front-end module performs debugging data and processing, information can be divided and packaged based on the interval between frames. For example, each 33ms or 16.6ms is used to package and process the forward debugging data corresponding to the length of time. It can be guaranteed that the packaged debugging data can correspond to the image data (acquisition timing) according to the index or time stamp of the data packet, and the AP can distinguish based on this when processing. It is also possible to pack the debug data and the image data of the camera into the same buffer register. When the monitoring data and image data are packaged and transmitted, the data needs to be split and processed, so the cache registers of the original data will be parsed and reorganized in the pipeline.

As an example, in practical applications, when infringement detection is required, it is possible to identify whether the front-end module is virtualized into a video recording device by checking the working status of the camera during use. Furthermore, by judging the size and output speed (frame rate) of the data uploaded by the camera module, if the size is consistent within a certain period of time, and the output speed is output at a fixed speed, it can be basically confirmed that the data provided by the embodiment of the present application is used. The implementation method can also be further confirmed whether it constitutes an infringement.

As an example, in practical applications, for the debugging data transmitted by the front-end module, due to the large amount of data, the file can be scanned on the platform side (mobile phone terminal) to check whether there is any large-sized data generated in real time. After the larger data is real-time, the data can be pulled through adb, and then the data content is analyzed to confirm whether it is the debugging data packet transmitted by the front-end module.

It can be seen that the data transmission control method described in the embodiment of the present application is used for testing electronic equipment and setting a virtual video equipment, and the virtual video equipment is configured to encapsulate the operation of the front-end module of the electronic equipment at the first frame rate. data, using the virtual video device to pack the running data according to the second frame rate to obtain the target data packet, and sending the target data packet to the processor, at least partially based on the value of the first frame rate and/or the second frame rate. To determine whether there is an abnormality in the front-end module, because the virtual video device can perform virtual video recording processing on the running data, so that the running data can be output to the external device according to a certain frame rate and size, and then, it can efficiently capture the working information of the front-end module for Developers analyze.

This application provides please refer to Figure 4, Figure 4 is a schematic flowchart of a data transmission control method provided by an embodiment of this application, which is applied to an electronic device, and the electronic device includes a front-end module and an application processor AP, as shown in the figure , the data transmission control method includes:

401. Open a camera function to call a hardware abstraction module, where the hardware abstraction module is configured to: perform an unpacking operation.

402. Obtain target pipeline configuration parameters.

403. According to the preset mapping relationship between the pipeline configuration parameters and the packaging processing parameters, determine the target packaging processing parameters corresponding to the target pipeline configuration parameters.

404. Set a virtual video device, where the virtual video device is configured to encapsulate the running data of the front-end module of the electronic device at a first frame rate.

405. Use the virtual video device to pack the running data according to the target packing processing parameters to obtain a target data package.

406. Send the target data packet to a processor.

407. Use the AP to receive the target data packet, and use the hardware abstraction module to copy the target data packet frame by frame to a target buffer register allocated by the USB service.

408. Use the hardware abstraction module to unpack the data in the target cache register to obtain the running data.

409. Call the USB service to upload the running data to the external device through the target cache register, so that the external device can perform data analysis on the running data.

Wherein, for the specific description of the above step 401-step 409, reference may be made to the relevant description of the data transmission control method described in FIG. 3A , which will not be repeated here.

For example, in the specific implementation, the following steps can be performed:

S1. Turn on the camera;

S2. Configure relevant customized pipeline configuration parameters, and perform resource allocation;

S3. The front-end module also configures the packaging method according to the pipeline configuration parameters, that is, to ensure that the data size after packaging is consistent with the cache register allocated by the AP side;

S4, start the data flow, each sub-module in the front-end module performs data acquisition and output of the module operation, the MIPI of the front-end module performs data packaging processing, and each module performs cache register rotation according to the set parameters;

S5. The AP receives the data through the hardware abstraction module, and performs data analysis and processing according to the data packaging method, and performs a copy operation on the analyzed data, and copies it to the USB service in real time;

S6, the USB service transmits the received data to the external device;

S7. Based on the above steps, the cache registers are rotated to ensure that the front-end monitoring data is packaged and transmitted to the back-end in real time for storage or transmission to the PC side.

Furthermore, because MIPI can process the operating data with a virtual video device, the operating data can be output to external devices at a certain frame rate and size, and then, the working information of the front-end module can be efficiently captured for developers to analyze.

Consistent with the above embodiment, please refer to FIG. 5. FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. As shown in the figure, the electronic device includes a front-end module, a processor, a memory, a communication interface, and One or more programs, wherein the above one or more programs are stored in the above memory and configured to be executed by the above processor or front-end module. In the embodiment of the present application, the above program includes instructions for performing the following steps:

sending the target data packet to a processor;

Optionally, in terms of setting the virtual video device, the above program includes instructions for performing the following steps:

The virtual video device is set through the MIPI of the front-end module.

Optionally, before the virtual video device is set, the above program also includes an instruction for performing the following steps:

Get target pipeline configuration parameters;

In terms of using the virtual video device to pack the running data at the second frame rate to obtain the target data package, the above program also includes instructions for performing the following steps:

Optionally, in terms of acquiring target pipeline configuration parameters, the above program includes instructions for performing the following steps:

Determine the target debugging content corresponding to the engineering mode;

Obtain attribute information corresponding to the target debugging content;

Optionally, the above program also includes instructions for performing the following steps:

Optionally, in terms of unpacking the target data packet to obtain the operating data, the above program includes instructions for performing the following steps:

Unpacking the data in the target cache register to obtain the running data.

Optionally, after the target data packet is unpacked to obtain the running data, the above program further includes instructions for performing the following steps:

Detecting whether the electronic device is in engineering mode;

When the electronic device is in the engineering mode, the step of setting a virtual video device is performed.

Enabling the camera of the electronic device to call a hardware abstraction module, wherein the hardware abstraction module is configured to: perform the function of unpacking the target data packet to obtain the operation data.

The foregoing mainly introduces the solutions of the embodiments of the present application from the perspective of executing the process on the method side. It can be understood that, in order to realize the above functions, the electronic device includes hardware structures and/or software modules corresponding to each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of the examples described in the embodiments provided herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.

The embodiment of the present application may divide the electronic device into functional units according to the above method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units. It should be noted that the division of units in the embodiment of the present application is schematic, and is only a logical function division, and there may be another division manner in actual implementation.

FIG. 6 is a block diagram of functional units of a data transmission control device 600 involved in the embodiment of the present application. The data transmission control device 600 is applied to an electronic device, the electronic device includes a front-end module and a processor, and the device includes: a setting unit 601, a packaging unit 602, a sending unit 603 and an abnormality detection unit 604, wherein,

The setting unit 601 is configured to set a virtual video device, the virtual video device is configured to encapsulate the operation data of the front-end module of the electronic device at a first frame rate;

The packaging unit 602 is configured to use the virtual video device to package the running data at a second frame rate to obtain a target data package;

The sending unit 603 is configured to send the target data packet to a processor;

The abnormality detection unit 604 is configured to determine whether there is an abnormality in the front-end module based at least in part on adjusting the value of the first frame rate and/or the second frame rate.

Optionally, in terms of setting the virtual video device, the setting unit 601 is specifically configured to:

The virtual video device is set through the MIPI of the front-end module.

Optionally, before the setting of the virtual video device, the apparatus 600 is further specifically configured to:

Get target pipeline configuration parameters;

In terms of using the virtual video device to pack the running data at a second frame rate to obtain a target data packet, the packing unit 602 is specifically used for:

Optionally, in terms of acquiring target pipeline configuration parameters, the device 600 is specifically used to:

Determine the target debugging content;

Obtain attribute information corresponding to the target debugging content;

Optionally, the device 600 is also specifically used for:

Optionally, in the aspect of unpacking the target data packet to obtain the operation data, the device 600 is specifically used for:

Unpacking the data in the target cache register to obtain the running data.

Optionally, after the target data packet is unpacked to obtain the operation data, the device 600 is further specifically configured to:

Optionally, the device 600 is also specifically used for:

It should be noted that the electronic devices described in the embodiments of the present application are presented in the form of functional units. The term "unit" used here should be understood as the broadest meaning possible. The object used to realize the functions described by each "unit" can be, for example, an integrated circuit ASIC, a single circuit, used to execute one or more software or firmware Processors (shared, dedicated, or chipsets) and memories of programs, combinational logic circuits, and/or other suitable components that provide the functions described above.

Wherein, the setting unit 601, the packaging unit 602, and the sending unit 603 may be front-end modules, and the abnormality detection unit 604 may be a processor, based on the above-mentioned unit modules, the functions or steps of any of the above-mentioned methods can be realized.

This embodiment also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, wherein the above-mentioned computer program enables the computer to execute the embodiment of the present application to implement Any method in the above embodiments.

This embodiment also provides a computer program product, which, when running on a computer, causes the computer to execute the above-mentioned related steps, so as to implement any method in the above-mentioned embodiments.

In addition, an embodiment of the present application also provides a device, which may specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store computer-executable instructions, and when the device is running, The processor can execute the computer-executable instructions stored in the memory, so that the chip executes any method in the above method embodiments.

Wherein, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is all used to execute the corresponding method provided above, therefore, the beneficial effects it can achieve can refer to the corresponding method provided above The beneficial effects in the method will not be repeated here.

Through the description of the above embodiments, those skilled in the art can understand that for the convenience and brevity of the description, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be assigned by different Completion of functional modules means that the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or It may be integrated into another device, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

A unit described as a separate component may or may not be physically separated, and a component shown as a unit may be one physical unit or multiple physical units, which may be located in one place or distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If an integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium Among them, several instructions are included to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods in various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes such as U disk, mobile hard disk, read only memory (ROM), random access memory (random access memory, RAM), magnetic disk or optical disk.

The above content is only the specific implementation of the application, but the scope of protection of the application is not limited thereto. Anyone familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the application, and should covered within the scope of protection of this application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

A data transmission control method for testing electronic equipment, characterized in that the method includes:

Setting a virtual video device, the virtual video device is configured to encapsulate the operating data of the front-end module of the electronic device at a first frame rate;

Using the virtual video device to pack the running data at a second frame rate to obtain a target data packet;

sending the target data packet to a processor;

Determining whether the front-end module is abnormal is based at least in part on adjusting values of the first frame rate and/or the second frame rate.
The method according to claim 1, wherein said setting a virtual video device comprises:

The virtual video device is set through the MIPI of the front-end module.
The method according to claim 1 or 2, wherein, before the setting of the virtual video device, the method further comprises:

Get target pipeline configuration parameters;

Wherein, said using said virtual video device to pack said running data according to a second frame rate to obtain a target data package, including:

According to the preset mapping relationship between the pipeline configuration parameters and the packaging processing parameters, determine the target packaging processing parameters corresponding to the target pipeline configuration parameters, and the target packaging processing parameters include at least the second frame rate;

The virtual video device packs the running data by using the target packing processing parameters to obtain the target data package.
The method according to claim 3, wherein the target data packet comprises at least one data packet, and the data size of each data packet is less than or equal to each buffer register in a plurality of buffer registers allocated by the USB service The size of the cache register is used to accommodate the data packets in the at least one data packet.
The method according to claim 3 or 4, wherein said acquiring target pipeline configuration parameters comprises:

Determine the target debugging content;

Obtain attribute information of the target debugging content;

The target pipeline configuration parameters corresponding to the attribute information of the target debugging content are determined according to the preset mapping relationship between the attribute information of the debugging content and the pipeline configuration parameters.
The method according to any one of claims 1-5, wherein the method further comprises:

The processor receives the target data packet, unpacks the target data packet to obtain the operation data, and the operation data is used for data analysis.
The method according to any one of claims 1-6, wherein the unpacking the target data packet to obtain the operating data includes:

Copying the target data packet frame by frame into the target buffer register allocated by the USB service;

Unpacking the data in the target cache register to obtain the running data.
The method according to claim 7, characterized in that, after the target data packet is unpacked to obtain the operating data, the method further comprises:

calling the USB service to upload the running data to the external device through the target buffer register, so that the external device can analyze the running data.
The method according to claim 8, characterized in that the method further comprises:

A rotation operation is performed on the target cache register, so that the target cache register after rotation continues to be used for accommodating data packets received by the processor.
The method according to any one of claims 1-9, wherein, before setting the virtual video device, the method further comprises:

Enabling the camera of the electronic device to invoke a hardware abstraction module, wherein the hardware abstraction module is configured to: perform the function of unpacking the target data packet to obtain the operation data.
A data transmission control device, characterized in that it is applied to electronic equipment, the electronic equipment includes a front-end module and a processor, and the device includes: a setting unit, a packaging unit, a sending unit, and an abnormality detection unit, wherein,

The setting unit is configured to set a virtual video device, and the virtual video device is configured to encapsulate the operation data of the front-end module of the electronic device at a first frame rate;

The packaging unit is configured to use the virtual video device to package the running data at a second frame rate to obtain a target data package;

The sending unit is configured to send the target data packet to a processor;

The abnormality detection unit is configured to determine whether there is an abnormality in the front-end module based at least in part on adjusting the value of the first frame rate and/or the second frame rate.
The device according to claim 11, wherein, in terms of setting the virtual video device, the setting unit is specifically used for:

The virtual video device is set through the MIPI of the front-end module.
The device according to claim 11 or 12, wherein, before setting the virtual video device, the device is further specifically used for:

Get target pipeline configuration parameters;

Wherein, in the aspect of using the virtual video device to pack the running data according to the second frame rate to obtain the target data packet, the packing unit is specifically used for:

According to the preset mapping relationship between the pipeline configuration parameters and the packaging processing parameters, determine the target packaging processing parameters corresponding to the target pipeline configuration parameters, and the target packaging processing parameters include at least the second frame rate;

The virtual video device packs the running data by using the target packing processing parameters to obtain the target data package.
The device according to claim 13, wherein the target data packet comprises at least one data packet, and the data size of each data packet is less than or equal to each buffer register in a plurality of buffer registers allocated by the USB service The size of the cache register is used to accommodate the data packets in the at least one data packet.
The device according to claim 13 or 14, wherein, in terms of acquiring target pipeline configuration parameters, the device is specifically used for:

Determine the target debugging content;

Obtain attribute information of the target debugging content;

The target pipeline configuration parameters corresponding to the attribute information of the target debugging content are determined according to the preset mapping relationship between the attribute information of the debugging content and the pipeline configuration parameters.
The device according to any one of claims 10-15, wherein the device is further specifically used for:

The processor receives the target data packet, unpacks the target data packet to obtain the operation data, and the operation data is used for data analysis.
An electronic device, comprising a front-end module and a processor, characterized in that:

The front-end module is configured to:

Setting a virtual video device to encapsulate the operation data of the front-end module at a first frame rate;

Packing the running data at a second frame rate by using the virtual video device to obtain a target data packet; and

sending the target data packet to the processor;

The processor is configured to:

Determining whether the front-end module is abnormal is based at least in part on adjusting values of the first frame rate and/or the second frame rate.
An electronic device, characterized in that the electronic device includes a front-end module, a processor, and a memory, the memory is used to store one or more programs, and is configured to be executed by the processor or the front-end module, the The program includes instructions for executing the steps in the method according to any one of claims 1-10.
A computer-readable storage medium, characterized by storing a computer program for electronic data exchange, wherein the computer program causes a computer to execute the method according to any one of claims 1-10.
A computer program product, characterized in that the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the computer program described in any one of claims 1-9. described method.