CN116110351B - Backlight control method, device, chip, electronic equipment and medium - Google Patents

Abstract

The embodiment of the application provides a backlight control method, a device, a chip, electronic equipment and a medium, wherein the method comprises the following steps: under the condition that a screen of the electronic equipment is in a full-screen display image state, acquiring first brightness issued by a first module of the electronic equipment, wherein the first module is used for issuing backlight brightness to the screen of the electronic equipment; and executing a first operation to enable the backlight brightness sent to the screen of the electronic equipment to be the threshold brightness under the condition that the first brightness is smaller than the preset threshold brightness corresponding to the screen of the electronic equipment. The embodiment of the application can improve the experience of the user when watching the video and the picture in a full screen under the dim light environment.

Description

Backlight control method, device, chip, electronic equipment and medium

Technical field

The present application relates to the technical field of electronic equipment, and in particular to a backlight control method, device, chip, electronic equipment and medium.

Background technique

In dark light environments, the backlight brightness of electronic devices can be adjusted to a lower value. However, at this time, it is difficult for users to see low-contrast, dark-toned images, which affects the user experience.

Contents of the invention

Embodiments of the present application provide a backlight control method, device, chip, electronic device and medium, which can improve the user's experience when watching videos and pictures in full-screen in dark light environments.

In a first aspect, embodiments of the present application provide a backlight control method, which includes: when the screen of the electronic device is in a full-screen image display state, obtaining the first brightness issued by the first module of the electronic device, and the first module is used to Send backlight brightness to the screen of the electronic device; when the first brightness is less than a preset threshold brightness corresponding to the screen of the electronic device, perform the first operation so that the backlight brightness sent to the screen of the electronic device is the threshold brightness.

In the embodiment of the present application, when the screen of the electronic device is in a full-screen image display state, the first brightness sent by the first module of the electronic device is obtained. The first module is used to send the backlight brightness to the screen of the electronic device. If the first brightness is less than The threshold brightness corresponding to the screen of the electronic device is preset, and the first operation is performed so that the backlight brightness sent to the screen of the electronic device is the threshold brightness. This can prevent the user from watching videos and pictures in full screen in a dark light environment. , it is difficult to see low-contrast, dark-toned images clearly, thus improving the user's experience when watching videos and pictures in full-screen in dark light environments.

Optionally, when the screen of the electronic device is in a full-screen image display state, the method further includes: obtaining an image displayed on the screen of the electronic device; obtaining the grayscale and brightness of the obtained image; when the grayscale of the obtained image is less than If at least one of the preset gray threshold and the brightness of the obtained image is less than the preset brightness threshold, the step of obtaining the first brightness issued by the first module of the electronic device is performed.

By first performing image detection and then performing on-demand backlight brightness control based on the image detection results, the backlight brightness can be controlled on-demand for full-screen low-contrast or dark image scenes, but not for full-screen high-contrast or bright image scenes. Control to achieve selective execution of on-demand backlight brightness control, avoid unnecessary on-demand backlight brightness control, and avoid high power consumption problems caused by always performing on-demand backlight brightness control.

Optionally, when the screen of the electronic device is in a full-screen image display state, the method further includes: when the screen of the electronic device begins to display the image in full screen, performing the step of acquiring the image displayed on the screen of the electronic device; When the screen is refreshed, the step of obtaining an image displayed on the screen of the electronic device is performed.

By performing image detection when full-screen image display begins and at each screen refresh, image detection can be performed accurately on demand, thereby helping to enable backlight control to be performed accurately and on demand.

Optionally, the preset grayscale threshold is obtained based on the grayscale of at least one preset image, and the preset brightness threshold is obtained based on the brightness of at least one preset image; wherein the step for obtaining the image grayscale includes: based on each Multiple channel values of pixels are used to obtain the grayscale value of each pixel in the image, and the grayscale of the image is obtained based on the grayscale value of each pixel in the image; the steps used to obtain the brightness of the image include: according to each pixel in the image The multiple channel values of the pixel are processed through color space conversion to obtain the brightness of each pixel in the image, and based on the brightness of each pixel in the image, the brightness of the image is obtained.

Feasibly, the preset image can be a predetermined low contrast or dark image, and the brightness threshold and grayscale threshold are obtained accordingly. When performing picture detection based on this, it is possible to accurately distinguish between scenes where low-contrast or dark images are displayed on the full screen and scenes where high-contrast or bright images are displayed on the full screen, thereby enabling accurate execution of backlight control on demand.

Optionally, the backlight control method also includes: monitoring whether the electronic device is in a full-screen video playback scene; monitoring whether the electronic device is in a full-screen picture display scene; where the screen of the electronic device is in a full-screen image display state: the electronic device is in a full-screen video display state. The playback scene and the electronic device are in any of the full-screen picture display scenes.

By monitoring the full-screen video playback scene and the full-screen picture display scene together, the full-screen display image scene can be accurately monitored on demand, thereby enabling accurate on-demand execution of backlight control.

Optionally, monitoring whether the electronic device is in a full-screen video playback scene includes: monitoring whether the electronic device is in a full-screen video playback scene without barrage; where the electronic device is in a full-screen video playback scene including: the electronic device is in a full-screen video playback scene without barrage The situation of playing the scene.

By monitoring the full-screen video playback scene without barrage, the impact of the presence of barrage on image detection can be avoided, which is helpful to ensure the accurate acquisition of image brightness and grayscale, thereby accurately identifying low-contrast or dark images displayed on the full screen in dark light environments. scenarios to ensure accurate on-demand execution of backlight brightness optimization based on threshold brightness.

Optionally, the threshold brightness is the minimum backlight brightness of the test device that enables the clarity of the first image to meet expectations; where the screen of the test device and the screen of the electronic device have the same structure; the first image is between the test device and the camera. When both are in the same no-light environment and the screen of the test device displays the preset image in full screen, the camera captures the portion of the image obtained from the screen of the test device that corresponds to the preset image.

In this way, the threshold brightness of different types of devices can be different accordingly. The threshold brightness is targeted and applicable to electronic devices. In this way, when performing backlight control, appropriate backlight brightness can be issued to avoid full-screen viewing of dark videos in dark light environments. /pictures are difficult to see clearly, which can improve the user’s experience when watching videos/pictures in full-screen in dark light environments.

Optionally, the first brightness is obtained based on at least one of the backlight brightness obtained by three-party applications in the electronic device, the backlight brightness adjustment instruction received by the electronic device, and the backlight brightness corresponding to the ambient illumination of the environment in which the electronic device is located.

By first obtaining an appropriate backlight brightness based on at least one dimming method, and then optimizing the backlight brightness delivered to the device screen based on the comparison between the obtained backlight brightness and the threshold brightness, as needed, a more appropriate backlight brightness can be delivered. .

In a second aspect, embodiments of the present application provide a backlight control device, including: an acquisition module configured to acquire the first brightness issued by the first module of the electronic device when the screen of the electronic device is in a full-screen image display state, The first module is used to send backlight brightness to the screen of the electronic device; the control module is used to perform a first operation to send backlight brightness to the screen of the electronic device when the first brightness is less than a preset threshold brightness corresponding to the screen of the electronic device. The backlight brightness of the screen of the electronic device is the threshold brightness.

In a third aspect, embodiments of the present application provide an electronic chip, including: a processor configured to execute computer program instructions stored in a memory, wherein when the computer program instructions are executed by the processor, the electronic chip is triggered to execute the following steps: method of any one of the aspects.

In a fourth aspect, embodiments of the present application provide an electronic device. The electronic device includes a memory for storing computer program instructions, a processor for executing computer program instructions, and a communication device. When the computer program instructions are executed by the processor, When, the electronic device is triggered to perform any of the methods in the first aspect.

In a fifth aspect, embodiments of the present application provide a computer-readable storage medium. The computer-readable storage medium stores a computer program that, when run on a computer, causes the computer to execute the method in any one of the first aspects.

In a sixth aspect, embodiments of the present application provide a computer program product. The computer program product includes a computer program. When the computer program is run on a computer, it causes the computer to execute the method of any one of the first aspects.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required to be used in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without exerting creative efforts.

Figure 1 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

Figure 2 is a schematic diagram of a backlight control process provided by an embodiment of the present application;

Figure 3 is a schematic diagram of another backlight control process provided by an embodiment of the present application;

Figure 4 is a schematic flow chart of a backlight control method provided by an embodiment of the present application;

Figure 5 is a schematic diagram of another backlight control process provided by an embodiment of the present application;

Figure 6 is a schematic flowchart of another backlight control method provided by an embodiment of the present application;

Figure 7 is a sequence diagram of scene recognition provided by an embodiment of the present application;

Figure 8 is a timing diagram of waking up and ending the image detection module provided by an embodiment of the present application;

Figure 9 is a schematic diagram of a test threshold brightness implementation method provided by an embodiment of the present application;

FIG. 10 is a schematic flowchart of yet another backlight control method provided by an embodiment of the present application.

Detailed ways

In order to better understand the technical solution of the present application, the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

It should be clear that the described embodiments are only some of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without making creative efforts fall within the scope of protection of this application.

The terminology used in the embodiments of the present application is only for the purpose of describing specific embodiments and is not intended to limit the present application. As used in the embodiments and the appended claims, the singular forms "a," "the" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise.

It should be understood that the term "at least one" used herein refers to one or more, and "plurality" refers to two or more. The term "and/or" used in this article is just an association relationship describing related objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A alone exists, A and B exist simultaneously, alone There are three situations B. Where A and B can be singular or plural. In addition, the character "/" in this article generally indicates that the related objects are an "or" relationship. "At least one of the following" and similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can represent: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, c can be single or multiple.

It should be understood that although the terms first, second, etc. may be used to describe the set thresholds in the embodiments of the present application, these set thresholds should not be limited to these terms. These terms are only used to distinguish set thresholds from each other. For example, without departing from the scope of the embodiments of the present application, the first set threshold may also be called a second set threshold, and similarly, the second set threshold may also be called a first set threshold.

The terms used in the embodiments of the present application are only used to explain specific embodiments of the present application and are not intended to limit the present application.

The backlight control method provided by any embodiment of the present application can be applied to the electronic device 100 shown in FIG. 1 . FIG. 1 shows a schematic structural diagram of an electronic device 100 .

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), an image signal processor ( image signal processor (ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors.

The controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuitsound, I2S) interface, a pulse code modulation (PCM) interface, and a universal asynchronous receiver (universal asynchronous receiver) /transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and/or Universal serial bus (USB) interface, etc.

The USB interface 130 is an interface that complies with USB standard specifications, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. It can be understood that the interface connection relationships between the modules illustrated in the embodiments of the present application are only schematic illustrations and do not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.

The mobile communication module 150 can provide solutions for wireless communication including 2G/3G/4G/5G applied on the electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

A modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be independent of the processor 110 and may be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (bluetooth, BT), and global navigation satellite system. (global navigation satellite system, GNSS), frequency modulation (FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (codedivision multiple access, CDMA), broadband code Wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM , and/or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou satellite navigation system (beidounavigation satellite system, BDS), quasi-zenith satellite system (quasi-zenith) satellitesystem (QZSS) and/or satellite based augmentation systems (SBAS).

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, videos, etc. Display 194 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode). (AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

The electronic device 100 can implement the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process the data fed back by the camera 193. Camera 193 is used to capture still images or video. The object passes through the lens to produce an optical image that is projected onto the photosensitive element.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can continuously learn by itself.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 . The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. Such as saving music, videos, etc. files in external memory card.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the stored program area can store an operating system, at least one application program required for a function (such as a sound playback function, an image playback function, etc.). The storage data area may store data created during use of the electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playback, recording, etc.

The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, pressure sensor 180A may be disposed on display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor may include at least two parallel plates of conductive material. When a force is applied to pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is performed on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 may also calculate the touched position based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch location but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold is applied to the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

The gyro sensor 180B may be used to determine the motion posture of the electronic device 100 . Air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation. Magnetic sensor 180D includes a Hall sensor. The acceleration sensor 180E can detect the acceleration of the electronic device 100 in various directions (generally three axes). Distance sensor 180F for measuring distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may utilize the distance sensor 180F to measure distance to achieve fast focusing. Proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The ambient light sensor 180L is used to sense ambient light brightness. Fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access to application locks, fingerprint photography, fingerprint answering of incoming calls, etc. Temperature sensor 180J is used to detect temperature.

Touch sensor 180K, also known as "touch device". The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation on or near the touch sensor 180K. The touch sensor can pass the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a location different from that of the display screen 194 .

The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 . The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 . The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

In order to avoid discomfort and damage to the user's eyes caused by over-brightness of the screen in low-light environments (such as relatively dark or completely dark environments), the backlight brightness of electronic devices can be adjusted to a lower value in low-light environments. Feasibly, when the electronic device is in a dark light environment, the backlight brightness of the electronic device can be adjusted to a lower value automatically or manually.

In a feasible implementation method, third-party applications can be installed in the electronic device, such as video software, camera fill-light applications, etc., and the backlight brightness of the electronic device screen can be automatically adjusted through the installed third-party applications.

In another possible implementation, when the electronic device is in a dark light environment, the electronic device can adjust the backlight brightness of the screen of the electronic device in response to a backlight brightness adjustment instruction issued by the user by performing a backlight brightness adjustment operation.

In another possible implementation, the ambient light sensor in the electronic device can collect the ambient illumination in real time, and the display management service module of the electronic device can map the corresponding backlight brightness according to the ambient illumination, and automatically adjust the backlight brightness of the electronic device screen accordingly.

In another feasible implementation method, any two or all of three-party application adjustment, user manual adjustment, and ambient light adjustment (i.e., ambient light dimming) can be combined to automatically adjust the backlight brightness of the electronic device screen. In one embodiment, when there is more than one adjustment method, the adjustment priority can be set in advance, and the backlight brightness sent to the electronic device screen is determined based on the adjustment priority and the backlight brightness generated by various adjustment methods.

In a feasible implementation method, the backlight control process shown in Figure 2 can be used for backlight control. Please refer to Figure 2. The electronic device may include an application (APP, Application) layer 21, an application framework (FWK, Framework) layer 22, a local service (Native) layer 23, a hardware abstraction (Hal, Hardware abstraction layer) layer 24, and a kernel ( Kernel layer 25, hardware layer 26.

The third-party application 211 in the application layer 21 can send the generated backlight brightness to Display management service (DMS, Display ManagerService) module 223 in the application framework layer 22.

In one embodiment, the SettingsProvider (settings storage) in the application framework layer 22 can connect to the third-party application 211 and the display management service module 223 respectively. Feasibly, SettingsProvider is a process in the Android system that provides data storage. It can store Android's default initial values and can be used to obtain the value of specified settings.

The backlight brightness setting module 212 in the application layer 21 can be used to set manual brightness adjustment, and send the set brightness to the display management service module 223 .

The sensor service module 224 in the application framework layer 22 can sense the intensity of ambient light in the environment where the electronic device is located, and send the corresponding backlight intensity mapped accordingly to the display management service module 223 .

The display management service module 223 can determine the backlight brightness to be sent to the electronic device screen based on the backlight brightness sent by the third-party application 211, the backlight brightness setting module 212 and the sensor service module 224, combined with the preset adjustment priority, and will determine the backlight brightness. The backlight brightness is sent to the backlight control module 231 in the local service layer 23 .

For example, it can be sent to the backlight control module 231 in the Surface Flinger (layer deliverer) service module of the local service layer 23 . Feasibly, the brightness values obtained by the three dimming methods are sent to the display management service module 223, and then uniformly sent to the Surface Flinger service module through the display management service module 223. Among them, the Surface Flinger service can be used to draw the UI (User Interface) of Android applications.

The backlight control module 231 may send the received backlight brightness to the brightness delivery module 241 in the hardware combination abstraction layer (HWC, hwcomposer) module 240 of the hardware abstraction layer 24 .

The brightness sending module 241 may send the received backlight brightness to the display engine driver 251 in the kernel layer 25 .

In one embodiment, the display engine driver 251 may be an SDE driver (Qualcomm Display Engine Driver). Among them, the full spelling of SDE is Snapdragon display engine.

In a feasible implementation, the backlight brightness can be sent to the backlight driver (BLdriver) in the SDE driver. Among them, the full spelling of BL can be backlight.

The display engine driver 251 can send the received backlight brightness to the liquid crystal display (LCD, LiquidCrystal Display) 262 in the hardware layer 26 via the display processing unit (DPU, Display Processing Unit) 261 in the hardware layer 26, thereby realizing the The purpose of emitting backlight brightness under the screen of electronic devices.

Please refer to Figure 2. The ambient light sensor 263 in the hardware layer 26 can collect ambient light information in real time.

In one embodiment, when the ambient light sensor is interrupted (that is, a change in ambient light is sensed), the ambient light intensity (in lux) can be calculated using the noise-censored RGBC channel value. Among them, R (red) can represent the red channel, G (green) can represent the green channel, B (blue) can represent the blue channel, and C (clear) can represent transparent light.

The ambient light driver 252 in the kernel layer 25 can report the ambient illumination to the sensor hardware abstraction layer service (such as sensor hidl service) module 248 on the AP (application process, application processor) side in the hardware abstraction layer 24, sensor hardware abstraction layer The service module 248 reports the ambient illumination to the sensor service module 224, and then the sensor service module 224 dispatches the value of the ambient illumination to the display management service module 223. The display management service module 223 can determine whether to adjust the light according to changes in ambient illumination. Among them, the display management service can be a listening thread. The full spelling of hidl is HAL Interface Definition Language (HAL interface definition language).

In a dark light environment, the backlight brightness of an electronic device can be adjusted to a lower value, but at this time it is difficult for users to see low-contrast, dark-tone images clearly, which affects the user experience. The image can be a picture, a photo, or any frame in a video.

For example, in a usage scenario where the mainstream dimming method is ambient light dimming and the user uses the mobile phone to watch videos/pictures in a dark light environment, the ambient light dimming module of the mobile phone can follow the environment in a dark light environment and change the brightness of the mobile phone screen. Adjusting the backlight brightness to a lower level will make it difficult for users to see the mobile phone screen clearly when watching videos/pictures with low contrast or dark main colors in full screen, resulting in a poor viewing experience.

In one embodiment of the present application, the backlight control process shown in Figure 3 can be used for backlight control. Please refer to Figure 3. In addition to the various modules shown in Figure 2, the electronic device can also include a video scene monitoring module 245 and a brightness detection module 247 in the hardware combination abstraction layer module 240 of the hardware abstraction layer 24 of the electronic device. The kernel layer 25 may also include a threshold brightness storage module 253.

In one embodiment, the video scene monitoring module 245 can monitor whether the electronic device is in a full-screen video playback scene (for example, it can be a full-screen video playback scene without barrage), and if so, the brightness detection module 247 can be awakened. If the electronic device is in a video playback scene that does not play videos in full screen, the brightness detection module 247 will not be awakened.

In another embodiment, the video scene monitoring module 245 can also monitor whether the electronic device is in a full-screen (or large-screen) picture display scene, and if so, the brightness detection module 247 can be awakened. If the electronic device is in a picture display scene that does not display pictures in full screen, the brightness detection module 247 will not be awakened.

After being awakened, the brightness detection module 247 can obtain the backlight brightness issued by the display management service module 223 and obtain the threshold brightness stored in the threshold brightness storage module 253 . In one embodiment, the threshold brightness storage module 253 can be a dtbo (Device Tree Blob Overlay, device tree block overlay) partition in the electronic device.

Among them, the threshold brightness stored in the threshold brightness storage module 253 can correspond to the liquid crystal display 262 of the electronic device, so that when the liquid crystal display 262 displays videos/pictures with lower contrast or darker main colors under the threshold brightness, the user can see Clear the screen displayed on the device.

If the delivered backlight brightness is lower than the threshold brightness, the brightness detection module 247 can change the delivered backlight brightness to the threshold brightness, that is, deliver the threshold brightness to the liquid crystal display 262 . If the delivered backlight brightness is not lower than the threshold brightness, the brightness detection module 247 may not perform processing so as not to change the delivered backlight brightness.

When the electronic device is in the full-screen video playback/picture display scene, there is a possibility that the user can watch videos/pictures with low contrast or dark main colors in full screen in a dark light environment. By using the electronic device in the full-screen video playback/picture display scene, During this time, the backlight brightness delivered is changed as needed according to the threshold brightness to prevent the backlight brightness delivered to the liquid crystal display 262 from being lower than the threshold brightness. This operation can avoid the situation where it is difficult for users to see the display screen clearly when watching videos/pictures with low contrast or dark main colors in full screen in dark light environments, and the user viewing experience will be good.

Please refer to Figure 4. Taking optimizing the user's viewing experience when watching a video in full screen in a dark light environment as an example, one embodiment of the present application provides a backlight control method. The method may include the following steps 401 to 408:

Step 401: When the scene recognition engine detects that the electronic device enters the video viewing scene, it starts full-screen video event monitoring.

In a feasible implementation, the scene recognition engine (APS) in the application framework layer of the electronic device can monitor changes in the scene in which the electronic device is located in real time.

In one embodiment, the scene recognition engine may be APS (Adaptive Power Saving, adaptive power saving module, or adaptive energy saving module).

In one embodiment, APS can be used to control application frame rate and resolution, and can also be used to identify special scenes to support the execution of corresponding power-saving processing.

In a feasible implementation, a video application can be installed on the electronic device. When the user issues a playback instruction for any video in the video application, the electronic device can start playing the corresponding video, and the scene recognition engine can detect the electronic device at this time. Enter the video viewing scene to enable full-screen video event monitoring. By turning on full-screen video event monitoring, you can monitor in real time whether the electronic device plays video in full screen (that is, monitor whether the electronic device is in a full-screen video playing scene) and obtain the monitoring results.

Correspondingly, when it is detected that the electronic device exits the video viewing scene, full-screen video event monitoring can be turned off. In this way, full-screen video event monitoring can be performed only when the electronic device is in a video viewing scene, so as to achieve effective monitoring of full-screen video events.

In one embodiment, when it is monitored that the electronic device plays a video in full screen, the obtained monitoring result may be id=1. When it is monitored that the electronic device does not play the video in full screen, the obtained monitoring result may be id=0. In this way, according to the id (Identity document, logo) changes to get the moment when the electronic device starts/ends full-screen video playback.

In one embodiment, the monitored full-screen video event may specifically be a full-screen video event without barrage. For example, if the user performs the operation of watching a video in full screen and turning off the barrage, a full-screen video event without barrage can be monitored, and the electronic device is currently in a full-screen video playback scene without barrage; if the user turns off barrage by default in the video software If you perform the operation of watching a video in full screen, you can monitor the full-screen video event without barrage, and the electronic device is currently in a full-screen video playback scenario without barrage.

Step 402: The video scene monitoring module determines whether the electronic device starts playing the video in full screen according to the monitoring results. If so, step 403 is executed; otherwise, step 402 is executed (that is, step 403 is not executed).

In one embodiment, based on the monitoring results generated in real time, the scene recognition engine can actively send notifications (ie, send monitoring results) to the video scene monitoring module. The video scene monitoring module can determine the moment when the electronic device starts/ends full-screen video playback based on the monitoring results.

In other embodiments of the present application, the video scene monitoring module can periodically (for example, at 5s intervals) poll whether the video decoding process is started, and after determining that the video decoding process is started, further determine whether the current scene of the electronic device is a full-screen video. Play the scene to determine when the electronic device starts playing the video full screen.

Step 403: The brightness detection module obtains the first brightness issued by the display management service module of the electronic device (that is, the backlight brightness currently issued by the display management service module, but the first brightness has not yet been issued to the screen of the electronic device).

In one embodiment, the video scene monitoring module may wake up the brightness detection module to initiate brightness monitoring when it is determined that the electronic device starts to play the video in full screen.

In one embodiment, the brightness detection module may periodically perform step 403 after being awakened.

In one embodiment, the video scene monitoring module may turn off the brightness detection module to turn off brightness monitoring when it is determined that the electronic device has finished playing the video in full screen.

Step 404: The brightness detection module determines whether the delivered first brightness is less than the pre-obtained threshold brightness corresponding to the screen of the electronic device. If so, execute step 405; otherwise, execute step 407 to deliver the first brightness to the screen of the electronic device. .

In one embodiment, the brightness detection module can obtain the threshold brightness corresponding to the screen of the electronic device after being awakened for the first time, and directly use the obtained threshold brightness when it is awakened subsequently.

If the delivered backlight brightness is not less than the threshold brightness, no operation is required so that the delivered backlight brightness is not changed, so that the delivered backlight brightness is delivered to the screen of the electronic device.

Step 405: The brightness detection module changes the backlight brightness issued by the display management service module from the first brightness to the threshold brightness and executes step 406 to issue the threshold brightness to the screen of the electronic device.

If the delivered backlight brightness is less than the threshold brightness, the delivered backlight brightness can be changed to the threshold brightness, so that the threshold brightness is delivered to the screen of the electronic device.

Step 406: The brightness delivery module delivers the threshold brightness to the screen of the electronic device, and executes step 408.

When the brightness detection module changes the backlight brightness delivered by the display management service module, the brightness delivery module delivers the changed backlight brightness to the screen of the electronic device.

Step 407: The brightness delivery module delivers the first brightness delivered by the display management service module to the screen of the electronic device, and executes step 408.

When the brightness detection module does not change the backlight brightness issued by the display management service module, the brightness delivery module delivers the backlight brightness (i.e., the original backlight brightness) issued by the display management service module to the screen of the electronic device.

Step 408: The scene recognition engine turns off full-screen video event monitoring when the monitoring electronic device exits the video viewing scene.

In one embodiment, changes in the scene in which the electronic device is located can be monitored in real time by a scene recognition engine in the electronic device. In one possible implementation, a video application can be installed on the electronic device. When the user issues a close command for the video played in the video application, the electronic device can end playing the corresponding video. At this time, the scene recognition engine can detect that the electronic device has exited viewing. Video scene, so that full-screen video event listening can be turned off.

In one embodiment, after turning off full-screen video event monitoring, the video scene monitoring module may turn off the brightness detection module to turn off brightness monitoring.

The embodiment shown in Figure 4 changes the backlight brightness delivered on demand according to the threshold brightness when the electronic device is in a full-screen video playback scene to prevent the backlight brightness delivered to the electronic device screen from being lower than that corresponding to the screen of the electronic device. The threshold brightness can avoid the situation where it is difficult for users to see the display clearly when watching videos with low contrast or dark main colors in full-screen in dark light environments, and the user viewing experience will be good.

In another embodiment of the present application, the backlight control process shown in Figure 5 can also be used for backlight control. Please refer to Figure 5. In addition to the modules shown in Figure 2, the electronic device can also include a scene recognition engine 225 in the application framework layer 22 of the electronic device, and the hardware combination abstraction layer module 240 of the hardware abstraction layer 24 of the electronic device. It may include a video scene monitoring module 245, an image detection module 246 and a brightness detection module 247. The core layer 25 of the electronic device may also include a threshold brightness storage module 253.

In one embodiment, the scene recognition engine 225 can send the scene recognition result to the video scene monitoring module 245. The video scene monitoring module 245 can monitor whether the electronic device is in a full-screen video playback scene (for example, specifically, based on the received scene recognition result). Full-screen video playback scene without barrage), if so, the image detection module 246 can be awakened. Among them, the barrage in the image is usually a bright color (such as white). By limiting the awakening of the image detection module to a full-screen video playback scenario without barrage, the impact of the barrage in the image on image detection can be removed, thereby achieving grayscale control of the image. and accurate detection of brightness.

In another embodiment, the video scene monitoring module 245 can also monitor whether the electronic device is in a full-screen picture display scene according to the received scene recognition result, and if so, the image detection module 246 can be awakened.

In one embodiment, if the electronic device is not in a full-screen video playback scene or a full-screen picture display scene, the image detection module 246 is not awakened.

It can be seen that the video scene monitoring module 245 can be used to limit the applicable scenes for backlight control based on threshold brightness. For example, it can be limited to be applicable to full-screen video playback scenes without bullet screens and full-screen picture display scenes.

After being awakened, the image detection module 246 can calculate the grayscale and brightness of the image displayed on the screen of the electronic device, and then compare the calculated grayscale and brightness with corresponding thresholds respectively. As long as at least one of the calculated grayscale and brightness is less than the corresponding threshold, the image detection module 246 can wake up the brightness detection module 247 . If neither the calculated grayscale nor the brightness is less than the corresponding threshold, the image detection module 246 may not wake up the brightness detection module 247 . Based on the on-demand wake-up of the brightness detection module 247 by the image detection module 246, it can be avoided that the brightness detection module 247 always works and causes high power consumption.

Among them, brightness can represent the light and dark distribution of the picture. The higher the brightness, the brighter the picture.

Among them, grayscale can use black tones to represent objects, that is, using black as the base color and different saturations of black to display images. The gray value can represent the brightness of a single pixel. The larger the gray value, the brighter the picture. The larger the grayscale average value, the brighter the image color.

After being awakened, the brightness detection module 247 can obtain the backlight brightness issued by the display management service module 223. The brightness detection module 247 can obtain the threshold brightness stored in the threshold brightness storage module 253 after being woken up for the first time. Among them, the threshold brightness stored in the threshold brightness storage module 253 can correspond to the liquid crystal display 262 of the electronic device, so that when the liquid crystal display 262 displays videos/pictures with lower contrast or darker main colors under the threshold brightness, the user can see Clear the displayed screen.

If the delivered backlight brightness is lower than the threshold brightness, the brightness detection module 247 can change the delivered backlight brightness to the threshold brightness, that is, deliver the threshold brightness to the liquid crystal display 262 . If the delivered backlight brightness is not lower than the threshold brightness, the brightness detection module 247 may not perform processing so as not to change the delivered backlight brightness.

Referring to Figure 2, the display management service module 223 can obtain the backlight brightness sent to the electronic device screen based on the dimming results of at least one of three-party application adjustment, user manual adjustment, and ambient light dimming.

In one embodiment, taking the brightness of the delivered backlight adjusted according to the third-party application as an example, if the backlight brightness generated by the third-party application in a dark light environment is higher, that is, the brightness of the delivered backlight is higher. During the full-screen video playback of the electronic device without barrage in a dark light environment, when the electronic device plays a video picture with a low contrast or a dark main color, the image detection module 246 can detect at least one of the grayscale and brightness of the current video picture. One is less than the corresponding threshold, so that the brightness detection module 247 can be awakened. After the brightness detection module 247 is awakened, it can detect that the delivered backlight brightness is not less than the threshold brightness, and no operation is required to change the delivered backlight brightness. The higher backlight brightness generated by the third-party application is then delivered to the electronic device. LCD 262. Since the liquid crystal display 262 displays a video image with a lower contrast or a darker main tone under the higher backlight brightness, the user can see the video image clearly.

In one embodiment, please refer to Figure 5. The hardware combination abstraction layer module 240 may also include an atomic commit interface (atomic_commit) 242, a cutout module 243 and a noise processing module 244 to perform the existing cutout process. Among them, the atomic submission interface 242 can notify the cutout module 243, so that the cutout module 243 obtains the image displayed on the screen of the electronic device in real time to achieve the purpose of real-time cutout. Feasibly, the cutout module 243 can also send the obtained image to the noise processing module 244, and the noise processing module 244 can perform noise processing on the received image to obtain a noise-removed image. The noise-removed image can be used in existing subsequent processing processes associated with the matting process.

In a feasible implementation, after being awakened, the image detection module 246 can obtain the latest image-cutting result of the image-cutting module 243 (that is, the last image-cutting result of the image-cutting module 243 before the current time) to obtain the information of the electronic device. The image currently displayed on the screen is used to calculate the grayscale and brightness of the resulting image.

In another possible implementation, after being awakened, the image detection module 246 can obtain the channel values of each pixel in the latest matting result provided by the matting module 243, and then calculate the grayscale of the latest matting result based on the obtained channel values. Degree and lightness.

When the electronic device is in a full-screen video playback/picture display scenario, there is a possibility that the user can watch videos/pictures with low contrast or dark main colors in full screen in a dark light environment. On the one hand, the grayscale and brightness of the displayed image are compared with Compare the size of the corresponding threshold to determine whether the electronic device is in a scene where the user is watching a video/picture with a low contrast or a dark main color in full screen, so that it can only be used when the user is watching a video/picture with a low contrast or a dark main color in the full screen. Backlight control is based on the threshold brightness. On the other hand, when the electronic device is in a scene where the electronic device is in a scene where videos/pictures with low contrast or dark main colors are viewed in full screen, the issued backlight brightness is changed on demand according to the threshold brightness to avoid The backlight brightness sent to the liquid crystal display 262 is lower than the threshold brightness. This operation not only enables on-demand execution of backlight control based on threshold brightness (that is, when the device plays a video/picture with a low contrast or a dark main color in full screen, it will be executed when the device plays a video/picture with a high contrast or a bright main color in the full screen). (not executed for videos/pictures), it can also avoid the situation where it is difficult for users to see the display screen clearly when watching videos/pictures with low contrast or dark main colors in full screen under dark light environments, so the user viewing experience is good.

Please refer to Figure 6. Taking optimizing the user's viewing experience when watching videos in full screen in a dark light environment as an example, one embodiment of the present application provides another backlight control method. The method may also include the following steps 601 to 611:

Step 601: When the scene recognition engine detects that the electronic device enters the video viewing scene, it starts full-screen video event monitoring.

Step 601 is the same as step 401 mentioned above, and will not be described again in this embodiment.

Step 602: The video scene monitoring module determines whether the electronic device starts playing the video in full screen according to the monitoring results. If so, step 603 is executed; otherwise, step 602 is executed (that is, step 603 is not executed).

Step 602 is the same as step 402 mentioned above, and will not be described again in this embodiment.

Step 603: The image detection module acquires the image displayed on the screen of the electronic device when the screen of the electronic device begins to display the image in full screen and when the screen of the electronic device refreshes.

In one embodiment, the image displayed by the electronic device may be a picture, such as a photo taken and stored by the electronic device. In another embodiment, the image displayed by the electronic device may be any frame in the video.

In one embodiment, an hwc callback (hardware combination abstraction layer callback function) can be registered, and every time a screen refresh is detected after the screen of the electronic device starts to display the image in full screen, the screen display image can be reacquired for detection. Feasibly, the image displayed before and after the screen is refreshed can be different.

In one embodiment, the video scene monitoring module may wake up the picture detection module to start picture verification when it is determined that the electronic device starts to play the video in full screen. The picture detection module can perform picture verification when it is awakened and every time the screen is refreshed after being awakened. In order to perform picture verification, the image currently displayed on the screen can be obtained as the picture to be verified.

When the electronic device starts to play the video in full screen, it does not directly wake up the brightness detection module, but first wakes up the picture detection module, and uses the picture detection module to realize the recognition of the full screen playback of dark light picture scenes. Among them, the picture detection module detects whether the current playback picture is a picture with a low contrast or a dark main color. If the brightness detection module is awakened, the brightness detection module is not awakened when the current playback picture is a picture with a high contrast or a bright main color. detection module, which can effectively wake up the brightness detection module on demand.

In one embodiment, the video scene monitoring module may close the picture detection module to end the picture verification when it is determined that the electronic device has finished playing the video in full screen.

Step 604: The image detection module obtains the grayscale and brightness of the obtained image.

In one embodiment, the monitored full-screen video event may specifically be a full-screen video event without barrage, so as to avoid the impact of barrage on the calculation of image grayscale and brightness.

In another embodiment, the monitored full-screen video event may not distinguish whether there is a barrage, and when obtaining the grayscale and brightness of the image, regardless of whether there is a barrage or not, the grayscale and brightness of the non-barrage display area in the image are directly obtained. lightness. Among them, the barrage display area and non-barrage display area of the image can be set in advance.

In another embodiment, the monitored full-screen video event may not distinguish whether there is a barrage, and when obtaining the grayscale and brightness of the image, it is detected whether there is a barrage. If there is no barrage, the grayscale and brightness of the image can be obtained. If there is barrage, obtain the grayscale and brightness of the non-barrage display area in the image.

Step 605: The picture detection module determines whether at least one of the following: the grayscale of the obtained image is less than the preset grayscale threshold and the brightness of the obtained image is less than the preset brightness threshold. If yes, step 606 is executed; otherwise, step 610 is executed (i.e., no execution is performed). Step 606).

If the calculated grayscale is less than the corresponding threshold and/or the brightness is less than the corresponding threshold, the obtained image can be considered to be an image with low contrast or a darker main tone. In this case, the brightness detection module can be awakened to adjust the backlight brightness. Need to control.

If the calculated grayscale and brightness are not less than the corresponding threshold, the obtained image can be considered to be an image with a higher contrast or a brighter main tone. In this case, the brightness detection module does not need to be awakened, that is, the backlight brightness will not be adjusted on demand. control.

In one implementation, the image saturation can be detected by calculating the brightness of the image, and the brightness of the image can be inversely proportional to the saturation of the image. In one implementation, the image contrast can be detected by calculating the grayscale of the image, and the grayscale of the image can be inversely proportional to the contrast of the image.

Step 606: The brightness detection module obtains the first brightness issued by the display management service module of the electronic device (that is, the backlight brightness currently issued by the display management service module, but the first brightness has not yet been issued to the screen of the electronic device).

In one embodiment, the obtained threshold brightness may be 20, for example.

In one embodiment, if at least one of the calculated grayscale and brightness is less than the corresponding threshold, the picture detection module can wake up the brightness detection module, and the brightness detection module can perform step 606 once after being awakened.

Step 607: The brightness detection module determines whether the delivered first brightness is less than the pre-obtained threshold brightness corresponding to the screen of the electronic device. If so, execute step 608; otherwise, execute step 610 to deliver the first brightness to the screen of the electronic device. .

In one embodiment, the brightness detection module can obtain the threshold brightness corresponding to the screen of the electronic device after being awakened for the first time, and directly use the obtained threshold brightness when it is awakened subsequently.

Step 608: The brightness detection module changes the backlight brightness issued by the display management service module from the first brightness to the threshold brightness and executes step 609 to issue the threshold brightness to the screen of the electronic device.

Step 609: The brightness delivery module delivers the threshold brightness to the screen of the electronic device, and executes step 611.

Step 610: The brightness delivery module delivers the first brightness delivered by the display management service module to the screen of the electronic device, and executes step 611.

Steps 607 to 610 are the same as the above-mentioned steps 404 to 407, and will not be described again in this embodiment.

Step 611: The scene recognition engine turns off full-screen video event monitoring when the monitoring electronic device exits the video viewing scene.

In one embodiment, changes in the scene in which the electronic device is located can be monitored in real time by a scene recognition engine in the electronic device. In one possible implementation, a video application can be installed on the electronic device. When the user issues a close command for the video played in the video application, the electronic device can end playing the corresponding video. At this time, the scene recognition engine can detect that the electronic device has exited viewing. Video scene, so that full-screen video event listening can be turned off.

In one embodiment, after turning off full-screen video event monitoring, the video scene monitoring module can turn off the picture detection module to end picture detection.

In the embodiment shown in FIG. 6 , when the electronic device plays a video in full screen, the grayscale and brightness of the displayed image are compared with the corresponding threshold to determine whether the electronic device is in a scene of watching a video with low contrast or a dark main color in full screen. In this way, backlight control can only be performed based on the threshold brightness when the user is watching a video with low contrast or dark main colors in full screen, thereby enabling on-demand execution of backlight control based on the threshold brightness.

The embodiment shown in Figure 6 changes the backlight brightness on demand according to the threshold brightness when the electronic device is in a scene where the electronic device is watching a video with a low contrast or a dark main color in full screen during full-screen video playback. This prevents the backlight brightness sent to the screen of the electronic device from being lower than the threshold brightness. This avoids the situation where it is difficult for users to see the display clearly when watching videos with low contrast or dark main colors in full-screen under dark light environments, which will degrade the user viewing experience. good.

Please refer to Figure 7. An embodiment of the present application provides a sequence diagram of scene recognition. The implementation process of scene recognition may include the following steps 701 to 708:

Step 701: The scene recognition engine 225 identifies whether the electronic device enters a full-screen video playback scene without barrage.

Step 702: Based on the operation of playing the video in full screen and closing the barrage, the scene recognition engine 225 recognizes that when the electronic device enters the full-screen video playback scene without barrage, it sends a notification: id=1 to the video scene monitoring module 245.

In one possible implementation, the user can operate the touch screen of the electronic device to perform the operation of playing the video in full screen and closing the barrage.

Step 703: The video scene monitoring module 245 determines whether the id issued by the scene recognition engine 225 is 1.

Step 704: When the video scene monitoring module 245 determines that the id issued by the scene recognition engine 225 is 1, it wakes up the image detection module 246.

When the video scene monitoring module 245 determines that the issued id is 1, it can determine that the electronic device has entered a full-screen video playback scene without barrage, and thus can wake up the image detection module 246 to initiate screen verification.

Step 705: The scene recognition engine 225 identifies whether the electronic device exits the full-screen video playback scene without barrage.

Step 706: The scene recognition engine 225 recognizes that the electronic device exits the full-screen video playback scene without barrage based on the operation of exiting the full-screen video playback or opening the barrage, and sends a notification: id=0 to the video scene monitoring module 245.

In one possible implementation, the user can operate the touch screen of the electronic device to exit the full-screen video playback and open the barrage.

Step 707: The video scene monitoring module 245 determines whether the id issued by the scene recognition engine 225 is 0.

Step 708: When the video scene monitoring module 245 determines that the id issued by the scene recognition engine 225 is 0, it closes the image detection module 246.

When the video scene monitoring module 245 determines that the issued id is 0, it can determine that the electronic device exits the full-screen video playback scene without barrage, so that the image detection module 246 can be closed to end the picture verification.

In a feasible implementation, the code program used to implement scene recognition may include the following:

enum class VIDEO_MODE :int32_t{

ENTER_VIDEO = 1,

EXIT_VIDEO = 0

};

static int videoholding_prepare(VIDEO_MODE cur_mode) {

int res;

switch (cur_mode) {

case VIDEO_MODE:: ENTER_VIDEO:

res = 1;

break;

case VIDEO_MODE:: EXIT_VIDEO:

res = 0;

break;

default:

/* -1: invalid*/

res = -1;

break;

}

return res;

}

Please refer to Figure 8. One embodiment of the present application provides a sequence diagram for waking up and ending the image detection module. The implementation process of waking up and ending the image detection module may include the following steps 801 to 804:

Step 801, when the video holding preparation thread (videoholding_prepare) 2451 receives a signal from the scene recognition engine 225 indicating that the electronic device enters a full-screen video playback scene without barrage, the video scene monitoring module 245 sends a signal to the video holding checking thread (videoholding_check) 2452. Send the first identification.

The video scene monitoring module 245 may include a video hold preparation thread 2451 and a video hold check thread 2452.

In one embodiment, the first identifier may be res=1, for example. res can represent events.

Step 802: When receiving the first identification, the video retention check thread 2452 starts the video image check thread (videoimage_check) 2461.

The image detection module 246 may include a video image check thread 2461, which may be pulled up through the video hold check thread 2452 to wake up the image detection module 246.

Step 803: When the video scene monitoring module 245 receives a signal from the scene recognition engine 225 indicating that the electronic device enters a full-screen video playback scene without barrage, the video retention preparation thread 2451 sends a second identification to the video retention check thread 2452.

In one embodiment, the second identifier may be res=0, for example.

Step 804: When the video retention check thread 2452 receives the second identification, it ends the video image check thread 2461.

In the embodiment shown in FIG. 8 , the video scene monitoring module 245 starts the thread videoimage_check when receiving a signal from the scene recognition engine 225 indicating that the electronic device enters a full-screen video playback scene without barrage, so that the image detection module 246 can be woken up. purpose, and when receiving a signal from the scene recognition engine 225 indicating that the electronic device exits the full-screen video playback scene without barrage, the thread videoimage_check is terminated, so that the purpose of ending the image detection module 246 can be achieved.

In a feasible implementation, the code program used to wake up and end the image detection module may include the following:

static int videoholding_thread(int cur_res) {

if(cur_res == 1){

int ret = pthread_create(&mThread, nullptr, videoimage_check, static_cast<void*>(this));

if (ret) {

is_thread_running_ = false;

LOGE("pthread_create failed, return %d", ret);

}

else {

LOGI("Create thread success.");

}

}

else if (cur_res == 0){

int ret = pthread_cancel(mThread);

if (ret) {

LOGE("pthread_cancel failed, return %d", ret);

}

else {

LOGI("cancel thread success.");

}

}

else{

LOGI("Error status %d.",cur_res)

}

return ret;

}

In one embodiment of the present application, please refer to Figures 5 and 8. The implementation process of image detection by the image detection module 246 may include:

When the video image inspection thread 2461 in the image detection module 246 is started, the latest matting result of the matting module 243 can be obtained (for example, it can be the image currently displayed by the electronic device), and the brightness and grayscale of the latest matting result can be calculated. The calculated brightness and grayscale can be recorded as res array: res[0], res[1]. Among them, res[0] can correspond to the brightness and can be used to record the calculated brightness, and res[1] can correspond to the grayscale and can be used to record the calculated grayscale.

After obtaining the res array, the res array can be compared with the preset brightness threshold (for example, recorded as standard_brightness, that is, the brightness standard value) and the grayscale threshold (for example, recorded as standard_gray, that is, the grayscale standard value).

In one embodiment, the standard values of brightness and grayscale (i.e., brightness threshold and grayscale threshold) can be stored in the standard (standard value) array in the form of an array, where standard[0] represents the standard value of brightness, standard[1 ] represents the standard value of grayscale.

If any value in the res array is less than the corresponding threshold, it means that the image currently displayed by the electronic device is an image with a low contrast or a dark main color, so the brightness detection module 247 can be started. If each value in the res array is not less than the corresponding threshold, it means that the image currently displayed by the electronic device is not an image with low contrast or a dark main color, so no operation is required and the brightness detection module 247 is not activated.

In a feasible implementation, the code program used to implement image detection may include the following:

//Get the cutout results

const float Standard_brightness;

const float Standard_gray;

static int videoimage_check ( ) {

uint8_t *cur_cwb_buffer=(uint8_t*)builtin_display.output_buffer_bases[index];

auto data = GenerateUint32PixelData(cur_cwb_buffer);

}

In one embodiment of the present application, the implementation method for calculating the brightness of an image can be: obtaining multiple channel values (such as RGB three-channel values) of each pixel in the image, and based on the multiple channel values of each pixel in the image Calculate the brightness of each pixel in the image, and then calculate the average brightness based on the brightness of each pixel in the image, and use the obtained average brightness as the brightness of the image. Alternatively, the brightness of each pixel in the image can be processed first to exclude blank data, and then the average brightness can be calculated, and the obtained average brightness can be used as the brightness of the image.

In image processing, the HSV color space used can be closer to people's perception of color than the RGB color space. The HSV color space can express the hue, vividness and lightness of the color very intuitively. Among them, H (Hue) can represent hue, S (Saturation) can represent saturation, and V (Value) can represent brightness (or brightness).

In one embodiment, the implementation method of obtaining the brightness of a pixel according to the RGB three-channel value of the pixel can be: according to the RGB three-channel value of the pixel, combined with the preset color space conversion rules or color space conversion tools, the conversion is The V value of the pixel, and the converted V value of the pixel is used as the obtained brightness of the pixel. Among them, according to the RGB three-channel value of the pixel and combined with the preset conversion rules or conversion tools, the HSV value (H value, S value and V value) of the pixel can be converted.

In an embodiment of the present application, the implementation method for calculating the grayscale of an image can be: obtaining multiple channel values (such as RGB three-channel values) of each pixel in the image, and based on the multiple channels of each pixel in the image. value, calculate the grayscale of each pixel in the image, and then calculate the grayscale mean based on the grayscale of each pixel in the image, and use the obtained grayscale mean as the grayscale of the image.

In one embodiment, the calculation formula for calculating the grayscale of a pixel based on the RGB three-channel value of the pixel can be: Gray scale =0.2126 * r + 0.7152 * g + 0.0722 * b. Among them, Gray scale can represent grayscale, r can represent the value of R channel, g can represent the value of G channel, and b can represent the value of B channel.

In one embodiment of the present application, please refer to Figures 5 and 8. The implementation process of the image detection module waking up and turning off the brightness detection module may include:

The image detection module 246 can compare the brightness and grayscale of the image currently displayed on the electronic device screen with the corresponding threshold when the video image check thread 2461 is pulled up. If the brightness and grayscale of the image currently displayed on the electronic device screen are When at least one is less than the corresponding threshold, the brightness detection thread in the brightness detection module 247 is pulled up to wake up the brightness detection module 247 .

The brightness detection module 247 can perform brightness detection based on the threshold brightness after the brightness detection thread is pulled up, and can block the brightness detection thread after completing the brightness detection each time, and wait for the next time it is pulled up to perform brightness detection again.

The image detection module 246 may detect whether the brightness detection thread exists when the video image checking thread 2461 ends, and if it exists, end the brightness detection thread to close the brightness detection module 247.

In a feasible implementation, the code program used to wake up the image detection module and turn off the brightness detection module may include the following:

static int lightcheck_thread(int cur_res) {

if(cur_res == 1){

int ret = pthread_create(&mThread, nullptr, lightcheck ,static_cast<void*>(this));

if (ret) {

is_thread_running_ = false;

LOGE("pthread_create failed, return %d", ret);

}

else {

LOGI("Createthread success.");

}

}

else if (cur_res == 0){

int ret = pthread_cancel(mThread);

if (ret) {

LOGE("pthread_cancel failed, return %d", ret);

}

else {

LOGI("cancel thread success.");

}

}

else{

LOGI("Error status %d.",cur_res)

}

return ret;

}

In one embodiment of the present application, please refer to Figure 5. The implementation process of brightness detection by the brightness detection module may include:

After being awakened, the brightness detection module 247 can obtain the threshold brightness stored in the threshold brightness storage module 253 . For example, in one embodiment, qcom,mdss-dsi-bl-video-min-level =<20> (indicating that the threshold brightness is 20) can be stored, and "qcom,mdss-dsi-bl-video-min-level" can mean Custom flag for threshold brightness.

In one embodiment, the threshold brightness data stored in the threshold brightness storage module 253 can be read through an LCD driver.

If the backlight brightness delivered by the display management service module 223 is lower than the threshold brightness, the brightness detection module 247 can change the delivered backlight brightness to the threshold brightness, that is, deliver the threshold brightness to the liquid crystal display 262 . If the backlight brightness issued by the display management service module 223 is not lower than the threshold brightness, the brightness detection module 247 may not perform processing so as not to change the backlight brightness issued.

In one embodiment, a listener can be registered to monitor the setDisplayBrightness (set display brightness) function, and obtain the backlight brightness issued by the display management service module 223 by monitoring the setDisplayBrightness function. In one embodiment, please refer to Figure 5. The backlight brightness entering the brightness delivery module 241 can be obtained by registering a listener.

When the issued backlight brightness is less than the threshold brightness, the issued backlight brightness is changed to the threshold brightness to achieve the purpose of re-delivering the backlight brightness; when the issued backlight brightness is greater than the threshold brightness, no operation is performed and there is no need to download again. Send backlight brightness.

In a feasible implementation, the code program used to wake up the image detection module and turn off the brightness detection module may include the following:

static int dsi_panel_parse_bl_config(struct dsi_panel *panel)

{

int rc = 0;

struct dsi_parser_utils *utils =&panel->utils;

rc = utils->read_u32(utils->data, "qcom,mdss-dsi-bl-video-min-level",&val);

if (rc) {

DSI_DEBUG("[%s]video-bl-min-level unspecified, defaulting tozero\n",

panel->name);

panel->video_bl_config.bl_min_level = 0;

} else {

panel->video_config.bl_min_level = val;

} }

Please refer to Figure 9. One embodiment of the present application provides an implementation method for testing threshold brightness, which may include the following steps 901 to 906:

Step 901: Place the test equipment and camera in a lightless environment of the laboratory.

In one embodiment, the test equipment and the camera can be automatically placed at preset designated positions through an automated placement device. In another embodiment, the test equipment and camera can also be placed manually.

In one embodiment, the device type of the test device may be a mobile phone.

In one embodiment, the camera used for testing may be a high-speed camera.

Step 902: Adjust the backlight brightness of the test device to the lowest backlight brightness, where the test device is in a state of displaying a preset image in full screen.

The preset image can be an image with lower contrast or a darker main color. When the backlight brightness of the test device is the minimum backlight brightness and the preset image is displayed in full screen, the user usually cannot clearly see the preset image displayed by the test device.

In one embodiment, the initial setting value of the backlight brightness of the test device may be the lowest backlight brightness.

Step 903: Obtain photos taken by the camera by shooting the screen of the test device.

After each adjustment of the backlight brightness of the test device, the screen of the test device can be photographed through the camera.

Step 904: Confirm whether the clarity of the photograph is as expected. If yes, execute step 905; otherwise, execute step 906.

In one embodiment, an automated recognition device can be used to automatically confirm whether the part of the photo that is related to the display content on the screen of the test device is clearly visible. If it is clearly visible, it is in line with expectations; otherwise, it is not in line with expectations. For example, you can calculate the sharpness of a photo and compare it with a preset sharpness threshold to determine whether the photo's sharpness meets expectations.

In another embodiment, you can also manually confirm whether the photo content is clearly visible.

Step 905: Record the current backlight brightness of the test device as the threshold brightness corresponding to the test device.

For other electronic devices with the same screen structure (such as the same LCD module) as the test device, the threshold brightness corresponding to the other electronic devices can be the threshold brightness corresponding to the test device.

In one embodiment, devices with different LCD modules can be used as test devices to test threshold brightness, so that threshold brightness corresponding to devices with various LCD modules can be obtained. In a feasible implementation method, the obtained threshold brightness can be saved in the dtsi file (device tree source include file, or device tree header file) of the corresponding LCD module.

Step 906: Increase the backlight brightness of the test device according to the set step size, and execute step 903.

In one embodiment, the step size may be set to 10, so that the backlight brightness after the increase is greater than the backlight brightness before the increase, and the difference between the two is 10.

Please refer to Figure 10. An embodiment of the present application provides yet another backlight control method. The method may also include the following steps 1001 to 1002:

Step 1001: When the screen of the electronic device is in a full-screen image display state, obtain the first brightness issued by the first module of the electronic device (the first brightness has not yet been issued to the screen of the electronic device), and the first module uses Used to emit backlight brightness to the screen of electronic devices.

In one embodiment, the first module may be the display management service module 223 shown in FIG. 5 .

In one embodiment of the present application, the first brightness is based on at least one of the backlight brightness obtained by three-party applications in the electronic device, the backlight brightness adjustment instruction received by the electronic device, and the backlight brightness corresponding to the ambient illumination of the environment in which the electronic device is located. get.

By first obtaining an appropriate backlight brightness based on at least one dimming method, and then optimizing the backlight brightness delivered to the device screen based on the comparison between the obtained backlight brightness and the threshold brightness, as needed, a more appropriate backlight brightness can be delivered. .

For example, when an electronic device displays an image in full screen, even if the ambient light is dimmed or the backlight brightness is manually adjusted to the minimum backlight brightness, the backlight brightness actually sent to the screen can be a threshold brightness higher than the minimum backlight brightness. This can avoid the occurrence of the device being in the dark. When a low-contrast or dark-light image is displayed in full screen at the lowest backlight brightness, it is difficult for users to see the image content clearly. When the electronic device exits full-screen image display, it resumes issuing the lowest backlight brightness.

In one embodiment of the present application, the backlight control method may further include: monitoring whether the electronic device is in a full-screen video playback scene; monitoring whether the electronic device is in a full-screen picture display scene; wherein the situation where the screen of the electronic device is in a full-screen image display state includes: The electronic device is in either a full-screen video playback scene or a full-screen picture display scene.

If the electronic device is in a video playback scene other than full-screen video playback, the screen of the electronic device is not in a full-screen image display state. If the electronic device is in a picture display scene that does not display pictures in full screen (such as a scene in which the electronic device displays picture thumbnails after opening a gallery application), the screen of the electronic device is not in a state of displaying images in full screen.

By monitoring the full-screen video playback scene and the full-screen picture display scene together, the full-screen display image scene can be accurately monitored on demand, thereby enabling accurate on-demand execution of backlight control.

In one embodiment, after it is determined that the electronic device enters the video playback scene (such as opening a video application), it can be monitored whether the electronic device is in the full-screen video playback scene. In this way, on-demand and accurate monitoring of full-screen video playback scenarios can be achieved.

In one embodiment, after determining that the electronic device enters a picture display scene (such as opening a gallery application), it may be monitored whether the electronic device is in a full-screen picture display scene. In this way, on-demand accurate monitoring of full-screen picture display scenes can be achieved.

Step 1002: When the first brightness is less than a preset threshold brightness corresponding to the screen of the electronic device, perform a first operation so that the backlight brightness sent to the screen of the electronic device reaches the threshold brightness.

Feasibly, the first operation may be an operation of changing the first brightness to a threshold brightness to control the backlight brightness delivered to the screen of the electronic device. In one embodiment, the first operation may be a backlight brightness changing operation of changing the first brightness in the brightness delivery module sent by the display management service module to the threshold brightness, so that the brightness delivery module will change the changed backlight brightness. The threshold brightness is sent to the screen of the electronic device.

In one embodiment, when the first brightness is not less than the threshold brightness, the current process can be ended without controlling the backlight brightness sent by the first module to the screen of the electronic device, so that the backlight brightness sent by the first module to the screen of the electronic device is The backlight brightness is the first brightness. That is, when the backlight brightness sent by the first module is changed, the changed backlight brightness is sent to the screen of the electronic device. When the backlight brightness sent by the first module is not changed, the first module The delivered backlight brightness is delivered to the screen of the electronic device.

In one embodiment of the present application, the threshold brightness is the minimum backlight brightness of the test device that enables the clarity of the first image to meet expectations; where the screen of the test device and the screen of the electronic device have the same structure (such as the same type of LCD module); the first image is the part of the image obtained by the camera that captures the screen of the test device that corresponds to the preset image when both the test device and the camera are in the same lightless environment and the screen of the test device displays the preset image in full screen.

In this way, the threshold brightness of different types of devices can be different accordingly. The threshold brightness is targeted and applicable to electronic devices. In this way, when performing backlight control, appropriate backlight brightness can be issued to avoid full-screen viewing of dark videos in dark light environments. /pictures are difficult to see clearly, which can improve the user’s experience when watching videos/pictures in full-screen in dark light environments.

Based on the implementation of the embodiment shown in Figure 10, the electronic device can intelligently increase the backlight brightness when displaying videos/pictures with low contrast or with dark main colors on the full screen in a dark light environment, so as to achieve full-screen display of videos on the electronic device in a dark light environment. The backlight brightness is optimized when viewing videos/pictures to ensure that the backlight brightness remains optimal when watching videos in full screen in dark light scenes. This can improve the user experience of watching videos/pictures in full screen in dark light scenes.

In one embodiment of the present application, when the screen of the electronic device is in a full-screen image display state, the backlight control method may further include: obtaining an image displayed on the screen of the electronic device; obtaining the grayscale and brightness of the obtained image; If at least one of the grayscale of the obtained image is less than the preset grayscale threshold and the brightness of the obtained image is less than the preset brightness threshold is established, the step of obtaining the first brightness issued by the first module of the electronic device is performed.

By first performing image detection and then performing on-demand backlight brightness control based on the image detection results, the backlight brightness can be controlled on-demand for full-screen low-contrast or dark image scenes, but not for full-screen high-contrast or bright image scenes. Control to achieve selective execution of on-demand backlight brightness control, avoid unnecessary on-demand backlight brightness control, and avoid high power consumption problems caused by always performing on-demand backlight brightness control.

In one embodiment, image detection can be performed in a dark video scene to optimize the backlight brightness, which can greatly improve the user experience and reduce the power consumption of the image detection module.

In one embodiment, the grayscale of the image can be obtained. If the grayscale of the image is less than a preset grayscale threshold, the step of obtaining the first brightness is performed. Otherwise, the step of obtaining the first brightness is not performed.

In another embodiment, the brightness of the image can be obtained. If the brightness of the image is less than the preset brightness threshold, the step of obtaining the first brightness is performed. Otherwise, the step of obtaining the first brightness is not performed.

In another embodiment, the grayscale and brightness of the image can be obtained. If either or both of the grayscale of the image is less than the preset grayscale threshold and the brightness of the image is less than the preset brightness threshold is true, then the first acquisition is performed. In the step of brightness, if neither the grayscale of the image is less than the preset grayscale threshold nor the brightness of the image is less than the preset brightness threshold, the step of obtaining the first brightness is not performed.

In one embodiment of the present application, when the screen of the electronic device is in a full-screen image display state, the method further includes: when the screen of the electronic device begins to display the image in full screen, performing the step of acquiring the image displayed on the screen of the electronic device; When the screen of the electronic device is refreshed, the step of obtaining an image displayed on the screen of the electronic device is performed.

By performing image detection when full-screen image display begins and at each screen refresh, image detection can be performed accurately on demand, thereby helping to enable backlight control to be performed accurately and on demand.

In one embodiment of the present application, the preset grayscale threshold is obtained based on the grayscale of at least one preset image, and the preset brightness threshold is obtained based on the brightness of at least one preset image; wherein, the steps for obtaining the image grayscale include: According to the multiple channel values of each pixel in the image, the grayscale value of each pixel in the image is obtained, and based on the grayscale value of each pixel in the image, the grayscale of the image is obtained; the steps for obtaining the brightness of the image include: According to the multiple channel values of each pixel in the image, through color space conversion processing, the brightness of each pixel in the image is obtained, and based on the brightness of each pixel in the image, the brightness of the image is obtained.

Feasibly, the preset image can be a predetermined low contrast or dark image, and the brightness threshold and grayscale threshold are obtained accordingly. When performing picture detection based on this, it is possible to accurately distinguish between scenes where low-contrast or dark images are displayed on the full screen and scenes where high-contrast or bright images are displayed on the full screen, thereby enabling accurate execution of backlight control on demand.

In one embodiment, the brightness of the preset image may be lower than the required brightness (such as <35, <40, etc.), and the grayscale of the preset image may be lower than the required grayscale (such as <25, <30, etc.), so as to Make the preset image a low-contrast or dark image.

In one embodiment, the preset image may be a low-contrast, low-saturation picture.

In the case where the picture is detected first and then the backlight brightness is controlled as needed according to the picture detection result, in one embodiment of the present application, monitoring whether the electronic device is in a full-screen video playback scene includes: monitoring whether the electronic device is in a full-screen mode without barrage. Video playback scenarios; where the electronic device is in a full-screen video playback scenario includes: the electronic device is in a full-screen video playback scenario without barrage.

In one embodiment, if the electronic device is in a full-screen video playback scene with barrage, the screen of the electronic device is not in a full-screen image display state; if the electronic device is in a video playback scene without barrage and non-full-screen video playback, the screen of the electronic device The image is not displayed in full screen mode.

In one embodiment, if the electronic device is in a full-screen video playback scene with barrage, the step of obtaining the image displayed on the screen of the electronic device is not performed. In another embodiment, if the electronic device is in a full-screen video playback scene with barrage, the step of obtaining the first brightness issued by the first module of the electronic device is not performed.

By monitoring the full-screen video playback scene without barrage, the impact of the presence of barrage on image detection can be avoided, which is helpful to ensure the accurate acquisition of image brightness and grayscale, thereby accurately identifying low-contrast or dark images displayed on the full screen in dark light environments. scenarios to ensure accurate on-demand execution of backlight brightness optimization based on threshold brightness.

An embodiment of the present application also provides a backlight control device, including: an acquisition module, configured to acquire the first brightness issued by the first module of the electronic device when the screen of the electronic device is in a full-screen image display state. The module is used to send the backlight brightness to the screen of the electronic device; the control module is used to perform the first operation to send the backlight brightness to the screen of the electronic device when the first brightness is less than a preset threshold brightness corresponding to the screen of the electronic device. The backlight brightness of the device's screen is the threshold brightness.

One embodiment of the present application also provides an electronic chip. The task processing chip is installed in an electronic device (UE). The electronic chip includes: a processor for executing computer program instructions stored on the memory, wherein when the computer program When the instruction is executed by the processor, the electronic chip is triggered to execute the method steps provided by any method embodiment of this application.

An embodiment of the present application also provides a terminal device. The terminal device includes a communication module, a memory for storing computer program instructions, and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor , triggering the terminal device to execute the method steps provided by any method embodiment of this application.

An embodiment of the present application also provides a server device. The server device includes a communication module, a memory for storing computer program instructions, and a processor for executing the program instructions. When the computer program instructions are executed by the processor , triggering the server device to execute the method steps provided by any method embodiment of this application.

An embodiment of the present application also provides an electronic device. The electronic device includes multiple antennas, a memory for storing computer program instructions, a processor for executing computer program instructions, and a communication device (such as one that can implement 5G communication based on the NR protocol). Communication module), wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method steps provided by any method embodiment of the application.

Specifically, in an embodiment of the present application, one or more computer programs are stored in the above-mentioned memory. The one or more computer programs include instructions. When the instructions are executed by the above-mentioned device, the above-mentioned device executes the implementation of the present application. The method steps described in the example.

Specifically, in an embodiment of the present application, the processor of the electronic device may be an on-chip device SOC (System on Chip, system-on-chip). The processor may include a central processing unit (Central Processing Unit, CPU), and may further Includes other types of processors. Specifically, in an embodiment of the present application, the processor of the electronic device may be a PWM control chip.

Specifically, in an embodiment of the present application, the processor involved may include, for example, a CPU, DSP (digital signal processor, digital signal processor) or microcontroller, and may also include a GPU (graphics processing unit, graphics processor), embedded Neural-network Process Units (NPU) and Image Signal Processing (ISP). The processor may also include necessary hardware accelerators or logic processing hardware circuits, such as ASICs, or one or more Integrated circuits used to control the execution of the program of the technical solution of this application, etc. Additionally, the processor may have functionality to operate one or more software programs, which may be stored in a storage medium.

Specifically, in an embodiment of the present application, the memory of the electronic device may be a read-only memory (ROM), other types of static storage devices that can store static information and instructions, or a random access memory (random access memory). , RAM) or other types of dynamic storage devices that can store information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory , CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can also be used for portability or storage Any computer-readable medium that has the desired program code in the form of instructions or data structures and that can be accessed by a computer.

Specifically, in an embodiment of the present application, the processor and the memory can be combined into a processing device, which is more commonly independent of each other. The processor is used to execute the program code stored in the memory to implement the method described in the embodiment of the present application. . During specific implementation, the memory can also be integrated in the processor, or independent of the processor.

Furthermore, the equipment, devices, and modules described in the embodiments of this application may be implemented by computer chips or entities, or by products with certain functions.

Those skilled in the art should understand that embodiments of the present application may be provided as methods, devices, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment that combines software and hardware aspects. Furthermore, the application may take the form of a computer program product embodied on one or more computer-usable storage media embodying computer-usable program code therein.

In the several embodiments provided in this application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application.

Specifically, an embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program that, when run on a computer, causes the computer to execute the method steps provided by the embodiment of the present application. .

An embodiment of the present application also provides a computer program product. The computer program product includes a computer program that, when run on a computer, causes the computer to execute the method steps provided by the embodiment of the present application.

The embodiments in the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatuses (devices), and computer program products according to embodiments of the present application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce a use A device for realizing the functions specified in a process or processes in a flowchart and/or a block or blocks in a block diagram.

These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions The device implements the functions specified in a process or processes in the flowchart and/or in a block or blocks in the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operating steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device. Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.

In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined. Either it can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

A unit described as a separate component may or may not be physically separate. A component shown as a unit may or may not be a physical unit, that is, it may be located in one place, or it may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.

The integrated unit implemented in the form of a software functional unit may be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium and includes a number of instructions to cause a computer device (which can be a personal computer, server, or network device, etc.) or processor (Processor) to execute the methods described in various embodiments of this application. Some steps. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.

In the embodiments of this application, the terms "comprising", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, commodity or device that includes a series of elements not only includes those elements, but also includes Other elements are not expressly listed or are inherent to the process, method, article or equipment. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of additional identical elements in a process, method, article, or device that includes the stated element.

The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including storage devices.

Each embodiment in this application is described in a progressive manner. The same and similar parts between the various embodiments can be referred to each other. Each embodiment focuses on its differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For relevant details, please refer to the partial description of the method embodiment.

Those of ordinary skill in the art can realize that each unit and algorithm step described in the embodiments of this application can be implemented by a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here.

The above are only preferred embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the present application. within the scope of protection.

Claims (11)

1. A backlight control method, comprising:

acquiring first brightness issued by a first module of electronic equipment under the condition that a screen of the electronic equipment is in a full-screen display image state, wherein the first module is used for issuing backlight brightness to the screen of the electronic equipment;

executing a first operation to enable the backlight brightness sent to the screen of the electronic equipment to be the threshold brightness under the condition that the first brightness is smaller than the preset threshold brightness corresponding to the screen of the electronic equipment;

in the case where the screen of the electronic device is in a full screen display image state, the method further includes:

acquiring an image displayed on a screen of the electronic equipment;

acquiring the gray level of the obtained image, and executing the step of acquiring the first brightness issued by the first module of the electronic equipment if the gray level of the obtained image is smaller than a preset gray level threshold; or,

Acquiring the brightness of the obtained image, and executing the step of acquiring the first brightness issued by the first module of the electronic equipment if the brightness of the obtained image is smaller than a preset brightness threshold; or,

and acquiring the gray level and the brightness of the obtained image, and executing the step of acquiring the first brightness issued by the first module of the electronic equipment under the condition that at least one of the gray level of the obtained image is smaller than a preset gray level threshold value and the brightness of the obtained image is smaller than a preset brightness threshold value.

2. The method of claim 1, wherein in the case where the screen of the electronic device is in a full screen display image state, the method further comprises:

executing the step of acquiring the image displayed on the screen of the electronic equipment when the screen of the electronic equipment starts to display the image in a full screen mode;

and executing the step of acquiring the image displayed on the screen of the electronic equipment when the screen of the electronic equipment is refreshed.

3. The method according to claim 1, wherein the preset gray threshold is derived from the gray level of at least one preset image, and the preset brightness threshold is derived from the brightness of the at least one preset image;

Wherein the step for acquiring the image gray level includes: acquiring gray values of all pixel points in the image according to the multiple channel values of all pixel points in the image, and acquiring gray of the image according to the gray values of all pixel points in the image;

the step for acquiring the brightness of the image comprises: according to the channel values of each pixel point in the image, the brightness of each pixel point in the image is obtained through color space conversion processing, and according to the brightness of each pixel point in the image, the brightness of the image is obtained.

4. A method according to any one of claims 1-3, characterized in that the method further comprises:

monitoring whether the electronic equipment is in a full-screen video playing scene;

monitoring whether the electronic equipment is in a full-screen picture display scene;

the condition that the screen of the electronic equipment is in a full-screen display image state comprises the following steps: and the electronic equipment is in a full-screen video playing scene and any scene in a full-screen picture displaying scene.

5. The method of claim 4, wherein the monitoring whether the electronic device is in a full-screen video playback scenario comprises:

Monitoring whether the electronic equipment is in a bullet screen-free full-screen video playing scene or not;

the situation that the electronic equipment is in a full-screen video playing scene comprises the following steps: the electronic equipment is in the condition of no bullet screen full screen video playing scene.

6. A method according to any of claims 1-3, wherein the threshold brightness is a minimum backlight brightness of the test device such that the sharpness of the first image corresponds to an expected;

wherein the screen of the test device and the screen of the electronic device have the same structure;

the first image is a part corresponding to a preset image in an image obtained by shooting the screen of the test equipment by the camera under the condition that the test equipment and the camera are in the same dark environment and the preset image is displayed on the screen of the test equipment in a full screen mode.

7. The method of any of claims 1-3, wherein the first brightness is derived based on at least one of a backlight brightness derived from a three-party application in the electronic device, a backlight brightness adjustment instruction received by the electronic device, and a backlight brightness corresponding to an ambient illuminance of an environment in which the electronic device is located.

8. A backlight control apparatus, comprising:

the electronic equipment comprises an acquisition module, a first display module and a second display module, wherein the acquisition module is used for acquiring first brightness issued by the first module of the electronic equipment when a screen of the electronic equipment is in a full-screen display image state, and the first module is used for issuing backlight brightness to the screen of the electronic equipment;

the control module is used for executing a first operation to enable the backlight brightness sent to the screen of the electronic equipment to be the threshold brightness under the condition that the first brightness is smaller than the preset threshold brightness corresponding to the screen of the electronic equipment;

the backlight control device obtains an image displayed on the screen of the electronic equipment under the condition that the screen of the electronic equipment is in a full-screen display image state;

acquiring the gray level of the obtained image, and executing the step of acquiring the first brightness issued by the first module of the electronic equipment if the gray level of the obtained image is smaller than a preset gray level threshold; or,

acquiring the brightness of the obtained image, and executing the step of acquiring the first brightness issued by the first module of the electronic equipment if the brightness of the obtained image is smaller than a preset brightness threshold; or,

And acquiring the gray level and the brightness of the obtained image, and executing the step of acquiring the first brightness issued by the first module of the electronic equipment under the condition that at least one of the gray level of the obtained image is smaller than a preset gray level threshold value and the brightness of the obtained image is smaller than a preset brightness threshold value.

9. An electronic chip, comprising:

a processor for executing computer program instructions stored on a memory, wherein the computer program instructions, when executed by the processor, trigger the electronic chip to perform the method of any of claims 1-7.

10. An electronic device comprising a memory for storing computer program instructions, a processor for executing the computer program instructions, and communication means, wherein the computer program instructions, when executed by the processor, trigger the electronic device to perform the method of any of claims 1-7.

11. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program which, when run on a computer, causes the computer to perform the method according to any of claims 1-7.