CN108563972A - Graphic code recognition methods, device, mobile terminal and storage medium - Google Patents

Abstract

The embodiment of the application discloses a pattern code recognition method, device, mobile terminal and storage medium, and relates to the technical field of mobile terminals. Wherein, the method includes: obtaining a graphic code image, and when the graphic code in the obtained graphic code image does not meet the recognition condition, acquiring a plurality of graphic code images; according to the graphic code in the plurality of graphic code images, acquiring includes satisfying identifying the target graphic code image of the graphic code of the condition; performing graphic code recognition on the target graphic code image. In this scheme, a pattern code image meeting the recognition condition is synthesized by multiple images, and the success rate of pattern code recognition is improved.

Description

Pattern code recognition method, device, mobile terminal and storage medium

technical field

The present application relates to the technical field of mobile terminals, and more specifically, to a pattern code recognition method, device, mobile terminal and storage medium.

Background technique

A graphic code is a collection of graphics that are arranged according to certain rules with certain specific geometric figures and are used to record data symbol information, such as barcodes, two-dimensional codes, etc.

The mobile terminal can scan and identify the graphic code, and obtain the information contained in the graphic code, so as to perform activities such as payment, web page opening, application program login, and friend addition according to the acquired information. However, during the scanning and recognition process of the graphic code, the scanned graphic code itself can be identified, but the scanned graphic code is sometimes blocked, making the graphic code unrecognizable.

Contents of the invention

In view of the above problems, the present application proposes a pattern code recognition method, device, mobile terminal and storage medium to improve the success rate of recognition of pattern codes that can be recognized by themselves.

In the first aspect, an embodiment of the present application provides a pattern code recognition method, which is applied to a mobile terminal. The method includes: obtaining a pattern code image, and obtaining multiple A graphic code image; according to the graphic code in the plurality of graphic code images, obtain a target graphic code image including a graphic code satisfying a recognition condition; perform graphic code recognition on the target graphic code image.

In the second aspect, the embodiment of the present application provides a device for identifying a graphic code, which is applied to a mobile terminal. The device includes: an image acquisition module, configured to obtain a graphic code image, and when the graphic code in the obtained graphic code image does not satisfy the During identification condition, obtain a plurality of graphic code images; Image processing module is used for according to the graphic code in described a plurality of graphic code images, obtains the target graphic code image that comprises the graphic code that satisfies recognition condition; Graphic code identification module, uses and performing pattern code recognition on the target pattern code image.

In a third aspect, an embodiment of the present application provides a mobile terminal, including a memory and a processor, the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the The processor executes the above method.

In a fourth aspect, the embodiment of the present application provides a computer-readable storage medium having a program code executable by a processor, and the program code causes the processor to execute the above-mentioned method applied to a mobile terminal.

The graphic code recognition method, device, mobile terminal and storage medium provided by the present application, in the case that the graphic code in the obtained graphic code image does not meet the recognition conditions, obtain multiple graphic codes to obtain the graphic codes that meet the recognition conditions. The graphic codes that meet the conditions are recognized to improve the success rate of graphic code recognition.

These or other aspects of the present application will be more concise and understandable in the description of the following embodiments.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.

Fig. 1 shows a kind of graphic code image in the embodiment of the present application;

Fig. 2 shows the flowchart of the graphic code recognition method that the first embodiment of the present application proposes;

Fig. 3 shows the flowchart of the graphic code recognition method that the second embodiment of the present application proposes;

Fig. 4 shows the first graphic code image in the second embodiment of the present application;

Fig. 5 shows the second graphic code image in the second embodiment of the present application;

Fig. 6 shows the third graphic code image in the second embodiment of the present application;

Fig. 7 shows the fourth graphic code image in the second embodiment of the present application;

Fig. 8 shows the fifth graphic code image in the second embodiment of the present application;

Fig. 9 shows the sixth to eighth graphic code images in the second embodiment of the present application;

Fig. 10 shows the ninth graphic code image in the second embodiment of the present application;

Fig. 11 shows the tenth graphic code image in the second embodiment of the present application;

Fig. 12 shows the functional block diagram of the graphic code recognition device proposed in the third embodiment of the present application;

FIG. 13 shows a structural block diagram of a mobile terminal proposed in an embodiment of the present application;

FIG. 14 shows a structural diagram of a mobile terminal proposed in an embodiment of the present application;

Fig. 15 shows a block diagram of a mobile terminal for performing the pattern code recognition method of the embodiment of the present application according to the embodiment of the present application.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

When the graphic code is scanned and recognized, some graphic codes can be recognized by themselves, but due to the influence of the scanning environment, there may be bad pixels in the scanned graphic code image, making the scanned graphic code incomplete and unable to obtain enough , Information that can identify the graphic code, resulting in failure to identify the graphic code. Among them, the bad point is in the area corresponding to the graphic code, which does not belong to the graphics constituting the graphic code, such as reflective points, occluder images, etc. The graphic code can be a barcode, a two-dimensional code, a three-dimensional code, etc. that contain data information. Fig. 1 shows a two-dimensional code image with a dead pixel A.

For example, when the flash is turned on and the external light is strong, if the carrier of the graphic code has a certain degree of reflection, there may be bright spots in the scanned graphic code due to reflection and other reasons. The bad points of the scanned graphics code are destroyed and cannot be recognized. For example, at night or when the light is poor, when scanning the QR code of the shared bicycle, when insufficient light is detected, the flash will be turned on. When the QR code on the shared bicycle is illuminated by strong light at night, there will always be a reflective spot, which makes it impossible to recognize the QR code when the flash is facing it.

As another example, when scanning a graphic code, there is an occluder between the scanning camera of the mobile terminal and the graphic code, so that in the scanned image of the graphic code, the occluder blocks part of the graphic code, and the image of the occluder that blocks the graphic code part is It is a bad point in the graphic code, which makes the graphic code incomplete and cannot identify the graphic code.

Therefore, the embodiment of the present application proposes a pattern code recognition method and device. During the pattern code recognition process, a pattern code image meeting a recognition condition is acquired through multiple images. When the user is scanning, the scanning position moves, so that in the scanned different graphic code images, the position of the dead point in the graphic code is different, so that the graphic code with the graphic code that meets the recognition conditions is obtained according to multiple graphic code images image.

The client can be run on the mobile terminal. For example, in this application, the client running in the mobile terminal can be an application client such as WeChat and Alipay that scans and recognizes graphic codes such as QR codes and barcodes, and users can scan and identify graphic codes through the client. In the following, the graphic code recognition method and device provided by the embodiment of the present application will be described from the client side of the mobile terminal, in conjunction with the accompanying drawings and through specific embodiments.

first embodiment

Referring to FIG. 2 , the first embodiment of the present application provides a pattern code recognition method for recognizing pattern codes. In the method, when the graphic code cannot be recognized in the graphic code image, the mobile terminal obtains the graphic code satisfying the recognition condition through multiple graphic code images, so as to improve the recognition success rate of the graphic code. In a specific embodiment, the pattern code recognition method is applied to the pattern code recognition device shown in FIG. 12 and the mobile terminal 100 corresponding to the pattern code recognition device 300 ( FIG. 13 , FIG. 14 ). In the embodiment of the present application, the mobile phone is mainly used as an example for illustration. As shown in FIG. 2, the above-mentioned graphic code recognition method may specifically include the following steps:

Step S110: Obtain a graphic code image. When the graphic code in the obtained graphic code image does not meet the recognition condition, acquire multiple graphic code images.

When the mobile phone scans the graphic code, the graphic code image is obtained, and the graphic code in the graphic code image is recognized. If the graphic code in the graphic code image does not meet the recognition condition, that is, there may be bad pixels and cannot be recognized, multiple graphic code images are acquired.

Step S120: According to the graphic codes in the plurality of graphic code images, acquire the target graphic code image including the graphic code meeting the recognition condition.

In the multiple graphic code images, the position of the bad point in the graphic code may be different in each graphic code image, so the graphic code meeting the recognition condition can be obtained according to the multiple graphic code images. For example, the graphic codes in each graphic code image are synthesized to obtain a graphic code satisfying the recognition condition, and the obtained image corresponding to the graphic code is the target graphic code image.

Step S130: Perform pattern code recognition on the target pattern code image.

The pattern code in the target pattern code image is recognized, so as to obtain the content corresponding to the pattern code.

In the pattern code recognition method provided in the embodiment of the present application, when the obtained pattern code does not satisfy the recognition condition, multiple pattern code images are acquired. Then, according to the obtained multiple graphic code images, a target graphic code image including a graphic code satisfying the recognition condition is synthesized, and the target graphic code image is recognized by the graphic code. In this method, if due to reflection and other reasons, under the condition that the graphic code itself can be recognized, the graphic code is blocked and cannot be recognized in the scanned image for graphic code recognition, then it can be through different multiple graphic code images, The pattern code image meeting the recognition condition is synthesized for recognition, and the success rate of pattern code recognition is improved.

second embodiment

This embodiment provides a method for pattern code recognition, please refer to Figure 3, the method includes:

Step S210: Obtain a graphic code image. When the graphic code in the obtained graphic code image does not meet the recognition condition, acquire multiple graphic code images.

When starting to recognize the pattern code, if the obtained single pattern code image cannot be recognized, multiple pattern code images can be obtained. Wherein, it can be that multiple graphic code images are acquired once the recognition fails, or multiple graphic code images fail to be recognized, and multiple graphic code images are obtained; or, the graphic code cannot be recognized within a preset time length , multiple graphic code images are acquired, and the preset time length is not limited in this embodiment of the application, such as 3s.

Since the mobile terminal is located at different positions, when scanning the graphic code, the scanning angle is different, and in the acquired graphic code image, the position of the dead point in the graphic code may be different. Or, when the flashlight is turned on for scanning, the position of the mobile terminal is different, and the reflective points of the flashlight on the two-dimensional code carrier are also different. For example, the graphic code image obtained when the mobile phone is at one position may be as shown in Figure 1, and when the mobile phone is scanning at another position, the camera shooting position and/or angle changes, and the graphic code image obtained may be as shown in Figure 4, two images The positions of bad pixels in the graphics are not the same in the graphics code.

Therefore, as an implementation mode, before acquiring multiple graphic code images, a prompt message for moving the mobile terminal can be displayed first, so that the user can move the mobile terminal to scan the graphic code at different positions and angles. The mobile terminal obtains graphic code images with different bad pixel positions at different positions.

In addition, as an implementation manner, if the obtained graphic code image cannot be recognized and the movement of the mobile terminal is detected, multiple graphic code images are acquired. Further optionally, it may be that when multiple images are acquired, a movement of the mobile terminal is detected, and a graphic code image is acquired once. Optionally, the movement of the mobile terminal may be a movement that satisfies certain movement conditions, for example, the movement acceleration reaches a certain preset value, the movement speed reaches a certain preset value, and the movement time reaches a certain preset value.

As an implementation, when the graphic code in the obtained graphic code image cannot be recognized, multiple graphic code images are continuously acquired, and there may be time intervals between the continuous multiple graphic code images, and the specific time interval length is implemented in this application In the example, it is not limited, such as 0.5s. When the user uses a mobile terminal such as a mobile phone to scan the graphic code, the hand usually shakes or shifts, so that the mobile phone shakes or shifts, and different graphic code images are obtained at different positions. Among the different graphic code images obtained , the dead pixels may be located at different locations in the graphics code.

In the embodiment of the present application, the above various implementation manners may be implemented independently or in combination, and are not limited to the embodiment of the present application.

Optionally, the graphic code itself is identifiable, and the unrecognizable image of the scanned graphic code is usually affected by flashlights. Therefore, in the embodiment of the present application, before acquiring multiple graphic code images, it may also include: judging the Whether the flash light of the mobile terminal is on; if it is on, it may be that the pattern code cannot be recognized due to the influence of the flash light, and multiple pattern code images are acquired. If the flash light is not on, it may be that the graphic code itself is damaged and cannot be recognized.

Wherein, the unrecognizable pattern code means that the pattern code does not satisfy the recognition condition. The identification condition may be that the graphic code is complete, that is, the acquired graphic code includes all the graphics in the graphic code.

In addition, since the graphic code has a certain error tolerance rate, or some graphics in the graphic code must be read, the recognition condition can also be that the proportion of the graphic code information that cannot be read in the total information of the graphic code is lower than that of the graphic code. The error tolerance rate, and/or, the graphic that must be read in the graphic code is in the acquired graphic code image.

For example, a two-dimensional code has a certain fault tolerance rate and storage fault tolerance level. Within the fault tolerance range, even if a part of the two-dimensional code is covered, the two-dimensional code can still be recognized and all the content of the two-dimensional code can be obtained. In addition, there are position detection patterns in the two-dimensional code, which are used to determine the coordinates of each module in the two-dimensional code symbol. If the number of position detection patterns in the obtained two-dimensional code image is lower than the preset number that can recognize the two-dimensional code, The modules in the QR code cannot be located, and the QR code does not meet the preset recognition conditions. Therefore, the recognition condition can be that the ratio of the unreadable pattern code information to the total information of the pattern code is lower than the error tolerance rate of the pattern code, and the number of position detection patterns that can be read in the pattern code greater than the preset amount.

After the multiple graphic code images are obtained, the target graphic code image including the graphic code meeting the recognition condition can be acquired according to the graphic codes in the multiple graphic code images.

In one embodiment, multiple images may be combined to obtain an image whose graphic code satisfies the recognition condition as the target graphic code image.

In another embodiment, it is also possible to use a pattern code image as the target pattern code image, and replace parts of the target pattern code image that do not meet the recognition conditions with pattern codes in other pattern code images. Specifically, in this embodiment, it may include:

Step S220: Determine a graphic code image as a target graphic code image, and obtain an area in the target graphic code image where the graphic code does not satisfy the recognition condition as a target composite area.

Can arbitrarily determine a graphic code image as the target graphic code image from the multiple images obtained; or, determine the image with the smallest dead point area as the graphic code image; it can also be that it cannot be recognized before obtaining multiple graphic code images The two-dimensional code image of is used as the target graphic code image, which is not limited in this embodiment of the present application.

In the target graphic code image, the area where the graphic code does not satisfy the recognition condition in the target graphic code image is acquired as the target composite area. The specific manner of acquiring the target synthesis area is not limited in the embodiment of the present application, for example, it may be realized by an image processing method such as edge detection.

In the embodiment of the present application, it may be that the graphics in the target synthesis area are not correct graphic code graphics, so that the determined graphic code image cannot be recognized. When the graphic code corresponding to the target synthesis area is a correct graphic code graphic, the graphics The code is identifiable.

Wherein, the target composite area in the target graphic code image can be the area corresponding to all the bad pixels, as shown in the dotted line in FIG. 5 ; or the area corresponding to some of the bad pixels, as shown in the dotted line in FIG. 6 .

For the area corresponding to some bad pixels as the target synthesis area, as an implementation, if there are multiple bad pixels in the graphic code image, the area corresponding to one or more of the bad pixels may be used as the target synthesis area. Wherein, the number of dead pixels may be the number of identifiable numbers of pattern codes when these dead points are correct patterns of pattern codes.

As another kind of embodiment, if there is only one bad point in the pattern code image, and if the part in this bad point is correct pattern code pattern, the pattern code just can If identified, the area corresponding to this part of bad pixels can be used as the target synthesis area.

Step S230: Acquiring an area corresponding to the target composite area from other image code images, where the image code in the target image code image satisfies the recognition condition, as the target image code area.

The other graphic code image is a graphic code image different from the determined target graphic code image among the obtained multiple graphic code images. The target graphic code area may be an area corresponding to the position of the target composite area in the graphic code. The target graphic code area may be the same size, shape, and position as the target synthesis area, or may be a smaller area than the target synthesis area and a corresponding position. The target pattern code area includes correct pattern code patterns, such as all correct pattern code patterns. Optionally, the target graphic code area may also be an area that is partly a correct graphic code graphic. When the pattern code in the target pattern code region is replaced in the target composite region, the pattern code in the target pattern code image can be recognized.

Specifically, this step may include: separately acquiring regions corresponding to the target composition regions from other graphic code images. If there is no correct graphic code pattern in the area corresponding to the target synthesis area of some other graphic code images, it cannot be used to identify the graphic code. Therefore, it is judged whether the area corresponding to the target synthesis area in each other graphic code images includes at least part of the graphics code. According to each graphic code image whose judgment result is yes, the area where the graphic code in the target graphic code image satisfies the recognition condition is acquired. In the embodiment of the present application, it may be an optional step to judge whether the area corresponding to the target synthesis area in each other graphic code image includes at least a part of the graphic code, or it may not be judged, but all other graphics The code image acquires the area where the graphic code in the target graphic code image satisfies the recognition condition.

As an implementation, if there is an image in other graphic code images that can obtain the area where the graphic code in the target graphic code image satisfies the recognition condition, then the target graphic code area can be directly obtained from the image. After the area shown by the dotted line in FIG. 7 is replaced with the target synthesis area in FIG. 5, the graphic code satisfying the recognition condition as shown in FIG. 8 can be obtained.

As another embodiment, a part of the target pattern code area can be respectively obtained from multiple images of other pattern code images, each part is a pattern code sub-area of the target pattern code area, and different pattern code sub-areas correspond to the Different regions of the target composite area. Specifically, from multiple images of other graphic code images, respectively determine the area corresponding to the target synthesis area, and judge whether the area corresponding to the target synthesis area in each image includes at least a part of the graphic code. Different graphic code sub-areas corresponding to the included graphic codes are respectively obtained from the area corresponding to the target composite area of the graphic code image whose determination result is yes. Then synthesize each graphic code sub-area into the target graphic code area.

Taking FIG. 9 as an example, the three images shown in FIG. 9 are used as other graphic code images for acquiring the target graphic code area, and the dotted line in FIG. 9 is the area corresponding to the target composite area. In Figure 9, there is a graphic code in the area corresponding to the target synthesis area in the first two images, but it does not exist in the last image, then the graphic code sub-area is determined from the area corresponding to the target synthesis area in the first two images, such as the dotted line box in the first two images The area corresponding to the graphic code in , that is, the area in the dashed box except the intersection with bad point A. Synthesize the graphic code sub-regions in the first two images in FIG. 9 to obtain the target graphic code area, such as the target graphic code area shown in the dotted line box in FIG. 10 .

It can be understood that, in the embodiment of the present application, the target graphic code area is acquired from other graphic code images, and the specific acquisition method is not limited. If a part of the target graphic code area is respectively obtained from multiple images of other graphic code images, the size of the sub-area of the graphic code obtained in each image is not limited. The graphic code sub-area in each image may be the area corresponding to the target synthesis area in the image, the area corresponding to all the graphic codes, or the area corresponding to part of the graphic codes.

It can be understood that if the target composite area in the target graphic code image is the area corresponding to some bad pixels, after determining a target composite area, if the target graphic code area that meets the conditions cannot be obtained in other images, the corresponding area can be re-determined. Different parts of dead pixels serve as target synthesis regions.

Step S240: replacing the target composite area with the target graphic code area to obtain a target graphic code image including a graphic code satisfying the recognition condition.

The target graphic code area is replaced with the target synthetic area, so that the graphic code in the target graphic code image can be recognized.

For example, after replacing the target composite area shown in FIG. 5 with the target graphic code area shown in FIG. 10 obtained as shown in FIG. 9 , the target graphic code image as shown in FIG. 8 is obtained.

In addition, if the target pattern code image includes multiple target pattern code subregions, each subregion may be used to replace the corresponding region in the target composite region.

Of course, it can be understood that, as mentioned above, if the graphic code has a certain error tolerance rate, that is, the recognition condition is that the ratio of the graphic code information that cannot be read to the total information of the graphic code is lower than the fault tolerance of the graphic code rate, and the number of position detection patterns that can be read in the pattern code is greater than the preset number, after the target pattern code area replaces the target synthesis area, there may also be dead pixels in the target pattern code image, but the Meet the identification conditions. After the target composite area indicated by the dotted line box in FIG. 6 is replaced, the obtained target pattern code image with bad pixel A is shown in FIG. 11 .

Step S250: Perform pattern code recognition on the target pattern code image.

The graphic code in the target graphic code image is recognized, and the content contained in the graphic code is obtained.

Optionally, the multiple obtained graphic code images and the synthesized target graphic code images can be stored, such as stored in a cache, and the stored images can be deleted after the recognition is successful.

In the pattern code recognition method provided in the embodiment of the present application, when the obtained pattern code does not satisfy the recognition condition, multiple pattern code images are acquired. Determine the region corresponding to the bad point and the pattern code does not meet the recognition conditions from an image as the target synthesis area, synthesize the target pattern code area corresponding to the target synthesis area from other images, and the target pattern code area is the correct pattern code graphics. Therefore, by replacing the target synthesis region with the target pattern code region, a pattern code meeting the recognition condition is obtained, and the success rate of pattern code recognition is improved.

third embodiment

The embodiment of the present application provides a pattern code recognition device 300, which is applied to a mobile terminal. Please refer to FIG. 12 , the device 300 includes: an image acquisition module 310, configured to obtain a graphic code image, and acquire multiple graphic code images when the graphic code in the obtained graphic code image does not meet the recognition condition. The image processing module 320 is configured to acquire, according to the graphic codes in the plurality of graphic code images, a target graphic code image including a graphic code satisfying a recognition condition. A pattern code recognition module 330, configured to perform pattern code recognition on the target pattern code image.

Optionally, the image processing module 320 may include: a first area acquisition unit, configured to determine a graphic code image as the target graphic code image, and acquire an area where the graphic code in the target graphic code image does not meet the recognition condition is used as the target Composite area. The second area acquisition unit is configured to acquire, from other graphic code images, an area corresponding to the target composite area, where the graphic code in the target graphic code image satisfies the recognition condition, as the target graphic code area. A replacement unit, configured to replace the target composite area with the target graphic code area to obtain a target graphic code image including a graphic code satisfying a recognition condition.

Optionally, the second area acquisition unit may include: a first area acquisition subunit, configured to respectively acquire areas corresponding to the target synthesis area from other graphic code images. A judging subunit, configured to judge whether the area corresponding to the target synthesis area in each of the other graphic code images includes at least a part of the graphic code. The second area acquisition subunit is used to acquire the area where the graphic code in the target graphic code image satisfies the recognition condition according to the graphic code images whose determination results are yes.

Optionally, the target graphic code area may include a plurality of graphic code sub-areas, and the second obtaining subunit may respectively acquire the included graphic codes from the areas corresponding to the target composite area of each graphic code image whose judgment result is yes Corresponding to different pattern code sub-regions, the different pattern code sub-regions respectively correspond to different regions of the target synthesis region; each pattern code sub-region is synthesized into the target pattern code region.

Optionally, the apparatus 300 may further include a prompt module 340, configured to display prompt information for moving the mobile terminal; when detecting the movement of the mobile terminal, the image acquisition module acquires multiple graphic code images.

Optionally, the embodiment of the present application may further include a flashlight judging module, configured to judge whether the flashlight of the mobile terminal is on. When the judging result is yes, the image acquisition module acquires multiple graphic code images.

The graphic code recognition method and device provided in the embodiments of the present application acquire multiple graphic code images when the graphic code cannot be recognized. A recognizable graphic code image is synthesized from a plurality of graphic code images. In the solution provided by the embodiment of the present application, for factors such as the reflection of the graphic code on the carrier, there are bad spots on a single graphic code image, and when the graphic code recognition cannot be realized through a single graphic code image, the graphic is synthesized through multiple images Code recognition, improve the success rate of graphic code recognition.

Fourth embodiment

Please refer to FIG. 13 again. Based on the above-mentioned pattern code recognition method and device, the embodiment of the present application further provides a mobile terminal 100 . As shown in Figure 13, the mobile terminal 100 includes a memory 104 and a processor 102, the memory 104 is coupled to the processor 102, the memory 104 stores instructions, and when the instructions are executed by the processor 102 The processor 102 executes the methods described in the first embodiment and the second embodiment above.

Specifically, as shown in FIG. 14 , the mobile terminal 100 may include an electronic body part 10 , and the electronic body part 10 includes a housing 12 and a display screen 120 disposed on the housing 12 . The housing 12 can be made of metal, such as steel or aluminum alloy. In this embodiment, the display screen 120 generally includes a display panel 111 , and may also include a circuit for responding to a touch operation on the display panel 111 . The display panel 111 may be a liquid crystal display panel (Liquid Crystal Display, LCD), and in some embodiments, the display panel 111 is also a touch screen 109 . In this embodiment, the webpage content may be displayed on the display screen 120 .

Please also refer to FIG. 15. In an actual application scenario, the mobile terminal 100 can be used as a smart phone terminal. In this case, the electronic main body 10 usually includes one or more (only shown in the figure) 1) A processor 102, a memory 104, an RF (Radio Frequency, radio frequency) module 106, an audio circuit 110, a sensor 114, an input module 118, a power module 122, a camera, and the like. Those skilled in the art can understand that the structure shown in FIG. 15 is only a schematic diagram, which does not limit the structure of the electronic body part 10 . For example, the electronic body part 10 may also include more or fewer components than those shown in FIG. 15 , or have a different correspondence from that shown in FIG. 15 .

Those skilled in the art can understand that, relative to the processor 102 , all other components belong to peripherals, and the processor 102 is coupled to these peripherals through a plurality of peripheral interfaces 124 . The peripheral interface 124 can be implemented based on the following standards: Universal Asynchronous Receiver/Transmitter (UART), General Purpose Input Output (GPIO), Serial Peripheral Interface (Serial Peripheral Interface) , SPI), inter-integrated circuit (Inter-Integrated Circuit, I2C), but not limited to the above standards. In some examples, the peripheral interface 124 may only include a bus; in other examples, the peripheral interface 124 may also include other components, such as one or more controllers, for example for connecting the display panel 111 display controller or memory controller for connecting memory. In addition, these controllers can also be separated from the peripheral interface 124 and integrated in the processor 102 or corresponding peripherals.

The memory 104 can be used to store software programs and modules, and the processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104 . The memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory that is remotely located relative to the processor 102 , and these remote memories may be connected to the electronic main body 10 or the display screen 120 through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The RF module 106 is used to receive and send electromagnetic waves, realize mutual conversion between electromagnetic waves and electrical signals, and communicate with communication networks or other devices. The RF module 106 may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption/decryption chips, Subscriber Identity Module (SIM) cards, memory, etc. . The RF module 106 can communicate with various networks such as the Internet, intranet, wireless network or communicate with other devices through the wireless network. The wireless network mentioned above may include a cellular telephone network, a wireless local area network or a metropolitan area network. The above-mentioned wireless network can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (Global System for Mobile Communication, GSM), Enhanced Data GSM Environment (EDGE), broadband code division multiple Access technology (wideband code division multiple access, W-CDMA), code division multiple access technology (Code division access, CDMA), time division multiple access technology (time division multiple access, TDMA), wireless fidelity technology (Wireless, Fidelity, WiFi) (such as IEEE 802.10A, IEEE802.11b, IEEE802.11g and/or IEEE802.11n), VoIP (Voice over internetprotocal, VoIP), Worldwide Interoperability for Microwave Access, Wi-Max), other protocols for email, instant messaging, and short messaging, and any other suitable communication protocol, even those that have not yet been developed.

The audio circuit 110 , the speaker 101 , the microphone 103 , and the microphone 105 jointly provide an audio interface between the user and the electronic main body 10 or the display screen 120 .

The sensor 114 is disposed in the electronic main body 10 or the display screen 120 , examples of the sensor 114 include but not limited to: an acceleration sensor 114F, a gyroscope 114G, a magnetometer 114H and other sensors.

In this embodiment, the input module 118 may include the touch screen 109 arranged on the display screen 120, and the touch screen 109 may collect touch operations of the user on or near it (for example, the user uses a finger, a stylus, etc. Any suitable object or accessory on the touch screen 109 or near the touch screen 109), so that the user's touch gesture can be obtained, and the corresponding connection device can be driven according to the preset program. Therefore, the user can The touch operation of the display screen selects the target area. Optionally, the touch screen 109 may include a touch detection device and a touch controller. Wherein, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, and The touch information is converted into touch point coordinates, and then sent to the processor 102, and can receive and execute commands sent by the processor 102. In addition, the touch detection function of the touch screen 109 can be realized by various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch screen 109 , in other modified implementation manners, the input module 118 may also include other input devices, such as keys 107 . The keys 107 may include, for example, character keys for inputting characters, and control keys for triggering control functions. Examples of the control buttons include a "return to main screen" button, a power on/off button, and the like.

The display screen 120 is used to display information input by the user, information provided to the user, and various graphical user interfaces of the electronic main body 10. These graphical user interfaces can be composed of graphics, text, icons, numbers, videos and other any combination to form. In one example, the touch screen 109 can be disposed on the display panel 111 so as to form an integral body with the display panel 111 .

The power module 122 is used to provide power supply to the processor 102 and other components. Specifically, the power module 122 may include a power management system, one or more power sources (such as batteries or alternating current), a charging circuit, a power failure detection circuit, an inverter, a power status indicator light, and any other components related to the electronic body. Components related to the generation, management and distribution of power in the unit 10 or the display screen 120 .

The mobile terminal 100 further includes a locator 119, and the locator 119 is used to determine the actual location of the mobile terminal 100. In this embodiment, the locator 119 uses a positioning service to realize the positioning of the mobile terminal 100. The positioning service should be understood as obtaining the position information (such as longitude and latitude coordinates) of the mobile terminal 100 through a specific positioning technology. ), a technology or service that marks the position of a positioned object on an electronic map.

It should be understood that the above-mentioned mobile terminal 100 is not limited to a smart phone terminal, but refers to a computer device that can be used on the move. Specifically, the mobile terminal 100 refers to a mobile computer device equipped with an intelligent operating system, and the mobile terminal 100 includes but is not limited to a smart phone, a smart watch, a tablet computer, and the like.

It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. For the same and similar parts in each embodiment, refer to each other, that is, Can. As for the device-type embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for related parts, please refer to part of the description of the method embodiments. Any of the processing methods described in the method embodiments can be implemented by corresponding processing modules in the device embodiments, and details will not be repeated in the device embodiments.

In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples and features of different embodiments or examples described in this specification without conflicting with each other.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present application, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments or portions of code comprising one or more executable instructions for implementing specific logical functions or steps of the process , and the scope of preferred embodiments of the present application includes additional implementations in which functions may be performed out of the order shown or discussed, including in substantially simultaneous fashion or in reverse order depending on the functions involved, which shall It should be understood by those skilled in the art to which the embodiments of the present application belong.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processors, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment used. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connection with one or more wires (mobile terminal), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. The program is processed electronically and stored in computer memory.

It should be understood that each part of the present application may be realized by hardware, software, firmware or a combination thereof. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included. In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application, and those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not drive the essence of the corresponding technical solutions away from the spirit and scope of the technical solutions of the various embodiments of the present application.

Claims (10)

1. A pattern code recognition method is characterized in that being applied to a mobile terminal, the method comprises: Obtain a graphic code image, and when the graphic code in the obtained graphic code image does not meet the recognition condition, acquire multiple graphic code images; Acquiring a target graphic code image including a graphic code satisfying a recognition condition according to the graphic code in the plurality of graphic code images; Perform pattern code recognition on the target pattern code image. 2. method according to claim 1, is characterized in that, described according to the graphic code in described multiple graphic code images, obtains the target graphic code image that comprises the graphic code that satisfies recognition condition, comprises: Determining a graphic code image as the target graphic code image, and obtaining the area where the graphic code in the target graphic code image does not meet the recognition conditions is used as the target composite area; Acquiring an area corresponding to the target synthesis area from other graphic code images, and making the graphic code in the target graphic code image meet the recognition condition, as the target graphic code area; The target pattern code region is replaced with the target pattern code region to obtain a target pattern code image including a pattern code satisfying the recognition condition. 3. method according to claim 2, it is characterized in that, obtain from other graphic code images and corresponding with described target composite area, make the graphic code in the target graphic code image meet the area of identification condition, comprising: Acquiring regions corresponding to the target synthesis regions from other graphic code images; judging whether the area corresponding to the target synthesis area in each of the other graphic code images includes at least a part of the graphic code; According to each graphic code image whose judgment result is yes, the area where the graphic code in the target graphic code image satisfies the recognition condition is acquired. 4. method according to claim 3, is characterized in that, described target graphic code area comprises a plurality of graphic code sub-regions, described according to the graphic code image that each judgment result is yes, obtains and makes described target graphic code image The area where the target graphic code meets the recognition conditions, including: From the area corresponding to the target synthesis area of each graphic code image whose judgment result is yes, obtain respectively different graphic code sub-areas corresponding to the included graphic code, and the different graphic code sub-areas correspond to different areas of the target synthesis area respectively. area; Synthesizing each graphic code sub-area into the target graphic code area. 5. method according to claim 1, is characterized in that, before described obtaining a plurality of graphic code images, also comprises: Display a prompt message for moving the mobile terminal; When it is detected that the mobile terminal is moving, the step of acquiring a plurality of graphic code images is executed. 6. method according to claim 1, is characterized in that, before obtaining a plurality of graphic code images, also comprises: Judging whether the flash light of the mobile terminal is on; If so, execute the step of acquiring multiple graphic code images. 7. The method according to any one of claims 1 to 6, wherein the identification condition is that the ratio of the graphic code information that cannot be read to the total information of the graphic code is lower than that of the graphic code The error tolerance rate and the number of position detection patterns that can be read in the pattern code are greater than the preset number. 8. A graphic code recognition device, characterized in that it is applied to a mobile terminal, and the device comprises: An image acquisition module, used to obtain a graphic code image, and when the graphic code in the obtained graphic code image does not meet the recognition conditions, acquire multiple graphic code images; An image processing module, configured to acquire a target graphic code image including a graphic code satisfying a recognition condition according to the graphic codes in the plurality of graphic code images; The pattern code recognition module is used to carry out pattern code recognition on the target pattern code image. 9. A mobile terminal, characterized in that it includes a memory and a processor, the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor executes The method according to any one of claims 1 to 7. 10. A computer-readable storage medium having a program code executable by a processor, wherein the program code causes the processor to execute the method according to any one of claims 1 to 7.