CN105847583A - Method and apparatus for image processing on mobile terminal - Google Patents

Abstract

The invention provides a method and device for image processing on a mobile terminal. The method includes: calling an image collector of the mobile terminal, and using the image collector to collect pictures contained in a specified physical object; searching for one or more virtual objects corresponding to the collected pictures in a preset virtual object library, wherein, The corresponding relationship between pictures and one or more virtual objects is stored in the virtual object library; the specified physical object, the pictures contained on the specified physical object, and one or more virtual objects are superimposed to generate a composite image; on the display interface of the mobile terminal Renders a composite image. It can be seen that the embodiments of the present invention can combine augmented reality technology with specific objects in daily life, thereby greatly increasing the interest of daily necessities, and at the same time contributing to the broader development of augmented reality technology.

Description

Method and device for image processing on mobile terminal

technical field

The invention relates to the field of computer applications, in particular to a method and device for image processing on a mobile terminal.

Background technique

Augmented reality (Augmented Reality, referred to as AR), is a new technology that "seamlessly" integrates real world information and virtual world information. Information (such as visual information, sound information, taste information, tactile information, etc.) is simulated by computer and other science and technology, and then the virtual information is superimposed on the real world. Apply virtual information to the real world and be perceived by human senses, so as to achieve a sensory experience beyond reality.

At present, for the application of augmented reality technology, most of them are to enhance the effect of the picture in the real scene. By adopting the augmented reality technology, the real scene seen by people is more colorful. However, in the prior art, there are few ways to combine augmented reality technology with concrete objects in life, which limits the application field of augmented reality technology to a certain extent. If the technology of augmented reality is applied in daily life, study, office supplies, then can greatly increase the interest of daily supplies. Therefore, combining augmented reality technology with physical objects is necessary for the wider development of augmented reality technology.

Contents of the invention

In view of the above problems, the present invention is proposed to provide a method and device for image processing on a mobile terminal that overcome the above problems or at least partially solve the above problems.

According to one aspect of the present invention, a method for image processing on a mobile terminal is provided, including:

Calling the image collector of the mobile terminal, and using the image collector to collect pictures contained in the specified object;

In the preset virtual object library, one or more virtual objects corresponding to the collected pictures are searched, wherein the corresponding relationship between the picture and one or more virtual objects is stored in the virtual object library;

superimposing the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects to generate a composite image;

presenting the synthesized image on a display interface of the mobile terminal.

Optionally, the virtual object library is located in the mobile terminal or a cloud server.

Optionally, superimposing the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects includes:

Loading one or more virtual objects corresponding to the pictures contained on the specified physical object from the virtual object library;

superimposing the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects.

Optionally, before invoking the image collector of the mobile terminal, the method further includes:

Scan and identify the logo on the specified physical object;

Obtaining the identification of the mobile terminal, and sending the identification on the specified physical object and the identification of the mobile terminal to a cloud server, so as to verify whether the mobile terminal has the authority to perform image processing on the mobile terminal.

Optionally, before searching for one or more virtual objects corresponding to the collected pictures in the preset virtual object library, the method further includes:

The virtual object library corresponding to the specified physical object is acquired.

Optionally, obtaining the virtual object library corresponding to the specified physical object includes:

Scan and identify the logo on the specified physical object;

According to the identification on the specified physical object, in the pre-established corresponding relationship between the identification of the physical object and the virtual object library, the virtual object library corresponding to the identification on the specified physical object is searched.

Optionally, when there are multiple one or more virtual objects corresponding to the picture, superimpose the specified real object, the picture contained on the specified real object, and the one or more virtual objects to generate a composite images, including:

Each virtual object is superimposed on the specified physical object and the pictures included on the specified physical object to generate multiple synthetic images.

Optionally, when generating multiple composite images, presenting the composite images on the display interface of the mobile terminal includes:

The plurality of generated synthetic images are sequentially presented on the display interface of the mobile terminal in a specified order.

Optionally, after the composite image is presented on the display interface of the mobile terminal, the method further includes: sharing the composite image.

Optionally, when the one or more virtual objects are dynamic and the composite image is a dynamic image, the sharing of the composite image includes:

Intercepting at least one frame of the composite image and sharing it.

Optionally, after the composite image is presented on the display interface of the mobile terminal, the method further includes:

receiving an operation instruction from a user on the virtual object in the synthesized image;

performing a corresponding operation on the virtual object in response to the operation instruction to obtain the operated virtual object;

superimposing the operated virtual object and the specified physical object to obtain a superimposed composite image;

and presenting the superimposed composite image on a display interface of the mobile terminal.

According to another aspect of the present invention, a device for image processing on a mobile terminal is also provided, including:

The collection module is adapted to call the image collector of the mobile terminal, and use the image collector to collect the pictures contained in the specified object;

The search module is adapted to search for one or more virtual objects corresponding to the collected pictures in a preset virtual object library, wherein the virtual object library stores correspondences between pictures and one or more virtual objects relation;

The first processing module is adapted to superimpose the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects to generate a composite image;

The first display module is adapted to present the synthesized image on a display interface of the mobile terminal.

Optionally, the virtual object library is located in the mobile terminal or a cloud server.

Optionally, the first processing module is also suitable for:

Loading one or more virtual objects corresponding to the pictures contained on the specified physical object from the virtual object library;

superimposing the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects.

Optionally, before the collection module invokes the image collector of the mobile terminal, the device further includes:

The identification module is suitable for scanning and identifying the identification on the specified physical object;

The verification module is adapted to obtain the identification of the mobile terminal, and send the identification on the specified physical object and the identification of the mobile terminal to the cloud server to verify whether the mobile terminal is capable of performing image processing on the mobile terminal. processing rights.

Optionally, before the search module searches the preset virtual object library for one or more virtual objects corresponding to the collected pictures, the device further includes:

The acquisition module is adapted to acquire the virtual object library corresponding to the specified physical object.

Optionally, the acquisition module is also suitable for:

Scan and identify the logo on the specified physical object;

According to the identification on the specified physical object, in the pre-established corresponding relationship between the identification of the physical object and the virtual object library, the virtual object library corresponding to the identification on the specified physical object is searched.

Optionally, when there are multiple one or more virtual objects corresponding to the picture, the first processing module is further adapted to:

Each virtual object is superimposed on the specified physical object and the pictures included on the specified physical object to generate multiple synthetic images.

Optionally, when generating multiple synthetic images, the first display module is further adapted to:

The plurality of generated synthetic images are sequentially presented on the display interface of the mobile terminal in a specified order.

Optionally, after the first display module presents the synthesized image on the display interface of the mobile terminal, the device further includes:

A sharing module, adapted to share the synthesized image.

Optionally, when the one or more virtual objects are dynamic and the composite image is a dynamic image, the sharing module is further adapted to:

Intercepting at least one frame of the composite image and sharing it.

Optionally, after the first display module presents the synthesized image on the display interface of the mobile terminal, the device further includes:

A receiving module, adapted to receive an operation instruction from a user on the virtual object in the synthesized image;

A response module, adapted to perform a corresponding operation on the virtual object in response to the operation instruction, to obtain the operated virtual object;

The second processing module is adapted to perform superposition processing on the operated virtual object and the specified physical object to obtain a superimposed composite image;

The second display module is adapted to present the superimposed composite image on a display interface of the mobile terminal.

In the embodiment of the present invention, when the image collector of the mobile terminal is called to collect the pictures contained in the specified physical objects, one or more virtual objects corresponding to the collected pictures are searched from the preset virtual object library, wherein, The corresponding relationship between pictures and one or more virtual objects is stored in the virtual object library, and then, the specified physical object, the pictures contained in the specified physical object, and one or more virtual objects are superimposed to generate a composite image, and the composite image displayed on the display interface of the mobile terminal. It can be seen that the embodiment of the present invention can superimpose the virtual object and the pictures contained in the collected specified real object, and generate a composite image to be displayed on the display interface of the mobile terminal, so that the augmented reality technology can be combined with the existing in daily life. The combination of specific objects greatly increases the interest of daily necessities, and at the same time contributes to the broader development of augmented reality technology.

Furthermore, by sending the identification on the specified physical object and the identification of the mobile terminal to the cloud, it can be verified whether the mobile terminal has the authority to use the collected pictures for image processing. Only when the mobile terminal has the authority to process images can it be used Image processing is performed on the pictures contained in the specified physical objects, thus effectively guaranteeing the use rights of the pictures on the specified physical objects.

The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.

Those skilled in the art will be more aware of the above and other objects, advantages and features of the present invention according to the following detailed description of specific embodiments of the present invention in conjunction with the accompanying drawings.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same parts. In the attached picture:

FIG. 1 is a schematic flowchart of a method for image processing on a mobile terminal according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a first display interface for performing image processing on a mobile terminal according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a second display interface for performing image processing on a mobile terminal according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a third display interface for performing image processing on a mobile terminal according to an embodiment of the present invention;

Fig. 5 is a schematic diagram of a fourth display interface for performing image processing on a mobile terminal according to an embodiment of the present invention;

6 is a schematic diagram of a fifth display interface for performing image processing on a mobile terminal according to an embodiment of the present invention;

FIG. 7 is a schematic flowchart of a method for image processing on a mobile terminal according to another embodiment of the present invention;

FIG. 8 is a schematic structural diagram of an apparatus for image processing on a mobile terminal according to an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of an apparatus for image processing on a mobile terminal according to another embodiment of the present invention; and

Fig. 10 is a schematic structural diagram of an apparatus for image processing on a mobile terminal according to yet another embodiment of the present invention.

detailed description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

In order to solve the above technical problems, an embodiment of the present invention provides a method for image processing on a mobile terminal, the method is applied to a client, and the mobile terminal may be a terminal device such as a smart phone, a tablet computer, or a smart watch. Fig. 1 is a schematic flowchart of a method for image processing on a mobile terminal according to an embodiment of the present invention. Referring to Fig. 1, the method may at least include step S102 to step S108.

Step S102, call the image collector of the mobile terminal, and use the image collector to collect pictures included in the specified object.

In this step, the specified object may be daily necessities, office items, various toys or stationery, etc.

Step S104, searching for one or more virtual objects corresponding to the collected picture in the preset virtual object library, wherein the virtual object library stores the corresponding relationship between the picture and one or more virtual objects.

In this step, at least one picture, one or more virtual objects corresponding to each picture, and the corresponding relationship between each picture and one or more virtual objects are preset in the virtual object library in advance. The virtual object library can be located locally on the mobile terminal or on a cloud server.

Step S106, superimposing the designated real object, the picture contained on the designated real object, and one or more virtual objects to generate a composite image.

In this step, one or more virtual objects corresponding to the pictures contained on the specified physical object can be loaded from the virtual object library first, and then the specified physical object, the pictures contained on the specified physical object, and one or more virtual objects can be superimposed processed and generate composite images. Moreover, in this step, the virtual objects stored in the virtual object library include static virtual objects and dynamic virtual objects.

Step S108, presenting the synthesized image on the display interface of the mobile terminal.

When the image collector of the mobile terminal is called to collect the pictures contained in the specified physical objects, one or more virtual objects corresponding to the collected pictures are searched from the preset virtual object library, wherein the pictures are stored in the virtual object library Correspondence with one or more virtual objects, and then superimpose the specified physical object, the pictures contained on the specified physical object, and one or more virtual objects to generate a composite image, and display the composite image on the display interface of the mobile terminal superior. It can be seen that the embodiment of the present invention can superimpose the virtual object and the pictures contained in the collected specified real object, and generate a composite image to be displayed on the display interface of the mobile terminal, so that the augmented reality technology can be combined with the existing in daily life. The combination of specific objects greatly increases the interest of daily necessities, and at the same time contributes to the broader development of augmented reality technology.

Before the above step S102 calls the image collector of the mobile terminal and uses the image collector to collect the pictures contained on the specified object, in one embodiment of the present invention, the image collector of the mobile terminal is first called to scan and identify the pictures on the specified object. identification (the identification can be a two-dimensional code, a bar code and other identification marks), and obtain the identification of the mobile terminal, and then send the identification on the specified physical object and the identification of the mobile terminal to the cloud server to verify whether the mobile terminal has Permission to perform image processing. For example, the authority may be that the specified physical object only allows five different mobile terminals to use the pictures on the specified physical object for image processing. After five different mobile terminals scan and recognize the identification on the specified physical object, the identification on the specified physical object will become invalid, and when the sixth mobile terminal scans the identification on the specified object, the sixth mobile terminal cannot be verified, that is, image processing cannot be performed.

By sending the identification on the specified physical object and the identification of the mobile terminal to the cloud, it can be verified whether the mobile terminal has the authority to use the collected pictures for image processing. The included pictures are subjected to image processing, thus effectively guaranteeing the use rights of the pictures on the specified physical objects.

In the above step S108, after the composite image is presented on the display interface of the mobile terminal, in an embodiment of the present invention, the composite image can also be shared, and the composite image can be shared with WeChat friends, Moments or Weibo friends Wait. In this way, the synthesized image can be shared with friends, family members, colleagues, etc., thereby enhancing mutual communication and communication.

In an embodiment of the present invention, at least one frame of the composite image can be intercepted, and the composite image can be shared in the form of a photo, or a video of the composite image can be intercepted, and the composite image can be shared in the form of a video. If the captured picture corresponds to a static virtual object in the virtual object library, after compositing the image, it is preferable to intercept at least one frame of the composite image and share the composite image in the form of a photo; if the collected picture is in the virtual object Corresponding to the dynamic virtual objects in the library, after synthesizing the image, you can preferably intercept a video in the synthesizing image, and share the synthesizing image in the form of video.

In order to reflect the embodiment of the present invention more clearly, a specific example is used to introduce in detail. In this embodiment, the mobile terminal is a mobile phone terminal, the client is installed on the mobile terminal, and the specified object is a mobile phone that contains multiple flower pictures. notebook.

Referring to Fig. 2, the user clicks the "Experience Now" button on the client interface to activate the client.

See Figure 3. When the client is enabled, the mobile phone terminal installed with the client automatically activates the camera, and uses the camera to capture any picture of a flower on the notebook. Find a bunch of virtual three-dimensional flowers corresponding to the collected flower pictures, and superimpose the notebook, the flower pictures contained in the notebook and the virtual three-dimensional flowers to generate a composite image.

Referring to FIG. 4 , the client displays the composite image generated by the notebook, the picture of flowers contained in the notebook and the virtual three-dimensional flower on the display screen of the mobile terminal. The user can record or take pictures of the synthesized image displayed on the display screen of the mobile phone by clicking the video recording button or the photographing button on the display screen.

Referring to Fig. 5, when the video recording button is clicked, the synthesized image displayed on the display screen of the mobile phone is recorded, and the user can select the length of recording time according to his needs.

Referring to Figure 6, after the recording is completed, two buttons "Cancel" and "Share" will be automatically displayed on the display screen of the mobile phone. If the user clicks "Cancel", the composite image on the display screen of the mobile phone can be re-recorded. When the user clicks "Share", the above completed video can be shared with WeChat friends, circle of friends or Weibo.

In one embodiment of the present invention, when the pictures contained in the specified physical object collected by the image collector correspond to multiple virtual objects in the preset virtual object library, the embodiment of the present invention also provides another A method for image processing on the Internet, the method is applied to a client, and the mobile terminal may be a terminal device such as a smart phone, a tablet computer, or a smart watch.

Fig. 7 is a schematic flowchart of a method for image processing on a mobile terminal according to another embodiment of the present invention. Referring to Fig. 7, the method may at least include step S202 to step S208.

Step S202, call the image collector of the mobile terminal, and use the image collector to collect pictures included in the specified object.

Step S204, searching for one or more virtual objects corresponding to the collected picture in the preset virtual object library, wherein the virtual object library stores the corresponding relationship between the picture and the one or more virtual objects.

Step S206, when there are multiple one or more virtual objects corresponding to the picture, each virtual object is superimposed on the specified physical object and the pictures included on the specified physical object to generate multiple composite images.

In step S208, the multiple generated synthetic images are presented in turn on the display interface of the mobile terminal in a specified order.

In the above step S204, before searching for one or more virtual objects corresponding to the captured pictures in the preset virtual object library, in an embodiment of the present invention, the virtual object library corresponding to the specified physical object can be obtained first . For example, the image acquisition device of the mobile terminal can be used to scan and identify the identification on the specified physical object, and according to the identification on the specified physical object, in the pre-established corresponding relationship between the identification of the physical object and the virtual object library, find the correspondence between the identification on the specified physical object library of virtual objects.

Referring to step S206 above, in one embodiment of the present invention, if there are multiple virtual objects corresponding to the picture, the generated composite images will be presented in turn on the display interface of the mobile terminal in turn in accordance with the specified order When uploaded, music can also be played at the same time, thereby enriching the effect of the final composite image. Music can be preset in the virtual object library in the form of audio files in advance, and a corresponding relationship between audio files and virtual objects is established. When superimposing the specified physical object, the pictures contained on the specified physical object, and each virtual object, respectively , while loading the corresponding audio file.

In an embodiment of the present invention, when there are multiple one or more virtual objects corresponding to the picture, multiple virtual objects can also be displayed on the display interface of the mobile terminal at the same time.

In step S208 above, after the composite image is presented on the display interface of the mobile terminal, in an embodiment of the present invention, the client may also receive an operation instruction from the user on the virtual object in the composite image, and respond to the operation instruction to The virtual object performs corresponding operations to obtain the operated virtual object. Finally, the operated virtual object is superimposed on the specified physical object to obtain a superimposed composite image, and the composite image is presented on the display interface of the mobile terminal. The user's operation instruction may be zoom in, zoom out, rotate, shift, etc. Taking the mobile terminal as a touch-screen mobile phone as an example, after the mobile terminal presents a synthesized image on the display interface, the user can use a finger to perform a sliding operation on the screen of the mobile phone to perform corresponding operations on the virtual objects in the synthesized image.

It should be noted that for the actual operation of the user corresponding to each operation instruction, the corresponding relationship between them needs to be preset in the client. For example, a single finger slide represents a displacement operation, two merged fingers separate represents a zoom in operation, two separated fingers merge represents a zoom out operation, one finger rotates clockwise while the other finger rotates counterclockwise represents a rotate operation, etc.

Based on the same inventive concept, the present invention also provides an image processing device on a mobile terminal. Fig. 8 is a schematic structural diagram of an apparatus for image processing on a mobile terminal according to an embodiment of the present invention. Referring to FIG. 8 , an apparatus 800 for image processing on a mobile terminal may at least include: an acquisition module 8010 , a search module 8020 , a first processing module 8030 and a first display module 8040 .

The functions of each component or device of the device 800 for image processing on a mobile terminal according to the embodiment of the present invention and the connection relationship between each part are introduced now:

The collection module 8010 is suitable for invoking the image collector of the mobile terminal, and using the image collector to collect the pictures contained in the specified object;

The search module 8020, coupled with the acquisition module 8010, is adapted to search for one or more virtual objects corresponding to the collected pictures in the preset virtual object library, wherein the virtual object library stores pictures and one or more virtual objects Correspondence of objects;

The first processing module 8030, coupled with the search module 8020, is suitable for superimposing the specified object, the picture contained on the specified object, and one or more virtual objects to generate a composite image;

The first display module 8040, coupled with the first processing module 8030, is adapted to present the synthesized image on the display interface of the mobile terminal.

In an embodiment of the present invention, the virtual object library can be located locally on the mobile terminal or on a cloud server.

In an embodiment of the present invention, the first processing module 8030 is also adapted to load one or more virtual objects corresponding to the pictures contained in the specified physical object from the virtual object library, and convert the specified physical object, the picture contained in the specified physical object And one or more virtual objects are superimposed.

The invention also provides another device for image processing on the mobile terminal. Fig. 9 is a schematic structural diagram of an apparatus for image processing on a mobile terminal according to another embodiment of the present invention. Referring to FIG. 9 , an apparatus 800 for image processing on a mobile terminal may include, in addition to the various modules shown in FIG. 8 , an identification module 8050 , a verification module 8060 and an acquisition module 8070 .

The identification module 8050 is adapted to scan and identify the identification on the specified object before the collection module 8010 invokes the image collector of the mobile terminal.

The verification module 8060, coupled with the identification module 8050, is adapted to obtain the identification of the mobile terminal, and send the identification on the specified physical object and the identification of the mobile terminal to the cloud server to verify whether the mobile terminal has the authority to perform image processing on the mobile terminal .

The acquisition module 8070, coupled with the acquisition module 8010, is adapted to acquire the virtual object library corresponding to the specified real object before the search module 8020 searches the preset virtual object library for one or more virtual objects corresponding to the collected pictures.

In an embodiment of the present invention, the acquisition module 8070 is also adapted to scan and identify the identification on the specified object, and search for the specified object in the pre-established correspondence between the identification of the physical object and the virtual object library according to the identification on the specified object. The virtual object library corresponding to the identification on the physical object.

When there are multiple one or more virtual objects corresponding to the picture, the first processing module 8030 is further adapted to superimpose each virtual object with the designated physical object and the pictures contained in the designated physical object to generate multiple composite images.

In an embodiment of the present invention, when generating multiple composite images, the first display module 8040 is further adapted to present the multiple generated composite images on the display interface of the mobile terminal in turn in a specified order.

The invention also provides another device for image processing on the mobile terminal. Fig. 10 is a schematic structural diagram of an apparatus for image processing on a mobile terminal according to yet another embodiment of the present invention. Referring to FIG. 10 , in addition to the various modules shown in FIG. 9 , the device 800 for image processing on a mobile terminal may also include: a sharing module 8080 , a receiving module 8090 , a response module 8100 , a second processing module 8110 and a second processing module 8110 . Two display modules 8120.

The sharing module 8080, coupled with the first display module 8040, is adapted to share the composite image after the first display module 8040 presents the composite image on the display interface of the mobile terminal.

The receiving module 8090, coupled with the first display module 8040, is suitable for the first display module 8040 to receive an operation instruction from the user on the virtual object in the composite image after presenting the composite image on the display interface of the mobile terminal.

The response module 8100, coupled with the receiving module 8090, is adapted to perform corresponding operations on the virtual object in response to the operation instruction, and obtain the operated virtual object.

The second processing module 8110, coupled with the response module 8100, is suitable for superimposing the operated virtual object and the specified physical object to obtain a superimposed composite image.

The second display module 8120, coupled with the second processing module 8110, is adapted to present the superimposed composite image on the display interface of the mobile terminal.

In an embodiment of the present invention, when one or more virtual objects are dynamic and the composite image is a dynamic image, the sharing module 8080 is also adapted to capture at least one frame of the composite image and share it.

According to any one of the above preferred embodiments or a combination of multiple preferred embodiments, the embodiments of the present invention can achieve the following beneficial effects:

In the embodiment of the present invention, when the image collector of the mobile terminal is called to collect the pictures contained in the specified physical objects, one or more virtual objects corresponding to the collected pictures are searched from the preset virtual object library, wherein, The corresponding relationship between pictures and one or more virtual objects is stored in the virtual object library, and then, the specified physical object, the pictures contained in the specified physical object, and one or more virtual objects are superimposed to generate a composite image, and the composite image displayed on the display interface of the mobile terminal. It can be seen that the embodiment of the present invention can superimpose the virtual object and the pictures contained in the collected specified real object, and generate a composite image to be displayed on the display interface of the mobile terminal, so that the augmented reality technology can be combined with the existing in daily life. The combination of specific objects greatly increases the interest of daily necessities, and at the same time contributes to the broader development of augmented reality technology.

Furthermore, by sending the identification on the specified physical object and the identification of the mobile terminal to the cloud, it can be verified whether the mobile terminal has the authority to use the collected pictures for image processing. Only when the mobile terminal has the authority to process images can it be used Image processing is performed on the pictures contained in the specified physical objects, thus effectively guaranteeing the use rights of the pictures on the specified physical objects.

In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, in order to streamline this disclosure and to facilitate an understanding of one or more of the various inventive aspects, various features of the invention are sometimes grouped together in a single embodiment, figure, or its description. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art can understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. Modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore may be divided into a plurality of sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method or method so disclosed may be used in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will understand that although some embodiments described herein include some features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of the invention. and form different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.

The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) can be used in practice to implement some or all of the components in the device for image processing on a mobile terminal according to an embodiment of the present invention. Full functionality. The present invention can also be implemented as an apparatus or an apparatus program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.

So far, those skilled in the art should appreciate that, although a number of exemplary embodiments of the present invention have been shown and described in detail herein, without departing from the spirit and scope of the present invention, the disclosed embodiments of the present invention can still be used. Many other variations or modifications consistent with the principles of the invention are directly identified or derived from the content. Accordingly, the scope of the present invention should be understood and deemed to cover all such other variations or modifications.

The embodiment of the present invention also provides A1, a method for image processing on a mobile terminal, including:

Calling the image collector of the mobile terminal, and using the image collector to collect pictures contained in the specified object;

In the preset virtual object library, one or more virtual objects corresponding to the collected pictures are searched, wherein the corresponding relationship between the picture and one or more virtual objects is stored in the virtual object library;

superimposing the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects to generate a composite image;

presenting the synthesized image on a display interface of the mobile terminal.

A2. The method according to A1, wherein the virtual object library is located in the mobile terminal or a cloud server.

A3. The method according to A2, wherein superimposing the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects includes:

Loading one or more virtual objects corresponding to the pictures contained on the specified physical object from the virtual object library;

superimposing the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects.

A4. The method according to any one of A1-A3, wherein, before invoking the image collector of the mobile terminal, the method further includes:

Scan and identify the logo on the specified physical object;

Obtaining the identification of the mobile terminal, and sending the identification on the specified physical object and the identification of the mobile terminal to a cloud server, so as to verify whether the mobile terminal has the authority to perform image processing on the mobile terminal.

A5. The method according to any one of A1-A4, wherein, in the preset virtual object library, before searching for one or more virtual objects corresponding to the collected pictures, the method further includes:

The virtual object library corresponding to the specified physical object is acquired.

A6. The method according to A5, wherein obtaining the virtual object library corresponding to the specified physical object includes:

Scan and identify the logo on the specified physical object;

According to the identification on the specified physical object, in the pre-established corresponding relationship between the identification of the physical object and the virtual object library, the virtual object library corresponding to the identification on the specified physical object is searched.

A7. The method according to any one of A1-A6, wherein, when there are multiple one or more virtual objects corresponding to the picture, the specified physical object, the picture contained on the specified physical object, and the The above-mentioned one or more virtual objects are superimposed to generate a composite image, including:

Each virtual object is superimposed on the specified physical object and the pictures included on the specified physical object to generate multiple synthetic images.

A8. The method according to A7, wherein, when generating multiple composite images, presenting the composite images on the display interface of the mobile terminal includes:

The plurality of generated synthetic images are sequentially presented on the display interface of the mobile terminal in a specified order.

A9. The method according to any one of A1-A8, wherein after the composite image is presented on the display interface of the mobile terminal, the method further includes: sharing the composite image.

A10. The method according to A9, wherein, when the one or more virtual objects are dynamic and the composite image is a dynamic image, the sharing of the composite image includes:

Intercepting at least one frame of the composite image and sharing it.

A11. The method according to any one of A1-A10, wherein, after presenting the synthesized image on the display interface of the mobile terminal, the method further includes:

receiving an operation instruction from a user on the virtual object in the synthesized image;

performing a corresponding operation on the virtual object in response to the operation instruction to obtain the operated virtual object;

superimposing the operated virtual object and the specified physical object to obtain a superimposed composite image;

and presenting the superimposed composite image on a display interface of the mobile terminal.

The embodiment of the present invention also provides B12, a device for image processing on a mobile terminal, including:

The collection module is adapted to call the image collector of the mobile terminal, and use the image collector to collect the pictures contained in the specified object;

The search module is adapted to search for one or more virtual objects corresponding to the collected pictures in a preset virtual object library, wherein the virtual object library stores correspondences between pictures and one or more virtual objects relation;

The first processing module is adapted to superimpose the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects to generate a composite image;

The first display module is adapted to present the synthesized image on a display interface of the mobile terminal.

B13. The device according to B12, wherein the virtual object library is located in the mobile terminal or a cloud server.

B14. The device according to B13, wherein the first processing module is further adapted to:

Loading one or more virtual objects corresponding to the pictures contained on the specified physical object from the virtual object library;

superimposing the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects.

B15. The device according to any one of B12-B14, wherein, before the acquisition module invokes the image collector of the mobile terminal, the device further includes:

The identification module is suitable for scanning and identifying the identification on the specified physical object;

The verification module is adapted to obtain the identification of the mobile terminal, and send the identification on the specified physical object and the identification of the mobile terminal to the cloud server to verify whether the mobile terminal is capable of performing image processing on the mobile terminal. processing rights.

B16. The device according to any one of B12-B15, wherein, before the search module searches for one or more virtual objects corresponding to the collected pictures in the preset virtual object library, the device Also includes:

The acquisition module is adapted to acquire the virtual object library corresponding to the specified physical object.

B17. The device according to B16, wherein the acquisition module is further adapted to:

Scan and identify the logo on the specified physical object;

According to the identification on the specified physical object, in the pre-established corresponding relationship between the identification of the physical object and the virtual object library, the virtual object library corresponding to the identification on the specified physical object is searched.

B18. The device according to any one of B12-B17, wherein when there are multiple one or more virtual objects corresponding to the picture, the first processing module is further adapted to:

Each virtual object is superimposed on the specified physical object and the pictures included on the specified physical object to generate multiple synthetic images.

B19. The device according to B18, wherein when generating a plurality of composite images, the first display module is further adapted to:

The plurality of generated synthetic images are sequentially presented on the display interface of the mobile terminal in a specified order.

B20. The device according to any one of B12-B19, wherein, after the first display module presents the synthesized image on the display interface of the mobile terminal, the device further includes:

A sharing module, adapted to share the synthesized image.

B21. The device according to B20, wherein, when the one or more virtual objects are dynamic and the composite image is a dynamic image, the sharing module is further adapted to:

Intercepting at least one frame of the composite image and sharing it.

B22. The device according to any one of B12-B21, wherein, after the first display module presents the synthesized image on the display interface of the mobile terminal, the device further includes:

A receiving module, adapted to receive an operation instruction from a user on the virtual object in the synthesized image;

A response module, adapted to perform a corresponding operation on the virtual object in response to the operation instruction, to obtain the operated virtual object;

The second processing module is adapted to perform superposition processing on the operated virtual object and the specified physical object to obtain a superimposed composite image;

The second display module is adapted to present the superimposed composite image on a display interface of the mobile terminal.

Claims (10)

1. A method for image processing on a mobile terminal, comprising: Calling the image collector of the mobile terminal, and using the image collector to collect pictures contained in the specified object; In the preset virtual object library, one or more virtual objects corresponding to the collected pictures are searched, wherein the corresponding relationship between the picture and one or more virtual objects is stored in the virtual object library; superimposing the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects to generate a composite image; presenting the synthesized image on a display interface of the mobile terminal. 2. The method according to claim 1, wherein the virtual object library is located in the mobile terminal or a cloud server. 3. The method according to claim 2, wherein superimposing the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects includes: Loading one or more virtual objects corresponding to the pictures contained on the specified physical object from the virtual object library; superimposing the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects. 4. The method according to any one of claims 1-3, wherein, before invoking the image collector of the mobile terminal, the method further comprises: Scan and identify the logo on the specified physical object; Obtaining the identification of the mobile terminal, and sending the identification on the specified physical object and the identification of the mobile terminal to a cloud server, so as to verify whether the mobile terminal has the authority to perform image processing on the mobile terminal. 5. The method according to any one of claims 1-4, wherein, in the preset virtual object library, before searching for one or more virtual objects corresponding to the collected pictures, the method further comprises : The virtual object library corresponding to the specified physical object is acquired. 6. The method according to claim 5, wherein obtaining the virtual object library corresponding to the specified physical object comprises: Scan and identify the logo on the specified physical object; According to the identification on the specified physical object, in the pre-established corresponding relationship between the identification of the physical object and the virtual object library, the virtual object library corresponding to the identification on the specified physical object is searched. 7. The method according to any one of claims 1-6, wherein, when there are multiple one or more virtual objects corresponding to the picture, the designated real object, the picture contained on the designated real object And the one or more virtual objects are superimposed to generate a composite image, including: Each virtual object is superimposed on the specified physical object and the pictures included on the specified physical object to generate multiple synthetic images. 8. The method according to claim 7, wherein, when generating a plurality of composite images, presenting the composite images on a display interface of the mobile terminal comprises: The plurality of generated synthetic images are sequentially presented on the display interface of the mobile terminal in a specified order. 9. The method according to any one of claims 1-8, wherein after the composite image is presented on the display interface of the mobile terminal, the method further comprises: sharing the composite image. 10. A device for image processing on a mobile terminal, comprising: The collection module is adapted to call the image collector of the mobile terminal, and use the image collector to collect the pictures contained in the specified object; The search module is adapted to search for one or more virtual objects corresponding to the collected pictures in a preset virtual object library, wherein the virtual object library stores correspondences between pictures and one or more virtual objects relation; The first processing module is adapted to superimpose the specified physical object, the picture contained on the specified physical object, and the one or more virtual objects to generate a composite image; The first display module is adapted to present the synthesized image on a display interface of the mobile terminal.