CN112230833B - Expression image processing method, sending device, receiving device, and server - Google Patents

Abstract

The invention provides an expression image processing method, a sending device, a receiving device and a server, wherein the expression image processing method comprises the steps of responding to a first operation of a user on a first expression image, displaying the first expression image in a conversation area of a first conversation window, and sending a second expression image corresponding to the first expression image to a conversation receiving party so as to display the second expression image in a conversation area of a second conversation window of the conversation receiving party, wherein the first expression image and the second expression image have image bodies with the same content but opposite directions. The expression image processing method can improve user experience.

Description

Expression image processing method, sending device, receiving device, and server

technical field

The present invention generally relates to the field of communications, and more particularly, to an expression image processing method, a sending device, a receiving device, and a server.

Background technique

In chat software, sending emoticons can express feelings more emotionally than plain text, and is deeply loved by everyone.

However, on closer inspection, the direction of the expressions displayed in the dialogue interface is often reversed.

For example, FIG. 1 is a schematic diagram showing the way of displaying expressions in the existing chat dialog box. As shown in FIG. 1 , the expressions sent by the contact are on the left side, and each expression is directed to the left, which is different from the sender on the right side. The expressions do not face each other, and there is no interactive atmosphere of "dialogue".

Although the expression direction does not affect the transmission of the main information, it reduces the intimacy of the dialogue and affects the user experience.

SUMMARY OF THE INVENTION

Exemplary embodiments of the present invention provide an expression image processing method and a corresponding device to solve the technical problems in the prior art that the intimacy is reduced and the user experience is poor due to the mismatch of the display directions of the sending and receiving expressions.

According to an aspect of the present invention, there is provided an expression image processing method, the expression image processing method comprising: in response to a first operation of the first expression image by a user, displaying the first expression image in a conversation area of a first conversation window, Send a second emoticon image corresponding to the first emoticon image to the conversation recipient, so that the second emoticon image is displayed in the conversation area of the second conversation window of the conversation recipient, wherein the first emoticon image and the second emoticon image have Image subject with the same content but opposite orientation.

Optionally, the step of sending a second emoticon image corresponding to the first emoticon image to the session recipient may include acquiring the second emoticon image from a local emoticon database or a server according to the first emoticon image.

Optionally, the step of sending a second emoticon image corresponding to the first emoticon image to the conversation recipient may include converting the first emoticon image into a second emoticon image.

Optionally, the step of converting the first emoticon image into the second emoticon image may include: converting the first emoticon image into the second emoticon image in response to the user's second operation on the converting control.

Optionally, the step of converting the first facial expression image to the second facial expression image may include: in response to the obtained orientation attribute of the first facial expression image, converting the first facial expression image to a position corresponding to the position where the facial expression image is displayed in the second conversation window. The matching second emoticon image.

Optionally, the first expression image and the second expression image may further include text, and the step of converting the first expression image to the second expression image may include mirror-transforming the image body of the first expression image and moving the image body in the first expression image. Text so that the relative positional relationship between the text before and after the movement relative to the main image remains unchanged.

According to another aspect of the present invention, an expression image processing method is provided, the expression image processing method comprising: in response to a first operation by a user on the first expression image, displaying the first expression image in a conversation area of a first conversation window , sending the first emoticon image and the conversion flag for converting the first emoticon image into the second emoticon image to the conversation recipient or the server, so that the second emoticon image is displayed in the conversation area of the second conversation window of the conversation recipient, wherein , the first expression image and the second expression image have image bodies with the same content but opposite directions.

According to another aspect of the present invention, there is provided an expression image processing method, the expression image processing method comprising: receiving a first expression image and a conversion flag from a conversation sender; acquiring a second expression corresponding to the first expression image from an expression library The image either converts the first expression image into a second expression image based on the conversion mark, sends the second expression image to the conversation receiver, or forwards both the first expression image and the conversion mark to the conversation receiver; The second facial expression image has image bodies with the same content but opposite directions.

According to another aspect of the present invention, an expression image processing method is provided. The expression image processing method includes: receiving a first expression image and a conversion flag; acquiring a second expression image corresponding to the first expression image from an expression database or converting The sign converts the first expression image into the second expression image; displays the second expression image in the conversation area of the second conversation window of the conversation receiver; wherein the first expression image and the second expression image have the same content but opposite directions Image subject.

According to another aspect of the present invention, an expression image processing method is provided, the expression image processing method comprising: receiving a first expression image and a conversion mark; sending a request signal for a second expression image to a server in response to the conversion mark; Receive a second emoticon image corresponding to the first emoticon image; display the second emoticon image in the conversation area of the second conversation window of the conversation recipient, wherein the first emoticon image and the second emoticon image have the same content but opposite directions Image subject.

According to another aspect of the present invention, there is provided an expression image sending device, the expression image sending device comprising: a display unit for displaying a first expression image in a conversation area of a first conversation window in response to a user's first operation on the first expression image an emoticon image, the sending unit sends a second emoticon image corresponding to the first emoticon image to the conversation recipient, so that the second emoticon image is displayed in the conversation area of the second conversation window of the conversation recipient, wherein the first emoticon image is The image and the second facial expression image have image bodies with the same content but opposite directions.

Optionally, the expression image sending apparatus may further include an adaptation unit, and the adaptation unit is configured to acquire the second expression image from the local expression database or the server according to the first expression image.

Optionally, the expression image sending apparatus may further include an adaptation unit configured to convert the first expression image into the second expression image.

Optionally, the expression image sending apparatus may further include an adapting unit, and the adapting unit is configured to convert the first expression image into the second expression image in response to the user's second operation on the conversion control.

Optionally, the first facial expression image and the second facial expression image may further include text, and the adaptation unit may be further configured to: in response to the obtained orientation attribute of the first facial expression image, convert the first facial expression image into a conversation with the second facial expression image. The window displays the second emoticon image that matches the position of the emoticon image.

Optionally, the adaptation unit may be further configured to mirror-transform the image body of the first facial expression image and move the text in the first facial expression image so that the relative positional relationship of the text with respect to the image body before and after the movement remains unchanged.

According to another aspect of the present invention, there is provided a server, the server comprising: a receiving unit for receiving a first expression image and a conversion flag from an expression image sending device; an adaptation unit for acquiring a first expression image corresponding to the first expression image from an expression library The second expression image or the first expression image is converted into the second expression image based on the conversion mark; the sending unit sends the second expression image to the conversation receiver or forwards both the first expression image and the conversion mark to the conversation receiver, wherein the first expression image is The first expression image and the second expression image have image bodies with the same content but opposite directions.

According to another aspect of the present invention, there is provided an expression image receiving device, the expression image receiving device comprising: a receiving unit for receiving a first expression image and a conversion flag; an adaptation unit for acquiring from an expression library corresponding to the first expression image The second emoticon image or the first emoticon image is converted into a second emoticon image based on the conversion flag; the display unit displays the second emoticon image in the conversation area of the second conversation window of the conversation recipient; wherein, the first emoticon image and The second facial expression image has image bodies with the same content but opposite directions.

According to another aspect of the present invention, an expression image receiving device is provided, the expression image receiving device may include: a first receiving unit for receiving a first expression image and a conversion mark; a sending unit for sending a request to a server in response to the conversion mark Two request signals for emoticon images; a second receiving unit, receiving a second emoticon image corresponding to the first emoticon image from the server; a display unit, displaying the second emoticon image in the conversation area of the second conversation window, wherein the first emoticon image is The image and the second facial expression image have image bodies with the same content but opposite directions.

According to the embodiment of the present invention, a more harmonious and friendly chat experience is created by adjusting the display direction of the expression image.

Description of drawings

The above and other objects and features of the exemplary embodiments of the present invention will become more apparent from the following description in conjunction with the accompanying drawings that exemplarily illustrate the embodiments, in which:

FIG. 1 is a schematic diagram illustrating an expression display manner in a conventional chat dialog.

FIG. 2A is a flow chart illustrating an expression image processing method according to the first embodiment of the present invention;

Fig. 2B shows the expression image processed by the expression image processing method according to the first embodiment of the present invention;

Fig. 2C shows the expression image processed by the expression image processing method according to the first embodiment of the present invention;

FIG. 3 is a flowchart illustrating an expression image processing method according to a second embodiment of the present invention;

FIG. 4 is a flow chart illustrating an expression image processing method according to a third embodiment of the present invention;

FIG. 5 is a flow chart illustrating an expression image processing method according to a fourth embodiment of the present invention;

FIG. 6 is a flow chart illustrating an expression image processing method according to a fifth embodiment of the present invention;

7A and 7B are block diagrams showing an expression image transmitting apparatus according to the first embodiment of the present invention;

8 is a block diagram showing an expression image receiving apparatus according to the first embodiment of the present invention;

9 is a block diagram showing an expression image receiving apparatus according to a second embodiment of the present invention;

10 is a block diagram illustrating a server according to an embodiment of the present invention.

Detailed ways

Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like parts throughout. The embodiments will be described below in order to explain the present invention by referring to the figures.

In the embodiment of the present invention, the expression image may be an expression picture (static/dynamic), etc., and the pictures and texts in the expression image that can express emotions and transmit information may be collectively referred to as expression elements.

The expression image can be produced by the producer, or can be generated by conversion, etc. When the producer produces the expression image, the producer can assign each expression image an orientation attribute (represented by the orientation attribute value of each expression image). After the release, the user can download the expression image containing the orientation attribute, and can directly use the orientation attribute value of the expression image, without the need to separately identify the orientation and elements of the expression image.

The direction attribute of the expression image can be stored in two ways. The expression image is generally in a picture format, and the picture can have two types: an explicit user-visible attribute and a hidden attribute.

The direction attribute can be stored in the explicit attribute of the picture, and the attribute can be one of the existing picture attributes, or a dedicated attribute is added according to the embodiment of the present invention, which is visible to the user.

For example, a direction value is added to a certain attribute of the image, for example, the attribute of offline status is assigned as left (leftward), thereby indicating that the current expression image has a leftward direction attribute. Alternatively, a new attribute orientation can be created to specifically represent the orientation of the expression in the expression image.

Orientation properties can also be stored in the image hidden properties. Different pictures have their own encoding format. According to the encoding format of the picture, the direction attribute can be added to the hidden attribute of the picture. When the image is displayed, the direction attribute can be obtained by parsing the hidden attribute of the image. The preferred embodiments of the present invention will be described in detail below.

FIG. 2A is a flowchart illustrating an expression image processing method according to the first embodiment of the present invention.

The expression processing method according to the first embodiment of the present invention may include step S101 and step S102.

In step S101, in response to the user's first operation on the first facial expression image, the first facial expression image is displayed in the conversation area of the first conversation window.

Here, the first operation on the first expression image may include an operation (eg, touch) for selecting the first expression image, etc., for example, directly touching the first expression image on the touch screen. The first conversation window may be a conversation window displayed by a conversation sender, or not limited to a group chat window of the sender or the recipient.

In step S102, a second emoticon image corresponding to the first emoticon image is sent to the conversation recipient, so that the second emoticon image is displayed in the conversation area of the second conversation window of the conversation recipient.

Here, the first expression image and the second expression image have image bodies with the same content but opposite directions. As an example, the first expression image and the image subject in the second expression image may be in a mirror image relationship, and the second expression image may be obtained by flipping the first expression image. For example, the image subject of the second expression image may be obtained by flipping the first expression image. The subject of the image is obtained.

2B shows an expression image processed by the expression image processing method according to the first embodiment of the present invention, and FIG. 2C shows an expression image processed by the expression image processing method according to the first embodiment of the present invention.

As shown in FIG. 2B , the image on the left may be the first expression image, and the image on the right may be the second expression image. The elements in the image bodies of the first expression image and the second expression image may be the same, but the first expression image and the second expression image may have the same elements. The direction of the second expression image is reversed. The image body may include at least an image element in the expression image that facilitates identification of the direction of the expression image.

As shown above, the orientation of the first facial expression image can be determined by its directional attribute, and the orientation of the first facial expression image can also be determined by identifying anthropomorphic feature elements in the first facial expression image.

For example, anthropomorphic feature elements such as eyes, ears, mouth, nose, and limbs in an expression image can be identified, and after determining that the message contains feature elements, the feature elements can be further judged to obtain the direction attribute of the expression, such as: head/ The deflection angle of the limbs (such as the proportional difference between the limbs and ears), the tendency of the movement direction (such as the body tilt, the position of the subject in the multi-frame picture of the moving picture changes direction, etc.), the offset direction of the eyes (the eyes are left/right )Wait.

So far, the expression element can be determined whether it has a direction attribute, for example, it has a left direction attribute, or a right direction attribute, or has no direction.

As an example, the step S102 of sending the second emoticon image corresponding to the first emoticon image to the session recipient may include acquiring the second emoticon image from a local emoticon database or a server according to the first emoticon image. That is, the second emoticon image may be an emoticon image originally existing in the local emoticon database or server. For example, the producer can create an emoticon image with two or more directional attributes when creating an emoticon image, or the first emoticon image has been originally An emoticon image is converted into a second emoticon image, and the second emoticon image is stored in a local emoticon library or server, or stored in the form of a cloud.

When the user of the sender selects the first emoticon image, the second emoticon image capable of increasing intimacy and enhancing user experience can be sent to the receiver.

As an example, according to the first expression image may include whether the orientation attribute of the first expression image matches the position information (display position information in the conversation window) where the expression image is to be displayed. In the case where the first emoticon image does not match the display position of the emoticon image in the conversation window, the second emoticon image may be sent to the conversation recipient, or the second emoticon image may be displayed in the conversation window.

The second emoticon image (new emoticon image or converted emoticon image) and the first emoticon image (original emoticon image) can be stored in the client (for example, the sender)/server, cloud at the same time in a chain or list format. on the device.

The chain storage method means that the new emoticon image and the original emoticon image are distinguished by attributes and connected by the address chain, and exist together in the device. One is explicitly stored (the user can see it) and the rest are implicitly stored (the user cannot see it). The original emoticon image resource can be explicitly stored, or the emoticon resource suitable for the sender can be explicitly stored.

Listed storage refers to the simultaneous display of expression images in all directions in the expression management column, which are all visible to the user.

Furthermore, for an emoticon image with multiple directional attributes or resources, only one directional emoticon resource can be displayed, and a special logo can be added to the displayed emoticon resource. When the user clicks the resource in the expression management bar, the expressions in all directions will be listed and expanded for the user to select again.

Optionally, the user-visible emoticon image resource can be replaced by changing the value of the orientation attribute. For example, the direction property of the current user-visible resource is right, and the invisible resource is left. When changing the direction property of the visible resource to the left, it does not actually change the direction property of the visible resource, but changes the resource to the left to be visible to the user and the resource to the right to be invisible. In this way, in the subsequent display, the image attribute value can be changed according to the needs of the display, so as to meet the needs of displaying expressions in different directions.

As an example, the direction of the expression image may be left or right, but embodiments of the present invention are not limited thereto, and the direction of the expression image may have other directions than left or right.

The step S102 of sending the second emoticon image corresponding to the first emoticon image to the conversation recipient may include converting the first emoticon image into the second emoticon image.

The converting the first emoticon image into the second emoticon image may include converting the first emoticon image into the second emoticon image in response to a second operation of the conversion control by the user.

The conversion control here may be a software virtual button, and the second operation includes, but is not limited to, direct touch on the conversion control.

The step of converting the first facial expression image into the second facial expression image includes: in response to the obtained orientation attribute of the first facial expression image, converting the first facial expression image into a second facial expression matching the position where the facial expression image is displayed in the second conversation window image.

For example, if the obtained orientation attribute of the first emoticon image is left and the position where the emoticon image is displayed in the second session window is the left side of the screen, then the first emoticon image with the orientation attribute of the left can be converted to have the right orientation The attribute's second emoji image.

As an example, the first expression image may be converted into the second expression image by mirror-transforming the image body of the first expression image.

When the first facial expression image includes text, the image body of the first facial expression image can be mirror-transformed and the text in the first facial expression image can be moved so that the relative positional relationship between the text before and after the movement relative to the image body remains unchanged, so as to obtain the second facial expression image. Emoji image.

According to an embodiment of the present invention, the text content and/or the position of the text box can be recognized by optical character recognition (OCR) technology. For example, the step of converting the first expression image into the second expression image may include the following steps:

a. The position of the text box where the text is located and the text content are identified by OCR technology;

b. Fill the background color to the text box position to cover the text box;

c. Flip the expression image that has blocked the text;

d. Calculate the new position of the flipped text box;

e. Place the text content identified in a in the new position of the flipped text box.

As an example, the step of converting the first expression image into the second expression image may also include the following steps:

A. The position of the text box where the text is identified by OCR technology;

B. Split the text box and the image area;

C. Flip the image area;

D. Move the text box.

As shown in FIG. 2C , the adjusted second emoticon image may have the text "hehe", and the second emoticon image here may be the second emoticon image after the above conversion, or the first emoticon image obtained from the server or the local emoticon database. Two emoji images.

FIG. 3 is a flowchart illustrating an expression image processing method according to a second embodiment of the present invention.

Different from the expression image processing method of the first embodiment, the expression image processing method of the second embodiment may include sending the original expression image and the corresponding conversion flag to the conversation recipient or the server.

Specifically, the expression image processing method according to the second embodiment of the present invention may include S301 and S302.

In step S301, in response to the user's first operation on the first expression image, the first expression image is displayed in the conversation area of the first conversation window,

In step S302, send the first emoticon image and the conversion flag for converting the first emoticon image into the second emoticon image to the conversation recipient or the server, so that the second emoticon is displayed in the conversation area of the second conversation window of the conversation recipient image. Here, the first expression image and the second expression image have image bodies with the same content but opposite directions.

The definition of the expression image, the storage of the expression image, the acquisition, addition and display of the direction or the direction attribute, etc. can all be as described above, and will not be repeated here. In addition, it should be noted that the descriptions of the various drawings, features or terms in the present invention can be mutually applicable to each other and are not limited unless they are obviously contradictory.

The conversion flag here can be used to indicate or indicate that the first facial expression image needs to be converted into the second facial expression image. The session sender only sends the first facial expression image and the conversion flag, and the specific conversion can be performed by the server or the session receiver. An expression image processing method executable by at least a server will be described below.

FIG. 4 is a flowchart illustrating an expression image processing method according to a third embodiment of the present invention.

As shown in FIG. 4 , the expression image processing method according to the third embodiment of the present invention may include steps S401 and S402.

In step S401, the first emoticon image and the transition flag are received from the conversation sender.

In step S402, obtain a second emoticon image corresponding to the first emoticon image from the emoticon library or convert the first emoticon image into a second emoticon image based on the conversion flag, and send the second emoticon image to the conversation receiver, or send the conversation receiver to the second emoticon image. Both the first emoticon image and the transition logo are forwarded.

In other words, when the server executes the expression image processing method according to the third embodiment of the present invention, it can perform the conversion and transmission of the expression image by itself, and can also act as a repeater to forward only the first expression image and the conversion mark. The following will describe an expression image processing method executable by at least an expression image recipient.

FIG. 5 is a flowchart illustrating an expression image processing method according to a fourth embodiment of the present invention.

The expression image processing method according to the fourth embodiment of the present invention may include step S501, step S502 and step S503.

In step S501, a second expression image corresponding to the first expression image is obtained from an expression library, or the first expression image is converted into a second expression image based on the conversion flag. The expression library here can be the local expression library of the receiver.

In step S502, a request signal for requesting a second emoticon image is sent to the server in response to the conversion flag.

In other words, the expression image receiving apparatus according to the fourth embodiment of the present invention does not perform expression conversion itself, and at least for the first time does not obtain the second expression image from the local expression database, but requests the server to provide the second expression image, and the server can obtain the second expression image from the server. Its local expression library or the cloud obtains the second expression image; of course, the server can also continue to request the session sender to provide the second expression image, and then forward the second expression image; The first emoticon image is converted into a second emoticon image, and the second emoticon image is sent to the conversation recipient.

The specific conversion method can use the OCR technology as described above, and details are not described here. In addition, the conversion method as described above may be performed by a conversation receiver (eg, an expression image receiving apparatus), a conversation sender (eg, an expression image transmitting apparatus), a server, and the like.

In step S503, a second emoticon image is displayed in the conversation area of the second conversation window of the conversation recipient. Here, the first expression image and the second expression image have image bodies with the same content but opposite directions.

FIG. 6 is a flowchart illustrating an expression image processing method according to a fifth embodiment of the present invention.

The facial expression image processing method of the fifth embodiment may include: step S601, step S602, step S603 and step S604.

In step S601, the first facial expression image and the conversion flag are received. As described above, the first facial expression image and the conversion flag may be received from the conversation sender or the server, and the facial expression image and the conversion flag may also be received from the server.

In step S602, a request signal for requesting a second emoticon image is sent to the server in response to the conversion flag.

In step S603, a second emoticon image corresponding to the first emoticon image is received from the server. Similarly, the emoticon image processing method according to the fifth embodiment of the present invention requests the server to provide the second emoticon image, and the server can obtain the second emoticon image from its local emoticon database. or the cloud to obtain the second emoticon image; of course, the server can also continue to request the session sender to provide the second emoticon image, and then forward the second emoticon image; Converted to a second emoticon image, and can send the second emoticon image to the conversation recipient.

In step S604, a second facial expression image is displayed in the conversation area of the second conversation window of the conversation recipient, where the first facial expression image and the second facial expression image have image bodies with the same content but opposite directions.

As an example, the expression image processing methods according to the first to fifth embodiments of the present invention may include judging whether the first expression image matches the display position of the expression image in the conversation window, and may If the display positions of the emoticon images in the window do not match, the second emoticon image is sent to the conversation receiver, or the second emoticon image is displayed in the conversation window.

As an example, the emoticon image made by the producer may usually have a specific orientation attribute (eg, to the left) and the emoticon image received by the conversation receiver is usually displayed on the left side. Therefore, after the user selects the first emoticon image, the conversation can be directed to the conversation directly. The receiver sends a second emoticon image corresponding to the first emoticon image, or causes the second emoticon image to be displayed in the conversation area of the second conversation window of the conversation recipient, thereby enhancing the intimacy of the conversation and enhancing the user experience. The expression image transmitting apparatus according to the embodiment of the present invention will be described below. The expression image transmitting device or the expression image receiving device according to the embodiment of the present invention may be an electronic device such as a telephone (eg, a smart phone), a wearable device (eg, a smart watch), a notebook computer, a desktop computer, and the like.

7A and 7B are block diagrams showing an expression image transmitting apparatus according to the first embodiment of the present invention.

As shown in FIG. 7A , the expression image sending apparatus 700 of the first embodiment may include a display unit 701 and a sending unit 702 .

The display unit 710 may display the first emoticon image in the conversation area of the first conversation window in response to the user's first operation on the first emoticon image.

The sending unit 702 may send a second emoticon image corresponding to the first emoticon image to the conversation recipient, so that the second emoticon image is displayed in the conversation area of the second conversation window of the conversation recipient, where the first emoticon image is the same as the first emoticon image. Two expression images have image subjects with the same content but opposite directions.

As shown in FIG. 7B , the image sending apparatus of the first embodiment may further include an adapting unit 703, and the adapting unit may acquire a second emoticon image from a local emoticon database or a server according to the first emoticon image. The adaptation unit 703 can be based on whether the orientation attribute of the first facial expression image matches the position information of the facial expression image to be displayed. For example, the adaptation unit 703 can use the first facial expression image and the facial expression image display position in the conversation window does not match the situation. Next, send the second emoticon image to the conversation recipient, or display the second emoticon image in the conversation window.

The adaptation unit 703 can also convert the first expression image into the second expression image. For example, the adaptation unit 703 may convert the first expression image to the second expression image in response to the user's second operation on the conversion control.

Furthermore, the adaptation unit 703 may convert the first facial expression image into a second facial expression image matching the position where the facial expression image is displayed in the second conversation window in response to the obtained orientation attribute of the first facial expression image. When the first expression image and the second expression image include characters, the adaptation unit 703 may mirror-transform the image body of the first expression image and move the characters in the first expression image to make the relative positions of the characters before and after the movement relative to the image body The relationship remains the same. The specific steps performed by the adaptation unit 703 may be as described in a to e or A to D above.

8 is a block diagram showing an expression image receiving apparatus according to the first embodiment of the present invention.

The expression image receiving apparatus 800 according to the first embodiment of the present invention may include a receiving unit 801 , an adaptation unit 802 and a display unit 803 .

The receiving unit 801 may receive the first expression image and the conversion flag from . Optionally, the receiving unit may receive the first expression image and the conversion mark from the server or the expression image sending apparatus, and may also receive the first expression image and the conversion mark from the server. The conversion flag here is as described above and will not be repeated here.

The adaptation unit 802 can obtain the second expression image corresponding to the first expression image from the expression library or convert the first expression image into the second expression image based on the conversion flag. An emoji library that stores emoji images in the form.

The display unit 803 may display a second emoticon image in the conversation area of the second conversation window of the conversation recipient, where the first emoticon image and the second emoticon image have image bodies with the same content but opposite directions.

9 is a block diagram showing an expression image receiving apparatus according to a second embodiment of the present invention.

The expression image receiving apparatus 900 according to the second embodiment of the present invention may include a first receiving unit 901 , a transmitting unit 902 , a second receiving unit 903 and a display unit 904 .

The first receiving unit 901 may receive the first expression image and the conversion mark, optionally, the first receiving unit 901 may receive the first expression image and the conversion mark from a server or an expression image sending device.

The sending unit 902 may send a request signal for requesting the second emoticon image to the server in response to the conversion flag, that is, the emoticon image receiving apparatus of the second embodiment does not obtain the second emoticon image from the local emoticon database at least for the first time, and at least for the first time does not The first emoticon image is converted into the second emoticon image, but the server is requested to provide the second emoticon image.

The second receiving unit 902 may receive a second expression image corresponding to the first expression image from the server, and the first receiving unit 901 and the second receiving unit 902 may also be the same receiving unit, or two parts of the same receiving unit, or for different receiving units.

The display unit 904 may display a second facial expression image in the conversation area of the second conversation window, where the first facial expression image and the second facial expression image have image bodies with the same content but opposite directions.

The display unit in the expression image transmitting apparatus and the expression image receiving apparatus according to the embodiment of the present invention may include a display, and the display may include a touch screen.

10 is a block diagram illustrating a server according to an embodiment of the present invention.

The server 1000 according to an embodiment of the present invention may include a receiving unit 1001 , an adapting unit 1002 and a sending unit 1003 .

The receiving unit 1001 may receive the first expression image and the conversion flag from the expression image transmitting device.

The adaptation unit 1002 may obtain the second expression image corresponding to the first expression image from the expression library or convert the first expression image into the second expression image based on the conversion flag. As mentioned above, the expression library here may include a local expression library or An emoji library that stores emoji images in cloud form.

The sending unit 1003 may send the second emoticon image to the conversation recipient or forward both the first emoticon image and the conversion sign to the conversation recipient, where the first emoticon image and the second emoticon image have image bodies with the same content but opposite directions.

When the expression image receiving apparatus receives the first expression image and the conversion flag, the expression image receiving apparatus may convert the first expression image into the second expression image.

The term 'unit' according to an embodiment of the present disclosure refers to, but is not limited to, a unit of software, hardware and firmware or any combination thereof.

The term "unit" may be used interchangeably with the terms "module", "logic", "logical block", "component" or "circuit". The term "unit" may refer to the smallest unit of a component or a portion thereof. The term "unit" may be the smallest unit that performs part of a component or at least one function. The unit may be implemented mechanically or electronically. For example, a module may include at least one of an application specific integrated circuit (ASIC) chip, a field programmable gate array (FPGA), and a programmable logic device known or developed for certain operations.

According to various embodiments of the present disclosure, the apparatuses (eg, modules or their functions) or methods may be implemented by computer program instructions stored in a computer-readable storage medium. Where the instructions are executed by a processor, the processor may perform functions corresponding to the instructions. The computer-readable storage medium may be a memory. At least a portion of a programming module may be implemented (eg, executed) by a processor. At least a portion of a programming module may include modules, programs, routines, sets of instructions, and processes for performing at least one function.

The computer-readable storage media include magnetic media such as floppy disks and magnetic tapes, optical media (including compact disk (CD) ROM and DVD ROM), magneto-optical media such as floppy disks, and ROMs designed to store and execute program commands. , RAM hardware devices and flash memory. The program commands include language code executable by the computer using an interpreter and machine language code generated by a compiler. The above-described hardware devices may be implemented by one or more software modules for performing operations of various embodiments of the present disclosure.

A unit, module or programming module of the present disclosure may include at least one of the foregoing components with some components omitted or other components added. The operations of the units, programming modules, or other components may be performed sequentially, in parallel, in a loop, or heuristically. Additionally, some operations may be performed in a different order, omitted, or extended with other operations.

The facial expression image processing method and the corresponding device according to the embodiments of the present invention can improve chat intimacy and enhance user experience.

While various embodiments of the present disclosure have been described using specific terminology, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense to assist in an understanding of the present disclosure. It will be apparent that various modifications and changes may be made by those skilled in the art (eg, different features in different embodiments may be combined) without departing from the broader spirit and scope of this disclosure. Accordingly, the scope of the present disclosure should be defined not by the specific embodiments and examples, but by the claims and their equivalents.

Claims (27)

1. An expression image processing method, comprising:

displaying a first emoticon in a conversation area of a first conversation window in response to a first operation of the first emoticon by a user,

transmitting a second emoticon corresponding to the first emoticon to the conversation recipient so that the second emoticon is displayed in a conversation area of a second conversation window of the conversation recipient,

wherein the first expression image and the second expression image have image bodies with the same content and opposite directions,

the first expression image and the second expression image further comprise characters, the image main body in the second expression image is in a mirror image relative to the image main body in the first expression image, the characters in the second expression image are not in a mirror image relative to the characters in the first expression image, and the relative position relationship of the characters in the second expression image relative to the image main body in the second expression image and the relative position relationship of the characters in the first expression image relative to the image main body in the first expression image are kept unchanged.

2. The method for processing the expression images according to claim 1, wherein the step of sending a second expression image corresponding to the first expression image to the session receiver includes acquiring the second expression image from a local expression library or a server according to the first expression image.

3. The method according to claim 1, wherein the step of transmitting a second expression image corresponding to the first expression image to the session receiver includes converting the first expression image into the second expression image.

4. The method according to claim 1, wherein the step of converting the first expression image into the second expression image comprises: and converting the first expression image into a second expression image in response to a second operation of the conversion control by the user.

5. The method according to claim 1, wherein the step of converting the first expression image into the second expression image comprises: and converting the first expression image into a second expression image matched with the position of the second conversation window for displaying the expression image in response to the obtained direction attribute of the first expression image.

6. The method according to claim 5, wherein the step of converting the first expression image into the second expression image includes mirror-converting an image body of the first expression image and moving the text in the first expression image so that a relative positional relationship of the text before and after the movement with respect to the image body remains unchanged.

7. The method according to claim 3, wherein the step of converting the first expression image into the second expression image comprises:

recognizing the position of the character by an optical character recognition technology;

segmenting a text region and an image region;

mirror image turning over the image area;

the text region is moved so that the relative positional relationship of the characters before and after the movement with respect to the image main body remains unchanged.

8. An expression image processing method, comprising:

displaying a first emoticon in a conversation area of a first conversation window in response to a first operation of the first emoticon by a user,

transmitting the first emoticon image and a conversion flag for converting the first emoticon image into a second emoticon image to a conversation receiver or a server so that the second emoticon image is displayed in a conversation area of a second conversation window of the conversation receiver,

wherein the first expression image and the second expression image have image bodies with the same content and opposite directions,

wherein the conversion mark is used for representing or indicating that the first expression image needs to be converted into the second expression image,

the first expression image and the second expression image further comprise characters, the image main body in the second expression image is in a mirror image relative to the image main body in the first expression image, the characters in the second expression image are not in a mirror image relative to the characters in the first expression image, and the relative position relationship of the characters in the second expression image relative to the image main body in the second expression image and the relative position relationship of the characters in the first expression image relative to the image main body in the first expression image are kept unchanged.

9. The method according to claim 8, wherein the first expression image and the second expression image are stored in a chain or a list.

10. An expression image processing method, comprising:

receiving a first emoticon and a conversion mark from a session sender;

converting the first expression image into a second expression image based on the conversion flag, transmitting the second expression image to the conversation receiver,

or

Forwarding both the first emoticon image and the conversion flag to a session receiver;

wherein the first expression image and the second expression image have image bodies with the same content but opposite directions,

wherein the conversion mark is used for representing or indicating that the first expression image needs to be converted into the second expression image,

the first expression image and the second expression image further comprise characters, the image main body in the second expression image is in a mirror image relative to the image main body in the first expression image, the characters in the second expression image are not in a mirror image relative to the characters in the first expression image, and the relative position relationship of the characters in the second expression image relative to the image main body in the second expression image and the relative position relationship of the characters in the first expression image relative to the image main body in the first expression image are kept unchanged.

11. The method according to claim 10, wherein the first expression image and the second expression image are stored in a chain or a list.

12. An expression image processing method, comprising:

receiving a first expression image and a conversion mark;

converting the first expression image into a second expression image based on the conversion mark;

displaying a second emoticon in a conversation area of a second conversation window of the conversation receiver;

wherein the first expression image and the second expression image have image bodies with the same content but opposite directions,

wherein the conversion mark is used for representing or indicating that the first expression image needs to be converted into the second expression image,

the first expression image and the second expression image further comprise characters, the image main body in the second expression image is in a mirror image relative to the image main body in the first expression image, the characters in the second expression image are not in a mirror image relative to the characters in the first expression image, and the relative position relationship of the characters in the second expression image relative to the image main body in the second expression image and the relative position relationship of the characters in the first expression image relative to the image main body in the first expression image are kept unchanged.

13. The expression image processing method according to claim 12, wherein the first expression image and the second expression image are stored in a chain or a columnar manner.

14. An expression image processing method, comprising:

receiving a first expression image and a conversion mark;

transmitting a request signal requesting the second emoticon to the server in response to the conversion flag;

receiving a second expression image corresponding to the first expression image from the server;

displaying a second emoticon in a conversation area of a second conversation window of the conversation recipient,

wherein the first expression image and the second expression image have image bodies with the same content and opposite directions,

wherein the conversion mark is used for representing or indicating that the first expression image needs to be converted into the second expression image,

the first expression image and the second expression image further comprise characters, an image main body in the second expression image is in a mirror image relative to an image main body direction in the first expression image, the characters in the second expression image are not in a mirror image relative to the characters in the first expression image, and a relative position relation of the characters in the second expression image relative to the image main body in the second expression image and a relative position relation of the characters in the first expression image relative to the image main body in the first expression image are kept unchanged.

15. The expression image processing method according to claim 14, wherein the first expression image and the second expression image are stored in a chain or a columnar manner.

16. An expression image transmission device characterized by comprising:

a display unit which displays a first emoticon image in a conversation area of a first conversation window in response to a first operation of a first emoticon image by a user,

a transmitting unit that transmits a second emoticon corresponding to the first emoticon to the conversation receiver so that the second emoticon is displayed in a conversation area of a second conversation window of the conversation receiver,

wherein the first expression image and the second expression image have image main bodies with the same content but opposite directions, the first expression image and the second expression image also comprise characters,

the first expression image and the second expression image further comprise characters, an image main body in the second expression image is in a mirror image relative to an image main body direction in the first expression image, the characters in the second expression image are not in a mirror image relative to the characters in the first expression image, and a relative position relation of the characters in the second expression image relative to the image main body in the second expression image and a relative position relation of the characters in the first expression image relative to the image main body in the first expression image are kept unchanged.

17. The emoticon sending device of claim 16, further comprising an adaptation unit configured to acquire a second emoticon from a local emoticon library or a server according to the first emoticon.

18. The expression image transmission device according to claim 16, further comprising an adaptation unit configured to convert the first expression image into the second expression image.

19. The emoticon sending apparatus according to claim 16, further comprising an adaptation unit configured to: and converting the first expression image into a second expression image in response to a second operation of the conversion control by the user.

20. The emoticon transmitting apparatus of claim 19, wherein the adapting unit is further configured to: and converting the first expression image into a second expression image matched with the position of the second conversation window displaying the expression image in response to the obtained direction attribute of the first expression image.

21. The emoticon transmitting apparatus according to claim 20, wherein the adapting unit is further configured to mirror-convert the image body of the first emoticon and move the text in the first emoticon so that the relative positional relationship of the text before and after the movement with respect to the image body remains unchanged.

22. The emoticon sending apparatus of claim 16, wherein the adapting unit is further configured to:

identifying the position of the character by an optical character recognition technology;

segmenting a text region and an image region;

turning over the image area in a mirror image manner;

the text region is moved so that the relative positional relationship of the characters before and after the movement with respect to the image main body remains unchanged.

23. A server, comprising:

a receiving unit that receives the first expression image and the conversion flag from the expression image transmitting device;

an adaptation unit that converts the first expression image into a second expression image based on the conversion flag;

a transmitting unit which transmits the second emoticon image to the conversation receiver or forwards both the first emoticon image and the conversion flag to the conversation receiver,

wherein the first expression image and the second expression image have image bodies with the same content and opposite directions,

wherein the conversion mark is used for representing or indicating that the first expression image needs to be converted into the second expression image,

the first expression image and the second expression image further comprise characters, an image main body in the second expression image is in a mirror image relative to an image main body direction in the first expression image, the characters in the second expression image are not in a mirror image relative to the characters in the first expression image, and a relative position relation of the characters in the second expression image relative to the image main body in the second expression image and a relative position relation of the characters in the first expression image relative to the image main body in the first expression image are kept unchanged.

24. The server according to claim 23, wherein the first emoticon and the second emoticon are stored in a chain or a list.

25. An expressive image receiving apparatus, comprising:

a receiving unit that receives the first expression image and the conversion flag;

an adaptation unit that converts the first expression image into a second expression image based on the conversion flag;

a display unit that displays a second emoticon in a conversation area of a second conversation window of the conversation recipient;

wherein the first expression image and the second expression image have image bodies with the same content but opposite directions,

wherein the conversion mark is used for representing or indicating that the first expression image needs to be converted into the second expression image,

the first expression image and the second expression image further comprise characters, the image main body in the second expression image is in a mirror image relative to the image main body in the first expression image, the characters in the second expression image are not in a mirror image relative to the characters in the first expression image, and the relative position relationship of the characters in the second expression image relative to the image main body in the second expression image and the relative position relationship of the characters in the first expression image relative to the image main body in the first expression image are kept unchanged.

26. The expressive image receiving device of claim 25, wherein the first expressive image and the second expressive image are stored in a chain or a list manner.

27. An expressive image receiving device, comprising:

a first receiving unit that receives the first expression image and the conversion flag;

a transmission unit that transmits a request signal requesting the second emoticon to the server in response to the conversion flag;

a second receiving unit that receives a second expression image corresponding to the first expression image from the server;

a display unit that displays the second emoticon image in a conversation area of the second conversation window,

wherein the first expression image and the second expression image have image bodies with the same content and opposite directions,

wherein the conversion mark is used for representing or indicating that the first expression image needs to be converted into the second expression image,

the first expression image and the second expression image further comprise characters, the image main body in the second expression image is in a mirror image relative to the image main body in the first expression image, the characters in the second expression image are not in a mirror image relative to the characters in the first expression image, and the relative position relationship of the characters in the second expression image relative to the image main body in the second expression image and the relative position relationship of the characters in the first expression image relative to the image main body in the first expression image are kept unchanged.

Images