CN113453041A - Data processing method, device, equipment and storage medium - Google Patents
Data processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113453041A CN113453041A CN202010232305.0A CN202010232305A CN113453041A CN 113453041 A CN113453041 A CN 113453041A CN 202010232305 A CN202010232305 A CN 202010232305A CN 113453041 A CN113453041 A CN 113453041A
- Authority
- CN
- China
- Prior art keywords
- information
- group
- equipment
- video
- splicing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25808—Management of client data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25808—Management of client data
- H04N21/25825—Management of client data involving client display capabilities, e.g. screen resolution of a mobile phone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Databases & Information Systems (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the application provides a data processing method, a data processing device, data processing equipment and a storage medium, so that a plurality of pieces of equipment can be used more fully to watch videos. The method comprises the following steps: receiving a splicing request of more than one device, and acquiring device information according to the splicing request; establishing a group of equipment according to the equipment information, and determining layout information of the equipment in the group; segmenting the video image according to the layout information, and determining a video subimage corresponding to the equipment; and transmitting the video sub-images to corresponding devices so as to display the corresponding videos through splicing of the more than one devices. The method and the device enable more than one device to display the same video in a splicing mode, so that the devices can be fully utilized, and the display size of the terminal for the video can be enlarged.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data processing method and apparatus, an electronic device, and a storage medium.
Background
With the development of terminal technology, users increasingly use mobile terminals such as mobile phones and tablet computers, and various activities such as payment, shopping and entertainment can be performed through the terminals.
When a user watches multimedia files such as pictures and videos by using a terminal such as a mobile phone, the display of the multimedia files is limited by the screen size of the device. Therefore, when a terminal such as a mobile phone is used to view contents such as pictures and videos, the viewable size is affected.
At present, a user often has multiple devices, such as multiple mobile phones, tablets and the like, and therefore how to watch videos by using the multiple devices more fully is a technical problem that needs to be solved urgently in the field.
Disclosure of Invention
The embodiment of the application provides a data processing method, so that a plurality of devices can be used more fully to watch videos.
Correspondingly, the embodiment of the application also provides a data processing device, an electronic device and a storage medium, which are used for ensuring the implementation and application of the method.
In order to solve the above problem, an embodiment of the present application discloses a data processing method, including: receiving a splicing request of more than one device, and acquiring device information according to the splicing request; establishing a group of equipment according to the equipment information, and determining layout information of the equipment in the group; segmenting the video image according to the layout information, and determining a video subimage corresponding to the equipment; and transmitting the video sub-images to corresponding devices so as to display the corresponding videos through splicing of the more than one devices.
The embodiment of the application also discloses a data processing method, which comprises the following steps: providing a page with a group function; determining equipment information according to the page, and generating a splicing request according to the equipment information; and sending the splicing request to establish a group of more than one device according to the splicing request, and splicing and displaying the same video.
The embodiment of the present application further discloses a data processing apparatus, including: the receiving module is used for receiving the splicing request of more than one device and acquiring the device information according to the splicing request; the group layout module is used for establishing a group of the equipment according to the equipment information and determining the layout information of the equipment in the group; the video segmentation module is used for segmenting the video image according to the layout information and determining a video subimage corresponding to the equipment; and the transmission module is used for transmitting the video sub-images to corresponding equipment so as to display the corresponding videos through splicing by the more than one equipment.
The embodiment of the present application further discloses a data processing apparatus, including: the page providing module is used for providing pages with group functions; the splicing request module is used for determining equipment information according to the page and generating a splicing request according to the equipment information; and the sending module is used for sending the splicing request so as to establish a group of more than one device according to the splicing request and splice and display the same video.
The embodiment of the application also discloses an electronic device, which comprises: a processor; and a memory having executable code stored thereon that, when executed, causes the processor to perform a method as described in one or more of the embodiments of the application.
Embodiments of the present application also disclose one or more machine-readable media having executable code stored thereon that, when executed, cause a processor to perform a method as described in one or more of the embodiments of the present application.
The embodiment of the application also discloses an electronic device, which comprises: a processor; and a memory having executable code stored thereon that, when executed, causes the processor to perform a method as described in one or more of the embodiments of the application.
Embodiments of the present application also disclose one or more machine-readable media having executable code stored thereon that, when executed, cause a processor to perform a method as described in one or more of the embodiments of the present application.
Compared with the prior art, the embodiment of the application has the following advantages:
in the embodiment of the application, more than one device can be grouped, the corresponding layout information is determined, then the video data can be divided according to the layout information to obtain more than one video sub-image, so that the corresponding sub-video stream is fed back to the corresponding device, the more than one device can be spliced to display the same video, the device can be fully utilized, and the display size of the terminal for the video can be enlarged.
Drawings
FIG. 1 is a schematic illustration of a tiled display of video according to an embodiment of the present application;
FIG. 2 is an interactive processing diagram of an example of data processing according to an embodiment of the present application;
FIGS. 3A and 3B are schematic diagrams of an example of a splice in accordance with embodiments of the present application;
fig. 4 is a diagram illustrating an example of playing an interactive play according to an embodiment of the present application;
FIG. 5 is a flowchart illustrating steps of an embodiment of a server of a data processing method according to the present application;
FIG. 6 is a flow chart of the steps of a client embodiment of a data processing method of the present application;
FIG. 7 is a flow chart of steps in another data processing method client embodiment of the present application;
FIG. 8 is a block diagram of an embodiment of a data processing apparatus of the present application;
FIG. 9 is a block diagram of another data processing apparatus embodiment of the present application;
fig. 10 is a schematic structural diagram of an apparatus according to an embodiment of the present application.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, the present application is described in further detail with reference to the accompanying drawings and the detailed description.
The embodiment of the application can be applied to a scene of splicing and displaying videos by multiple devices, and the devices for displaying the videos can be various devices with screens, such as electronic devices such as mobile phones, tablet computers and personal computers. One video can be displayed in a splicing mode through a plurality of devices. The method can be applied to various video playing scenes, such as the playing of videos of live broadcast, on-demand broadcast and the like, and can also comprise the playing of videos of movie and art and videos of interactive drama and the like in a video application program.
As shown in fig. 1, in a video splicing display diagram, a user may use multiple devices to request splicing, and a server determines a video according to the requests of the multiple devices, and segments the video and feeds the video back to the devices for display. The processing procedure is shown in fig. 2:
step 202, the device sends a splicing request, where the splicing request includes device information.
The user may use multiple devices to stitch the display video, and thus may determine the multiple devices that need to be stitched, such as 3 devices for stitching in fig. 1. A splicing request may be sent to the server for each device, which may carry device information for that device.
Wherein the device information may include: the device identifier may be used to uniquely identify one device, for example, a Media Access Control (MAC) address is used as the device identifier, and the screen information may be used to determine related information of the device screen display, for example, including a screen size and/or a screen resolution, so as to determine a layout of a mosaic based on the screen information when different devices are mosaiced. In addition, the device information further includes group information, and the group information is used for determining a group to which the devices belong, so that the devices in the same group are spliced.
In the process of splicing multiple devices, it is necessary to identify which devices are to be spliced together, and therefore in some alternative embodiments, the devices may be in a group, so that the multiple devices to be spliced in some may be determined based on the group. In some examples, an application, such as a video application, provides a function of creating a group, such as creating a room, and devices are added to a group based on the group function, so that a user can enter the same room (group) on different devices, and thus can determine a group identifier of the group in which the devices are located, and mark the device to input a group to be spliced. In other examples, multiple devices display videos in a tiled manner, so that the devices are located at the same position, and therefore the devices can also be connected to the same local area network such as a WiFi network, and thus it can be determined that the multiple devices belong to the devices to be tiled through corresponding device MAC addresses and the like.
In some optional embodiments, a page with group functionality is provided; after the equipment enters a page of an appointed group, acquiring the group information of the appointed group, and adding the group information into the equipment information of the equipment. The page with group function can be provided through application program, the user can click to create/enter the appointed group, in addition, different devices can be added into the same appointed group through invitation mode, after each device enters the page of the appointed group, each device can obtain the group information of the appointed group, and the group information is added into the device information of the device. The group information includes: the group identifier is used for uniquely identifying a group, each device in each group can also be configured with a device serial number, the device serial number can be in a form of acquiring other permutation for the serial number, in some examples, the device serial number can also be formed in a mode of group identifier plus serial number, so that the group can be represented according to the device requirement, and the specific setting is carried out according to the requirement. In other examples, the device serial number may also indicate arrangement information of the devices, for example, the arrangement manner and the order of the devices are specified by the device serial number, and may be specifically set according to requirements.
In some examples, the device serial number of the device in the group may also be related to the splicing sequence of the devices, for example, the splicing sequence of the device in the horizontal direction or the vertical direction is determined according to the device serial number, and may be specifically set according to actual requirements.
Step 204, establishing a group of devices according to the device information, and determining layout information of the devices in the group.
After the server receives the device information of more than one device, a group can be established at the server based on the device information to associate the devices, so that the transmission of video related data can be carried out based on the group, and the structures of the devices in the group are arranged to facilitate the splitting and splicing display of videos.
In some optional embodiments, the establishing a group of devices according to the device information includes: determining devices belonging to a group according to the device information; and binding the devices in the group, and determining the group identifier of the group. Wherein determining devices belonging to a group according to the device information comprises: determining that the more than one device belongs to a group according to the MAC address in the device information; and/or determining that the more than one device belongs to a group according to group information in the device information, wherein the group information includes: group identification and/or device serial number in the group. The sequential structure among the devices can be determined when the group is constructed, and can also be determined according to the arrangement mode of the devices when the group is laid out.
The MAC address of the device may be obtained from the device information, and a device list capable of forming a group, for example, each device used by one user, may be determined in advance at the server, so that the MAC address may be queried in the device list, thereby determining that more than one device belongs to one group. In some other examples, after the device side determines the group of devices, the server may also establish dissuasion of the devices so that the device information may carry group information, and then determine multiple devices belonging to the same group based on the group information, and determine more than one device as a group. Then, a plurality of devices belonging to a group may be bound according to a device identifier, such as a MAC address, for example, a group device list may be created to record the bound devices in the group, and the group identifier of the group may be set, so that a group can be uniquely determined, and splitting, splicing, and the like of a video can be facilitated.
In some other optional embodiments, the determining layout information of the devices in the group includes: arranging the equipment according to the equipment information, and determining corresponding equipment arrangement information; and determining corresponding layout information according to the screen information in the equipment information and the equipment arrangement information. Wherein the screen information includes: screen size and/or screen resolution. The layout information may include an arrangement manner of the devices, and device arrangement information and display information corresponding to the arrangement manner. The arrangement mode refers to a layout arrangement mode of equipment splicing, such as transverse arrangement, longitudinal arrangement, double rows, three rows and the like. The device arrangement information includes a device identifier, an arrangement number, and the like, where the arrangement number is used to identify the position information of the device corresponding to the arrangement mode, such as a sequence number. The display information may be used to determine display-related information of the devices after splicing, such as screen information of each device, and information such as resolution of videos that can be displayed after being laid out in an arrangement manner, and may obtain a splicing area of each screen.
In some optional embodiments, the determining, according to the screen information in the device information and the device arrangement information, corresponding layout information includes: determining splicing screen information of the corresponding splicing screen and a splicing area corresponding to each device according to the screen information and the device arrangement information; and determining display information according to the splicing screen information and the splicing area, and taking the display information and the equipment arrangement information as layout information.
The screen information of each device in the group can be determined, more than one device in the group can be laid out according to the screen information, for example, the devices can be laid out in a horizontal and vertical layout arrangement mode based on the device serial number of the device in the group, the arrangement number of the device can be determined based on the arrangement sequence, and the device arrangement information can be obtained by combining the device identification such as the MAC address of the device. And according to the screen size, the screen resolution and other information corresponding to the screen formed by the equipment in the group. The size and the resolution of the spliced screen after the equipment splicing can be determined based on the layout arrangement mode, and if the minimum value after the equipment splicing is taken as a corresponding value, the size and the resolution of the corresponding spliced screen are obtained.
In the schematic diagrams of the screen splicing examples shown in fig. 3A, 3B, 4 devices are spliced laterally as in fig. 3A, 4 devices are spliced in 2 rows as in fig. 3B, the entire spliced screen is shown on the left side of fig. 3B, and the actual discharge position may be shown on the right side of fig. 3B. Each screen is spliced according to a layout arrangement mode, the center point of the spliced screen is aligned with the center point of the spliced screen, the minimum edge in the edges of one or more equipment combinations is taken as the edge corresponding to the spliced screen according to the layout arrangement mode, the part exceeding the edge can be ignored, the shadow part shown in figures 3A and 3B is the area of the spliced screen, the exceeding part does not display the spliced video, and therefore the size and the resolution of the spliced screen, the splicing area of each equipment and the like are determined.
Thereby enabling to establish a group for a plurality of devices and determine layout information of the group for segmentation and splicing of video based on the layout information.
And step 206, segmenting the video image according to the layout information, and determining a video sub-image corresponding to the equipment.
The video to be spliced and displayed can be determined, wherein the video information can be carried in the splicing request, or after splicing, the video can be selected through any equipment, then a playing request is sent out, and the video is determined based on the playing request. After the video is determined, corresponding video data can be obtained, video images in the video data can be obtained, then the video images are segmented according to the layout information, and the video images are segmented based on the splicing area occupied by each device in the splicing layout to obtain video subimages corresponding to each device.
In an optional embodiment, the segmenting the video image according to the layout information and determining the video sub-image corresponding to the device include: acquiring equipment arrangement information and display information from the layout information; segmenting the video image according to the display information to obtain corresponding video subimages; and determining the video subimages corresponding to the devices according to the device arrangement information. The device arrangement information and the display information can be acquired from the layout information, the information such as the size and the resolution of a splicing screen is determined according to the display information, the splicing area corresponding to each device is determined, each video image is segmented, video sub-images matched with the segmentation corresponding to each splicing area are obtained, the device corresponding to each video sub-image is determined according to the device arrangement information, and therefore the video sub-image corresponding to each device is obtained.
The video played in the embodiment of the application can be various videos on demand and live broadcast, videos such as movie and television dramas and integrated art in video application, and videos such as interactive dramas.
Taking live broadcasting as an example, live broadcasting can be carried out, and users such as students can watch live video of lectures by using a plurality of devices at home, so that the display size of the video can be enlarged. In some examples, the teacher gives a lecture using the PPT, the lecture, and the like, and for the splicing of the videos, it may also be determined that some devices are devices that display independent sub-parts in the videos such as the PPT and the lecture, so as to better present the videos. For another example, in some live videos, evening videos and the like, some small windows are used for displaying other videos, and in the process of splicing display and layout, the small windows can be independently displayed in one or more devices, so that the videos can be watched more clearly.
Step 208, transmitting the video sub-image to a corresponding device.
After each frame of image in the video is divided, each video sub-image can be compressed to form a sub-video stream, and then the sub-video stream is transmitted to corresponding equipment. And audio data corresponding to the video can be transmitted to a specified one or more devices, so that the video can be displayed in the devices.
Thus, in some alternative embodiments, video sub-images of successive frames may be compressed to form corresponding sub-video streams; and transmitting the sub-video stream to corresponding equipment. Audio data corresponding to the video may also be added to one or more sub-video streams.
And step 210, the device analyzes and displays the sub-video stream.
After the devices acquire the sub-video stream, the sub-video stream can be analyzed and displayed, so that the same video is displayed by splicing a plurality of devices, and each device can display a part of the video picture.
And the server side can also generate splicing prompt information according to the layout information and feed back the splicing prompt information to the more than one device. After the layout information of the equipment is determined, splicing prompt information prompting the splicing mode can be generated, wherein the splicing prompt information can prompt the splicing position of each equipment, so that more accurate prompt is given back to the equipment.
Therefore, the device can output the splicing prompt information, for example, prompt in a mode of displaying the splicing prompt information, playing the splicing prompt information, and the like. For example, the device may display a tile legend, and display the location of the device in the tile legend, for example, highlight the location of the device in the tile legend through various manners such as flashing, bolding, changing colors, and the like. The embodiment of the present application is not limited to the style of the splicing illustration, and can be set according to the requirement, for example, fig. 3A and 3B can be used as an example of the splicing illustration.
The embodiment of the application can also be applied to a playing scene of an interactive play, wherein the interactive play can be understood as an interactive network video which can be participated by a user, and can be regarded as a game video or a video game. The user can play a role to participate in the interactive drama, and as the user selects different drama nodes in the drama of the interactive drama, the interactive drama can show different dramas.
An interactive series may be viewed as a video with more than one storyline, in case the played video comprises more than one storyline: the equipment end can send scenario nodes so as to request to play videos of different branch scenario in the equipment of the group; the server side can receive plot nodes fed back by the equipment in the group; and feeding back the videos of the scenario nodes corresponding to the branch scenario to corresponding equipment so as to play different branch scenarios in the equipment of the group. The embodiment of the application can display different plot nodes on different equipment along with the promotion of plots in the process of splicing and displaying interactive plots, so that the equipment selecting different plot nodes can play videos of different branch line plots, a user can synchronously experience different plots when experiencing interactive plots, and time is saved. In addition, in scenes such as a friend party and the like, mobile phones of the friends of the party can be spliced together to display an interactive drama, different users can select different roles and drama nodes along with the development of the drama of the interactive drama, and corresponding equipment can play corresponding videos, so that the purpose of interactive communication of the friends is achieved, different dramas can be experienced, and rich dramas in the interactive drama can be known.
In an example of an interactive play based on the service shown in fig. 5, a plurality of devices request the service to create a group and to display the interactive play in a mosaic manner. The method comprises the steps that more than one branch line scenario exists in an interactive scenario, so that when a certain scenario node is reached, a user is prompted to select a corresponding scenario node, each device can display the prompt at the moment, different devices can select respective scenario nodes to a server, after the server receives the scenario nodes fed back by the devices, videos of the branch line scenarios corresponding to the scenario nodes are determined, the videos of the branch line scenarios are sent to the corresponding devices to play, and different branch line scenarios are played in the devices of a group. As shown in fig. 5, different devices respectively trigger different scenario nodes 1, 2, and 3, and the server may return videos of the corresponding scenarios 1, 2, and 3 to the devices for playing based on the request, so that the interactive dramas may show different scenario trends.
In summary, more than one device may be grouped, corresponding layout information is determined, and then the video data may be segmented according to the layout information to obtain more than one video sub-image, so as to feed back the corresponding sub-video stream to the corresponding device, so that the more than one device may display the same video in a splicing manner, thereby fully utilizing the device and enlarging the display size of the terminal for the video.
Taking a friend party as an example, the party personnel are used as users, and the users often play mobile phones respectively and lack communication, so that the terminals such as the mobile phones of the users can be spliced in groups, and then the videos are displayed through the mobile phones of the users after being split, thereby improving novel and interesting interaction and shortening the distance between the users.
On the basis of the above embodiments, the present embodiment provides a data processing method on the server side, which can perform grouping, layout, and video segmentation in combination with information of devices, and implement various required processes.
Referring to fig. 5, a flowchart illustrating steps of an embodiment of a server of a data processing method according to the present application is shown.
Step 502, receiving a splicing request, and acquiring device information of more than one device from the splicing request.
Step 504, determining the devices belonging to a group according to the device information; and binding the devices in the group, and determining the group identifier of the group.
Wherein determining devices belonging to a group according to the device information comprises: determining that the more than one device belongs to a group according to a Media Access Control (MAC) address in the device information; and/or determining that the more than one device belongs to a group according to group information in the device information, wherein the group information includes: group identification and/or device serial number in the group. And after more than one device of the group is determined, binding the devices into the group, and determining the corresponding group identifier.
Wherein the screen information includes: screen size and/or screen resolution. The determining the corresponding layout information according to the screen information and the device arrangement information in the device information includes: determining splicing screen information of the corresponding splicing screen and a splicing area corresponding to each device according to the screen information and the device arrangement information; and determining display information according to the splicing screen information and the splicing area, and taking the display information and the equipment arrangement information as layout information.
And 512, generating splicing prompt information according to the layout information, and feeding back the splicing prompt information to the more than one device.
And 516, segmenting the video image according to the display information to obtain corresponding video sub-images.
And 522, sending the sub-video stream to a corresponding device.
The steps of the embodiments of the present application are similar to those of the embodiments described above, and reference may be made to the description of the embodiments described above for corresponding steps. In other embodiments, the splicing request may carry information of the requested video, so step 512 may be omitted, which may be determined according to actual situations, and this is not limited by the embodiments of the present application.
Receiving plot nodes fed back by the equipment in the group under the condition that the played video comprises more than one branch plot; and feeding back the videos of the scenario nodes corresponding to the branch scenario to corresponding equipment so as to play different branch scenarios in the equipment of the group.
Therefore, the method can be adapted from a data source, determine the display area of each device and segment the image data of the video, and realize splicing and display with higher quality. Physical connection is not needed among all the devices, the device can adapt to the sizes and the resolutions of different screens, and more optimal display is realized.
On the basis of the above embodiments, the present embodiment provides a data processing method on the client side, which can perform a group request and a mosaic display after video segmentation in combination with the information of the devices, thereby performing interesting interaction on each piece of furniture.
Referring to fig. 6, a flow chart of steps of an embodiment of a client of a data processing method of the present application is shown.
Wherein, the determining the device information according to the page includes: after the equipment enters a page of an appointed group, acquiring group information of the appointed group; the device identification sum, screen information and group information of the device are adopted as the device information.
Therefore, the devices do not need to be physically connected, the sizes and the resolutions of different screens can be adapted, and more optimal display is realized.
Referring to FIG. 7, a flow chart of steps of another data processing method client embodiment of the present application is shown.
And 712, receiving the splicing prompt information and prompting according to the splicing prompt information.
At step 714, a sub-video stream is received. The sub-video stream corresponds to the device, and the sub-video stream is obtained by dividing according to the layout information of the more than one device.
And step 716, analyzing and displaying the sub-video stream.
In case the played video comprises more than one branching scenario, sending scenario nodes to request to play videos of different branching scenarios in the devices of the group.
Therefore, a plurality of mobile phones can be put together, each device of the group is regarded as one display unit, the display units are integrated to be used as a complete display screen to display videos, the display range of the videos can be expanded, and more interesting and clearer watching experience is provided.
The embodiment of the application can provide more interesting watching experience, and can be integrated with video applications to enable users to enjoy novel and interesting video watching experience through terminals such as mobile phones on the basis of massive video resources.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the embodiments. Further, those skilled in the art will also appreciate that the embodiments described in the specification are presently preferred and that no particular act is required of the embodiments of the application.
On the basis of the above embodiments, the present embodiment further provides a data processing apparatus, which is applied to an electronic device at a server.
Referring to fig. 8, a block diagram of a data processing apparatus according to an embodiment of the present application is shown, which may specifically include the following modules:
the receiving module 802 is configured to receive a splicing request of more than one device, and obtain device information according to the splicing request.
A group layout module 804, configured to establish a group of devices according to the device information, and determine layout information of the devices in the group.
And a video segmentation module 806, configured to segment the video image according to the layout information, and determine a video sub-image corresponding to the device.
A transmission module 808, configured to transmit the video sub-images to corresponding devices, so as to display the corresponding videos through the more than one device in a splicing manner.
Wherein the group layout module comprises: a group submodule and a layout submodule, wherein:
the group submodule is used for determining equipment belonging to a group according to the equipment information; and binding the devices in the group, and determining the group identifier of the group.
The group submodule is used for determining that the more than one device belongs to a group according to the MAC address in the device information; and/or determining that the more than one device belongs to a group according to group information in the device information, wherein the group information includes: group identification and/or device serial number in the group.
The layout submodule is used for arranging the equipment according to the equipment information and determining corresponding equipment arrangement information; determining corresponding layout information according to screen information and the equipment arrangement information in the equipment information, wherein the screen information comprises: screen size and/or screen resolution.
The layout submodule is used for determining splicing screen information of a corresponding splicing screen and a splicing area corresponding to each device according to the screen information and the device arrangement information; and determining display information according to the splicing screen information and the splicing area, and taking the display information and the equipment arrangement information as layout information.
The video segmentation module 806 is configured to obtain device arrangement information and display information from the layout information; segmenting the video image according to the display information to obtain corresponding video subimages; and determining the video subimages corresponding to the devices according to the device arrangement information.
The transmission module 808 is configured to compress video sub-images of consecutive frames to form a corresponding sub-video stream; and transmitting the sub-video stream to corresponding equipment.
The transmission module 808 is further configured to add audio data corresponding to the video to one or more sub-video streams.
Further comprising: and the prompt determining submodule is used for generating splicing prompt information according to the layout information and feeding back the splicing prompt information to the more than one device.
The transmission module 808 is further configured to receive scenario nodes fed back by the devices in the group when the played video includes more than one branch scenario; and feeding back the videos of the scenario nodes corresponding to the branch scenario to corresponding equipment so as to play different branch scenarios in the equipment of the group.
In summary, more than one device may be grouped, corresponding layout information is determined, and then the video data may be segmented according to the layout information to obtain more than one video sub-image, so as to feed back the corresponding sub-video stream to the corresponding device, so that the more than one device may display the same video in a splicing manner, thereby fully utilizing the device and enlarging the display size of the terminal for the video.
On the basis of the above embodiments, the present embodiment further provides a data processing apparatus, which is applied to electronic devices such as a mobile phone and a tablet computer at a client.
Referring to fig. 9, a block diagram of another data processing apparatus according to another embodiment of the present application is shown, which may specifically include the following modules:
a page providing module 902, configured to provide a page with group function.
And a splicing request module 904, configured to determine device information according to the page, and generate a splicing request according to the device information.
A sending module 906, configured to send the splicing request, so as to establish a group of more than one device according to the splicing request, and splice and display the same video.
The splicing request module 904 is configured to obtain group information of an appointed group after a device enters a page of the appointed group; the device identification sum, screen information and group information of the device are adopted as the device information.
Further comprising: the display module is used for receiving a sub-video stream, wherein the sub-video stream corresponds to the equipment and is obtained by dividing the sub-video stream according to the layout information of more than one equipment; and analyzing and displaying the sub-video stream.
And the splicing prompt module is used for receiving the splicing prompt information and prompting according to the splicing prompt information.
The sending module 906 is further configured to send a scenario node to request that videos of different leg scenarios be played in the devices of the group, in a case that the played video includes more than one leg scenario.
The method can be used for adapting from a data source, determining the display area of each device and segmenting the image data of the video, thereby realizing splicing and display with higher quality. Physical connection is not needed among all the devices, the device can adapt to the sizes and the resolutions of different screens, and more optimal display is realized.
The mobile phones can be placed together, each device of the group is regarded as one display unit, the display units are integrated to serve as a complete display screen to display videos, the display range of the videos can be enlarged, and more interesting and clearer watching experience is provided.
The embodiment of the application can provide more interesting watching experience, and can be integrated with video applications to enable users to enjoy novel and interesting video watching experience through terminals such as mobile phones on the basis of massive video resources.
The present application further provides a non-transitory, readable storage medium, where one or more modules (programs) are stored, and when the one or more modules are applied to a device, the device may execute instructions (instructions) of method steps in this application.
Embodiments of the present application provide one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause an electronic device to perform the methods as described in one or more of the above embodiments. In the embodiment of the present application, the electronic device includes various types of devices such as a terminal device and a server (cluster).
Embodiments of the present disclosure may be implemented as an apparatus, which may include electronic devices such as a terminal device, a server (cluster), etc., using any suitable hardware, firmware, software, or any combination thereof, to perform a desired configuration. Fig. 10 schematically illustrates an example apparatus 1000 that may be used to implement various embodiments described herein.
For one embodiment, fig. 10 illustrates an example apparatus 1000 having one or more processors 1002, a control module (chipset) 1004 coupled to at least one of the processor(s) 1002, memory 1006 coupled to the control module 1004, non-volatile memory (NVM)/storage 1008 coupled to the control module 1004, one or more input/output devices 1010 coupled to the control module 1004, and a network interface 1012 coupled to the control module 1004.
The processor 1002 may include one or more single-core or multi-core processors, and the processor 1002 may include any combination of general-purpose or special-purpose processors (e.g., graphics processors, application processors, baseband processors, etc.). In some embodiments, the apparatus 1000 can be used as a terminal device, a server (cluster), or the like in this embodiment.
In some embodiments, the apparatus 1000 may include one or more computer-readable media (e.g., the memory 1006 or the NVM/storage 1008) having instructions 1014 and one or more processors 1002 that, in conjunction with the one or more computer-readable media, are configured to execute the instructions 1014 to implement modules to perform the actions described in this disclosure.
For one embodiment, control module 1004 may include any suitable interface controllers to provide any suitable interface to at least one of the processor(s) 1002 and/or any suitable device or component in communication with control module 1004.
The control module 1004 may include a memory controller module to provide an interface to the memory 1006. The memory controller module may be a hardware module, a software module, and/or a firmware module.
Memory 1006 may be used, for example, to load and store data and/or instructions 1014 for device 1000. For one embodiment, memory 1006 may comprise any suitable volatile memory, such as suitable DRAM. In some embodiments, the memory 1006 may comprise a double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).
For one embodiment, the control module 1004 may include one or more input/output controllers to provide an interface to the NVM/storage 1008 and input/output device(s) 1010.
For example, NVM/storage 1008 may be used to store data and/or instructions 1014. NVM/storage 1008 may include any suitable non-volatile memory (e.g., flash memory) and/or may include any suitable non-volatile storage device(s) (e.g., one or more hard disk drive(s) (HDD (s)), one or more Compact Disc (CD) drive(s), and/or one or more Digital Versatile Disc (DVD) drive (s)).
The NVM/storage 1008 may include storage resources that are physically part of the device on which the apparatus 1000 is installed, or it may be accessible by the device and need not be part of the device. For example, NVM/storage 1008 may be accessed over a network via input/output device(s) 1010.
Input/output device(s) 1010 may provide an interface for apparatus 1000 to communicate with any other suitable device, input/output devices 1010 may include communication components, audio components, sensor components, and so forth. Network interface 1012 may provide an interface for device 1000 to communicate over one or more networks, and device 1000 may communicate wirelessly with one or more components of a wireless network according to any of one or more wireless network standards and/or protocols, such as access to a communication standard-based wireless network, such as WiFi, 2G, 3G, 4G, 5G, etc., or a combination thereof.
For one embodiment, at least one of the processor(s) 1002 may be packaged together with logic for one or more controller(s) (e.g., memory controller module) of control module 1004. For one embodiment, at least one of the processor(s) 1002 may be packaged together with logic for one or more controller(s) of control module 1004 to form a System In Package (SiP). For one embodiment, at least one of the processor(s) 1002 may be integrated on the same die with the logic of one or more controllers of the control module 1004. For one embodiment, at least one of the processor(s) 1002 may be integrated on the same die with logic for one or more controller(s) of control module 1004 to form a system on chip (SoC).
In various embodiments, the apparatus 1000 may be, but is not limited to: a server, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.), among other terminal devices. In various embodiments, the apparatus 1000 may have more or fewer components and/or different architectures. For example, in some embodiments, device 1000 includes one or more cameras, a keyboard, a Liquid Crystal Display (LCD) screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, an Application Specific Integrated Circuit (ASIC), and speakers.
The detection device can adopt a main control chip as a processor or a control module, sensor data, position information and the like are stored in a memory or an NVM/storage device, a sensor group can be used as an input/output device, and a communication interface can comprise a network interface.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the true scope of the embodiments of the application.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The foregoing detailed description has provided a data processing method and apparatus, an electronic device and a storage medium, and the principles and embodiments of the present application are described herein using specific examples, which are merely used to help understand the method and its core ideas of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (21)
1. A method of data processing, comprising:
receiving a splicing request of more than one device, and acquiring device information according to the splicing request;
establishing a group of equipment according to the equipment information, and determining layout information of the equipment in the group;
segmenting the video image according to the layout information, and determining a video subimage corresponding to the equipment;
and transmitting the video sub-images to corresponding devices so as to display the corresponding videos through splicing of the more than one devices.
2. The method of claim 1, wherein the establishing a group of devices from the device information comprises:
determining devices belonging to a group according to the device information;
and binding the devices in the group, and determining the group identifier of the group.
3. The method of claim 2, wherein determining devices belonging to a group based on the device information comprises:
determining that the more than one device belongs to a group according to a Media Access Control (MAC) address in the device information; and/or
Determining that the more than one device belongs to a group according to group information in the device information, wherein the group information includes: group identification and/or device serial number in the group.
4. The method of claim 1, wherein the determining layout information for devices in the group comprises:
arranging the equipment according to the equipment information, and determining corresponding equipment arrangement information;
determining corresponding layout information according to screen information and the equipment arrangement information in the equipment information, wherein the screen information comprises: screen size and/or screen resolution.
5. The method of claim 4, wherein the determining the corresponding layout information according to the screen information and the device arrangement information in the device information comprises:
determining splicing screen information of the corresponding splicing screen and a splicing area corresponding to each device according to the screen information and the device arrangement information;
and determining display information according to the splicing screen information and the splicing area, and taking the display information and the equipment arrangement information as layout information.
6. The method of claim 5, wherein the segmenting the video image according to the layout information and determining the video sub-image corresponding to the device comprises:
acquiring equipment arrangement information and display information from the layout information;
segmenting the video image according to the display information to obtain corresponding video subimages;
and determining the video subimages corresponding to the devices according to the device arrangement information.
7. The method of claim 1, wherein the transmitting the video sub-images to corresponding devices comprises:
compressing the video sub-images of the continuous frames to form corresponding sub-video streams;
and transmitting the sub-video stream to corresponding equipment.
8. The method of claim 4, further comprising:
and adding the audio data corresponding to the video into one or more sub-video streams.
9. The method of claim 1, further comprising:
and generating splicing prompt information according to the layout information, and feeding back the splicing prompt information to the more than one device.
10. The method of claim 1, further comprising:
receiving plot nodes fed back by the equipment in the group under the condition that the played video comprises more than one branch plot;
and feeding back the videos of the scenario nodes corresponding to the branch scenario to corresponding equipment so as to play different branch scenarios in the equipment of the group.
11. A method of data processing, comprising:
providing a page with a group function;
determining equipment information according to the page, and generating a splicing request according to the equipment information;
and sending the splicing request to establish a group of more than one device according to the splicing request, and splicing and displaying the same video.
12. The method of claim 11, wherein said determining device information from said page comprises:
after the equipment enters a page of an appointed group, acquiring group information of the appointed group;
the device identification sum, screen information and group information of the device are adopted as the device information.
13. The method of claim 11, further comprising:
receiving a sub-video stream, wherein the sub-video stream corresponds to the equipment and is obtained by dividing the sub-video stream according to the layout information of the more than one equipment;
and analyzing and displaying the sub-video stream.
14. The method of claim 11, further comprising:
and receiving splicing prompt information, and prompting according to the splicing prompt information.
15. The method of claim 11, further comprising:
in case the played video comprises more than one branching scenario, sending scenario nodes to request to play videos of different branching scenarios in the devices of the group.
16. A data processing apparatus comprising:
the receiving module is used for receiving the splicing request of more than one device and acquiring the device information according to the splicing request;
the group layout module is used for establishing a group of the equipment according to the equipment information and determining the layout information of the equipment in the group;
the video segmentation module is used for segmenting the video image according to the layout information and determining a video subimage corresponding to the equipment;
and the transmission module is used for transmitting the video sub-images to corresponding equipment so as to display the corresponding videos through splicing by the more than one equipment.
17. A data processing apparatus, comprising:
the page providing module is used for providing pages with group functions;
the splicing request module is used for determining equipment information according to the page and generating a splicing request according to the equipment information;
and the sending module is used for sending the splicing request so as to establish a group of more than one device according to the splicing request and splice and display the same video.
18. An electronic device, comprising: a processor; and
memory having stored thereon executable code which, when executed, causes the processor to perform the method of one or more of claims 1-10.
19. One or more machine-readable media having executable code stored thereon that, when executed, causes a processor to perform the method of one or more of claims 1-10.
20. An electronic device, comprising: a processor; and
memory having stored thereon executable code which, when executed, causes the processor to perform the method of one or more of claims 11-15.
21. One or more machine-readable media having executable code stored thereon that, when executed, causes a processor to perform the method of one or more of claims 11-15.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010232305.0A CN113453041A (en) | 2020-03-27 | 2020-03-27 | Data processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010232305.0A CN113453041A (en) | 2020-03-27 | 2020-03-27 | Data processing method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113453041A true CN113453041A (en) | 2021-09-28 |
Family
ID=77808176
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010232305.0A Pending CN113453041A (en) | 2020-03-27 | 2020-03-27 | Data processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113453041A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115460413A (en) * | 2022-09-15 | 2022-12-09 | 无锡思朗电子科技有限公司 | Method for solving multiple displays of high-bit-rate video |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103685430A (en) * | 2012-09-26 | 2014-03-26 | 中国电信股份有限公司 | A mobile terminal combined display method, a system, and a server |
| CN104850382A (en) * | 2015-05-27 | 2015-08-19 | 联想(北京)有限公司 | Display module control method, electronic device and display splicing group |
| CN105245928A (en) * | 2015-09-30 | 2016-01-13 | 努比亚技术有限公司 | Video playback device, method and system |
| CN105739935A (en) * | 2016-01-22 | 2016-07-06 | 厦门美图移动科技有限公司 | Multi-terminal combined display method, apparatus and system |
| CN109729338A (en) * | 2018-11-28 | 2019-05-07 | 利亚德光电股份有限公司 | Show processing method, the device and system of data |
| CN110784752A (en) * | 2019-09-27 | 2020-02-11 | 腾讯科技（深圳）有限公司 | Video interaction method and device, computer equipment and storage medium |
-
2020
- 2020-03-27 CN CN202010232305.0A patent/CN113453041A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103685430A (en) * | 2012-09-26 | 2014-03-26 | 中国电信股份有限公司 | A mobile terminal combined display method, a system, and a server |
| CN104850382A (en) * | 2015-05-27 | 2015-08-19 | 联想(北京)有限公司 | Display module control method, electronic device and display splicing group |
| CN105245928A (en) * | 2015-09-30 | 2016-01-13 | 努比亚技术有限公司 | Video playback device, method and system |
| CN105739935A (en) * | 2016-01-22 | 2016-07-06 | 厦门美图移动科技有限公司 | Multi-terminal combined display method, apparatus and system |
| CN109729338A (en) * | 2018-11-28 | 2019-05-07 | 利亚德光电股份有限公司 | Show processing method, the device and system of data |
| CN110784752A (en) * | 2019-09-27 | 2020-02-11 | 腾讯科技（深圳）有限公司 | Video interaction method and device, computer equipment and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115460413A (en) * | 2022-09-15 | 2022-12-09 | 无锡思朗电子科技有限公司 | Method for solving multiple displays of high-bit-rate video |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8803991B2 (en) | Snapshot capture in video stream | |
| US10574933B2 (en) | System and method for converting live action alpha-numeric text to re-rendered and embedded pixel information for video overlay | |
| US20150350594A1 (en) | Methods, apparatuses and computer programs for adapting content | |
| CN111970524B (en) | Control method, device, system, equipment and medium for interactive live broadcast and microphone connection | |
| WO2016138844A1 (en) | Multimedia file live broadcast method, system and server | |
| US20190392197A1 (en) | Face swap method, face swap device, host terminal and audience terminal | |
| US20030086003A1 (en) | Video data processing apparatus and method, data distributing apparatus and method, data receiving apparatus and method, storage medium, and computer program | |
| CN113099258A (en) | Cloud director system, live broadcast processing method and device, and computer readable storage medium | |
| CN108769824A (en) | A kind of video mixed flow method, apparatus, system, equipment and medium | |
| US10575050B2 (en) | Providing a plurality of points of view of digital environments | |
| US20160164970A1 (en) | Application Synchronization Method, Application Server and Terminal | |
| US20200213631A1 (en) | Transmission system for multi-channel image, control method therefor, and multi-channel image playback method and apparatus | |
| US20180247672A1 (en) | Bundling Separate Video Files to Support a Controllable End-User Viewing Experience with Frame-Level Synchronization | |
| CN114374853B (en) | Content display method, device, computer equipment and storage medium | |
| CN108833809A (en) | A kind of video mixed flow control method, device, system, equipment and medium | |
| CN116708867B (en) | Live broadcast data processing method, device, equipment and storage medium | |
| WO2015180446A1 (en) | System and method for maintaining connection channel in multi-device interworking service | |
| KR20130039521A (en) | Method and device for providing multi angle video to devices | |
| CN102364960B (en) | Mobile digital television picture in picture and channel thumbnail playing method and mobile terminal | |
| KR102152627B1 (en) | Method and apparatus for displaying contents related in mirroring picture | |
| CN113453041A (en) | Data processing method, device, equipment and storage medium | |
| CN105916000A (en) | Video display method and device | |
| CN105828162A (en) | Video display method and device | |
| CN111385590A (en) | Live broadcast data processing method and device and terminal | |
| CN116248950A (en) | Interactive video multi-picture presentation method and device, storage medium and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210928 |
|
| RJ01 | Rejection of invention patent application after publication |