CN110650210B - Image data acquisition method, device and storage medium - Google Patents

Abstract

The application discloses an image data acquisition method and device, and belongs to the technical field of computers. In the application, one or more image data identifiers can be extracted from a plurality of data packets transmitted between a first client and a server, and the extracted image data identifiers are sent to a second client, so that the second client can obtain corresponding image data according to the received image data identifiers. Because the image data identification is extracted from the data packet transmitted between the first client and the server, the accuracy is relatively high, the condition that the identification cannot be realized does not exist, the success rate of acquiring the image data by the second client is ensured, and the diagnosis efficiency is improved.

Description

Image data acquisition method, device and storage medium

technical field

The present application relates to the field of computer technology, and in particular, to a method, device and storage medium for acquiring image data.

Background technique

With the advent of the digital information age and the development of artificial intelligence, the medical industry has also made great progress. For example, diagnostic imaging equipment can obtain image data of various parts of the human body. When doctors examine the obtained image data , which can assist in the analysis of image data through the artificial intelligence-aided diagnosis system, so as to achieve more convenient and accurate treatment.

In the related art, the terminal can obtain image data from the server of the medical image information system through the client of the medical image information system and display it, and use the client of the artificial intelligence aided diagnosis system to perform auxiliary analysis on the displayed image data. Since the medical imaging information system and the artificial intelligence assisted diagnosis system belong to two different systems, it is difficult to directly display the image data displayed by the medical imaging information system in the artificial intelligence assisted diagnosis system. In this case, the terminal can identify the identification of the image data currently displayed by the client of the medical imaging information system by means of optical character recognition, and then download the image data through the identification, and display it on the client of the artificial intelligence aided diagnosis system. The downloaded image data is displayed for auxiliary analysis.

At present, in the related art, when the terminal uses optical character recognition to recognize the image data identifier, there is a situation of recognition error or inability to recognize, which will affect the client of the artificial intelligence-aided diagnosis system to obtain image data, thereby reducing the efficiency of diagnosis.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an image data acquisition method, device, and storage medium, which solve the problem of recognition errors or inability to recognize image data identifiers by means of optical character recognition. The technical solution is as follows:

In one aspect, a method for acquiring image data is provided, the method comprising:

acquiring a plurality of data packets transmitted between a first client and a server, where the first client is a client of a medical imaging information system, and the server is a server of the medical imaging information system;

extracting one or more image data identifiers from the plurality of data packets;

Sending the one or more image data identifiers to a second client, so that the second client obtains corresponding image data according to the one or more image data identifiers, and the second client is artificial intelligence Auxiliary diagnostic system client.

Optionally, the extracting one or more image data identifiers from the multiple data packets includes:

Screening the plurality of data packets to obtain one or more target data packets, where the one or more target data packets are data packets sent when the first client requests data from the server;

The one or more image data identifiers are determined based on the one or more target data packets.

Optionally, screening the multiple data packets to obtain one or more target data packets, including:

Get the packet type of each packet from the packet information of each packet;

One or more data packets whose data packet type is the first type are used as the one or more target data packets, and the first type is the data packet sent when the first client requests data from the server. type.

Optionally, the determining the one or more image data identifiers according to the one or more target data packets includes:

Extract the application layer information of each target data packet from each target data packet;

Divide the application layer information of each target data packet to obtain multiple data slices of each target data packet;

Obtain data slices whose slice types are the second type and the third type from the multiple data slices of each target data packet;

The one or more image data identifiers are determined according to the acquired data slices.

Optionally, determining the one or more image data identifiers according to the acquired data slices includes:

Extract a first address segment from the data slices whose slice type is the second type in the multiple data slices of each target data packet, where the first address segment is used to indicate the image data corresponding to the corresponding data packet. Storage path;

Extracting a second address segment from the data slices whose slice types are the third type in the multiple data slices of each target data packet, where the second address segment is the address information of the server;

According to the first address segment and the second address segment extracted from each target data packet, an image data identifier corresponding to each target data packet is generated.

In another aspect, a device for acquiring image data is provided, the device comprising:

an acquisition module, configured to acquire a plurality of data packets transmitted between a first client and a server, where the first client is a client of the medical imaging information system, and the server is a server of the medical imaging information system;

an extraction module for extracting one or more image data identifiers from the plurality of data packets;

a sending module, configured to send the one or more image data identifiers to a second client, so that the second client obtains corresponding image data according to the one or more image data identifiers, the second The client is the client of the artificial intelligence aided diagnosis system.

Optionally, the extraction module includes:

A screening unit, configured to screen the plurality of data packets to obtain one or more target data packets, where the one or more target data packets are data sent when the first client requests data from the server Bag;

A determining unit, configured to determine the one or more image data identifiers according to the one or more target data packets.

Optionally, the screening unit is specifically used for:

Get the packet type of each packet from the packet information of each packet;

One or more data packets whose data packet type is the first type are used as the one or more target data packets, and the first type is the data packet sent when the first client requests data from the server. type.

Optionally, the determining unit includes:

an extraction subunit, used for extracting the application layer information of each target data packet from each target data packet;

The sub-slicing unit is used to segment the application layer information of each target data packet to obtain multiple data slices of each target data packet;

an obtaining subunit, used to obtain data slices whose slice types are the second type and the third type from the multiple data slices of each target data packet;

A determination subunit, configured to determine the one or more image data identifiers according to the acquired data slices.

Optionally, the determining subunit is specifically used for:

Extract a first address segment from the data slices whose slice type is the second type in the multiple data slices of each target data packet, where the first address segment is used to indicate the image data corresponding to the corresponding data packet. Storage path;

Extracting a second address segment from the data slices whose slice types are the third type in the multiple data slices of each target data packet, where the second address segment is the address information of the server;

According to the first address segment and the second address segment extracted from each target data packet, an image data identifier corresponding to each target data packet is generated.

In another aspect, an image data acquisition device is provided, the device includes a processor, a communication interface, a memory and a communication bus;

Wherein, the processor, the communication interface and the memory communicate with each other through the communication bus;

The memory is used to store computer programs;

The processor is used for executing the program stored in the memory, so as to realize the foregoing method for obtaining image data.

In another aspect, a computer-readable storage medium is provided, and a computer program is stored in the storage medium, and when the computer program is executed by a processor, the steps of the image data acquisition method provided above are implemented.

The beneficial effects brought by the technical solutions provided in the embodiments of the present application include at least:

In this embodiment of the present application, one or more image data identifiers may be extracted from multiple data packets transmitted between the first client and the server, and the extracted image data identifiers are sent to the second client, thus, The second client can acquire corresponding image data according to the received image data identifier. Since the image data identifier is extracted from the data packet transmitted between the first client and the server, the accuracy rate is relatively high, and there is no unidentifiable situation, which ensures the success of the second client to obtain the image data rate and improve the efficiency of diagnosis.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 is a system architecture diagram of an image data acquisition provided by an embodiment of the present application;

FIG. 2 is a flowchart of a method for acquiring image data provided by an embodiment of the present application;

FIG. 3 is a schematic structural diagram of an image data acquisition device provided by an embodiment of the present application;

FIG. 4 is a structural block diagram of an image data acquisition terminal provided by an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

Before the detailed explanation of the embodiments of the present application, the application scenarios involved in the embodiments of the present application are introduced.

During the current inspection in the hospital, the diagnostic imaging equipment can be used to obtain the image data of the inspection site. After that, the terminal can obtain the image data from the server of the medical image information system through the client of the medical image information system and display it. Artificial intelligence The client of the auxiliary diagnosis system can display the image data by acquiring the identifier of the image data displayed by the client of the current medical image information system, and perform auxiliary analysis. The image data acquisition method provided by the embodiment of the present application can be used in the above scenario, by acquiring the image data identifier, display the image data on the client side of the artificial intelligence aided diagnosis system, and perform auxiliary analysis on the image data.

Next, the system architecture involved in the image data acquisition method provided by the embodiment of the present application is introduced.

FIG. 1 is a system architecture diagram involved in a method for acquiring image data provided by an embodiment of the present application. As shown in FIG. 1 , the system 100 includes a server 101 and a terminal 102 . The server 101 and the terminal 102 are connected by wireless or wired for communication.

The first client 1021 and the second client 1022 are installed on the terminal 102, the first client 1021 is the client of the medical imaging information system, and the second client 1022 is the client of the artificial intelligence aided diagnosis system. The image information system and the artificial intelligence aided diagnosis system are different systems. Therefore, the image data displayed by the first client 1021 cannot be directly displayed in the second client 1022 .

The terminal 102 also includes a network analysis module 1023. Optionally, the network analysis module 1023 may be an application installed in the terminal 102, a piece of executable code saved in the terminal 102, or an external hardware of the terminal 102. A piece of code obtained from .

The terminal 102 sends an image data acquisition request to the server 101 through the first client 1021, and receives the image data acquisition response returned by the server 101. After that, the requested image data can be obtained from the image data acquisition response, and the first client 1021 displays the image data.

In this process, the terminal 102 can obtain the image data identifier of the image data requested by the first client 1021 through the network analysis module 1023, and send the image data identifier to the second client 1022, so that the second client 1022 can pass the image The data identifier acquires the image data from the server 101 and displays the image data.

The image data identifier may be any identifier that can uniquely identify the image data, for example, the image data identifier may be the address of the image data, the id of the image data, and the like.

The server 101 is the server of the medical imaging information system, and can receive the image data acquisition request sent by the terminal 102. The image acquisition request carries the identifier of the image data requested by the terminal 102, and the server 101 can acquire the image data requested by the terminal according to the image data identifier. , and then, the server 101 may return to the terminal 102 an image data acquisition response carrying the requested image data.

In this embodiment of the present application, the server 101 may be a server or a server cluster. The terminal 102 may be a tablet computer, a desktop computer, or other devices, which are not limited in this embodiment of the present application.

Next, the image data acquisition method provided by the embodiment of the present application will be introduced.

FIG. 2 is a flowchart of a method for acquiring image data provided by an embodiment of the present application. This method can be applied to the network analysis module in Figure 1. As shown in Figure 2, the method includes the following steps:

Step 201: Acquire multiple data packets transmitted between the first client and the server.

The first client is the client of the medical image information system, and the server is the server of the medical image information system.

When acquiring a plurality of data packets transmitted between the first client and the server, the network analysis module can acquire, according to the source address and destination address of the data packets, from all the data packets sent and received by the terminal where the first client is located, Data packets transmitted between the terminal and the server of the first client.

Exemplarily, the network analysis module may use the address of the terminal where the first client is located as the source address, and the address of the medical imaging information system server as the destination address, and obtain all data packets transmitted by the first client to the medical imaging information system server. . Of course, the address of the medical imaging information system server may also be used as the source address, and the address of the first client terminal may be used as the destination address to acquire all data packets transmitted by the medical imaging information system server to the first client. The network analysis module may acquire all data packets transmitted between the terminal and the server according to the address of the terminal where the first client is located and the address of the server corresponding to the first client.

Optionally, in a possible situation, the network analysis module may also acquire multiple data packets transmitted between the first client and the server by setting a listening port. Among them, the port is the entrance and exit for the terminal to communicate with the outside, and the ports can be divided into three categories according to the port number: recognized ports, registered ports, dynamic and/or private ports.

In this embodiment of the present application, the network analysis module may be set to monitor all ports of the terminal where the first client is located, and obtain data packets transmitted through each port. That is, the network analysis module can obtain all data packets sent and received by the terminal. After that, the network analysis module can filter all the data packets according to the source addresses and destination addresses of all the obtained data packets, and reserve the data packets whose source address or destination address is the address of the server corresponding to the first client, Delete the rest of the packets. In this way, the data packets transmitted between the terminal and the server corresponding to the first client can be acquired from all the acquired data packets.

Or, when using different protocols for different services, data packets will be transmitted through different ports, and each service has a corresponding default port. Therefore, data can be transmitted between the terminal and the server of the first client according to the The protocol of the packet, which will use the default port used to transmit packets as the listening port. This can prevent the problem of too many packets obtained by listening to all ports and reduce the workload of data analysis. In this case, the network analysis module can monitor whether there is data packet transmission on the port in real time. When the terminal sends or receives data packets through this port, the network analysis module can capture the data packets sent or received. At this time, the captured data packets are the data packets transmitted between the terminal and the server. .

It should be noted that the first client can obtain image data by sending an HTTP (HTTP-Hypertexttransfer protocol, hypertext transfer protocol) request to the server, and accordingly, the server can send back the image data to the first client by sending an HTTP response . That is, the data packets transmitted between the first client and the server for acquiring image data may be HTTP data packets. Among them, since the default port used when using the HTTP protocol to transmit HTTP data packets is usually port 80, port 80 can be used as the listening port, and the HTTP data packets transmitted through port 80 can be used as the terminal and the first client server. packets transmitted between.

Optionally, in some cases, the terminal may not use the default port for transmission, but reopen a new port that is not a recognized port, and use the port as the port for transmitting HTTP data packets. Based on this, the terminal can monitor the port, and obtain the data packet transmitted through the port as the data packet transmitted between the terminal and the server of the first client. It should be noted that in this case, when accessing a web page through an address, the port number of the port needs to be written in the port field of the address, so that the terminal no longer uses the default port to transmit HTTP packets, but uses this port to transmit HTTP packets.

In addition, in this embodiment of the present application, the first client can apply to the server to register an account and password, and the server will save the account and password, and generate a corresponding relationship between the account and password. When the first client obtains image data from the server, the first client can log in to the server through the account and password.

Optionally, the network analysis module may store the organization format of the image data related information when the first client acquires the image data. In this way, the network analysis module can acquire the image data identifier from the data packet sent by the first client more accurately and quickly according to the information format.

Further, the network analysis module may correspond to a database, and the database may store the image data identifiers obtained by the network analysis module. It should be noted that the database has a storage upper limit, that is, the maximum number of image data identifiers that can be stored.

Step 202: Extract one or more image data identifiers from multiple data packets.

After acquiring multiple data packets, the network analysis module can filter the multiple data packets to obtain one or more target data packets, and the one or more target data packets are the data sent when the first client requests data from the server Packet; according to one or more target data packets, determine one or more image data identifiers.

Wherein, it can be known from the introduction in the foregoing step 201 that the acquired multiple data packets may be multiple HTTP data packets transmitted between the first client and the server, and the multiple HTTP data packets include the first client to send to the server. multiple request packets for acquiring image data, and multiple response packets for returning image data sent by the server to the first client. Based on this, the network analysis module can obtain one or more request data packets from multiple data packets, and use the obtained one or more request data packets as one or more target data packets.

In a possible implementation manner, the network analysis module may acquire one or more request data packets from the plurality of data packets according to the data packet information of the plurality of data packets. In this case, the network analysis module can obtain the data packet information of each data packet in multiple data packets, and obtain the data packet type of each data packet from the data packet information of each data packet; set the data packet type as One or more data packets of the first type are used as one or more target data packets, and the first type is the type of data packets sent when the first client requests data from the server.

It should be noted that the data packet information of multiple data packets is usually organized in the form of a list, each row of information is the data packet information of one data packet, and each row of data packet information includes the data packet corresponding to the row of data packet information. number, timestamp, source address, destination address, protocol, length, packet type, storage path, and protocol version.

Among them, the number is the sorting position of the corresponding data packet in the obtained multiple data packets, the time stamp is the time difference between the time when the network analysis module starts to grab the data packet and the time when the corresponding data packet is obtained, and the source address is is the address of the terminal where the first client that sends the corresponding data packet is located, the destination address is the address of the server corresponding to the first client that receives the corresponding data packet, and the protocol is the protocol used when sending the corresponding data packet, which can be HTTP here Protocol, the packet type is the method used to obtain the image data, and the storage path is the location where the image data is stored in the server.

Exemplarily, a row of packet information in the list is 2 0.000038 192.168.10.202192.168.10.176HTTP 553GET/Images/img_sid/save2.png HTTP/1.1, then the packet number corresponding to the row of packet information is 2, and the The data packet is obtained 0.000038 seconds after starting to obtain the data packet. The source address of the data packet is 192.168.10.202 and the destination address is 192.168.10.176. The protocol used to send the data packet is the HTTP protocol, and the length of the data packet is 553. In addition, the data packet type of the data packet is GET, the storage path is /Images/img_sid/save2.png, and the HTTP protocol used for sending is version 1.1.

After acquiring the data packet information of each data packet, the network analysis module can extract the data packet type from the data packet information of each data packet.

It should be noted that the commonly used data packet types of HTTP request packets are GET, POST and HEAD. The GET type is used to request the image data identified by the URL (Uniform Resource Locator); the POST type is used in the New data is appended to the image data identified by the URL; the HEAD type is used to request the response header of the image data identified by the URL. And only one data packet type is used when transmitting data packets between the same first client and the server.

Since the obtained data packets may include the above-mentioned various types of data packets, the network analysis module can obtain each data packet from the data packet information of each data packet in the captured plurality of data packets and count the number of data packets of each data packet type among the currently acquired multiple data packets, and use the data packet type with the largest number of data packets as the first type. After that, the data packets whose data packet type is not the first type can be deleted from the obtained multiple data packets, only the data packets whose data packet type is the first type can be obtained, and the data packets whose data packet type is the first type can be used as destination packet.

Screening multiple data packets by the above method can further reduce the number of acquired target data packets, reduce the computing resources occupied when analyzing the data packets, and also reduce the storage resources of the terminal occupied by the data packets, so that the Reduce the computing and storage overhead of the terminal.

After acquiring one or more target data packets, the network analysis module can extract the application layer information of each target data packet from each target data packet; A plurality of data slices of each target data packet; obtain data slices whose slice types are the second type and the third type from the plurality of data slices of each target data packet; determine one or more image data slices according to the obtained data slices logo.

It should be noted that the data packet is obtained by encapsulation according to the five-layer network model of physical layer, data link layer, network layer, transport layer and application layer. The last layer of encapsulation is the application layer encapsulation. Since the image data identifier is located in the application layer information of the application layer encapsulation, the application layer information can be extracted from each target data packet.

In this embodiment of the present application, the application layer information includes four parts: a request line, a request header, a blank line and a request body of the HTTP request. The request line contains the packet type, storage path, and protocol version used by the request, and includes a carriage return line feed at the end of the request line. The request header may include additional information of the request sent by the first client to the server and information of the first client itself, and the information included in the request header may vary according to different situations. The content of the request body varies according to the packet type.

Exemplarily, the request behavior of the HTTP request is Method Request-URL HTTP-VersionCRLF, where Method represents the data packet type used by the request, Request-URL represents the storage path, HTTP-Version represents the requested protocol version, and CRLF represents carriage return and line feed. Suppose, the request behavior of an HTTP request is GET/Images/img_sid/save2.pngHTTP/1.1(CRLF), the data packet type used by this request is GET, the storage path is /Images/img_sid/save2.png, and the protocol version used is HTTP1.1.

The request header can include fields such as Accept, User-Agent, Host, Content-Length, Accept-Encoding, and Accept-Langeuage. The Accept field refers to the file format of the multi-purpose Internet mail extension that can be received by the browser used by the first client; the User-Agent field refers to the type of browser that the first client can use; the Host field refers to the requested server Domain name and port number; the Content-Length field refers to the length of the request body; the Accept-Encoding field refers to the image data compression encoding type returned by the server supported by the browser used by the first client; The languages accepted by your browser.

Exemplarily, the request header of an HTTP request is:

Host:localhost:8030

Content-Length: 16

User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.181Safari/537.36

Accept: image/gif, image/x-xbitmap, image/jepg, image/pjpeg, */*

Accept-Encoding: gzip,deflate,br

Accept-Language:zh-CN，zh-EN

Among them, the HOST field indicates that the domain name of the requested server is localhost and the port number is 8030; the Content-Length field indicates that the length of the request body is 16; the User-Agent field indicates that the type of browser used by the first client can be Mozilla, AppleWebKit , Chrome, and Safari; the Accept field indicates that the image formats that the browser used by the first client can receive are gif, x-xbitmap, jepg, and pjpeg; the Accept-Encoding field indicates that the browser used by the first client can support compression encoding types are gzip, deflate, and br; the Accept-Language field indicates that the languages acceptable to the browser used by the first client are Chinese and English.

Depending on the packet type, the content of the request body varies. Among them, when the data packet type is GET, the request body is empty, and the data sent by the first client to the server is written after the storage address of the request line and sent to the server as part of the storage address. In this case, the first The amount of data sent by the client to the server cannot be too large. When the data packet type is POST, the request body includes the data sent by the first client to the server, and there is no limit to the amount of data.

After the application layer information of each target data packet is extracted from each target data packet, the application layer information of each target data packet can be segmented. The method for segmenting the application layer information of each target data packet may be segmenting each row of the application layer information according to the line break, that is, taking the data corresponding to each row of the application layer information as a data slice. Since the data is represented in binary or hexadecimal in the terminal, the newline character can be represented as "0d 0a" in the data. After that, the application layer information of each target data packet is divided according to "0d0a", and multiple data slices of each target data packet are obtained.

The multiple data slices of each target data packet are classified separately, which can be classified according to the content of each field in the four parts included in the foregoing application layer information, and each data slice is marked according to the corresponding field. The type of the data slice, that is, the field to which the data slice belongs. Exemplarily, the type of the data slice may be request line, HOST, Content-Length, and so on.

After obtaining multiple data slices of each target data packet, the network analysis module can obtain data slices of the second type and the third type from the multiple data slices of each target data packet, and analyze the data slices according to the second type and the third type of data slice, and further obtain the image data identifier corresponding to each target data packet.

The second type refers to the type marked by the field containing the storage path of the image data, and the third type refers to the type marked by the field containing the server information. It can be seen from the foregoing that the data slice of the request line type includes the data packet type, storage path and protocol version used by the request. Based on this, in the embodiment of the present application, the second type may refer to the request line type; in addition, since the HOST type The data slice includes the domain name and port number of the requested server. Therefore, in this embodiment of the present application, the third type may refer to the HOST type.

After acquiring the data slices of the second type and the third type, since the data slice of the second type contains the storage path and the data slice of the third type contains the server information, the data slices of each target data packet can be retrieved from the In the data slices of which the slice type is the second type, the first address segment is extracted, and the first address segment is used to indicate the storage path of the image data corresponding to the corresponding data packet; The slice type in the data slice is the data slice of the third type, extract the second address segment, and the second address segment is the address information of the server; then, according to the first address segment extracted from each target data packet and The second address segment generates an image data identifier corresponding to each target data packet. The address information of the server may refer to the domain name and port number of the server.

In the embodiment of the present application, since the first client requests the server to obtain the image data through the address of the image data, and the address in the network has a prescribed fixed composition format, the fixed composition format is a domain name, a port number, and a storage path. , therefore, the composition format of the domain name, port number and storage path can be used as a template to compare and match the acquired data slices of the second type and the third type, so that the images can be identified in the second type of data slices. For the storage path of the data, the identified storage path of the image data is acquired, and the storage path of the image data is used as the first address segment. Similarly, the domain name and port number can be identified in the data slice of the third type, the identified domain name and port number can be obtained, and the domain name and port number can be used as the second address segment.

After obtaining the first address segment and the second address segment, the obtained first address segment and the second address segment can be combined according to the fixed composition format of addresses specified in the aforementioned network: domain name, port number and storage path, That is, the first address segment is placed after the second address segment, so that the image data identifier corresponding to each target data packet can be obtained. At this time, the image data is identified as a URL for identifying the image data.

Wherein, in order for the network analysis module to identify the storage path, domain name and port number of the image data, the network analysis module may include a neural network trained according to a large number of addresses in a fixed composition format. The network analysis module can identify the storage path of the image data from the data slice of the second type, and identify the domain name and port number of the server from the slice data of the third type through the neural network. After that, the network analysis module combines the storage path, domain name and port number of the image data to obtain the image data identifier corresponding to each target data packet.

Optionally, the storage path part of the image data in the data slice of the second type may also include a parameter, and the parameter is the ID ((Identity, identification) of the image data to be acquired. The ID can uniquely identify an image data, based on Therefore, the network analysis module can also obtain the ID in the storage path of the image data, and use the ID as the image data identifier.

The above are only several possible implementations of image data identification given in the embodiments of the present application. In the embodiments of the present application, any information that can identify a unique image data in each target data packet can also be obtained as the image data. identification, which is not limited here.

It should be noted that data packets are transmitted and stored in the terminal or server in binary or hexadecimal form. Therefore, when obtaining the image data identifier, the data packet can be encoded, and the binary or hexadecimal data in the data packet can be visualized as information in the form of characters, and then the image data identifier can be obtained from the visualized information. The method for encoding the data packet may be any one of the encoding methods supported in the aforementioned Accept-Encoding field, which is not limited herein.

The above-mentioned embodiments mainly introduce the implementation process of using one or more request data packets as target data packets, and then acquiring the image data identifier from the target data packets. In another possible implementation manner, one or more response data packets may also be used as target data packets, and then one or more image data identifiers are determined therefrom. The application layer information of the response packet includes four parts: status line, response header, blank line and response body. The beginning of the status line is the version of the HTTP protocol used by the server, separated by spaces, followed by the response status code and text description of the status code sent back by the server; the response header is similar to the request header, adding some additional information to the response packet; The response body is the processing result, and the browser used by the first client can extract the data in the body content to generate corresponding image data. Since the response body contains the relevant information of the image data, the network analysis module can extract one or more image data identifiers from the response body of the response data packet, which is not repeated in this embodiment of the present application.

Optionally, after obtaining the image data identifier, the image data identifier may be stored in the database corresponding to the aforementioned network analysis module. When the number of stored image data identifiers is equal to the storage upper limit of the data block, if there are image data identifiers to be stored subsequently, the previously stored image data identifiers can be deleted in sequence according to the storage sequence of each image data identifier. Then, the newly acquired image data identification is stored in the database.

Step 203: Send the extracted one or more image data identifiers to the second client, so that the second client acquires corresponding image data according to the one or more image data identifiers.

Wherein, the second client is the client of the artificial intelligence aided diagnosis system.

In some embodiments, the first client and the second client are two independent clients. In this case, when the second client needs to perform auxiliary analysis on the image data currently displayed by the first client, the first client can be opened. Second client, the network analysis module can send the acquired image data identifier of the image data currently displayed by the first client to the second client, and the second client can display the received image data identifier newly obtained by the network analysis module, and acquire image data according to the image data identifier, and then display the image data, and perform auxiliary analysis on the image data.

Exemplarily, if the image data received by the second client is identified as the address of the image data, the second client can obtain the image data from the server through the image data identifier; if the image data received by the second client is identified as the The id of the image data. At this time, the image data can be downloaded from the first client according to the id of the image data through the download interface provided by the first client.

In other embodiments, when the first client is an Internet client, the first client can display image data through a browser, and at this time, the second client can be encapsulated in the browser as a plug-in. When it is necessary to perform auxiliary analysis on the image data currently displayed by the first client, the second client encapsulated in the browser in the form of a plug-in can be called. At this time, the second client can directly obtain the most recent data obtained by the network analysis module. the image data identifier of the first client, and determine the identifier of the image data currently displayed by the first client from the acquired image data identifier, and then display the image data currently displayed by the first client according to the influence data identifier, and use the image data Perform auxiliary analysis.

In a possible situation, whenever the first client opens a page through the browser to display a piece of image data, the second client can be called by clicking the function button corresponding to the second client in the page, and the second client The client can acquire the identifier of the image data displayed on the current page, and then acquire the corresponding image data through the identifier of the image data for auxiliary analysis.

In this embodiment of the present application, one or more image data identifiers may be extracted from multiple data packets transmitted between the first client and the server, and the extracted image data identifiers are sent to the second client, thus, The second client can acquire corresponding image data according to the received image data identifier. Since the image data identifier is extracted from the data packet transmitted between the first client and the server, the accuracy rate is relatively high, and there is no unidentifiable situation, which ensures the success of the second client to obtain the image data rate and improve the efficiency of diagnosis.

Referring to FIG. 3 , an embodiment of the present application provides an apparatus 300 for acquiring image data. The apparatus for acquiring image data can be applied to a terminal. The apparatus 300 includes:

The obtaining module 301 is configured to obtain a plurality of data packets transmitted between a first client and a server, where the first client is a client of the medical imaging information system, and the server is a server of the medical imaging information system;

an extraction module 302, configured to extract one or more image data identifiers from a plurality of data packets;

The sending module 303 is configured to send one or more image data identifiers to the second client, so that the second client can obtain corresponding image data according to the one or more image data identifiers, and the second client is artificial intelligence-assisted diagnosis system client.

Optionally, the extraction module 302 includes:

A screening unit, configured to screen multiple data packets to obtain one or more target data packets, where the one or more target data packets are data packets sent when the first client requests data from the server;

The determining unit is configured to determine one or more image data identifiers according to the one or more target data packets.

Optionally, the screening unit is specifically used for:

Get the packet type of each packet from the packet information of each packet;

One or more data packets whose data packet type is the first type is used as one or more target data packets, and the first type is the type of the data packet sent when the first client requests data from the server.

Optionally, the determining unit includes:

an extraction subunit, used for extracting the application layer information of each target data packet from each target data packet;

The sub-slicing unit is used to segment the application layer information of each target data packet to obtain multiple data slices of each target data packet;

an obtaining subunit, used to obtain data slices whose slice types are the second type and the third type from the multiple data slices of each target data packet;

The determining subunit is configured to determine one or more image data identifiers according to the acquired data slices.

Optionally, the determining subunit is specifically used for:

Extracting a first address segment from a data slice whose slice type is the second type in the plurality of data slices of each target data packet, where the first address segment is used to indicate the storage path of the image data corresponding to the corresponding data packet;

Extracting a second address segment from a data slice whose slice type is the third type in the multiple data slices of each target data packet, where the second address segment is the address information of the server;

According to the first address segment and the second address segment extracted from each target data packet, an image data identifier corresponding to each target data packet is generated.

In this embodiment of the present application, one or more image data identifiers may be extracted from multiple data packets transmitted between the first client and the server, and the extracted image data identifiers are sent to the second client, thus, The second client can acquire corresponding image data according to the received image data identifier. Since the image data identifier is extracted from the data packet transmitted between the first client and the server, the accuracy rate is relatively high, and there is no unidentifiable situation, which ensures the success of the second client to obtain the image data rate and improve the efficiency of diagnosis.

It should be noted that when the image data acquisition apparatus provided in the above embodiments acquires image data, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions may be allocated to different functional modules as required. , that is, dividing the internal structure of the device into different functional modules to complete all or part of the functions described above. In addition, the image data acquisition method embodiments provided by the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, which will not be repeated here.

FIG. 4 is a structural block diagram of a terminal 400 for acquiring image data according to an exemplary embodiment. The terminal 400 may be a notebook computer, a desktop computer, or the like.

Generally, the terminal 400 includes: a processor 401 and a memory 402 .

The processor 401 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 401 may use at least one hardware form of DSP (Digital Signal Processing, digital signal processing), FPGA (Field-Programmable Gate Array, field programmable gate array), and PLA (Programmable Logic Array, programmable logic array). accomplish. The processor 401 may also include a main processor and a coprocessor. The main processor is a processor used to process data in a wake-up state, also called a CPU (Central Processing Unit, central processing unit); A low-power processor for processing data in a standby state. In some embodiments, the processor 401 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing the content that needs to be displayed on the display screen. In some embodiments, the processor 401 may further include an AI (Artificial Intelligence, artificial intelligence) processor, where the AI processor is used to process computing operations related to machine learning.

Memory 402 may include one or more computer-readable storage media, which may be non-transitory. Memory 402 may also include high-speed random access memory, as well as non-volatile memory, such as one or more disk storage devices, flash storage devices. In some embodiments, a non-transitory computer-readable storage medium in the memory 402 is used to store at least one instruction, wherein the at least one instruction is used to be executed by the processor 401 to implement the methods provided by the method embodiments in this application. Image data acquisition method.

In some embodiments, the terminal 400 may optionally further include: a peripheral device interface 403 and at least one peripheral device. The processor 401, the memory 402 and the peripheral device interface 403 may be connected through a bus or a signal line. Each peripheral device can be connected to the peripheral device interface 403 through a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 404 , a display screen 405 , a camera assembly 406 , an audio circuit 407 , a positioning assembly 408 and a power source 409 .

The peripheral device interface 403 may be used to connect at least one peripheral device related to I/O (Input/Output) to the processor 401 and the memory 402 . In some embodiments, processor 401, memory 402, and peripherals interface 403 are integrated on the same chip or circuit board; in some other embodiments, any one of processor 401, memory 402, and peripherals interface 403 or The two can be implemented on a separate chip or circuit board, which is not limited in this embodiment.

The radio frequency circuit 404 is used for receiving and transmitting RF (Radio Frequency, radio frequency) signals, also called electromagnetic signals. The radio frequency circuit 404 communicates with the communication network and other communication devices via electromagnetic signals. The radio frequency circuit 404 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 404 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and the like. The radio frequency circuit 404 may communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: World Wide Web, Metropolitan Area Network, Intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), wireless local area network and/or WiFi (Wireless Fidelity, Wireless Fidelity) network. In some embodiments, the radio frequency circuit 404 may further include a circuit related to NFC (Near Field Communication, short-range wireless communication), which is not limited in this application.

The display screen 405 is used for displaying UI (User Interface, user interface). The UI can include graphics, text, icons, video, and any combination thereof. When the display screen 405 is a touch display screen, the display screen 405 also has the ability to acquire touch signals on or above the surface of the display screen 405 . The touch signal may be input to the processor 401 as a control signal for processing. At this time, the display screen 405 may also be used to provide virtual buttons and/or virtual keyboards, also referred to as soft buttons and/or soft keyboards. In some embodiments, there may be one display screen 405, which is provided on the front panel of the terminal 400; in other embodiments, there may be at least two display screens 405, which are respectively arranged on different surfaces of the terminal 400 or in a folded design; In still other embodiments, the display screen 405 may be a flexible display screen, which is disposed on a curved surface or a folding surface of the terminal 400 . Even, the display screen 405 can also be set as a non-rectangular irregular figure, that is, a special-shaped screen. The display screen 405 can be made of materials such as LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, organic light emitting diode). It should be noted that, in this embodiment of the present application, when the terminal 400 is a horizontal screen terminal, the aspect ratio of the display screen of the terminal 400 is greater than 1, for example, the aspect ratio of the display screen of the terminal 400 may be 16 :9 or 4:3. When the terminal 400 is a vertical screen terminal, the aspect ratio of the display screen of the terminal 400 is less than 1, for example, the aspect ratio of the display screen of the terminal 400 may be 9:18 or 3:4.

The camera assembly 406 is used to capture images or video. Optionally, the camera assembly 406 includes a front camera and a rear camera. Usually, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth-of-field camera to realize the background blur function, the main camera It is integrated with the wide-angle camera to achieve panoramic shooting and VR (Virtual Reality, virtual reality) shooting functions or other integrated shooting functions. In some embodiments, camera assembly 406 may also include a flash. The flash can be a single color temperature flash or a dual color temperature flash. Dual color temperature flash refers to the combination of warm light flash and cold light flash, which can be used for light compensation under different color temperatures.

Audio circuitry 407 may include a microphone and speakers. The microphone is used to collect the sound waves of the user and the environment, convert the sound waves into electrical signals, and input them to the processor 401 for processing, or to the radio frequency circuit 404 to realize voice communication. For the purpose of stereo collection or noise reduction, there may be multiple microphones, which are respectively disposed in different parts of the terminal 400 . The microphone may also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert the electrical signal from the processor 401 or the radio frequency circuit 404 into sound waves. The loudspeaker can be a traditional thin-film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert electrical signals into sound waves audible to humans, but also convert electrical signals into sound waves inaudible to humans for distance measurement and other purposes. In some embodiments, audio circuitry 407 may also include a headphone jack.

The positioning component 408 is used to locate the current geographic location of the terminal 400 to implement navigation or LBS (Location Based Service, location-based service). The positioning component 408 may be a positioning component based on the GPS (Global Positioning System, global positioning system) of the United States, the Beidou system of China, or the Galileo system of the European Union.

The power supply 409 is used to power various components in the terminal 400 . The power source 409 may be alternating current, direct current, disposable batteries or rechargeable batteries. When the power source 409 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. Wired rechargeable batteries are batteries that are charged through wired lines, and wireless rechargeable batteries are batteries that are charged through wireless coils. The rechargeable battery can also be used to support fast charging technology.

In some embodiments, the terminal 400 also includes one or more sensors 410 . The one or more sensors 410 include, but are not limited to, an acceleration sensor 411 , a gyro sensor 412 , a pressure sensor 413 , a fingerprint sensor 414 , an optical sensor 415 and a proximity sensor 416 .

The acceleration sensor 411 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the terminal 400 . For example, the acceleration sensor 411 can be used to detect the components of the gravitational acceleration on the three coordinate axes. The processor 401 may control the display screen 405 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 411 . The acceleration sensor 411 can also be used for game or user movement data collection.

The gyroscope sensor 412 can detect the body direction and rotation angle of the terminal 400 , and the gyroscope sensor 412 can cooperate with the acceleration sensor 411 to collect 3D actions of the user on the terminal 400 . The processor 401 can implement the following functions according to the data collected by the gyro sensor 412 : motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

The pressure sensor 413 may be disposed on the side frame of the terminal 400 and/or the lower layer of the display screen 405 . When the pressure sensor 413 is disposed on the side frame of the terminal 400 , the user's holding signal of the terminal 400 can be detected, and the processor 401 can perform left and right hand identification or quick operation according to the holding signal collected by the pressure sensor 413 . When the pressure sensor 413 is disposed on the lower layer of the display screen 405, the processor 401 controls the operability controls on the UI interface according to the user's pressure operation on the display screen 405. The operability controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

The fingerprint sensor 414 is used to collect the user's fingerprint, and the processor 401 identifies the user's identity according to the fingerprint collected by the fingerprint sensor 414, or the fingerprint sensor 414 identifies the user's identity according to the collected fingerprint. When the user's identity is identified as a trusted identity, the processor 401 authorizes the user to perform relevant sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings. The fingerprint sensor 414 may be provided on the front, back or side of the terminal 400 . When the terminal 400 is provided with a physical button or a manufacturer's logo, the fingerprint sensor 414 may be integrated with the physical button or the manufacturer's logo.

Optical sensor 415 is used to collect ambient light intensity. In one embodiment, the processor 401 may control the display brightness of the display screen 405 according to the ambient light intensity collected by the optical sensor 415 . Specifically, when the ambient light intensity is high, the display brightness of the display screen 405 is increased; when the ambient light intensity is low, the display brightness of the display screen 405 is decreased. In another embodiment, the processor 401 may also dynamically adjust the shooting parameters of the camera assembly 406 according to the ambient light intensity collected by the optical sensor 415 .

A proximity sensor 416 , also called a distance sensor, is usually provided on the front panel of the terminal 400 . The proximity sensor 416 is used to collect the distance between the user and the front of the terminal 400 . In one embodiment, when the proximity sensor 416 detects that the distance between the user and the front of the terminal 400 is gradually decreasing, the processor 401 controls the display screen 405 to switch from the bright screen state to the off screen state; when the proximity sensor 416 detects When the distance between the user and the front of the terminal 400 gradually increases, the processor 401 controls the display screen 405 to switch from the closed screen state to the bright screen state.

That is, the embodiments of the present application not only provide a terminal, including a processor and a memory for storing instructions executable by the processor, wherein the processor is configured to execute the image data acquisition method shown in FIG. 3 , but also, Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored in the storage medium, and when the computer program is executed by a processor, the image data acquisition method shown in FIG. 3 can be implemented.

The embodiment of the present application also provides a computer program product including instructions, which, when running on a computer, enables the computer to execute the image data acquisition method provided by the embodiment shown in FIG. 3 above.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. The storage medium mentioned may be a read-only memory, a magnetic disk or an optical disk, etc.

The above descriptions are only optional embodiments of the present application, and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the protection of the present application. within the range.

Claims (9)

1. The image data acquisition method is applied to a network analysis module of a terminal, wherein a first client and a second client are installed on the terminal, and the method comprises the following steps:

acquiring a plurality of data packets transmitted between the first client and a server, wherein the first client is a client of a medical image information system, and the server is a server of the medical image information system;

screening the plurality of data packets to obtain one or more target data packets, wherein the one or more target data packets are data packets sent when the first client requests data from the server;

determining the one or more image data identifiers according to the one or more target data packets;

and sending the one or more image data identifiers to the second client so that the second client can obtain corresponding image data according to the one or more image data identifiers, wherein the second client is a client of an artificial intelligence auxiliary diagnosis system.

2. The method of claim 1, wherein the filtering the plurality of packets to obtain one or more target packets comprises:

acquiring the data packet type of each data packet from the data packet information of each data packet;

and taking one or more data packets with the data packet type of a first type as the one or more target data packets, wherein the first type is the type of the data packet sent when the first client requests data from the server.

3. The method of claim 1, wherein said determining the one or more image data identifiers from the one or more destination data packets comprises:

extracting application layer information of each target data packet from each target data packet;

segmenting the application layer information of each target data packet to obtain a plurality of data slices of each target data packet;

acquiring data slices of which the slice types are a second type and a third type from a plurality of data slices of each target data packet, wherein the second type is a type marked by a field containing a storage path of the image data, and the third type is a type marked by a field containing server information;

determining the one or more image data identifiers from the acquired data slices.

4. The method of claim 3, wherein determining the one or more image data identifications from the acquired data slices comprises:

extracting a first address field from the data slice with the second type in the slice type in the plurality of data slices of each target data packet, wherein the first address field is used for indicating a storage path of image data corresponding to the corresponding data packet;

extracting a second address field from the data slice with the slice type of the third type in the plurality of data slices of each target data packet, wherein the second address field is address information of the server;

and generating an image data identifier corresponding to each target data packet according to the first address field and the second address field extracted from each target data packet.

5. The utility model provides an image data acquisition device, its characterized in that is arranged in the network analysis module of terminal, install first client and second client on the terminal, the device includes:

the acquisition module is used for acquiring a plurality of data packets transmitted between the first client and the server, wherein the first client is a client of a medical image information system, and the server is a server of the medical image information system;

the extraction module is used for extracting one or more image data identifications from the plurality of data packets;

wherein the extraction module comprises:

the screening unit is used for screening the plurality of data packets to obtain one or more target data packets, and the one or more target data packets are data packets sent when the first client requests data from the server;

a determining unit, configured to determine the one or more image data identifiers according to the one or more target data packets;

and the sending module is used for sending the one or more image data identifiers to the second client so that the second client can obtain corresponding image data according to the one or more image data identifiers, and the second client is a client of an artificial intelligence auxiliary diagnosis system.

6. The apparatus according to claim 5, wherein the screening unit is specifically configured to:

acquiring the data packet type of each data packet from the data packet information of each data packet;

and taking one or more data packets with the data packet type of a first type as the one or more target data packets, wherein the first type is the type of the data packet sent when the first client requests data from the server.

7. The apparatus of claim 5, wherein the determining unit comprises:

an extraction subunit, configured to extract application layer information of each target packet from each target packet;

the segmentation subunit is used for segmenting the application layer information of each target data packet to obtain a plurality of data slices of each target data packet;

an obtaining subunit, configured to obtain, from the multiple data slices of each target data packet, data slices of a second type and a third type, where the second type is a type marked by a field including a storage path of the image data, and the third type is a type marked by a field including server information;

and the determining subunit is used for determining the one or more image data identifications according to the acquired data slices.

8. The apparatus of claim 7, wherein the determining subunit is specifically configured to:

extracting a first address field from the data slice with the second type in the slice type in the plurality of data slices of each target data packet, wherein the first address field is used for indicating a storage path of image data corresponding to the corresponding data packet;

extracting a second address field from the data slice with the slice type of the third type in the plurality of data slices of each target data packet, wherein the second address field is address information of the server;

and generating an image data identifier corresponding to each target data packet according to the first address field and the second address field extracted from each target data packet.

9. A computer-readable storage medium, characterized in that a computer program is stored in the storage medium, which computer program, when being executed by a processor, carries out the steps of the method of one of the claims 1 to 4.

Images