[go: up one dir, main page]

CN112734004A - Neural network construction method under homomorphic encryption, image processing method and system - Google Patents

Neural network construction method under homomorphic encryption, image processing method and system Download PDF

Info

Publication number
CN112734004A
CN112734004A CN202011622912.4A CN202011622912A CN112734004A CN 112734004 A CN112734004 A CN 112734004A CN 202011622912 A CN202011622912 A CN 202011622912A CN 112734004 A CN112734004 A CN 112734004A
Authority
CN
China
Prior art keywords
neural network
convolutional neural
data
image data
network model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011622912.4A
Other languages
Chinese (zh)
Inventor
刘圣龙
王衡
周鑫
王迪
夏雨潇
张舸
江伊雯
吕艳丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Big Data Center of State Grid Corp of China
Original Assignee
Big Data Center of State Grid Corp of China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Big Data Center of State Grid Corp of China filed Critical Big Data Center of State Grid Corp of China
Priority to CN202011622912.4A priority Critical patent/CN112734004A/en
Publication of CN112734004A publication Critical patent/CN112734004A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/602Providing cryptographic facilities or services
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Molecular Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Bioethics (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Image Analysis (AREA)

Abstract

本发明提供了一种同态加密下神经网络构建方法、图像处理方法和系统,包括:获取预先训练的卷积神经网络模型输出所述卷积神经网络模型的网络参数;根据所述网络参数,在同态加密下对所述卷积神经网络模型进行转换,得到可识别多类型数据的卷积神经网络;其中,所述卷积神经网络模型是由用户层多个图像数据及其对应的分类结果训练得到的。本发明构建了一个可同时处理原始数据和同态加密的数据的可识别多类型数据的卷积神经网络,改善现有机器学习的弊端,提高预测准确率。

Figure 202011622912

The invention provides a neural network construction method, image processing method and system under homomorphic encryption, including: obtaining a pre-trained convolutional neural network model and outputting network parameters of the convolutional neural network model; according to the network parameters, Convert the convolutional neural network model under homomorphic encryption to obtain a convolutional neural network that can identify multiple types of data; wherein, the convolutional neural network model is composed of multiple image data at the user layer and their corresponding classifications result of training. The invention constructs a convolutional neural network capable of processing original data and homomorphically encrypted data at the same time, which can identify multiple types of data, improves the drawbacks of the existing machine learning, and improves the prediction accuracy.

Figure 202011622912

Description

Neural network construction method under homomorphic encryption, image processing method and system
Technical Field
The invention belongs to the technical field of data processing, and particularly relates to a neural network construction method under homomorphic encryption, an image processing method and an image processing system.
Background
Currently, machine learning as a service (MLaaS) is becoming popular due to its versatility as artificial intelligence technology is applied and landed in various fields. The machine learning is that the service works in the cloud computing platform, and the user can complete related classification and prediction tasks after uploading own data. Because machine learning related algorithms and models require a large amount of data to train, the required data contains more personal privacy data, and the related fields are numerous, machine learning, namely service, faces a serious data security problem in use.
Homomorphic encryption refers to a series of encryption schemes with a special algebraic structure, the structure allows calculation to be directly performed on encrypted data without a decryption key, and the obtained operation result is consistent with the operation result on a plaintext after being decrypted. Although the current mainstream homomorphic encryption framework supports homomorphic addition, homomorphic multiplication and the like, in machine learning related calculation, complex operations such as gradient calculation, exponential operation and the like are included, and in some scenes, homomorphic encrypted data cannot meet the complex operations in a machine learning model. Graepel et al, which discusses suitable and inappropriate scenarios for machine learning using homomorphic cryptography, provides two examples of linear mean classifiers and linear discriminant analysis, both of which can be implemented using low-order polynomials in homomorphic cryptography. Xie et al use an additive homomorphic encryption scheme to aggregate some of the intermediate statistics, however computing the intermediate information requires expensive computational costs. Crawford et al performed well in training small Logistic regression models, but their solutions only allowed computing very little data on features. Kim et al propose a secure Logistic regression model based on efficient approximate arithmetic homomorphic encryption. Chen et al applied multi-bit plaintext space and fixed point number coding in fully homomorphic encryption, and proposed a SEAL-based encryption Logistic regression model.
Although numerous scholars have attempted to combine machine learning with homomorphic encryption, there is little involvement in convolutional neural networks. And the machine learning model (convolutional neural network) can only process original data or encrypted data, and cannot process the two data simultaneously.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention provides a neural network construction method under homomorphic encryption, which comprises the following steps: acquiring a pre-trained convolutional neural network model and outputting network parameters of the convolutional neural network model;
converting the convolutional neural network model under homomorphic encryption according to the network parameters to obtain a convolutional neural network capable of identifying various types of data;
the convolutional neural network model is obtained by training a plurality of image data of a user layer and corresponding classification results.
Preferably, the converting the convolutional neural network model under homomorphic encryption according to the network parameters to obtain a convolutional neural network capable of identifying multiple types of data includes:
converting an input layer of the convolutional neural network model according to the image data in the convolutional neural network model;
converting the convolution layer of the convolutional neural network model according to the network parameters in the convolutional neural network model;
converting an activation function of a pooling connection output layer of the convolutional neural network model according to network parameters in the convolutional neural network model;
and under homomorphic encryption, obtaining the convolutional neural network capable of identifying various types of data according to the conversion result of the activation functions of the input layer, the convolutional layer and the pooling connection output layer.
Preferably, the input layer conversion calculation formula is as follows:
Figure BDA0002876606100000021
wherein x is the input of image data information, and sign (x) is the image data information after the input layer conversion.
Preferably, the convolutional layer conversion calculation formula is as follows:
Figure BDA0002876606100000022
wherein tau is a precision parameter, omega is a network parameter in the convolutional neural network model, processWeight (omega, tau) is a network parameter and a precision parameter after convolutional layer conversion,
Figure BDA0002876606100000023
is a pair of
Figure BDA0002876606100000024
And rounding up.
Preferably, the converting the activation function of the pooled connection output layer of the convolutional neural network model according to the network parameters in the convolutional neural network model includes:
and according to the network parameters in the convolutional neural network model, expanding the activation function of the pooled connection output layer of the convolutional neural network model by adopting a Taylor series to obtain the converted activation function of the pooled connection output layer.
Preferably, the training of the convolutional neural network model includes:
taking a plurality of image data of a user layer as an input function, and taking a classification result corresponding to the image data as an output function;
training the input function and the output function to obtain the convolutional neural network model;
the convolutional neural network model comprises an input layer, a convolutional layer and a pooling connection output layer.
Based on the same inventive concept, the invention also provides an image data processing method, which is characterized by comprising the following steps:
acquiring image data to be processed;
processing the image data to be processed by utilizing a convolution neural network capable of identifying various types of data to obtain a classification result of the image data to be processed;
the convolutional neural network capable of identifying the multiple types of data is constructed in advance by adopting a neural network construction method under homomorphic encryption.
Preferably, the processing the image data to be processed by using a convolutional neural network capable of identifying multiple types of data to obtain a classification result of the image data to be processed includes:
inputting image data to be processed into a convolutional neural network through an input layer in the convolutional neural network capable of identifying various types of data, carrying out convolutional processing on the image data to be processed through a convolutional layer in the convolutional neural network capable of identifying various types of data, and outputting a classification result of the image data to be processed through a pooling connection output layer in the convolutional neural network capable of identifying various types of data.
Preferably, after the processing the image data to be processed by using the convolutional neural network capable of identifying multiple types of data, the method further includes:
and verifying the convolutional neural network capable of identifying the multiple types of data to obtain the accuracy of the data based on the original data and homomorphic encryption.
Based on the same inventive concept, the present invention also provides an image data processing system, comprising: the device comprises an acquisition module and a processing module;
the acquisition module is used for acquiring image data to be processed;
the processing module is used for processing the image data to be processed by utilizing a convolution neural network capable of identifying various types of data to obtain a classification result of the image data to be processed;
the convolutional neural network capable of identifying the multiple types of data is constructed in advance by adopting a neural network construction method under homomorphic encryption.
Compared with the closest prior art, the invention has the following beneficial effects:
1. the invention discloses a neural network construction method under homomorphic encryption, which comprises the following steps: acquiring a pre-trained convolutional neural network model and outputting network parameters of the convolutional neural network model; converting the convolutional neural network model under homomorphic encryption according to the network parameters to obtain a convolutional neural network capable of identifying various types of data; the convolutional neural network model is obtained by training a plurality of image data of a user layer and corresponding classification results. The method constructs a convolution neural network which can process original data and homomorphic encrypted data and can identify various types of data, overcomes the defects of the existing machine learning, and improves the prediction accuracy.
2. The invention solves the defect of complex operation of homomorphic encrypted data and simultaneously improves the data security of the convolutional neural network.
3. The invention provides an image processing method and system, comprising the following steps: acquiring image data to be processed; processing the image data to be processed by utilizing a convolution neural network capable of identifying various types of data to obtain a classification result of the image data to be processed; the convolutional neural network capable of identifying the multiple types of data is constructed in advance by adopting a neural network construction method under homomorphic encryption. The invention provides a method for processing data by using a newly constructed convolutional neural network capable of identifying various types of data, and the efficiency and the accuracy of data processing are improved.
Drawings
FIG. 1 is a schematic flow chart of a neural network construction method under homomorphic encryption according to the present invention;
FIG. 2 is a schematic diagram of homomorphic neurons in a convolutional neural network construction method under homomorphic encryption according to the present invention;
FIG. 3 is a schematic flow chart of an image data processing method according to the present invention;
FIG. 4 is a block diagram of an image data processing system according to the present invention.
Detailed Description
The following describes embodiments of the present invention in further detail with reference to the accompanying drawings.
Example 1:
the schematic flow chart of the construction method of the convolutional neural network under homomorphic encryption provided by the invention is shown in fig. 1, and comprises the following steps:
step 1: acquiring a pre-trained convolutional neural network model and outputting network parameters of the convolutional neural network model;
step 2: converting the convolutional neural network model under homomorphic encryption according to the network parameters to obtain a convolutional neural network capable of identifying various types of data;
the convolutional neural network model is obtained by training a plurality of image data of a user layer and corresponding classification results.
Specifically, the method comprises the following steps:
step 1: acquiring a pre-trained convolutional neural network model and outputting network parameters of the convolutional neural network model;
and training a plurality of image data of the user layer and corresponding classification results thereof to obtain a trained convolutional neural network model, and obtaining network parameters in the trained convolutional neural network model.
Step 2: converting the convolutional neural network model under homomorphic encryption according to the network parameters to obtain a convolutional neural network capable of identifying various types of data;
the conversion of input layers, the conversion of convolution parameters and the conversion of other layer activation functions in the convolutional neural network.
The conversion of the input layer is to limit the message space of the input layer of the homomorphic LeNet-5 model in [ -1,1], and to convert the input data by a sign (x) function, wherein the specific conversion mode is as follows:
Figure BDA0002876606100000041
the input data is image information of a user layer, sign (x) is a sign function of the image data, the efficiency of overall evaluation can be improved only when the message space is as small as possible, and meanwhile, as the output value of the activation function used in the neural network is in [ -1,1], in order to enable the input and the network input to be in the same range, semantic information in the image input is reserved, and the input is converted.
The convolution parameter conversion, the parameter in the convolution layer should also be correspondingly converted, so that the convolution layer can process the cryptograph after homomorphic encryption. The following transformation is proposed as formula (2):
Figure BDA0002876606100000051
wherein, tau is a precision parameter, and omega is an original network parameter.
Figure BDA0002876606100000052
Is a pair of
Figure BDA0002876606100000053
And rounding up. Process weight (ω, τ) is a step weight function of network parameters and precision parameters, which are adjusted according to different models. After the above processing is carried out according to the function, the network parameter boundary can be reduced, and the ciphertext data can not be excessively dispersed after calculation, so that the problem that the network is difficult to fit is caused.
After the input layer and the convolutional layer are converted, the neurons in the convolutional neural network can be represented as shown in fig. 2:
y=sign(<ω,x>) (3)
wherein, x is the input of image data information as formula (3), and ω is the original network parameter.
The conversion of the activation function, the pooling connection output layer (a series of layers in the convolutional neural network, such as a pooling layer, a connection layer and an output layer) in the neural network, all the activation functions can effectively introduce nonlinear characteristics, so that the network avoids the problem of gradient disappearance. In LeNet-5 neural networks, the activation function used is a sigmoid function, as in equation (4):
Figure BDA0002876606100000054
the current homomorphic encryption scheme does not support exponential operation, so Taylor series expansion is used for approximately solving the exponential part, and then calculation is carried out by an equation (4), wherein the expansion mode is as follows:
Figure BDA0002876606100000055
wherein l is the input of the upper network in the pooling connection output layer.
Example 2:
the invention takes LeNet-5 convolution neural network as an example, and uses the method of the invention to carry out conversion:
1. firstly, converting input, and for each pixel value a in an input image, the following steps are provided:
Figure BDA0002876606100000056
2. the convolution layer is as follows:
Figure BDA0002876606100000057
Figure BDA0002876606100000061
D2=N
wherein, W1 × H1 is the feature size of the input image, N is the number of convolution kernels, F is the size of the convolution kernels, S is the step size, and P is the number of zero padding.
For the weight W in the convolutional layer, the following conversion is performed:
Figure BDA0002876606100000062
wherein, tau is a precision parameter, and omega is an original network parameter.
3. The classification function softmax in the convolutional network is as follows:
softmax(b)=normalize(exp(b))
it is converted using a taylor series as follows:
Figure BDA0002876606100000063
wherein b is the input of the upper layer network.
The LeNet-5 model was trained using raw data and validated using raw data to record baseline accuracy, with the results shown in Table 1:
TABLE 1 reference results
Table 1 Benchmark result
Figure BDA0002876606100000064
The LeNet-5 model is trained by using original data, the LeNet-5 model and the homomorphic-transformed LeNet-5 model are verified by using data which is approximately homomorphic encrypted, whether the transformation is effective is proved by the step, and the result is shown in Table 2:
TABLE 2 LeNet-5 conversion comparison
Table 2 LeNet-5 conversion comparison
Figure BDA0002876606100000065
Figure BDA0002876606100000071
As can be seen from the above table, after the model is converted, the accuracy of processing the data after the approximate homomorphic encryption is greatly improved.
Training a LeNet-5 model by using the approximately homomorphic encrypted data, and verifying the homomorphic transformed LeNet-5 by using the original data and the approximately homomorphic encrypted data respectively, which proves that homomorphic transformation of the model is necessary for the approximately homomorphic encrypted data, and the result is shown in Table 3.
Table 3 encrypted data comparison
Table 3 Data conversion comparison
Figure BDA0002876606100000072
From the analysis of the above table, aiming at the prediction of the encrypted data, the LeNet-5 model after conversion is improved by 23 percentage points compared with the model without conversion, and the effectiveness and the practicability of the model conversion thought provided by the scheme are verified through the step of experiment.
Example 3:
based on the same invention concept, the invention also provides an image data processing method, and repeated parts are not repeated as the processing method is based on a neural network construction method under homomorphic encryption.
The method, as shown in fig. 3, includes:
acquiring image data to be processed;
processing the image data to be processed by utilizing a convolution neural network capable of identifying various types of data to obtain a classification result of the image data to be processed;
the convolutional neural network capable of identifying the multiple types of data is constructed in advance by adopting a neural network construction method under homomorphic encryption.
The method specifically comprises the following steps:
preferably, the processing the image data to be processed by using a convolutional neural network capable of identifying multiple types of data to obtain a classification result of the image data to be processed includes:
inputting image data to be processed into a convolutional neural network through an input layer in the convolutional neural network capable of identifying various types of data, carrying out convolutional processing on the image data to be processed through a convolutional layer in the convolutional neural network capable of identifying various types of data, and outputting a classification result of the image data to be processed through a pooling connection output layer in the convolutional neural network capable of identifying various types of data.
Preferably, after the processing the image data to be processed by using the convolutional neural network capable of identifying multiple types of data, the method further includes:
and verifying the convolutional neural network capable of identifying the multiple types of data to obtain the accuracy of the data based on the original data and homomorphic encryption.
Example 4:
based on the same inventive concept, the invention also provides an image data processing system, and the principles of solving the technical problems of the devices are similar to those of an image data processing method, so repeated parts are not repeated.
The system, as shown in fig. 4, includes:
the device comprises an acquisition module and a processing module;
the acquisition module is used for acquiring image data to be processed;
the processing module is used for processing the image data to be processed by utilizing a convolution neural network capable of identifying various types of data to obtain a classification result of the image data to be processed;
the convolutional neural network capable of identifying the multiple types of data is constructed in advance by adopting a neural network construction method under homomorphic encryption.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that the above-mentioned embodiments are only for illustrating the technical solutions of the present invention and not for limiting the protection scope thereof, and although the present invention has been described in detail with reference to the above-mentioned embodiments, those skilled in the art should understand that after reading the present invention, they can make various changes, modifications or equivalents to the specific embodiments of the present invention, but these changes, modifications or equivalents are within the protection scope of the appended claims.

Claims (10)

1.一种同态加密下神经网络构建方法,其特征在于,包括:1. a neural network construction method under homomorphic encryption, is characterized in that, comprises: 获取预先训练的卷积神经网络模型输出所述卷积神经网络模型的网络参数;Obtain the network parameters of the pre-trained convolutional neural network model and output the convolutional neural network model; 根据所述网络参数,在同态加密下对所述卷积神经网络模型进行转换,得到可识别多类型数据的卷积神经网络;According to the network parameters, the convolutional neural network model is converted under homomorphic encryption to obtain a convolutional neural network that can identify multiple types of data; 其中,所述卷积神经网络模型是由用户层多个图像数据及其对应的分类结果训练得到的。Wherein, the convolutional neural network model is obtained by training multiple user layer image data and their corresponding classification results. 2.根据权利要求1所述的方法,其特征在于,所述根据所述网络参数,在同态加密下对所述卷积神经网络模型进行转换,得到可识别多类型数据的卷积神经网络,包括:2. The method according to claim 1, wherein, according to the network parameters, the convolutional neural network model is converted under homomorphic encryption to obtain a convolutional neural network that can identify multiple types of data ,include: 根据所述卷积神经网络模型中的图像数据,对所述卷积神经网络模型的输入层进行转换;Convert the input layer of the convolutional neural network model according to the image data in the convolutional neural network model; 根据所述卷积神经网络模型中的网络参数,对所述卷积神经网络模型的卷积层进行转换;Convert the convolution layer of the convolutional neural network model according to the network parameters in the convolutional neural network model; 根据所述卷积神经网络模型中的网络参数,对所述卷积神经网络模型的池化连接输出层的激活函数进行转换;Convert the activation function of the pooled connection output layer of the convolutional neural network model according to the network parameters in the convolutional neural network model; 在同态加密下根据所述输入层、所述卷积层和所述池化连接输出层的激活函数的转换的结果,得到可识别多类型数据的卷积神经网络。Under homomorphic encryption, a convolutional neural network capable of recognizing multiple types of data is obtained according to the conversion result of the activation functions of the input layer, the convolutional layer and the pooled connection output layer. 3.根据权利要求2所述的方法,其特征在于,3. The method of claim 2, wherein 所述输入层转换计算式如下:The input layer conversion calculation formula is as follows:
Figure FDA0002876606090000011
Figure FDA0002876606090000011
其中,x为图像数据信息的输入,sign(x)为输入层转换后的图像数据信息。Among them, x is the input of image data information, and sign(x) is the image data information converted by the input layer.
4.根据权利要求2所述的方法,其特征在于,4. The method according to claim 2, wherein 所述卷积层转换计算式如下:The conversion calculation formula of the convolutional layer is as follows:
Figure FDA0002876606090000012
Figure FDA0002876606090000012
其中,τ为精度参数,ω为卷积神经网络模型中的网络参数,processWeight(ω,τ)为卷积层转换后的网络参数和精度参数,
Figure FDA0002876606090000013
为对
Figure FDA0002876606090000014
进行向上取整。
Among them, τ is the precision parameter, ω is the network parameter in the convolutional neural network model, processWeight(ω, τ) is the network parameter and precision parameter converted by the convolution layer,
Figure FDA0002876606090000013
for right
Figure FDA0002876606090000014
Round up.
5.根据权利要求2所述的方法,其特征在于,所述根据所述卷积神经网络模型中的网络参数,对所述卷积神经网络模型的池化连接输出层的激活函数进行转换,包括:5. The method according to claim 2, wherein, according to the network parameters in the convolutional neural network model, the activation function of the pooled connection output layer of the convolutional neural network model is converted, include: 根据所述卷积神经网络模型中的网络参数,对所述卷积神经网络模型的池化连接输出层的激活函数采用泰勒级数进行展开,得到池化连接输出层转换后的激活函数。According to the network parameters in the convolutional neural network model, the activation function of the pooled connection output layer of the convolutional neural network model is expanded using Taylor series to obtain the converted activation function of the pooled connection output layer. 6.根据权利要求1所述的方法,其特征在于,所述卷积神经网络模型的训练,包括:6. The method according to claim 1, wherein the training of the convolutional neural network model comprises: 将用户层的多个图像数据作为输入函数,将图像数据对应的分类结果作为输出函数;Take multiple image data of the user layer as the input function, and take the classification result corresponding to the image data as the output function; 对所述输入函数和所述输出函数进行训练,得到所述卷积神经网络模型;The input function and the output function are trained to obtain the convolutional neural network model; 所述卷积神经网络模型包括输入层、卷积层和池化连接输出层。The convolutional neural network model includes an input layer, a convolutional layer and a pooled connection output layer. 7.一种图像数据处理方法,其特征在于,包括:7. A method for processing image data, comprising: 获取待处理图像数据;Get the image data to be processed; 利用可识别多类型数据的卷积神经网络对所述待处理图像数据进行处理,得到待处理图像数据的分类结果;Using a convolutional neural network that can identify multiple types of data to process the image data to be processed to obtain a classification result of the image data to be processed; 其中,所述可识别多类型数据的卷积神经网络采用如权利要求1-6任一所述的方法预先构建而成。Wherein, the convolutional neural network capable of recognizing multiple types of data is pre-built by using the method according to any one of claims 1-6. 8.根据权利要求7所述的方法,其特征在于,所述利用可识别多类型数据的卷积神经网络,对所述待处理图像数据进行处理,得到待处理图像数据的分类结果,包括:8. The method according to claim 7, characterized in that, using a convolutional neural network that can identify multiple types of data to process the to-be-processed image data to obtain a classification result of the to-be-processed image data, comprising: 将待处理图像数据通过可识别多类型数据的卷积神经网络中的输入层输入至卷积神经网络中,通过可识别多类型数据的卷积神经网络中的卷积层对所述待处理图像数据进行卷积处理后,通过可识别多类型数据的卷积神经网络中池化连接输出层输出待处理图像数据的分类结果。The image data to be processed is input into the convolutional neural network through the input layer in the convolutional neural network that can identify multiple types of data, and the image to be processed is processed through the convolutional layer in the convolutional neural network that can identify multiple types of data. After the data is processed by convolution, the classification result of the image data to be processed is output through the pooled connection output layer in the convolutional neural network that can identify multiple types of data. 9.根据权利要求7所述的方法,其特征在于,所述利用可识别多类型数据的卷积神经网络,对所述待处理图像数据进行处理之后,还包括:9. The method according to claim 7, wherein, after processing the image data to be processed by using a convolutional neural network capable of recognizing multiple types of data, the method further comprises: 验证所述可识别多类型数据的卷积神经网络得到基于原始数据和同态加密的数据的准确率。Verify that the convolutional neural network capable of identifying multiple types of data obtains the accuracy rate based on the original data and the homomorphically encrypted data. 10.一种图像数据处理系统,其特征在于,包括:获取模块和处理模块;10. An image data processing system, comprising: an acquisition module and a processing module; 所述获取模块,用于获取待处理图像数据;The acquisition module is used to acquire the image data to be processed; 所述处理模块,用于利用可识别多类型数据的卷积神经网络对所述待处理图像数据进行处理,得到待处理图像数据的分类结果;The processing module is used to process the image data to be processed by using a convolutional neural network that can identify multiple types of data to obtain a classification result of the image data to be processed; 其中,所述可识别多类型数据的卷积神经网络采用如权利要求1-6任一所述的方法预先构建而成。Wherein, the convolutional neural network capable of recognizing multiple types of data is pre-built by using the method according to any one of claims 1-6.
CN202011622912.4A 2020-12-31 2020-12-31 Neural network construction method under homomorphic encryption, image processing method and system Pending CN112734004A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011622912.4A CN112734004A (en) 2020-12-31 2020-12-31 Neural network construction method under homomorphic encryption, image processing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011622912.4A CN112734004A (en) 2020-12-31 2020-12-31 Neural network construction method under homomorphic encryption, image processing method and system

Publications (1)

Publication Number Publication Date
CN112734004A true CN112734004A (en) 2021-04-30

Family

ID=75608838

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011622912.4A Pending CN112734004A (en) 2020-12-31 2020-12-31 Neural network construction method under homomorphic encryption, image processing method and system

Country Status (1)

Country Link
CN (1) CN112734004A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114944919A (en) * 2022-05-19 2022-08-26 中国银行股份有限公司 Block chain-based message encryption method and related equipment
CN115512235A (en) * 2022-09-30 2022-12-23 南京信息工程大学 Satellite cloud picture identification method, device and medium based on generalized nonlinear convolutional neural network
CN119646458A (en) * 2025-02-18 2025-03-18 北京建恒信安科技有限公司 Method, device, electronic device and medium for identifying homomorphic encrypted data

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160350648A1 (en) * 2014-11-07 2016-12-01 Microsoft Technology Licensing, Llc. Neural networks for encrypted data
EP3301617A1 (en) * 2016-09-30 2018-04-04 Safran Identity & Security Methods for secure learning of parameters of a convolutional neural network, and secure classification of input data
CN110490128A (en) * 2019-08-16 2019-11-22 南京邮电大学 A kind of hand-written recognition method based on encryption neural network
CN111984960A (en) * 2020-07-13 2020-11-24 深圳市捷讯云联科技有限公司 Privacy protection equipment identification model design and use method based on homomorphic encryption

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160350648A1 (en) * 2014-11-07 2016-12-01 Microsoft Technology Licensing, Llc. Neural networks for encrypted data
EP3301617A1 (en) * 2016-09-30 2018-04-04 Safran Identity & Security Methods for secure learning of parameters of a convolutional neural network, and secure classification of input data
CN110490128A (en) * 2019-08-16 2019-11-22 南京邮电大学 A kind of hand-written recognition method based on encryption neural network
CN111984960A (en) * 2020-07-13 2020-11-24 深圳市捷讯云联科技有限公司 Privacy protection equipment identification model design and use method based on homomorphic encryption

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
FLORIAN BOURSE,ET AL.: "Fast Homomorphic Evaluation of Deep Discretized Neural Networks", 《ADVANCES IN CRYPTOLOGY – CRYPTO 2018》 *
谢四江等: "基于同态加密的卷积神经网络前向传播方法", 《计算机应用与软件》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114944919A (en) * 2022-05-19 2022-08-26 中国银行股份有限公司 Block chain-based message encryption method and related equipment
CN115512235A (en) * 2022-09-30 2022-12-23 南京信息工程大学 Satellite cloud picture identification method, device and medium based on generalized nonlinear convolutional neural network
CN115512235B (en) * 2022-09-30 2025-09-16 南京信息工程大学 Satellite cloud image identification method, device and medium based on generalized nonlinear convolutional neural network
CN119646458A (en) * 2025-02-18 2025-03-18 北京建恒信安科技有限公司 Method, device, electronic device and medium for identifying homomorphic encrypted data

Similar Documents

Publication Publication Date Title
CN109002861B (en) Federal modeling method, device and storage medium
JP6382354B2 (en) Neural network and neural network training method
CN112734004A (en) Neural network construction method under homomorphic encryption, image processing method and system
KR102587254B1 (en) Method and apparatus for key generation based on face recognition using cnn and rnn
CN105224984B (en) A kind of data category recognition methods and device based on deep neural network
CN109299728A (en) Federated learning method, system and readable storage medium
CN105608388B (en) Differential privacy data publishing method and system based on dependency removal
CN111507386B (en) Method and system for detecting encryption communication of storage file and network data stream
CN107086910A (en) A weight encryption and decryption method and system for neural network processing
CN112862001A (en) Decentralized data modeling method under privacy protection
CN112395643A (en) Data privacy protection method and system of neural network
Pan et al. K-same-siamese-gan: K-same algorithm with generative adversarial network for facial image de-identification with hyperparameter tuning and mixed precision training
CN113542228A (en) Federated learning-based data transmission method, device and readable storage medium
WO2020011200A1 (en) Cross-domain data fusion method and system, and storage medium
CN111144576A (en) Model training method, device and electronic device
CN113240129A (en) Multi-type task image analysis-oriented federal learning system
CN110874571A (en) Training method and device of face recognition model
CN108921282B (en) A method and device for constructing a deep neural network model
CN109002883A (en) Convolutional neural networks model computing device and calculation method
Song et al. Try before you buy: Privacy-preserving data evaluation on cloud-based machine learning data marketplace
CN111738276A (en) Image processing method, device and device based on multi-kernel convolutional neural network
CN117081722A (en) Method and device for constructing side channel attack model, and side channel attack method and device
CN119918693B (en) Accurate and safe longitudinal federal learning method, system and product based on feature conversion
CN110991462B (en) Privacy protection CNN-based secret image identification method and system
CN114612989A (en) Method and device for generating face recognition data set, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210430