[go: up one dir, main page]

CN116189028B - Image recognition method, device, electronic equipment and storage medium - Google Patents

Image recognition method, device, electronic equipment and storage medium Download PDF

Info

Publication number
CN116189028B
CN116189028B CN202211533716.9A CN202211533716A CN116189028B CN 116189028 B CN116189028 B CN 116189028B CN 202211533716 A CN202211533716 A CN 202211533716A CN 116189028 B CN116189028 B CN 116189028B
Authority
CN
China
Prior art keywords
target
feature
target object
processing strategy
features
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211533716.9A
Other languages
Chinese (zh)
Other versions
CN116189028A (en
Inventor
施依欣
王冠中
牛志博
倪烽
张亚娴
陈建业
吕雪莹
赵乔
江左
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202211533716.9A priority Critical patent/CN116189028B/en
Publication of CN116189028A publication Critical patent/CN116189028A/en
Application granted granted Critical
Publication of CN116189028B publication Critical patent/CN116189028B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Image Analysis (AREA)

Abstract

The disclosure discloses an image recognition method, an image recognition device, electronic equipment and a storage medium. Relates to the technical field of artificial intelligence, in particular to the technical field of deep learning and computer vision, and comprises the following specific implementation schemes: obtaining a time sequence image sequence to be identified according to the video image; responding to the received selection operation aiming at the target identification task, and obtaining a target processing strategy; and processing the time sequence image sequence to be identified based on the target processing strategy to obtain an identification result.

Description

图像识别方法、装置、电子设备以及存储介质Image recognition method, device, electronic device and storage medium

技术领域Technical Field

本公开涉及人工智能技术领域,尤其涉及深度学习、计算机视觉技术领域,应用于图像识别技术领域。具体涉及一种图像识别方法、装置、电子设备以及存储介质。The present disclosure relates to the field of artificial intelligence technology, in particular to the field of deep learning and computer vision technology, and is applied to the field of image recognition technology, and specifically to an image recognition method, device, electronic device, and storage medium.

背景技术Background technique

计算机视觉技术是指用图像采集设备和计算机代替人眼对目标进行识别、跟踪和测量等机器视觉,并进一步做图像处理。在计算机视觉技术中处理的图像可以包括静态图像和动态图像。Computer vision technology refers to the use of image acquisition equipment and computers to replace human eyes to identify, track and measure targets, and further perform image processing. The images processed in computer vision technology can include static images and dynamic images.

随着人工智能技术的发展,人工智能技术在计算机视觉方面的应用越来越广泛,例如:基于人工智能技术进行图像识别等。With the development of artificial intelligence technology, its application in computer vision is becoming more and more extensive, for example: image recognition based on artificial intelligence technology.

发明内容Summary of the invention

本公开提供了一种图像识别的方法、装置、电子设备以及存储介质。The present disclosure provides an image recognition method, an apparatus, an electronic device, and a storage medium.

根据本公开的一方面,提供了一种图像识别方法,包括:According to one aspect of the present disclosure, there is provided an image recognition method, comprising:

根据视频图像,得到待识别的时序图像序列;According to the video image, a time-series image sequence to be identified is obtained;

响应于接收到针对目标识别任务的选择操作,得到目标处理策略;以及In response to receiving a selection operation for a target recognition task, obtaining a target processing strategy; and

基于目标处理策略,对待识别的时序图像序列进行处理,得到识别结果。Based on the target processing strategy, the time-series image sequence to be recognized is processed to obtain the recognition result.

根据本公开的另一方面,提供了一种图像识别装置,包括:第一获得模块、第二获得模块、第三获得模块。According to another aspect of the present disclosure, an image recognition device is provided, including: a first obtaining module, a second obtaining module, and a third obtaining module.

第一获得模块,用于根据视频图像,得到待识别的时序图像序列;A first acquisition module is used to obtain a time-series image sequence to be identified based on the video image;

第二获得模块,用于响应于接收到针对目标识别任务的选择操作,得到目标处理策略;以及A second obtaining module is configured to obtain a target processing strategy in response to receiving a selection operation for a target recognition task; and

第三获得模块,用于基于目标处理策略,对待识别的时序图像序列进行处理,得到识别结果。The third acquisition module is used to process the time-series image sequence to be recognized based on the target processing strategy to obtain the recognition result.

根据本公开的另一方面,提供了一种电子设备,包括:至少一个处理器;以及与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行如上所述的方法。According to another aspect of the present disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method as described above.

根据本公开的另一方面,提供了一种存储有计算机指令的非瞬时计算机可读存储介质,其中,所述计算机指令用于使所述计算机执行如上所述的方法。According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method as described above.

根据本公开的另一方面,提供了一种计算机程序产品,包括计算机程序,所述计算机程序在被处理器执行时实现如上所述的方法。According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein the computer program implements the method described above when executed by a processor.

应当理解,本部分所描述的内容并非旨在标识本公开的实施例的关键或重要特征,也不用于限制本公开的范围。本公开的其它特征将通过以下的说明书而变得容易理解。It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

附图用于更好地理解本方案,不构成对本公开的限定。其中:The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

图1示意性示出了根据本公开实施例的可以应用图像识别方法及装置的示例性系统架构;FIG1 schematically shows an exemplary system architecture to which an image recognition method and apparatus can be applied according to an embodiment of the present disclosure;

图2示意性示出了根据本公开实施例的图像识别方法的流程图;FIG2 schematically shows a flow chart of an image recognition method according to an embodiment of the present disclosure;

图3示意性示出了根据本公开实施例的响应于接收到针对目标识别任务的选择操作,得到目标处理策略的示意图;FIG3 schematically shows a schematic diagram of obtaining a target processing strategy in response to receiving a selection operation for a target recognition task according to an embodiment of the present disclosure;

图4示意性示出了根据本公开实施例的对空间关系特征进行处理得到识别结果的示意图,;FIG4 schematically shows a schematic diagram of processing spatial relationship features to obtain recognition results according to an embodiment of the present disclosure;

图5示意性示出了根据本公开实施例的对第一目标对象的动作特征进行处理得到识别结果的示意图;FIG5 schematically shows a schematic diagram of processing the action features of the first target object to obtain a recognition result according to an embodiment of the present disclosure;

图6示意性示出了根据本公开实施例的对目标区域的位置特征和第一目标对象的位置特征进行处理得到识别结果的示意图;FIG6 schematically shows a schematic diagram of obtaining a recognition result by processing the position features of the target area and the position features of the first target object according to an embodiment of the present disclosure;

图7示意性示出了根据本公开实施例的对第一目标对象的位置特征和第二目标对象的位置特征进行处理得到识别结果的示意图;FIG7 schematically shows a schematic diagram of obtaining a recognition result by processing the position feature of the first target object and the position feature of the second target object according to an embodiment of the present disclosure;

图8示意性示出了根据本公开实施例的对第一目标对象的特征和第三目标对象的特征进行处理得到识别结果的示意图;FIG8 schematically shows a schematic diagram of processing the features of the first target object and the features of the third target object to obtain a recognition result according to an embodiment of the present disclosure;

图9示意性示出了根据本公开实施例的与不同处理策略相对应的整体示例性系统架构图;FIG9 schematically shows an overall exemplary system architecture diagram corresponding to different processing strategies according to an embodiment of the present disclosure;

图10示意性示出了根据本公开实施例的示例性系统架构部署图;FIG10 schematically shows an exemplary system architecture deployment diagram according to an embodiment of the present disclosure;

图11示意性示出了根据本公开实施例的图像识别装置的框图;以及FIG. 11 schematically shows a block diagram of an image recognition device according to an embodiment of the present disclosure; and

图12示意性示出了根据本公开实施例的适于实现图像识别方法的电子设备的框图。FIG. 12 schematically shows a block diagram of an electronic device suitable for implementing an image recognition method according to an embodiment of the present disclosure.

具体实施方式Detailed ways

以下结合附图对本公开的示范性实施例做出说明,其中包括本公开实施例的各种细节以助于理解,应当将它们认为仅仅是示范性的。因此,本领域普通技术人员应当认识到,可以对这里描述的实施例做出各种改变和修改,而不会背离本公开的范围和精神。同样,为了清楚和简明,以下的描述中省略了对公知功能和结构的描述。The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

随着人工智能技术的发展,可以基于特定任务的网络结构算法,基于模型训练得到满足特定任务的模型,用于目标识别。例如:目标检测模型。但是,这种特定任务模型受限于特定任务场景,较难满足复杂应用场景需求。例如:在智能安防场景中,场景需求可以包括目标对象的识别需求、目标对象的异常行为识别需求、目标对象的行动轨迹识别需求等。With the development of artificial intelligence technology, models that meet specific tasks can be obtained based on network structure algorithms for specific tasks and model training for target recognition. For example: target detection model. However, this specific task model is limited to specific task scenarios and is difficult to meet the needs of complex application scenarios. For example: in smart security scenarios, scenario requirements may include the recognition requirements of target objects, the recognition requirements of abnormal behaviors of target objects, the recognition requirements of the movement trajectories of target objects, etc.

有鉴于此,本公开实施例提供了一种图像识别方法,包括:根据视频图像,得到待识别的时序图像序列;响应于接收到针对目标识别任务的选择操作,得到目标处理策略;以及基于目标处理策略,对待识别的时序图像序列进行处理,得到识别结果。In view of this, an embodiment of the present disclosure provides an image recognition method, comprising: obtaining a time-series image sequence to be recognized based on a video image; obtaining a target processing strategy in response to receiving a selection operation for a target recognition task; and processing the time-series image sequence to be recognized based on the target processing strategy to obtain a recognition result.

图1示意性示出了根据本公开实施例的可以应用图像识别方法及装置的示例性系统架构。FIG. 1 schematically shows an exemplary system architecture to which an image recognition method and apparatus can be applied according to an embodiment of the present disclosure.

需要注意的是,图1所示仅为可以应用本公开实施例的系统架构的示例,以帮助本领域技术人员理解本公开的技术内容,但并不意味着本公开实施例不可以用于其他设备、系统、环境或场景。例如,在另一实施例中,可以应用图像识别方法及装置的示例性系统架构可以包括终端设备,但终端设备可以无需与服务器进行交互,即可实现本公开实施例提供的图像识别方法及装置。It should be noted that FIG. 1 is only an example of a system architecture to which the embodiments of the present disclosure can be applied, in order to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios. For example, in another embodiment, the exemplary system architecture to which the image recognition method and apparatus can be applied may include a terminal device, but the terminal device may implement the image recognition method and apparatus provided by the embodiments of the present disclosure without interacting with the server.

如图1所示,根据该实施例的系统架构100可以包括第一终端设备101、第二终端设备102、第三终端设备103,网络104和服务器105。网络104用以在第一终端设备101、第二终端设备102、第三终端设备103和服务器105之间提供通信链路的介质。网络104可以包括各种连接类型,例如有线和/或无线通信链路等等。As shown in Fig. 1, the system architecture 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the first terminal device 101, the second terminal device 102, the third terminal device 103 and the server 105. The network 104 may include various connection types, such as wired and/or wireless communication links, etc.

用户可以使用第一终端设备101、第二终端设备102、第三终端设备103通过网络104与服务器105交互,以接收或发送消息等。终端设备101、102、103上可以安装有各种通讯客户端应用,例如知识阅读类应用、网页浏览器应用、搜索类应用、即时通信工具、邮箱客户端和/或社交平台软件等(仅为示例)。The user can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 through the network 104 to receive or send messages, etc. Various communication client applications can be installed on the terminal devices 101, 102, and 103, such as knowledge reading applications, web browser applications, search applications, instant messaging tools, email clients, and/or social platform software, etc. (only as examples).

第一终端设备101、第二终端设备102、第三终端设备103可以是具有显示屏并且支持网页浏览的各种电子设备,包括但不限于智能手机、平板电脑、膝上型便携计算机和台式计算机等等。The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be various electronic devices having display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

服务器105可以是提供各种服务的服务器,例如对用户利用第一终端设备101、第二终端设备102、第三终端设备103所浏览的内容提供支持的后台管理服务器(仅为示例)。后台管理服务器可以对接收到的用户请求等数据进行分析等处理,并将处理结果(例如根据用户请求获取或生成的网页、信息、或数据等)反馈给终端设备。The server 105 may be a server that provides various services, such as a background management server (only as an example) that provides support for the content browsed by the user using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.

需要说明的是,本公开实施例所提供的图像识别方法一般可以由服务器105执行。相应地,本公开实施例所提供的图像识别装置一般可以设置于服务器105中。本公开实施例所提供的图像识别方法也可以由不同于服务器105且能够与第一终端设备101、第二终端设备102、第三终端设备103和/或服务器105通信的服务器或服务器集群执行。相应地,本公开实施例所提供的图像识别装置也可以设置于不同于服务器105且能够与第一终端设备101、第二终端设备102、第三终端设备103和/或服务器105通信的服务器或服务器集群中。It should be noted that the image recognition method provided in the embodiment of the present disclosure can generally be executed by the server 105. Accordingly, the image recognition device provided in the embodiment of the present disclosure can generally be set in the server 105. The image recognition method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and/or the server 105. Accordingly, the image recognition device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and/or the server 105.

例如,在用户在线选择目标识别任务时,第一终端设备101、第二终端设备102、第三终端设备103可以获取目标识别任务的标识信息,然后将目标识别任务的标识信息和视频图像发送给服务器105,由服务器105根据视频图像,得到待识别的时序图像序列;对目标识别任务的标识信息进行分析,确定目标处理策略;并基于目标处理策略,对待识别的时序图像序列进行处理,得到识别结果。或者由能够与第一终端设备101、第二终端设备102、第三终端设备103和/或服务器105通信的服务器或服务器集群确定目标处理策略,并基于目标处理策略,对待识别的时序图像序列进行处理,得到识别结果。For example, when a user selects a target recognition task online, the first terminal device 101, the second terminal device 102, and the third terminal device 103 can obtain the identification information of the target recognition task, and then send the identification information of the target recognition task and the video image to the server 105, and the server 105 obtains the time-series image sequence to be recognized based on the video image; analyzes the identification information of the target recognition task to determine the target processing strategy; and processes the time-series image sequence to be recognized based on the target processing strategy to obtain the recognition result. Alternatively, the server or server cluster that can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and/or the server 105 determines the target processing strategy, and processes the time-series image sequence to be recognized based on the target processing strategy to obtain the recognition result.

本公开实施例所提供的图像识别方法一般也可以由第一终端设备101、第二终端设备102、第三终端设备103执行。相应地,本公开实施例所提供的图像识别装置一般可以设置于第一终端设备101、第二终端设备102、第三终端设备103中。The image recognition method provided in the embodiment of the present disclosure can also be generally performed by the first terminal device 101, the second terminal device 102, and the third terminal device 103. Accordingly, the image recognition device provided in the embodiment of the present disclosure can generally be set in the first terminal device 101, the second terminal device 102, and the third terminal device 103.

应该理解,图1中的终端设备、网络和服务器的数目仅仅是示意性的。根据实现需要,可以具有任意数目的终端设备、网络和服务器。It should be understood that the number of terminal devices, networks and servers in Figure 1 is only illustrative. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

在本公开的技术方案中,所涉及的用户个人信息的收集、存储、使用、加工、传输、提供、公开和应用等处理,均符合相关法律法规的规定,采取了必要保密措施,且不违背公序良俗。In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision, disclosure and application of user personal information involved comply with the provisions of relevant laws and regulations, take necessary confidentiality measures, and do not violate public order and good morals.

在本公开的技术方案中,在获取或采集用户个人信息之前,均获取了用户的授权或同意。In the technical solution of the present disclosure, the user's authorization or consent is obtained before obtaining or collecting the user's personal information.

图2示意性示出了根据本公开实施例的图像识别方法的流程图。FIG. 2 schematically shows a flow chart of an image recognition method according to an embodiment of the present disclosure.

如图2所示,该方法包括操作S210~S230。As shown in FIG. 2 , the method includes operations S210 to S230 .

在操作S210,根据视频图像,得到待识别的时序图像序列。In operation S210, a time-sequential image sequence to be identified is obtained according to a video image.

在操作S220,响应于接收到针对目标识别任务的选择操作,得到In operation S220, in response to receiving a selection operation for a target recognition task,

目标处理策略。Target processing strategy.

在操作S230,基于目标处理策略,对待识别的时序图像序列进行处理,得到识别结果。In operation S230 , the time-series image sequence to be recognized is processed based on the target processing strategy to obtain a recognition result.

根据本公开的实施例,视频图像可以是离线采集的视频图像,也可以是实时采集的视频图像。According to an embodiment of the present disclosure, the video image may be a video image acquired offline or a video image acquired in real time.

根据本公开的实施例,根据视频图像,可以通过采集每一帧的图像帧,得到待识别的时序图像序列。也可以根据实际业务需求,设定采集周期,例如:可以每隔3~10帧进行一次采集,得到待识别的时序图像序列。According to the embodiments of the present disclosure, based on the video image, the time-series image sequence to be identified can be obtained by collecting each frame of the image frame. The collection cycle can also be set according to actual business needs, for example, the time-series image sequence to be identified can be obtained by collecting every 3 to 10 frames.

根据本公开的实施例,目标识别任务可以包括以下任意一种:异常行为识别任务、目标属性特征识别任务、目标对象的行为轨迹识别任务等。According to an embodiment of the present disclosure, the target recognition task may include any one of the following: an abnormal behavior recognition task, a target attribute feature recognition task, a target object behavior trajectory recognition task, etc.

根据本公开的实施例,用户可以利用客户端的可视化界面,与服务端进行交互,得到目标处理策略。例如:用户在客户端的可视化界面选择异常行为Db1的识别任务,服务端可以根据异常行为Db1的信息,得到与异常行为Db1相对应的目标处理策略。According to the embodiments of the present disclosure, the user can use the visual interface of the client to interact with the server to obtain the target processing strategy. For example, the user selects the recognition task of abnormal behavior Db 1 in the visual interface of the client, and the server can obtain the target processing strategy corresponding to the abnormal behavior Db 1 based on the information of the abnormal behavior Db 1 .

根据本公开的实施例,基于目标处理策略可以确定目标处理路径,并基于目标处理路径对待识别的图像特征序列进行处理,得到异常行为的识别结果。According to the embodiments of the present disclosure, a target processing path can be determined based on a target processing strategy, and an image feature sequence to be identified is processed based on the target processing path to obtain an abnormal behavior identification result.

例如:与异常行为Db1的识别任务相对应的目标处理策略可以包括图像特征提取路径和特征处理路径。可以为先提取待识别的时序图像序列的图像特征,再对图像特征进行处理,得到识别结果。For example, the target processing strategy corresponding to the recognition task of abnormal behavior Db 1 may include an image feature extraction path and a feature processing path. The image features of the time-series image sequence to be recognized may be firstly extracted, and then the image features may be processed to obtain the recognition result.

例如:与目标对象的行为轨迹的识别任务相对应的目标处理策略可以包括对象特征的提取路径、对象特征的识别路径、目标对象的位置特征的提取路径和目标对象的位置特征的识别路径等。可以先提取对象特征,识别目标对象;再识别目标对象的位置特征,得到目标对象的行动轨迹的识别结果。For example, the target processing strategy corresponding to the recognition task of the target object's behavior trajectory may include an object feature extraction path, an object feature recognition path, a target object position feature extraction path, and a target object position feature recognition path. The object feature may be extracted first to recognize the target object; then the target object's position feature may be recognized to obtain the recognition result of the target object's action trajectory.

根据本公开的实施例,由于目标处理策略是响应于接收到的针对目标识别任务的选择操作得到的,基于系统之间的数据交互实现了目标识别任务与目标处理策略的自动匹配,以适应于复杂的应用场景需求。解决了相关技术中基于特定任务的网络结构算法训练得到的模型需要二次开发才能应用于实际应用场景中的问题。According to the embodiments of the present disclosure, since the target processing strategy is obtained in response to the received selection operation for the target recognition task, the automatic matching of the target recognition task and the target processing strategy is realized based on the data interaction between the systems to adapt to the requirements of complex application scenarios. This solves the problem in the related art that the model obtained by training the network structure algorithm based on a specific task needs to be redeveloped before it can be applied to the actual application scenario.

根据本公开的实施例,操作S210~S230可以由电子设备执行。电子设备可以是服务器或终端设备。服务器可以是图1中的服务器105。终端设备可以是图1中的第一终端设备101、第二终端设备102或第三终端设备103。According to an embodiment of the present disclosure, operations S210 to S230 may be performed by an electronic device. The electronic device may be a server or a terminal device. The server may be the server 105 in FIG. 1 . The terminal device may be the first terminal device 101, the second terminal device 102, or the third terminal device 103 in FIG. 1 .

根据本公开的实施例,操作S220可以包括以下操作:According to an embodiment of the present disclosure, operation S220 may include the following operations:

根据选择操作,确定目标识别任务的标识信息。根据目标识别任务的标识信息,从识别任务与处理策略的映射关系中得到目标处理策略信息。According to the selection operation, identification information of the target recognition task is determined. According to the identification information of the target recognition task, target processing strategy information is obtained from the mapping relationship between the recognition task and the processing strategy.

下面参考图3~图10,结合具体实施例对图2所示的方法做进一步说明。The method shown in FIG. 2 will be further described below with reference to FIG. 3 to FIG. 10 in combination with specific embodiments.

图3示意性示出了根据本公开实施例的响应于接收到针对目标识别任务的选择操作,得到目标处理策略的示意图。FIG3 schematically shows a schematic diagram of obtaining a target processing strategy in response to receiving a selection operation for a target recognition task according to an embodiment of the present disclosure.

如图3所示,在300中,识别任务321中可以包括识别任务T1(321_1)、识别任务T2(321_2)、...、识别任务Tm(321_m)。在识别任务与处理策略的映射关系323中可以包括识别任务T1与处理策略TA1的映射关系323_1、识别任务T2与处理策略TA2的映射关系323_2、...、识别任务Tn与处理策略TAn的映射关系323_n。As shown in FIG3 , in 300, the recognition task 321 may include a recognition task T1 (321_1), a recognition task T2 (321_2), ..., and a recognition task Tm (321_m). The mapping relationship 323 between the recognition task and the processing strategy may include a mapping relationship 323_1 between the recognition task T1 and the processing strategy TA1 , a mapping relationship 323_2 between the recognition task T2 and the processing strategy TA2 , ..., and a mapping relationship 323_n between the recognition task Tn and the processing strategy TAn .

根据本公开的实施例,根据选择操作,可以确定目标识别任务的标识为识别任务T2的标识,表示目标识别任务322为识别任务T2。根据识别任务T2的标识,可以从识别任务与处理策略的映射关系323中确定目标处理策略324为与识别任务T2相对应的处理策略TA2According to an embodiment of the present disclosure, according to the selection operation, the identifier of the target recognition task can be determined to be the identifier of the recognition task T 2 , indicating that the target recognition task 322 is the recognition task T 2. According to the identifier of the recognition task T 2 , the target processing strategy 324 can be determined from the mapping relationship 323 between the recognition task and the processing strategy to be the processing strategy TA 2 corresponding to the recognition task T 2 .

根据本公开的实施例,根据目标识别任务的标识信息,从识别任务与处理策略的映射关系中得到目标处理策略信息,可以包括如下操作:According to an embodiment of the present disclosure, obtaining target processing strategy information from a mapping relationship between the recognition task and the processing strategy according to the identification information of the target recognition task may include the following operations:

根据目标识别任务的标识信息,从识别任务与处理策略的映射关系中,得到待选择处理策略信息。响应于接收到的针对待选择处理策略信息的选择操作,得到目标处理策略。According to the identification information of the target recognition task, the processing strategy information to be selected is obtained from the mapping relationship between the recognition task and the processing strategy. In response to the received selection operation for the processing strategy information to be selected, the target processing strategy is obtained.

根据本公开的实施例,与识别任务T2相对应的处理策略可以包括多个,例如:处理策略TA2-1、处理策略TA2-2、...、处理策略TA2-I,则待选择处理策略信息可以包括:处理策略TA2-1、处理策略TA2-2、...、处理策略TA2-IAccording to an embodiment of the present disclosure, the processing strategies corresponding to the identification task T2 may include multiple ones, for example: processing strategy TA2-1 , processing strategy TA2-2 , ..., processing strategy TA2-I , and the processing strategy information to be selected may include: processing strategy TA2-1 , processing strategy TA2-2 , ..., processing strategy TA2 -I .

根据本公开的实施例,待选择的策略信息可以通过可视化界面在客户端进行展示,以便于用户进行选择操作。基于用户针对待选择的策略信息的选择,可以得到目标处理策略。例如:用户选择的可以是处理策略TA2-2,则与识别任务T2相对应的目标处理策略可以是处理策略TA2-2According to an embodiment of the present disclosure, the policy information to be selected can be displayed on the client through a visual interface to facilitate the user to perform a selection operation. Based on the user's selection of the policy information to be selected, the target processing policy can be obtained. For example, if the user selects the processing policy TA 2-2 , then the target processing policy corresponding to the identification task T 2 can be the processing policy TA 2-2 .

根据本公开的实施例,用户针对待选择的策略信息的选择,也可以是针对两项或两项以上的处理策略的选择,得到的目标处理策略可以是该两项或两项以上的处理策略的组合处理策略。According to an embodiment of the present disclosure, the user's selection of the policy information to be selected may also be a selection of two or more processing strategies, and the obtained target processing strategy may be a combination processing strategy of the two or more processing strategies.

例如:用户选择的可以是处理策略TA2-2和处理策略TA2-3,得到的目标处理策略可以是处理策略TA2-2和处理策略TA2-3的组合处理策略。For example, the user may select processing strategy TA 2-2 and processing strategy TA 2-3 , and the obtained target processing strategy may be a combined processing strategy of processing strategy TA 2-2 and processing strategy TA 2-3 .

根据本公开的实施例,对于组合处理策略,组合中的各处理策略的先后顺序可以基于选择顺序确定,也可以基于组合中的各处理策略之间的处理逻辑的关联关系确定。例如:处理策略TA2-2中的输入数据是基于处理策略TA2-3的处理结果得到的,可以确定该组合处理策略中的顺序为处理策略TA2-3→处理策略TA2-2According to an embodiment of the present disclosure, for a combination of processing strategies, the order of the processing strategies in the combination can be determined based on the selection order, or based on the association relationship of the processing logic between the processing strategies in the combination. For example: the input data in the processing strategy TA 2-2 is obtained based on the processing result of the processing strategy TA 2-3 , and the order in the combined processing strategy can be determined as processing strategy TA 2-3 →processing strategy TA 2-2 .

根据本公开的实施例,目标处理策略可以包括目标特征提取策略和目标特征处理策略。操作S230可以包括如下操作:According to an embodiment of the present disclosure, the target processing strategy may include a target feature extraction strategy and a target feature processing strategy. Operation S230 may include the following operations:

基于目标特征提取策略,提取待识别的时序图像序列的目标特征。基于目标特征处理策略,对目标特征进行处理,得到识别结果。Based on the target feature extraction strategy, the target features of the time-series image sequence to be identified are extracted. Based on the target feature processing strategy, the target features are processed to obtain the recognition result.

图4示意性示出了根据本公开实施例的对空间关系特征进行处理得到识别结果的示意图。FIG. 4 schematically shows a schematic diagram of processing spatial relationship features to obtain recognition results according to an embodiment of the present disclosure.

如图4所示,在400中,根据视频数据431得到待识别的时序图像序列432,待识别的时序图像序列432可以包括与t1时刻对应的图像P1(432_1)、与t2时刻对应的图像P2(432_2)、...、与ti时刻对应的图像Pi(432_i)。As shown in FIG. 4 , in 400 , a time-series image sequence 432 to be identified is obtained according to video data 431 , and the time-series image sequence 432 to be identified may include image P 1 ( 432_1 ) corresponding to time t 1 , image P 2 ( 432_2 ) corresponding to time t 2 , ... , image P i ( 432_i ) corresponding to time ti .

根据本公开的实施例,基于目标特征提取策略,依次提取待识别的时序图像序列432中每一个图像的空间关系特征,得到空间关系特征433。空间关系特征433可以包括与t1时刻对应的空间关系特征433_1、与t2时刻对应的空间关系特征433_2、...、与ti时刻对应的空间关系特征433_i。空间关系特征表征图像中图像中的前景特征与背景特征之间的相对运动特征。例如:图像中可以包括街道、房屋和多个活动对象。多个活动对象可以是图像的前景特征,街道、房屋可以是图像的背景特征。前景特征与背景特征之间的空间相对关系特征可以表征多个活动对象与街道、房屋之间的相对运动特征。According to an embodiment of the present disclosure, based on the target feature extraction strategy, the spatial relationship features of each image in the time-series image sequence 432 to be identified are extracted in sequence to obtain the spatial relationship features 433. The spatial relationship features 433 may include the spatial relationship features 433_1 corresponding to the time t1 , the spatial relationship features 433_2 corresponding to the time t2 , ..., and the spatial relationship features 433_i corresponding to the time t1 . The spatial relationship features characterize the relative motion features between the foreground features and the background features in the image. For example, the image may include streets, houses, and multiple active objects. Multiple active objects may be the foreground features of the image, and the streets and houses may be the background features of the image. The spatial relative relationship features between the foreground features and the background features may characterize the relative motion features between the multiple active objects and the streets and houses.

根据本公开的实施例,基于目标特征处理策略,得到空间关系特征随时间变化的特征434。根据空间关系特征随时间变化的特征,得到识别结果435。According to the embodiment of the present disclosure, based on the target feature processing strategy, the feature 434 of the spatial relationship feature changing over time is obtained. According to the feature of the spatial relationship feature changing over time, the recognition result 435 is obtained.

例如:在t1~ti时刻,随着时间的变化,多个活动对象与街道、房屋之间的相对运动特征可以为逐渐向同一方向聚集,可以确定该识别结果为多个活动对象已发生异常行为,该异常行为可以为聚众斗殴行为。For example, during the time interval from t 1 to t i , as time changes, the relative motion characteristics between multiple active objects and streets and houses may be gradually gathered in the same direction, and the recognition result may be determined as abnormal behavior of multiple active objects, which may be gang fighting.

图5示意性示出了根据本公开实施例的对第一目标对象的动作特征进行处理得到识别结果的示意图。FIG. 5 schematically shows a schematic diagram of processing the action features of the first target object to obtain a recognition result according to an embodiment of the present disclosure.

如图5所示,在500中,根据视频数据531得到待识别的时序图像序列532,待识别的时序图像序列532可以包括与t1时刻对应的图像P1(532_1)、与t2时刻对应的图像P2(532_2)、...、与ti时刻对应的图像Pi(532_i)。As shown in FIG. 5 , in 500 , a time-series image sequence 532 to be identified is obtained according to video data 531 , and the time-series image sequence 532 to be identified may include image P 1 ( 532_1 ) corresponding to time t 1 , image P 2 ( 532_2 ) corresponding to time t 2 , ... , image P i ( 532_i ) corresponding to time ti .

根据本公开的实施例,基于目标特征提取策略,依次提取待识别的时序图像序列532中每一个图像的第一目标对象的动作特征,得到第一目标对象的动作特征533。第一目标对象的动作特征533可以包括与t1时刻对应的第一目标对象的动作特征533_1、与t2时刻对应的第一目标对象的动作特征533_2、...、与ti时刻对应的第一目标对象的动作特征533_i。According to an embodiment of the present disclosure, based on the target feature extraction strategy, the action features of the first target object of each image in the time-series image sequence 532 to be identified are extracted in sequence to obtain the action features 533 of the first target object. The action features 533 of the first target object may include an action feature 533_1 of the first target object corresponding to time t1 , an action feature 533_2 of the first target object corresponding to time t2 , ..., an action feature 533_i of the first target object corresponding to time t1 .

根据本公开的实施例,动作特征可以包括动作方向特征和动作变化特征。动作方向特征可以表征第一目标对象的动作相对于地面的移动方向特征。动作变化特征可以表征第一目标对象的动作变化特征。According to an embodiment of the present disclosure, the motion feature may include a motion direction feature and a motion change feature. The motion direction feature may characterize the moving direction feature of the motion of the first target object relative to the ground. The motion change feature may characterize the motion change feature of the first target object.

根据本公开的实施例,基于目标特征处理策略,得到第一目标对象的动作特征随时间变化的特征534。根据第一目标对象的动作特征随时间变化的特征,得到识别结果535。According to an embodiment of the present disclosure, based on the target feature processing strategy, a feature 534 of the action feature of the first target object changing over time is obtained. According to the feature of the action feature of the first target object changing over time, a recognition result 535 is obtained.

例如:在t1~ti时刻,随着时间的变化,第一目标对象的动作方向特征可以为相对于地面的移动方向相同,并逐渐缩短与地面之间的距离。第一目标对象的动作变化特征可以为第一目标对象的动作由膝盖弯曲动作,变化为身体前倾动作,最后变化为双手支撑地面的匍匐动作。可以确定当前第一目标对象已发生异常行为,异常行为可以为摔倒行为。For example, at time t1 - t1 , as time changes, the motion direction feature of the first target object may be the same moving direction relative to the ground, and gradually shortening the distance from the ground. The motion change feature of the first target object may be that the motion of the first target object changes from a knee bending motion to a body leaning forward motion, and finally changes to a crawling motion with both hands supporting the ground. It can be determined that the first target object has currently performed an abnormal behavior, and the abnormal behavior may be a fall.

根据本公开的实施例,第一目标对象的动作特征可以表征第一目标对象的目标骨骼点特征。基于目标特征处理策略,对第一目标对象的动作特征进行处理,得到第一目标对象的动作特征随时间变化的特征,可以包括如下操作:According to an embodiment of the present disclosure, the action feature of the first target object can characterize the target skeleton point feature of the first target object. Based on the target feature processing strategy, the action feature of the first target object is processed to obtain the feature of the action feature of the first target object changing over time, which may include the following operations:

基于目标特征处理策略,对目标骨骼点特征进行处理,得到目标骨骼点随时间变化的变化趋势特征;根据目标骨骼点随时间变化的变化趋势特征,得到第一目标对象的动作特征随时间变化的特征。Based on the target feature processing strategy, the target skeleton point features are processed to obtain the change trend features of the target skeleton points over time; based on the change trend features of the target skeleton points over time, the change features of the action features of the first target object over time are obtained.

例如:目标骨骼点可以包括人体躯干、四肢、头部等部位的骨骼点。骨骼点特征的变化可以较为精准地表征第一目标对象的动作特征的变化。基于目标特征处理策略,对目标骨骼点特征进行处理,可以提高图像识别的精度。For example, the target skeleton points may include skeleton points of the human body trunk, limbs, head, etc. The change of the skeleton point features can more accurately characterize the change of the action features of the first target object. Based on the target feature processing strategy, the target skeleton point features are processed to improve the accuracy of image recognition.

图6示意性示出了根据本公开实施例的对目标区域的位置特征和第一目标对象的位置特征进行处理得到识别结果的示意图。FIG. 6 schematically shows a schematic diagram of obtaining a recognition result by processing the position features of the target area and the position features of the first target object according to an embodiment of the present disclosure.

如图6所示,在600中,根据视频数据631得到待识别的时序图像序列632,待识别的时序图像序列632可以包括与t1时刻对应的图像P1(632_1)、与t2时刻对应的图像P2(632_2)、...、与ti时刻对应的图像Pi(632_i)。As shown in FIG6 , in 600 , a time-series image sequence 632 to be identified is obtained according to video data 631 , and the time-series image sequence 632 to be identified may include image P 1 ( 632_1 ) corresponding to time t 1 , image P 2 ( 632_2 ) corresponding to time t 2 , ... , image P i ( 632_i ) corresponding to time ti .

根据本公开的实施例,基于目标特征提取策略,依次提取待识别的时序图像序列632中每一个图像的第一目标对象的位置特征和目标区域的位置特征,得到第一目标对象的位置特征633和目标区域的位置特征634。第一目标对象的位置特征633可以包括与t1时刻对应的第一目标对象的位置特征633_1、与t2时刻对应的第一目标对象的位置特征633_2、...、与ti时刻对应的第一目标对象的位置特征633_i。目标区域的位置特征634可以包括与t1时刻对应的第二目标对象的位置特征633_1、与t2时刻对应的目标区域的位置特征634_2、...、与ti时刻对应的目标区域的位置特征634_i。According to an embodiment of the present disclosure, based on the target feature extraction strategy, the position features of the first target object and the position features of the target area of each image in the time-series image sequence 632 to be identified are extracted in sequence to obtain the position features 633 of the first target object and the position features 634 of the target area. The position features 633 of the first target object may include the position features 633_1 of the first target object corresponding to the time t1 , the position features 633_2 of the first target object corresponding to the time t2 , ..., and the position features 633_i of the first target object corresponding to the time t1 . The position features 634 of the target area may include the position features 633_1 of the second target object corresponding to the time t1 , the position features 634_2 of the target area corresponding to the time t2 , ..., and the position features 634_i of the target area corresponding to the time t1 .

根据本公开的实施例,基于目标特征处理策略,对目标区域的位置特征和第一目标对象的位置特征进行处理,得到第一变化特征635,其中,第一变化特征表征第一目标对象与目标区域的第一相对位置关系随时间变化的特征。根据第一变化特征635,得到识别结果636。According to an embodiment of the present disclosure, based on the target feature processing strategy, the position feature of the target area and the position feature of the first target object are processed to obtain a first change feature 635, wherein the first change feature characterizes the feature of the first relative position relationship between the first target object and the target area changing over time. According to the first change feature 635, a recognition result 636 is obtained.

例如:第一目标对象的位置特征可以为像素坐标特征,第一目标对象与目标区域的第一相对位置关系随时间变化的特征,可以包括第一目标对象的像素坐标与目标区域的边缘坐标之间的距离逐渐缩小,直至第一目标对象的像素坐标在目标区域内。表示第一目标对象进入目标区域,得到的识别结果可以为第一对象已发生进入目标区域的行为。For example, the position feature of the first target object may be a pixel coordinate feature, and the feature of the first relative position relationship between the first target object and the target area changing over time may include that the distance between the pixel coordinates of the first target object and the edge coordinates of the target area gradually decreases until the pixel coordinates of the first target object are within the target area. This indicates that the first target object has entered the target area, and the recognition result obtained may be that the first object has entered the target area.

图7示意性示出了根据本公开实施例的对第一目标对象的位置特征和第二目标对象的位置特征进行处理得到识别结果的示意图;FIG7 schematically shows a schematic diagram of obtaining a recognition result by processing the position feature of the first target object and the position feature of the second target object according to an embodiment of the present disclosure;

如图7所示,在700中,根据视频数据731得到待识别的时序图像序列732,待识别的时序图像序列732可以包括与t1时刻对应的图像P1(732_1)、与t2时刻对应的图像P2(732_2)、...、与ti时刻对应的图像Pi(732_i)。As shown in FIG. 7 , in 700 , a time-series image sequence 732 to be identified is obtained according to video data 731 , and the time-series image sequence 732 to be identified may include image P 1 ( 732_1 ) corresponding to time t 1 , image P 2 ( 732_2 ) corresponding to time t 2 , ... , image P i ( 732_i ) corresponding to time ti .

根据本公开的实施例,基于目标特征提取策略,依次提取待识别的时序图像序列732中每一个图像的第一目标对象的位置特征和第二目标对象的位置特征,得到第一目标对象的位置特征733和第二目标对象的位置特征734。第一目标对象的位置特征733可以包括与t1时刻对应的第一目标对象的位置特征733_1、与t2时刻对应的第一目标对象的位置特征733_2、...、与ti时刻对应的第一目标对象的位置特征733_i。第二目标对象的位置特征734可以包括与t1时刻对应的第二目标对象的位置特征733_1、与t2时刻对应的第二目标对象的位置特征734_2、...、与ti时刻对应的第二目标对象的位置特征734_i。According to an embodiment of the present disclosure, based on the target feature extraction strategy, the position features of the first target object and the second target object of each image in the time-series image sequence 732 to be identified are sequentially extracted to obtain the position features 733 of the first target object and the position features 734 of the second target object. The position features 733 of the first target object may include the position features 733_1 of the first target object corresponding to the time t1 , the position features 733_2 of the first target object corresponding to the time t2 , ..., and the position features 733_i of the first target object corresponding to the time t1 . The position features 734 of the second target object may include the position features 733_1 of the second target object corresponding to the time t1 , the position features 734_2 of the second target object corresponding to the time t2 , ..., and the position features 734_i of the second target object corresponding to the time t1 .

根据本公开的实施例,基于目标特征处理策略,对第一目标对象的位置特征和第二目标对象的位置特征进行处理,得到第二变化特征735。根据第二变化特征735,得到识别结果736。According to an embodiment of the present disclosure, based on the target feature processing strategy, the position feature of the first target object and the position feature of the second target object are processed to obtain a second change feature 735. According to the second change feature 735, a recognition result 736 is obtained.

根据本公开的实施例,第二变化特征表征第一目标对象和第二目标对象的第二相对位置关系随时间变化的特征。第一目标对象可以表示人以及人的耳部、头部或口部等部位,第二目标对象可以表示任意物品,例如:手机、香烟等等。第一目标对象和第二目标对象的相对位置关系随时间变化的特征,可以为人与手机之间的相对位置随时间变化的特征。According to an embodiment of the present disclosure, the second change feature characterizes the feature that the second relative position relationship between the first target object and the second target object changes over time. The first target object may represent a person and parts such as the ear, head or mouth of the person, and the second target object may represent any object, such as a mobile phone, a cigarette, etc. The feature that the relative position relationship between the first target object and the second target object changes over time may be the feature that the relative position between the person and the mobile phone changes over time.

例如:第一目标对象与第二目标对象的相对位置关系逐渐靠近,表示手机与人的耳部或头部之间的距离逐渐缩短,可以确定第一目标对象的行为为人正在使用手机接打电话,得到的识别结果为第一目标对象已发生接打电话的行为。For example, the relative positions of the first target object and the second target object are gradually getting closer, indicating that the distance between the mobile phone and the ear or head of a person is gradually shortening. It can be determined that the behavior of the first target object is that the person is using the mobile phone to make a call, and the recognition result is that the first target object has made a call.

图8示意性示出了根据本公开实施例的对第一目标对象的特征和第三目标对象的特征进行处理得到识别结果的示意图。FIG8 schematically shows a schematic diagram of processing features of a first target object and features of a third target object to obtain a recognition result according to an embodiment of the present disclosure.

如图8所示,在800中,根据视频数据831得到待识别的时序图像序列832,待识别的时序图像序列832可以包括与t1时刻对应的图像P1(832_1)、与t2时刻对应的图像P2(832_2)、...、与ti时刻对应的图像Pi(832_i)。As shown in FIG8 , in 800 , a time-series image sequence 832 to be identified is obtained according to video data 831 , and the time-series image sequence 832 to be identified may include image P 1 ( 832_1 ) corresponding to time t 1 , image P 2 ( 832_2 ) corresponding to time t 2 , ... , image P i ( 832_i ) corresponding to time ti .

根据本公开的实施例,基于目标特征提取策略,依次提取待识别的时序图像序列832中每一个图像的第一目标对象的位置特征和第三目标对象的位置特征,得到第一目标对象的位置特征833和第二目标对象的位置特征834。第一目标对象的位置特征833可以包括与t1时刻对应的第一目标对象的位置特征833_1、与t2时刻对应的第一目标对象的位置特征833_2、...、与ti时刻对应的第一目标对象的位置特征833_i。第二目标对象的位置特征834可以包括与t1时刻对应的第二目标对象的位置特征833_1、与t2时刻对应的第二目标对象的位置特征834_2、...、与ti时刻对应的第二目标对象的位置特征834_i。According to an embodiment of the present disclosure, based on the target feature extraction strategy, the position features of the first target object and the third target object of each image in the time-series image sequence 832 to be identified are sequentially extracted to obtain the position features 833 of the first target object and the position features 834 of the second target object. The position features 833 of the first target object may include the position features 833_1 of the first target object corresponding to the time t1 , the position features 833_2 of the first target object corresponding to the time t2 , ..., and the position features 833_i of the first target object corresponding to the time t1 . The position features 834 of the second target object may include the position features 833_1 of the second target object corresponding to the time t1 , the position features 834_2 of the second target object corresponding to the time t2 , ..., and the position features 834_i of the second target object corresponding to the time t1 .

根据本公开的实施例,视频图像831可以是由不同采集方向的采集设备采集得到的,也可以是由相同采集方向的采集设备采集得到的。According to an embodiment of the present disclosure, the video image 831 may be acquired by acquisition devices in different acquisition directions, or may be acquired by acquisition devices in the same acquisition direction.

根据本公开的实施例,基于目标处理策略,可以进行如下操作:According to an embodiment of the present disclosure, based on the target processing strategy, the following operations may be performed:

对第一目标对象的特征和第三目标对象的特征进行匹配,得到特征匹配结果835。在特征匹配结果满足预定阈值的情况下,根据第一目标对象的特征和第三目标对象的特征,得到识别结果836。The features of the first target object and the features of the third target object are matched to obtain a feature matching result 835. When the feature matching result meets a predetermined threshold, a recognition result 836 is obtained based on the features of the first target object and the features of the third target object.

根据本公开的实施例,在特征匹配结果满足预定阈值的情况下,根据第一目标对象的特征和第三目标对象的特征,得到识别结果,可以包括如下操作:According to an embodiment of the present disclosure, when the feature matching result meets a predetermined threshold, obtaining a recognition result according to the feature of the first target object and the feature of the third target object may include the following operations:

在特征匹配结果满足预定阈值的情况下,确定第一目标对象和第三目标对象为同一目标对象。根据第一目标对象的特征和第三目标对象的特征,得到目标对象属性特征。根据目标对象属性特征,得到识别结果。When the feature matching result meets a predetermined threshold, the first target object and the third target object are determined to be the same target object. According to the features of the first target object and the features of the third target object, the target object attribute features are obtained. According to the target object attribute features, the recognition result is obtained.

根据本公开的实施例,第一目标对象的特征、第三目标对象的特征均可以包括人体不同部位的特征和动作特征,例如:面部特征、衣着颜色特征、行走姿势特征等等。According to an embodiment of the present disclosure, the features of the first target object and the features of the third target object may include features of different parts of the human body and action features, such as facial features, clothing color features, walking posture features, and the like.

根据本公开的实施例,利用第一目标对象的特征与第三目标对象的特征的相似度,得到特征匹配结果。当相似度满足预定阈值的情况下,表示第一目标对象的特征与第三目标对象的特征相匹配,可以确定第一目标对象和第三目标对象为同一对象。According to an embodiment of the present disclosure, a feature matching result is obtained by using the similarity between the feature of the first target object and the feature of the third target object. When the similarity meets a predetermined threshold, it means that the feature of the first target object matches the feature of the third target object, and it can be determined that the first target object and the third target object are the same object.

根据本公开的实施例,在确定第一目标对象和第三目标对象为同一对象的情况下,可以用于统计某个时间段内的人群流量。According to an embodiment of the present disclosure, when it is determined that the first target object and the third target object are the same object, it can be used to count the crowd flow in a certain time period.

根据本公开的实施例,第一目标对象的特征还可以包括第一目标对象与图像中的背景物体的相对运动方向特征。According to an embodiment of the present disclosure, the feature of the first target object may further include a feature of a relative motion direction between the first target object and a background object in the image.

例如:图像中第一目标对象相对于背景物体(例如:房屋)的相对运动方向为远离房屋,可以根据第一目标对象与图像中的背景物体的相对运动方向特征,统计某个时间段内离开该房屋的人群流量。同理,在第一目标对象相对于背景物体(例如:房屋)的相对运动方向为进入房屋的情况下,可以根据第一目标对象与图像中的背景物体的相对运动方向特征,统计某个时间段内进入该房屋的人群流量。For example, if the relative motion direction of the first target object in the image relative to the background object (e.g., a house) is away from the house, the flow of people leaving the house in a certain time period can be counted based on the relative motion direction characteristics of the first target object and the background object in the image. Similarly, if the relative motion direction of the first target object relative to the background object (e.g., a house) is entering the house, the flow of people entering the house in a certain time period can be counted based on the relative motion direction characteristics of the first target object and the background object in the image.

图9示意性示出了根据本公开实施例的与不同处理策略相对应的整体示例性系统架构图。FIG. 9 schematically shows an overall exemplary system architecture diagram corresponding to different processing strategies according to an embodiment of the present disclosure.

如图9所示,在900中,配置了与不同处理策略相对应的处理模块。在目标识别任务为第一异常行为识别的情况下,目标处理策略相对应的处理模块可以包括:检测跟踪模块903、关键点检测模块904、第一异常行为识别模块905。基于与第一异常行为识别任务相对应的目标处理策略,对第一采集设备的视频图像901进行处理,得到待识别的时序图像序列902。检测跟踪模块903对待识别的时序图像序列902进行处理,得到第一目标对象的骨骼点特征。关键点监测模块904对第一目标对象的骨骼点特征进行处理,得到目标骨骼点特征。利用第一异常行为识别模块905对目标骨骼点特征进行处理,得到第一异常行为的识别结果。As shown in FIG9 , in 900 , processing modules corresponding to different processing strategies are configured. When the target recognition task is the first abnormal behavior recognition, the processing modules corresponding to the target processing strategy may include: a detection and tracking module 903, a key point detection module 904, and a first abnormal behavior recognition module 905. Based on the target processing strategy corresponding to the first abnormal behavior recognition task, the video image 901 of the first acquisition device is processed to obtain a time-series image sequence 902 to be recognized. The detection and tracking module 903 processes the time-series image sequence 902 to be recognized to obtain the skeleton point features of the first target object. The key point monitoring module 904 processes the skeleton point features of the first target object to obtain the target skeleton point features. The target skeleton point features are processed using the first abnormal behavior recognition module 905 to obtain the recognition result of the first abnormal behavior.

根据本公开的实施例,在变更目标识别任务的情况下,目标处理策略相应发生变更。则利用与目标识别任务相对应的其它行为识别模块对待识别的时序图像序列902进行处理,在此不做赘述。According to the embodiment of the present disclosure, when the target recognition task is changed, the target processing strategy is changed accordingly. Then, other behavior recognition modules corresponding to the target recognition task are used to process the time-series image sequence 902 to be recognized, which will not be described in detail here.

根据本公开的实施例,在目标识别任务为出入计算统计任务或属性识别任务的情况下,可以结合第二采集设备的视频图像910与第二采集设备的视频图像901共同进行处理。例如:利用检测跟踪模块912处理待识别的时序图像序列911,得到第三目标对象的特征。例如检测跟踪模块903处理待识别的时序图像序列902,得到第一目标对象的特征。利用特征匹配模块913对第一目标对象的特征和第三目标对象的特征进行处理,得到特征匹配结果。再利用属性识别模块914对第一目标对象的特征和第三目标对象的特征进行处理,得到属性识别结果。或利用出入计数模块915对同一目标对象进行计算统计,得到出入计数统计结果。According to an embodiment of the present disclosure, when the target recognition task is an input/output calculation and statistics task or an attribute recognition task, the video image 910 of the second acquisition device can be processed together with the video image 901 of the second acquisition device. For example: the detection and tracking module 912 is used to process the time-series image sequence 911 to be recognized to obtain the characteristics of the third target object. For example, the detection and tracking module 903 processes the time-series image sequence 902 to be recognized to obtain the characteristics of the first target object. The feature matching module 913 is used to process the characteristics of the first target object and the characteristics of the third target object to obtain a feature matching result. Then, the attribute recognition module 914 is used to process the characteristics of the first target object and the characteristics of the third target object to obtain an attribute recognition result. Or the input/output counting module 915 is used to perform calculation and statistics on the same target object to obtain an input/output counting and statistics result.

图10示意性示出了根据本公开实施例的示例性系统架构部署图。FIG. 10 schematically shows an exemplary system architecture deployment diagram according to an embodiment of the present disclosure.

如图10所示,在示例性系统架构部署图1000中,包括算法架构层1001、应用层1002、部署层1003。在算法架构层1001中,输入数据10011可以包括图像文件、单镜头视频图像、多镜头视频图像。算法原理10012是通过对输入数据进行目标检测,得到目标特征。利用多目标跟踪技术、特征关联技术、面部识别技术、轨迹融合等技术等对目标特征进行处理,得到输出数据10013。具体的处理策略是根据目标识别任务确定的,输出的数据10013可以包括属性识别结果、异常行为识别结果、轨迹/流量计数等。As shown in FIG10 , in the exemplary system architecture deployment diagram 1000, an algorithm architecture layer 1001, an application layer 1002, and a deployment layer 1003 are included. In the algorithm architecture layer 1001, input data 10011 may include image files, single-lens video images, and multi-lens video images. The algorithm principle 10012 is to obtain target features by performing target detection on the input data. The target features are processed using multi-target tracking technology, feature association technology, facial recognition technology, trajectory fusion technology, and other technologies to obtain output data 10013. The specific processing strategy is determined according to the target recognition task, and the output data 10013 may include attribute recognition results, abnormal behavior recognition results, trajectory/traffic counts, and the like.

应用层1002部署了各种应用功能模块,包括异常行为预警功能模块10021、流量密度监测功能模块10022、出入流量控制功能模块10023、视频结构化功能模块10024、属性分析功能模块10025等。The application layer 1002 deploys various application function modules, including an abnormal behavior warning function module 10021, a traffic density monitoring function module 10022, an inbound and outbound traffic control function module 10023, a video structuring function module 10024, an attribute analysis function module 10025, etc.

部署层1003包括原生推理库(Paddle Inference)10031、服务化部署框架(PaddleServing)10032、深度学习优化推理优化器(TensorRT)10033。The deployment layer 1003 includes the native inference library (Paddle Inference) 10031, the service-oriented deployment framework (PaddleServing) 10032, and the deep learning optimized inference optimizer (TensorRT) 10033.

图11示意性示出了根据本公开实施例的图像识别装置的框图.Figure 11 schematically shows a block diagram of an image recognition device according to an embodiment of the present disclosure.

如图11所示,该图像识别装置1100包括第一获得模块1101、第二获得模块1102和第三获得模块1103。As shown in FIG. 11 , the image recognition device 1100 includes a first obtaining module 1101 , a second obtaining module 1102 and a third obtaining module 1103 .

第一获得模块,用于根据视频图像,得到待识别的时序图像序列。The first acquisition module is used to obtain a time-series image sequence to be identified according to the video image.

第二获得模块,用于响应于接收到针对目标识别任务的选择操作,得到目标处理策略。The second obtaining module is used to obtain a target processing strategy in response to receiving a selection operation for a target recognition task.

第三获得模块,用于基于目标处理策略,对待识别的时序图像序列进行处理,得到识别结果。The third acquisition module is used to process the time-series image sequence to be recognized based on the target processing strategy to obtain the recognition result.

根据本公开的实施例,第二获得模块1102可以包括确定单元和第一获得单元。According to an embodiment of the present disclosure, the second obtaining module 1102 may include a determining unit and a first obtaining unit.

确定单元,用于根据选择操作,确定目标识别任务的标识信息。The determination unit is used to determine the identification information of the target recognition task according to the selection operation.

第一获得单元,用于根据目标识别任务的标识信息,从识别任务与处理策略的映射关系中得到目标处理策略信息。The first obtaining unit is used to obtain target processing strategy information from the mapping relationship between the recognition task and the processing strategy according to the identification information of the target recognition task.

根据本公开的实施例,第一获得单元可以包括第一获得子单元和第二获得子单元。According to an embodiment of the present disclosure, the first obtaining unit may include a first obtaining sub-unit and a second obtaining sub-unit.

第一获得子单元,用于根据目标识别任务的标识信息,从识别任务与处理策略的映射关系中,得到待选择处理策略信息。The first obtaining subunit is used to obtain the processing strategy information to be selected from the mapping relationship between the recognition task and the processing strategy according to the identification information of the target recognition task.

第二获得子单元,用于响应于接收到的针对待选择处理策略信息的选择操作,得到目标处理策略。The second obtaining subunit is used to obtain a target processing strategy in response to a received selection operation on the processing strategy information to be selected.

根据本公开的实施例,目标处理策略包括目标特征提取策略和目标特征处理策略,第三获得模块1103可以包括:第二获得单元和第三获得单元。According to an embodiment of the present disclosure, the target processing strategy includes a target feature extraction strategy and a target feature processing strategy, and the third obtaining module 1103 may include: a second obtaining unit and a third obtaining unit.

第二获得单元,用于基于目标特征提取策略,提取待识别的时序图像序列的目标特征。The second obtaining unit is used to extract the target features of the time-series image sequence to be identified based on the target feature extraction strategy.

第三获得单元,用于基于目标特征处理策略,对目标特征进行处理,得到识别结果。The third obtaining unit is used to process the target feature based on the target feature processing strategy to obtain the recognition result.

根据本公开的实施例,标特征包括空间关系特征,第三获得单元包括:第三获得子单元和第四获得子单元。According to an embodiment of the present disclosure, the landmark feature includes a spatial relationship feature, and the third obtaining unit includes: a third obtaining sub-unit and a fourth obtaining sub-unit.

第三获得子单元,用于基于目标特征处理策略,对空间关系特征进行处理,得到空间关系特征随时间变化的特征。The third obtaining subunit is used to process the spatial relationship features based on the target feature processing strategy to obtain the characteristics of the spatial relationship features that change over time.

第四获得子单元,用于根据空间关系特征随时间变化的特征,得到识别结果。The fourth obtaining subunit is used to obtain the recognition result according to the characteristics of the spatial relationship characteristics that change over time.

根据本公开的实施例,目标特征包括第一目标对象的动作特征,第三获得单元包括:第五获得子单元和第六获得子单元。According to an embodiment of the present disclosure, the target feature includes an action feature of the first target object, and the third obtaining unit includes: a fifth obtaining sub-unit and a sixth obtaining sub-unit.

第五获得子单元,用于基于目标特征处理策略,对第一目标对象的动作特征进行处理,得到第一目标对象的动作特征随时间变化的特征。The fifth obtaining subunit is used to process the action feature of the first target object based on the target feature processing strategy to obtain the feature of the action feature of the first target object that changes with time.

第六获得子单元,用于根据第一目标对象的动作特征随时间变化的特征,得到识别结果。The sixth obtaining subunit is used to obtain a recognition result according to the characteristics of the action characteristics of the first target object that change over time.

根据本公开的实施例,第一目标对象的动作特征表征第一目标对象的目标骨骼点特征,第六获得子单元用于基于目标特征处理策略,对目标骨骼点特征进行处理,得到目标骨骼点随时间变化的变化趋势特征。根据目标骨骼点随时间变化的变化趋势特征,得到第一目标对象的动作特征随时间变化的特征。According to an embodiment of the present disclosure, the action feature of the first target object represents the target skeleton point feature of the first target object, and the sixth acquisition subunit is used to process the target skeleton point feature based on the target feature processing strategy to obtain the change trend feature of the target skeleton point over time. According to the change trend feature of the target skeleton point over time, the feature of the action feature of the first target object changing over time is obtained.

根据本公开的实施例,目标特征包括目标区域的位置特征和第一目标对象的位置特征,第三获得单元包括:第七获得子单元和第八获得子单元。According to an embodiment of the present disclosure, the target feature includes a position feature of the target area and a position feature of the first target object, and the third obtaining unit includes: a seventh obtaining subunit and an eighth obtaining subunit.

第七获得子单元,用于基于目标特征处理策略,对目标区域的位置特征和第一目标对象的位置特征进行处理,得到第一变化特征,其中,第一变化特征表征第一目标对象与目标区域的第一相对位置关系随时间变化的特征。第八获得子单元,用于根据第一变化特征,得到识别结果。The seventh obtaining subunit is used to process the position feature of the target area and the position feature of the first target object based on the target feature processing strategy to obtain a first change feature, wherein the first change feature represents a feature of a first relative position relationship between the first target object and the target area that changes over time. The eighth obtaining subunit is used to obtain a recognition result based on the first change feature.

根据本公开的实施例,目标特征包括第一目标对象的位置特征和第二目标对象的位置特征,第三获得单元包括:第九获得子单元和第十获得子单元。According to an embodiment of the present disclosure, the target feature includes a position feature of a first target object and a position feature of a second target object, and the third obtaining unit includes: a ninth obtaining subunit and a tenth obtaining subunit.

第九获得子单元,用于基于目标特征处理策略,对第一目标对象的位置特征和第二目标对象的位置特征进行处理,得到第二变化特征,其中,第二变化特征表征第一目标对象和第二目标对象的第二相对位置关系随时间变化的特征。第十获得子单元,用于根据第二变化特征,得到识别结果。The ninth obtaining subunit is used to process the position feature of the first target object and the position feature of the second target object based on the target feature processing strategy to obtain a second change feature, wherein the second change feature represents a feature of a second relative position relationship between the first target object and the second target object that changes over time. The tenth obtaining subunit is used to obtain a recognition result based on the second change feature.

根据本公开的实施例,目标特征包括:第一目标对象的特征和第三目标对象的特征,第一目标对象的特征和第三目标对象的特征是从采集方向不同的至少两个图像中提取得到的;第三获得单元包括:第十一获得子单元和第十二获得子单元。According to an embodiment of the present disclosure, the target features include: features of a first target object and features of a third target object, and the features of the first target object and the features of the third target object are extracted from at least two images with different acquisition directions; the third acquisition unit includes: an eleventh acquisition subunit and a twelfth acquisition subunit.

第十一获得子单元,用于基于目标特征处理策略,对第一目标对象的特征和第三目标对象的特征进行匹配,得到特征匹配结果。The eleventh obtaining subunit is used to match the features of the first target object and the features of the third target object based on the target feature processing strategy to obtain a feature matching result.

第十二获得子单元,用于在特征匹配结果满足预定阈值的情况下,根据第一目标对象的特征和第三目标对象的特征,得到识别结果。The twelfth obtaining subunit is used to obtain a recognition result according to the features of the first target object and the features of the third target object when the feature matching result meets a predetermined threshold.

根据本公开的实施例,第十二获得子单元用于:在特征匹配结果满足预定阈值的情况下,确定第一目标对象和第三目标对象为同一目标对象。根据第一目标对象的特征和第三目标对象的特征,得到目标对象属性特征。根据目标对象属性特征,得到识别结果。According to an embodiment of the present disclosure, the twelfth obtaining subunit is used to: determine that the first target object and the third target object are the same target object when the feature matching result meets a predetermined threshold value. Obtain target object attribute features based on the features of the first target object and the features of the third target object. Obtain recognition results based on the target object attribute features.

根据本公开的实施例,本公开还提供了一种电子设备、一种可读存储介质和一种计算机程序产品。According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

根据本公开的实施例,一种电子设备,包括:至少一个处理器;以及与至少一个处理器通信连接的存储器;其中,存储器存储有可被至少一个处理器执行的指令,指令被至少一个处理器执行,以使至少一个处理器能够执行如上所述的方法。According to an embodiment of the present disclosure, an electronic device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method as described above.

根据本公开的实施例,一种存储有计算机指令的非瞬时计算机可读存储介质,其中,计算机指令用于使计算机执行如上所述的方法。According to an embodiment of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause a computer to execute the method described above.

根据本公开的实施例,一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现如上所述的方法。According to an embodiment of the present disclosure, a computer program product includes a computer program, and when the computer program is executed by a processor, the computer program implements the method as described above.

图12示出了可以用来实施本公开的实施例的示例电子设备1200的示意性框图。电子设备旨在表示各种形式的数字计算机,诸如,膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示各种形式的移动装置,诸如,个人数字处理、蜂窝电话、智能电话、可穿戴设备和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例,并且不意在限制本文中描述的和/或者要求的本公开的实现。FIG. 12 shows a schematic block diagram of an example electronic device 1200 that can be used to implement an embodiment of the present disclosure. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and/or required herein.

如图12所示,设备1200包括计算单元1201,其可以根据存储在只读存储器(ROM)1202中的计算机程序或者从存储单元1208加载到随机访问存储器(RAM)1203中的计算机程序,来执行各种适当的动作和处理。在RAM 1203中,还可存储设备800操作所需的各种程序和数据。计算单元1201、ROM 1202以及RAM 1203通过总线804彼此相连。输入/输出(I/O)接口1205也连接至总线1204。As shown in FIG. 12 , the device 1200 includes a computing unit 1201, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1202 or a computer program loaded from a storage unit 1208 into a random access memory (RAM) 1203. In the RAM 1203, various programs and data required for the operation of the device 800 can also be stored. The computing unit 1201, the ROM 1202, and the RAM 1203 are connected to each other via a bus 804. An input/output (I/O) interface 1205 is also connected to the bus 1204.

设备1200中的多个部件连接至I/O接口1205,包括:输入单元1206,例如键盘、鼠标等;输出单元1207,例如各种类型的显示器、扬声器等;存储单元1208,例如磁盘、光盘等;以及通信单元1209,例如网卡、调制解调器、无线通信收发机等。通信单元1209允许设备1200通过诸如因特网的计算机网络和/或各种电信网络与其他设备交换信息/数据。A number of components in the device 1200 are connected to the I/O interface 1205, including: an input unit 1206, such as a keyboard, a mouse, etc.; an output unit 1207, such as various types of displays, speakers, etc.; a storage unit 1208, such as a disk, an optical disk, etc.; and a communication unit 1209, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1209 allows the device 1200 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.

计算单元1201可以是各种具有处理和计算能力的通用和/或专用处理组件。计算单元801的一些示例包括但不限于中央处理单元(CPU)、图形处理单元(GPU)、各种专用的人工智能(AI)计算芯片、各种运行机器学习模型算法的计算单元、数字信号处理器(DSP)、以及任何适当的处理器、控制器、微控制器等。计算单元1201执行上文所描述的各个方法和处理,例如图像识别方法。例如,在一些实施例中,图像识别方法可被实现为计算机软件程序,其被有形地包含于机器可读介质,例如存储单元1208。在一些实施例中,计算机程序的部分或者全部可以经由ROM 1202和/或通信单元1209而被载入和/或安装到设备1200上。当计算机程序加载到RAM 1203并由计算单元1201执行时,可以执行上文描述的图像识别方法的一个或多个步骤。备选地,在其他实施例中,计算单元1201可以通过其他任何适当的方式(例如,借助于固件)而被配置为执行图像识别方法。The computing unit 1201 may be a variety of general and/or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1201 performs the various methods and processes described above, such as image recognition methods. For example, in some embodiments, the image recognition method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 1208. In some embodiments, part or all of the computer program may be loaded and/or installed on the device 1200 via ROM 1202 and/or communication unit 1209. When the computer program is loaded into RAM 1203 and executed by the computing unit 1201, one or more steps of the image recognition method described above may be performed. Alternatively, in other embodiments, the computing unit 1201 may be configured to perform the image recognition method in any other appropriate manner (e.g., by means of firmware).

本文中以上描述的系统和技术的各种实施方式可以在数字电子电路系统、集成电路系统、场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、芯片上系统的系统(SOC)、复杂可编程逻辑设备(CPLD)、计算机硬件、固件、软件、和/或它们的组合中实现。这些各种实施方式可以包括:实施在一个或者多个计算机程序中,该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释,该可编程处理器可以是专用或者通用可编程处理器,可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令,并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and/or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

用于实施本公开的方法的程序代码可以采用一个或多个编程语言的任何组合来编写。这些程序代码可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器或控制器,使得程序代码当由处理器或控制器执行时使流程图和/或框图中所规定的功能/操作被实施。程序代码可以完全在机器上执行、部分地在机器上执行,作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, implements the functions/operations specified in the flow chart and/or block diagram. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

在本公开的上下文中,机器可读介质可以是有形的介质,其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备,或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

为了提供与用户的交互,可以在计算机上实施此处描述的系统和技术,该计算机具有:用于向用户显示信息的显示装置(例如,CRT(阴极射线管)或者LCD(液晶显示器)监视器);以及键盘和指向装置(例如,鼠标或者轨迹球),用户可以通过该键盘和该指向装置来将输入提供给计算机。其它种类的装置还可以用于提供与用户的交互;例如,提供给用户的反馈可以是任何形式的传感反馈(例如,视觉反馈、听觉反馈、或者触觉反馈);并且可以用任何形式(包括声输入、语音输入或者、触觉输入)来接收来自用户的输入。To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

可以将此处描述的系统和技术实施在包括后台部件的计算系统(例如,作为数据服务器)、或者包括中间件部件的计算系统(例如,应用服务器)、或者包括前端部件的计算系统(例如,具有图形用户界面或者网络浏览器的用户计算机,用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互)、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信(例如,通信网络)来将系统的部件相互连接。通信网络的示例包括:局域网(LAN)、广域网(WAN)和互联网。The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

计算机系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行并且彼此具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。服务器可以是云服务器,也可以是分布式系统的服务器,或者是结合了区块链的服务器。A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server arises through computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

应该理解,可以使用上面所示的各种形式的流程,重新排序、增加或删除步骤。例如,本发公开中记载的各步骤可以并行地执行也可以顺序地执行也可以不同的次序执行,只要能够实现本公开公开的技术方案所期望的结果,本文在此不进行限制。It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

上述具体实施方式,并不构成对本公开保护范围的限制。本领域技术人员应该明白的是,根据设计要求和其他因素,可以进行各种修改、组合、子组合和替代。任何在本公开的精神和原则之内所作的修改、等同替换和改进等,均应包含在本公开保护范围之内。The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims (25)

1.一种图像识别方法,包括:1. An image recognition method, comprising: 根据视频图像,得到待识别的时序图像序列;According to the video image, a time-series image sequence to be identified is obtained; 响应于接收到针对目标识别任务的选择操作,从识别任务与处理策略的映射关系中得到与所述目标识别任务对应的目标处理策略,其中,所述目标处理策略包括与所述目标识别任务对应的组合处理策略,所述组合处理策略中的各处理策略的执行顺序是基于所述各处理策略的处理逻辑的关联关系确定的;所述目标识别任务包括以下任意一种:异常行为识别任务、目标属性特征识别任务和目标对象的行为轨迹识别任务;以及In response to receiving a selection operation for a target recognition task, a target processing strategy corresponding to the target recognition task is obtained from a mapping relationship between recognition tasks and processing strategies, wherein the target processing strategy includes a combination processing strategy corresponding to the target recognition task, and the execution order of each processing strategy in the combination processing strategy is determined based on the association relationship of the processing logic of each processing strategy; the target recognition task includes any one of the following: an abnormal behavior recognition task, a target attribute feature recognition task, and a target object behavior trajectory recognition task; and 基于与所述目标处理策略对应的目标处理路径,对所述待识别的时序图像序列进行处理,得到识别结果;所述目标处理策略包括目标特征提取策略和目标特征处理策略。Based on the target processing path corresponding to the target processing strategy, the time-series image sequence to be identified is processed to obtain an identification result; the target processing strategy includes a target feature extraction strategy and a target feature processing strategy. 2.根据权利要求1所述的方法,其中,所述响应于接收到针对目标识别任务的选择操作,从识别任务与处理策略的映射关系中得到与所述目标识别任务对应的目标处理策略,包括:2. The method according to claim 1, wherein, in response to receiving a selection operation for a target recognition task, obtaining a target processing strategy corresponding to the target recognition task from a mapping relationship between recognition tasks and processing strategies comprises: 根据所述选择操作,确定目标识别任务的标识信息;以及According to the selection operation, determining identification information of the target recognition task; and 根据所述目标识别任务的标识信息,从识别任务与处理策略的映射关系中得到所述目标处理策略信息。According to the identification information of the target recognition task, the target processing strategy information is obtained from the mapping relationship between the recognition task and the processing strategy. 3.根据权利要求2所述的方法,其中,所述根据所述目标识别任务的标识信息,从识别任务与处理策略的映射关系中得到所述目标处理策略信息,包括:3. The method according to claim 2, wherein the step of obtaining the target processing strategy information from a mapping relationship between the recognition task and the processing strategy according to the identification information of the target recognition task comprises: 根据所述目标识别任务的标识信息,从识别任务与处理策略的映射关系中,得到待选择处理策略信息;以及According to the identification information of the target recognition task, obtaining the processing strategy information to be selected from the mapping relationship between the recognition task and the processing strategy; and 响应于接收到的针对所述待选择处理策略信息的选择操作,得到所述目标处理策略。In response to the received selection operation on the to-be-selected processing strategy information, the target processing strategy is obtained. 4.根据权利要求1所述的方法,其中,所述基于与所述目标处理策略对应的目标处理路径,对待识别的时序图像序列进行处理,得到所述识别结果,包括:4. The method according to claim 1, wherein the step of processing the time-series image sequence to be identified based on the target processing path corresponding to the target processing strategy to obtain the identification result comprises: 基于所述目标特征提取策略,提取所述待识别的时序图像序列的目标特征;以及Extracting target features of the time-series image sequence to be identified based on the target feature extraction strategy; and 基于所述目标特征处理策略,对所述目标特征进行处理,得到所述识别结果。Based on the target feature processing strategy, the target feature is processed to obtain the recognition result. 5.根据权利要求4所述的方法,其中,所述目标特征包括空间关系特征,所述基于所述目标特征处理策略,对所述目标特征进行处理,得到所述识别结果,包括:5. The method according to claim 4, wherein the target feature includes a spatial relationship feature, and the processing of the target feature based on the target feature processing strategy to obtain the recognition result comprises: 基于所述目标特征处理策略,对所述空间关系特征进行处理,得到所述空间关系特征随时间变化的特征;以及Based on the target feature processing strategy, the spatial relationship feature is processed to obtain a feature of the spatial relationship feature changing over time; and 根据所述空间关系特征随时间变化的特征,得到所述识别结果。The recognition result is obtained according to the characteristics of the spatial relationship characteristics changing with time. 6.根据权利要求4所述的方法,其中,所述目标特征包括第一目标对象的动作特征,所述基于所述目标特征处理策略,对所述目标特征进行处理,得到所述识别结果,包括:6. The method according to claim 4, wherein the target feature comprises an action feature of the first target object, and the step of processing the target feature based on the target feature processing strategy to obtain the recognition result comprises: 基于所述目标特征处理策略,对所述第一目标对象的动作特征进行处理,得到所述第一目标对象的动作特征随时间变化的特征;以及Based on the target feature processing strategy, the action feature of the first target object is processed to obtain a feature of the action feature of the first target object changing over time; and 根据所述第一目标对象的动作特征随时间变化的特征,得到所述识别结果。The recognition result is obtained according to the characteristics of the action characteristics of the first target object that change over time. 7.根据权利要求6所述的方法,其中,所述第一目标对象的动作特征表征第一目标对象的目标骨骼点特征,所述基于所述目标特征处理策略,对所述第一目标对象的动作特征进行处理,得到所述第一目标对象的动作特征随时间变化的特征,包括:7. The method according to claim 6, wherein the motion feature of the first target object represents the target bone point feature of the first target object, and the processing of the motion feature of the first target object based on the target feature processing strategy to obtain the feature of the motion feature of the first target object changing over time comprises: 基于所述目标特征处理策略,对所述目标骨骼点特征进行处理,得到目标骨骼点随时间变化的变化趋势特征;以及Based on the target feature processing strategy, the target skeleton point features are processed to obtain the change trend features of the target skeleton point over time; and 根据所述目标骨骼点随时间变化的变化趋势特征,得到所述第一目标对象的动作特征随时间变化的特征。According to the change trend characteristics of the target skeleton points over time, the characteristics of the action characteristics of the first target object changing over time are obtained. 8.根据权利要求4所述的方法,其中,所述目标特征包括目标区域的位置特征和第一目标对象的位置特征,所述基于所述目标特征处理策略,对所述目标特征进行处理,得到所述识别结果,包括:8. The method according to claim 4, wherein the target feature comprises a position feature of a target area and a position feature of a first target object, and the step of processing the target feature based on the target feature processing strategy to obtain the recognition result comprises: 基于所述目标特征处理策略,对所述目标区域的位置特征和所述第一目标对象的位置特征进行处理,得到第一变化特征,其中,所述第一变化特征表征所述第一目标对象与所述目标区域的第一相对位置关系随时间变化的特征;以及Based on the target feature processing strategy, the position feature of the target area and the position feature of the first target object are processed to obtain a first change feature, wherein the first change feature represents a feature of a first relative position relationship between the first target object and the target area that changes over time; and 根据所述第一变化特征,得到所述识别结果。The recognition result is obtained according to the first change feature. 9.根据权利要求4所述的方法,其中,所述目标特征包括第一目标对象的位置特征和第二目标对象的位置特征,所述基于所述目标特征处理策略,对所述目标特征进行处理,得到所述识别结果,包括:9. The method according to claim 4, wherein the target feature comprises a position feature of a first target object and a position feature of a second target object, and the step of processing the target feature based on the target feature processing strategy to obtain the recognition result comprises: 基于所述目标特征处理策略,对所述第一目标对象的位置特征和所述第二目标对象的位置特征进行处理,得到第二变化特征,其中,所述第二变化特征表征所述第一目标对象和所述第二目标对象的第二相对位置关系随时间变化的特征;以及Based on the target feature processing strategy, the position feature of the first target object and the position feature of the second target object are processed to obtain a second change feature, wherein the second change feature represents a feature of a second relative position relationship between the first target object and the second target object that changes over time; and 根据所述第二变化特征,得到所述识别结果。The recognition result is obtained according to the second change feature. 10.根据权利要求4所述的方法,其中,所述目标特征包括:第一目标对象的特征和第三目标对象的特征,所述第一目标对象的特征和所述第三目标对象的特征是从采集方向不同的至少两个图像中提取得到的;所述基于所述目标特征处理策略,对所述目标特征进行处理,得到所述识别结果,包括:10. The method according to claim 4, wherein the target features include: features of a first target object and features of a third target object, and the features of the first target object and the features of the third target object are extracted from at least two images with different acquisition directions; and the processing of the target features based on the target feature processing strategy to obtain the recognition result comprises: 基于所述目标特征处理策略,对所述第一目标对象的特征和第三目标对象的特征进行匹配,得到特征匹配结果;以及Based on the target feature processing strategy, matching the features of the first target object and the features of the third target object to obtain a feature matching result; and 在所述特征匹配结果满足预定阈值的情况下,根据所述第一目标对象的特征和所述第三目标对象的特征,得到所述识别结果。When the feature matching result meets a predetermined threshold, the recognition result is obtained according to the feature of the first target object and the feature of the third target object. 11.根据权利要求10所述的方法,其中,所述在所述特征匹配结果满足预定阈值的情况下,根据所述第一目标对象的特征和所述第三目标对象的特征,得到所述识别结果,包括:11. The method according to claim 10, wherein, when the feature matching result satisfies a predetermined threshold, obtaining the recognition result according to the feature of the first target object and the feature of the third target object comprises: 在所述特征匹配结果满足预定阈值的情况下,确定所述第一目标对象和所述第三目标对象为同一目标对象;When the feature matching result satisfies a predetermined threshold, determining that the first target object and the third target object are the same target object; 根据所述第一目标对象的特征和所述第三目标对象的特征,得到目标对象属性特征;以及Obtaining target object attribute features according to the features of the first target object and the features of the third target object; and 根据所述目标对象属性特征,得到所述识别结果。The recognition result is obtained according to the attribute characteristics of the target object. 12.一种图像识别装置,包括:12. An image recognition device, comprising: 第一获得模块,用于根据视频图像,得到待识别的时序图像序列;A first acquisition module is used to obtain a time-series image sequence to be identified based on the video image; 第二获得模块,用于响应于接收到针对目标识别任务的选择操作,从识别任务与处理策略的映射关系中得到与所述目标识别任务对应的目标处理策略,其中,所述目标处理策略包括与所述目标识别任务对应的组合处理策略,所述组合处理策略中的各处理策略的执行顺序是基于所述各处理策略的处理逻辑的关联关系确定的;所述目标识别任务包括以下任意一种:异常行为识别任务、目标属性特征识别任务和目标对象的行为轨迹识别任务;以及A second obtaining module is used for, in response to receiving a selection operation for a target recognition task, obtaining a target processing strategy corresponding to the target recognition task from a mapping relationship between recognition tasks and processing strategies, wherein the target processing strategy includes a combination processing strategy corresponding to the target recognition task, and the execution order of each processing strategy in the combination processing strategy is determined based on the association relationship of the processing logic of each processing strategy; the target recognition task includes any one of the following: an abnormal behavior recognition task, a target attribute feature recognition task, and a target object behavior trajectory recognition task; and 第三获得模块,用于基于与所述目标处理策略对应的目标处理路径,对所述待识别的时序图像序列进行处理,得到识别结果;所述目标处理策略包括目标特征提取策略和目标特征处理策略。The third acquisition module is used to process the time-series image sequence to be identified based on the target processing path corresponding to the target processing strategy to obtain the identification result; the target processing strategy includes a target feature extraction strategy and a target feature processing strategy. 13.根据权利要求12所述的装置,其中,所述第二获得模块包括:13. The apparatus according to claim 12, wherein the second obtaining module comprises: 确定单元,用于根据所述选择操作,确定目标识别任务的标识信息;以及a determining unit, configured to determine identification information of a target recognition task according to the selection operation; and 第一获得单元,用于根据所述目标识别任务的标识信息,从识别任务与处理策略的映射关系中得到所述目标处理策略信息。The first obtaining unit is used to obtain the target processing strategy information from the mapping relationship between the recognition task and the processing strategy according to the identification information of the target recognition task. 14.根据权利要求13所述的装置,其中,所述第一获得单元包括:14. The apparatus according to claim 13, wherein the first obtaining unit comprises: 第一获得子单元,用于根据所述目标识别任务的标识信息,从识别任务与处理策略的映射关系中,得到待选择处理策略信息;以及A first obtaining subunit is used to obtain the processing strategy information to be selected from the mapping relationship between the recognition task and the processing strategy according to the identification information of the target recognition task; and 第二获得子单元,用于响应于接收到的针对所述待选择处理策略信息的选择操作,得到所述目标处理策略。The second obtaining subunit is used to obtain the target processing strategy in response to the received selection operation for the to-be-selected processing strategy information. 15.根据权利要求12所述的装置,其中,所述第三获得模块包括:15. The device according to claim 12, wherein the third obtaining module comprises: 第二获得单元,用于基于所述目标特征提取策略,提取所述待识别的时序图像序列的目标特征;以及a second obtaining unit, configured to extract target features of the time-series image sequence to be identified based on the target feature extraction strategy; and 第三获得单元,用于基于所述目标特征处理策略,对所述目标特征进行处理,得到所述识别结果。The third obtaining unit is used to process the target feature based on the target feature processing strategy to obtain the recognition result. 16.根据权利要求15所述的装置,其中,所述目标特征包括空间关系特征,所述第三获得单元包括:16. The apparatus according to claim 15, wherein the target feature comprises a spatial relationship feature, and the third obtaining unit comprises: 第三获得子单元,用于基于所述目标特征处理策略,对所述空间关系特征进行处理,得到所述空间关系特征随时间变化的特征;以及A third obtaining subunit is used to process the spatial relationship feature based on the target feature processing strategy to obtain a feature of the spatial relationship feature changing over time; and 第四获得子单元,用于根据所述空间关系特征随时间变化的特征,得到所述识别结果。The fourth obtaining subunit is used to obtain the recognition result according to the characteristics of the spatial relationship characteristics that change over time. 17.根据权利要求15所述的装置,其中,所述目标特征包括第一目标对象的动作特征,所述第三获得单元包括:17. The device according to claim 15, wherein the target feature comprises an action feature of the first target object, and the third obtaining unit comprises: 第五获得子单元,用于基于所述目标特征处理策略,对所述第一目标对象的动作特征进行处理,得到所述第一目标对象的动作特征随时间变化的特征;以及a fifth obtaining subunit, configured to process the motion feature of the first target object based on the target feature processing strategy to obtain a feature of the motion feature of the first target object that changes over time; and 第六获得子单元,用于根据所述第一目标对象的动作特征随时间变化的特征,得到所述识别结果。The sixth obtaining subunit is used to obtain the recognition result according to the characteristics of the action characteristics of the first target object that change over time. 18.根据权利要求17所述的装置,其中,所述第一目标对象的动作特征表征第一目标对象的目标骨骼点特征,所述第六获得子单元用于:18. The device according to claim 17, wherein the action feature of the first target object represents a target skeleton point feature of the first target object, and the sixth obtaining subunit is used for: 基于所述目标特征处理策略,对所述目标骨骼点特征进行处理,得到目标骨骼点随时间变化的变化趋势特征;以及Based on the target feature processing strategy, the target skeleton point feature is processed to obtain a change trend feature of the target skeleton point over time; and 根据所述目标骨骼点随时间变化的变化趋势特征,得到所述第一目标对象的动作特征随时间变化的特征。According to the change trend characteristics of the target skeleton points over time, the characteristics of the action characteristics of the first target object changing over time are obtained. 19.根据权利要求15所述的装置,其中,所述目标特征包括目标区域的位置特征和第一目标对象的位置特征,所述第三获得单元包括:19. The device according to claim 15, wherein the target feature comprises a position feature of the target area and a position feature of the first target object, and the third obtaining unit comprises: 第七获得子单元,用于基于所述目标特征处理策略,对所述目标区域的位置特征和所述第一目标对象的位置特征进行处理,得到第一变化特征,其中,所述第一变化特征表征所述第一目标对象与所述目标区域的第一相对位置关系随时间变化的特征;以及a seventh obtaining subunit, configured to process the position feature of the target area and the position feature of the first target object based on the target feature processing strategy to obtain a first change feature, wherein the first change feature represents a feature of a first relative position relationship between the first target object and the target area that changes over time; and 第八获得子单元,用于根据所述第一变化特征,得到所述识别结果。An eighth obtaining subunit is used to obtain the recognition result according to the first change feature. 20.根据权利要求15所述的装置,其中,所述目标特征包括第一目标对象的位置特征和第二目标对象的位置特征,所述第三获得单元包括:20. The apparatus according to claim 15, wherein the target feature comprises a position feature of a first target object and a position feature of a second target object, and the third obtaining unit comprises: 第九获得子单元,用于基于所述目标特征处理策略,对所述第一目标对象的位置特征和所述第二目标对象的位置特征进行处理,得到第二变化特征,其中,所述第二变化特征表征所述第一目标对象和所述第二目标对象的第二相对位置关系随时间变化的特征;以及a ninth obtaining subunit, configured to process the position feature of the first target object and the position feature of the second target object based on the target feature processing strategy to obtain a second change feature, wherein the second change feature represents a feature of a second relative position relationship between the first target object and the second target object changing over time; and 第十获得子单元,用于根据所述第二变化特征,得到所述识别结果。The tenth obtaining subunit is used to obtain the recognition result according to the second change feature. 21.根据权利要求15所述的装置,其中,所述目标特征包括:第一目标对象的特征和第三目标对象的特征,所述第一目标对象的特征和所述第三目标对象的特征是从采集方向不同的至少两个图像中提取得到的;所述第三获得单元包括:21. The device according to claim 15, wherein the target features include: features of a first target object and features of a third target object, the features of the first target object and the features of the third target object are extracted from at least two images with different acquisition directions; and the third obtaining unit includes: 第十一获得子单元,用于基于所述目标特征处理策略,对所述第一目标对象的特征和第三目标对象的特征进行匹配,得到特征匹配结果;以及an eleventh obtaining subunit, configured to match the features of the first target object and the features of the third target object based on the target feature processing strategy to obtain a feature matching result; and 第十二获得子单元,用于在所述特征匹配结果满足预定阈值的情况下,根据所述第一目标对象的特征和所述第三目标对象的特征,得到所述识别结果。The twelfth obtaining subunit is used to obtain the recognition result according to the feature of the first target object and the feature of the third target object when the feature matching result meets a predetermined threshold. 22.根据权利要求21所述的装置,其中,所述第十二获得子单元用于:22. The apparatus according to claim 21, wherein the twelfth obtaining subunit is used for: 在所述特征匹配结果满足预定阈值的情况下,确定所述第一目标对象和所述第三目标对象为同一目标对象;When the feature matching result satisfies a predetermined threshold, determining that the first target object and the third target object are the same target object; 根据所述第一目标对象的特征和所述第三目标对象的特征,得到目标对象属性特征;以及Obtaining target object attribute features according to the features of the first target object and the features of the third target object; and 根据所述目标对象属性特征,得到所述识别结果。The recognition result is obtained according to the attribute characteristics of the target object. 23.一种电子设备,包括:23. An electronic device, comprising: 至少一个处理器;以及at least one processor; and 与所述至少一个处理器通信连接的存储器;其中,a memory communicatively connected to the at least one processor; wherein, 所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行权利要求1-11中任一项所述的方法。The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 11. 24.一种存储有计算机指令的非瞬时计算机可读存储介质,其中,所述计算机指令用于使所述计算机执行根据权利要求1-11中任一项所述的方法。24. A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the method according to any one of claims 1-11. 25.一种计算机程序产品,包括计算机程序,所述计算机程序在被处理器执行时实现根据权利要求1-11中任一项所述的方法。25. A computer program product comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 11.
CN202211533716.9A 2022-11-29 2022-11-29 Image recognition method, device, electronic equipment and storage medium Active CN116189028B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211533716.9A CN116189028B (en) 2022-11-29 2022-11-29 Image recognition method, device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211533716.9A CN116189028B (en) 2022-11-29 2022-11-29 Image recognition method, device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN116189028A CN116189028A (en) 2023-05-30
CN116189028B true CN116189028B (en) 2024-06-21

Family

ID=86451238

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211533716.9A Active CN116189028B (en) 2022-11-29 2022-11-29 Image recognition method, device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116189028B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110472554A (en) * 2019-08-12 2019-11-19 南京邮电大学 Table tennis action identification method and system based on posture segmentation and crucial point feature
CN114723966A (en) * 2022-03-30 2022-07-08 北京百度网讯科技有限公司 Multi-task recognition method, training method, device, electronic device and storage medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9355123B2 (en) * 2013-07-19 2016-05-31 Nant Holdings Ip, Llc Fast recognition algorithm processing, systems and methods
US11334709B2 (en) * 2018-11-13 2022-05-17 International Business Machines Corporation Contextually adjusting device notifications
CN112580557A (en) * 2020-12-25 2021-03-30 深圳市优必选科技股份有限公司 Behavior recognition method and device, terminal equipment and readable storage medium
CN114005053A (en) * 2021-09-17 2022-02-01 阿里巴巴达摩院(杭州)科技有限公司 Video processing method, video processing device, computer equipment and computer-readable storage medium
CN114332670A (en) * 2021-10-15 2022-04-12 腾讯科技(深圳)有限公司 Video behavior recognition method, device, computer equipment and storage medium
CN114863320B (en) * 2022-04-06 2025-02-18 斑马网络技术有限公司 Target object behavior recognition method, device, electronic device and medium
CN114779937B (en) * 2022-04-28 2025-01-14 脑陆(重庆)智能科技研究院有限公司 Multimedia interactive imaging method, device, storage medium and computer program product

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110472554A (en) * 2019-08-12 2019-11-19 南京邮电大学 Table tennis action identification method and system based on posture segmentation and crucial point feature
CN114723966A (en) * 2022-03-30 2022-07-08 北京百度网讯科技有限公司 Multi-task recognition method, training method, device, electronic device and storage medium

Also Published As

Publication number Publication date
CN116189028A (en) 2023-05-30

Similar Documents

Publication Publication Date Title
CN112528850B (en) Human body recognition method, device, equipment and storage medium
CN113361603B (en) Training method, category identification device, electronic device, and storage medium
WO2019196534A1 (en) Verification code-based human-computer recognition method and apparatus
CN114187392B (en) Method, device and electronic device for generating virtual idol
US20220139061A1 (en) Model training method and apparatus, keypoint positioning method and apparatus, device and medium
CN115690545B (en) Method and device for training target tracking model and target tracking
CN111178323A (en) Video-based group behavior identification method, device, equipment and storage medium
CN112860068B (en) Man-machine interaction method, device, electronic equipment, medium and computer program product
US20220284678A1 (en) Method and apparatus for processing face information and electronic device and storage medium
CN113642519A (en) Face recognition system and face recognition method
CN114360053B (en) A motion recognition method, terminal and storage medium
JP2023040201A (en) Face recognition method and device, apparatus and storage medium
CN112507833A (en) Face recognition and model training method, device, equipment and storage medium
CN114140851B (en) Image detection method and method for training an image detection model
CN114549926A (en) Target detection and target detection model training method and device
CN116189028B (en) Image recognition method, device, electronic equipment and storage medium
CN113642472A (en) The training method of the discriminator model and the action recognition method
CN109600627B (en) Video identification method and device
CN116453222B (en) Target object posture determining method, training device and storage medium
CN116703963A (en) An AR tracking method, device, AR equipment and storage medium
CN111767676B (en) Method and apparatus for predicting a result of a personal change operation
CN114550269A (en) Mask wearing detection method, equipment and medium
CN115311723A (en) Living body detection method, living body detection device and computer-readable storage medium
CN114648814A (en) Face liveness detection method and model training method, device, equipment and medium
CN114998963A (en) Image detection method and method for training image detection model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant