KR20200078947A - Method and device for work capability evaluation based on online history data - Google Patents

Abstract

The present invention relates to an online history data-based programmer capability evaluation method performed by a server, the method comprising: receiving history information of a programmer; Based on the history information, quantifying the capabilities of the programmer for each predetermined item using a preset evaluation method; And outputting an analysis result of the digitized item programmer competency. It includes.

Description

METHOD AND DEVICE FOR WORK CAPABILITY EVALUATION BASED ON ONLINE HISTORY DATA}

The present invention relates to a method and apparatus for evaluating a capability of an online history data-based programmer, and more particularly, to a method for evaluating and analyzing a capability of a programmer based on history information performed by a programmer.

Beginning with the development of manufacturing-oriented industries, as the fourth industrial revolution, such as data analysis and processing, in which data processing is complex, information processing experts are increasingly required.

In particular, a large number of programmers in the software field are required, and according to the needs, the number of people receiving software education has been increasing since the lower grades of elementary school.

As the number of software workers gradually increased, he became responsible for various fields of practice, and programmers with various spectrums are also working in the field in terms of skill.

In terms of businesses that need these programmers as employees or service personnel, it is not easy to filter programmers that are suitable for their work among too many programmers, and it is not easy to obtain information about the professionalism of the work as well as the relationship with the work. not.

Accordingly, there is an increasing need for a method for evaluating the capability of programmers by comparing them with existing work processing histories.

However, if the subjective opinion of the evaluator is included in the aspect of evaluation, the objectivity of the evaluation is lowered. Therefore, for fair evaluation, it is necessary to output the numerical evaluation results based on objective items.

The present invention is to solve the problems of the prior art described above, and in the present invention, the history information of the programmer as well as the programmer himself can be collected and digitized.

In addition, the present invention can not only quantify the programmer's history, but also provide career matching suitable for the history or provide educational content that can enhance the programmer's capabilities. Furthermore, it can be used to enhance the competitiveness of companies by measuring the capabilities and speed of development of individual developers at the enterprise or development organizational level.

In one embodiment of the present invention, an online history data-based programmer capability evaluation method performed by a server, comprising: receiving history information of a programmer; Based on the history information, quantifying the capabilities of the programmer for each predetermined item using a preset evaluation method; And outputting an analysis result of the digitized item programmer competency. It includes.

Another embodiment of the present invention, the programmer capability evaluation server, the history information receiving unit for receiving the history information of the programmer; A capability evaluation unit that quantifies the capabilities of the programmer for each predetermined item using a preset evaluation method based on the history information; And a capability information output unit that outputs an analysis result of the programmer capability for each numerical item.

The present invention relates to a method for evaluating a programmer's ability, and the programmer's ability can be evaluated with an objective value.

In addition, according to the present invention, it is possible to provide a career matching service suitable for a history to a programmer, and provide educational content for strengthening a programmer's capabilities. Furthermore, since the capability and speed of development of programmers can be quantitatively measured at the enterprise or development organizational unit, it is possible to enhance the competitiveness of the company through efficiency in talent management and evaluation of talent capabilities.

1 is a block diagram showing a programmer capability evaluation method according to an embodiment of the present invention.
2 is a flowchart illustrating a programmer capability evaluation process according to an embodiment of the present invention.
3 is a block diagram conceptually showing input/output information of an analysis server according to an embodiment of the present invention.
4 is a block diagram conceptually showing the structure of an analysis server according to an embodiment of the present invention.
5 is a view showing an example of a competency evaluation report according to an embodiment of the present invention.
6 is a view showing an example of a career matching report according to an embodiment of the present invention.
7 is a diagram showing an example of an educational content recommendation report for capacity enhancement according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present invention pertains can easily practice. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. In addition, in order to clearly describe the present invention in the drawings, parts irrelevant to the description are omitted, and like reference numerals are assigned to similar parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with other elements in between. . Also, when a part “includes” a certain component, this means that other components may be further included, rather than excluding other components, unless otherwise specified.

In the present specification, the term “unit” includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be realized by using two or more hardware, and two or more units may be realized by one hardware. Meanwhile,'~unit' is not limited to software or hardware, and'~unit' may be configured to be in an addressable storage medium or may be configured to reproduce one or more processors. Thus, as an example,'~ unit' refers to components such as software components, object-oriented software components, class components and task components, processes, functions, attributes, and procedures. , Subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, database, data structures, tables, arrays and variables. The functions provided within components and'~units' may be combined into a smaller number of components and'~units', or further separated into additional components and'~units'. In addition, the components and'~ unit' may be implemented to play one or more CPUs in the device or secure multimedia card.

The "user terminal" mentioned below may be implemented as a computer or a portable terminal capable of accessing a server or another terminal through a network. Here, the computer includes, for example, a laptop equipped with a web browser (WEB Browser), a desktop (desktop), a laptop (laptop), and the like, and the portable terminal is, for example, a wireless communication device that guarantees portability and mobility. , International Mobile Telecommunication (IMT)-2000, Code Division Multiple Access (CDMA)-2000, W-Code Division Multiple Access (W-CDMA), Wireless Broadband Internet (Wibro), Long Term Evolution (LTE) communication based terminal, smart It may include all kinds of handheld-based wireless communication devices, such as phones, tablet PCs, and the like. In addition, the "network" is a wired network or a mobile radio communication network or satellite, such as a local area network (LAN), a wide area network (WAN), or a value added network (VAN). It can be implemented with any kind of wireless network, such as a communication network.

1 is a block diagram showing a programmer capability evaluation method according to an embodiment of the present invention.

1, the programmer capability evaluation system 100 includes an analysis server 101, the analysis server 101 receives the programmer history information from the user terminal 102, external server 103, The result of capability evaluation by analyzing the history information may be provided to the enterprise terminal 104 and the user terminal 105.

The analysis server 101 may have an algorithm for analyzing a programmer's capabilities based on the programmer's history information, and a detailed description thereof will be described later.

It is sufficient if the user terminal 102 is a terminal for a programmer to transmit his/her history information to the analysis server 101. Various terminals, such as a PC, a tablet, and a smart phone, may correspond to this.

The external server 103 can be widely understood as an online server operated by a programmer. For example, if the programmer has been active in a service or community providing a source code repository such as github, the operating server of github may correspond to the external server 103. In addition, a server capable of acquiring programmer's online activity information is sufficient even if it is not a site where the programmer directly accesses and operates.

The corporate terminal 104 is sufficient to be a terminal used by a company or a company that wants to obtain programmer's capability information for hiring or servicing a programmer. Various terminals, such as a PC, a tablet, and a smart phone, may correspond to this.

It is sufficient if the user terminal 105 is a terminal for a programmer to acquire the evaluated capability information.

2 is a flowchart illustrating a programmer capability evaluation process according to an embodiment of the present invention.

As shown in FIG. 2, the programmer capability evaluation server may receive the history information of the programmer (S210 ).

The method of receiving the programmer's history information may vary. In the most general way, it is a method of acquiring the input history information by inputting the programmer's history information directly from the programmer.

The history information that can be obtained by directly inputting from the programmer may include history information of the cloud coding test service. Among the cloud coding tests, information such as scores, ranks, and percentiles may be included as actual test or mock test results.

The history information that can be obtained by directly inputting from a programmer may include development history information in a cloud integrated development environment. The development history information may include information such as service access history, code writing history (type of amount, speed, project scale), number of projects, number of recommendations for each project, stack information or language information used in the project.

The history information that can be obtained by directly inputting from a programmer may include a learning history in the cloud SW education environment. Learning history information may include the number and frequency of accesses, test scores, achievements, and percentiles. In addition, specifically, information such as a learning history in the public education service and a learning history (elementary, secondary, high school, university, institution, etc.) generated while using the service for each life cycle may be included.

The history information that can be obtained by directly inputting from the programmer may include, in addition to the above-mentioned items, stack information of the software that the programmer himself is confident of, mainly dealing with, or of dealing with software well, or information related to the programmer's blog and internet posting.

History information that can be obtained by crawling the Internet through an external server rather than a programmer may include history information of a source code repository service such as github and gitlab. Includes the level and number of projects the programmer participated in on the site, the number of stars given to the project, recognition, information contributed to open source, the frequency of commits, PR times, and the degree of contribution to other owned projects. can do.

The history information that can be obtained by crawling the Internet through an external server, not a programmer, may include the number of questions and answers at the stackoverflow site. It may include information on the number of answers on the site, the quality of the answers (which can be evaluated based on a selected number, like rate, etc.).

Historical information that can be obtained by crawling the Internet through an external server rather than a programmer may include reputation data from search engines (eg, Google) and SNS (eg, Facebook, Twitter). Specifically, the number of followers, the number of friends, the number of mentions, how central it is in networking with other developers (which can be judged through graph analysis), the information exposed by search engines, the information exposed to the media, etc. It can contain.

The analysis server may quantify the programmer's capabilities for each predetermined item (S220). The items that can be quantified by the analysis server can be various, such as expertise, thinking ability, problem solving ability, design ability, consistency, productivity, self-development speed, community activity, reputation, and project experience. The above examples are for convenience of explanation, and evaluation items may be various without being limited thereto.

The analysis server may output an analysis result of the programmer competence for each item (S230). The analysis result for each item may be simply output, and information for matching a career suitable for the analyzed capability and content information necessary for strengthening the analyzed capability may be provided. In addition, the analysis result of the programmer's competence for each numerical item may further include a comparison order of the programmers among all programmers using the numerical items of other programmers.

3 is a block diagram conceptually showing input/output information of an analysis server according to an embodiment of the present invention.

As shown in FIG. 3, the programmer history information 301 and 302 input to the analysis server 300 will be omitted because they have been described in detail in FIG. 2 above.

The analysis server 300 may output programmer's competency analysis result information, and the programmer's competency objective numerical result information 310, career matching and recommendation result information 320, and training contents for competency enhancement Information 330 may be included.

The programmer's competency objective digitization result information 310 may include pre-set numerical information for each item, and, for example, a rating of an item such as consistency.

As an example of the evaluation of the steady-state item, a case in which a programmer works daily at an interval of a working time within a project period may be set as the highest point, and a case where the work is performed by focusing on a specific date may be set as the lowest point. And, by analyzing work time information between the highest and lowest points, the steady-state item can be quantified.

As an example of the evaluation of the productivity item, a numerical evaluation can be performed based on the number of completed projects, the number of implemented functions, etc. as the amount of work within the working time.

As an example of the evaluation of the self-development speed item, a numerical evaluation can be performed based on the number of languages that a programmer can speak and the number of projects that can be handled.

As an example of the evaluation of community activity items, participation in github, gitlab, etc. can be evaluated numerically and in open source forums, and more specifically, in addition to quantitative evaluation of activities, the size of participating forums, other programmers It can be evaluated numerically based on the positive/negative feedback information of their feedback.

As an example of evaluating project experience items, a numerical evaluation can be performed based on information such as the title, size, work duration, and project output of a project in which a programmer participates.

Although the above numerical methods were described in a manner of evaluating within the highest to lowest points with only the history information of the programmer, it is also possible to quantify or re-adjust the numerical value by evaluating the relative competence with other programmers, which are other evaluation targets. Do. For example, while most programmers still lack skills for a project that fits the latest trends, if a specific programmer is assessed at a proficient level of skill rather than insufficient, it is possible to further evaluate the value of that evaluation. .

In the above description, for convenience of explanation, the numerical methods of a limited number of items have been described as an example, but it is not necessarily limited thereto, and it is necessary to note that the evaluation items can also be changed according to the purpose of evaluation.

Further, as a further embodiment, the capability analysis result information may additionally include task concentration evaluation information or peer review information between colleagues. For example, peer review information may be constructed by collecting qualitative or quantitative evaluation information of a specific programmer provided from colleagues who have worked together.

4 is a block diagram conceptually showing the structure of an analysis server according to an embodiment of the present invention.

As shown in FIG. 4, the analysis server 400 may include a history information receiving unit 410, a capability evaluation unit 420, and a capability information output unit 430.

The history information receiving unit 410 may obtain and receive history information directly from a programmer, or obtain history information by crawling the Internet through an external server.

The competency evaluation unit 420 may evaluate the acquired programmer's history information for each predetermined item. For example, the programmer's competency can be quantified by items such as consistency, productivity, self-development speed, community activities, reputation, and project experience.

The competency information output unit 430 may output programmer capability analysis result information analyzed for each item. It can be simply output for each item, and in some cases, it can provide employment information matching careers suitable for competency. When it is determined that the analysis server is insufficient in a specific competency, education content information capable of enhancing the insufficient competency may be provided together.

5 is a view showing an example of a competency evaluation report according to an embodiment of the present invention.

As shown in FIG. 5, the capability analysis result information of the programmer evaluated by the analysis server may be output as an item of the capability evaluation report. Identification information (name, age, career, etc.) that can identify the programmer and numerical information for each predetermined item may be visually displayed. In addition, it is possible to improve objectivity by displaying the basis information and the calculation history information on the evaluation result based on what criteria the numerical evaluation was performed.

The competency evaluation report may be provided to the enterprise terminal 104 at the request of the enterprise terminal 104 or may be provided to the user terminal 105. When provided to the enterprise terminal 104, the competency of the candidate can be seen at a glance It is a basis data that can be easily grasped, and when provided to the user terminal 105, the programmer himself/herself to be evaluated can receive it and use it as an index for capacity enhancement.

In addition, the items in the competency evaluation report can be changed depending on the purpose of the subject to be evaluated, and the form of the graph can be changed to a form suitable for the number of items.

The competency evaluation report is web-based and can be issued online, and can be output in the form of an electronic file (eg, PDF). In addition, through verification of the authenticity of the contents, etc., it is possible to receive the proof of contents from a third party and secure the authenticity of the contents.

6 is a view showing an example of a career matching report according to an embodiment of the present invention. The career matching report may be provided to the user terminal 105 at the request of the user terminal 105.

As shown in FIG. 6, the analysis server may provide employment information suitable for a career based on competency evaluation information of a programmer who is an evaluation target. Specifically, the analysis server can measure each evaluation item (eg, steadiness, productivity, self-development speed, community activity, reputation, project experience, etc.) in programmer competency evaluation information and items. Based on the scores for each job, scores for each occupation group can be calculated. For example, the A programmer obtained 80 points for the occupation group of the advertising marketing company, but may be calculated to obtain 70 points for the occupation group of the defense industry. Based on this, the company with the highest score for the programmer can be recommended through the Career Matching Recommendation Report. For example, in case a job group a, c job group, and d job group are calculated as the highest score for the programmer A, information on any one company in job a can be extracted and suggested through a recommendation report. a Any one of a plurality of companies included in the job group may be recommended, but the evaluation item scores of the programmers who have applied or passed the plurality of companies and the evaluation item scores of the programmers are compared to rank the recommendations for the plurality of companies. It can also be calculated and suggested. At this time, when selecting any one company information in the relevant job group, it is possible to comply with specific criteria, but it is also possible to preferentially select the information of the company that paid the advertisement. In this way, for example, when the programmer A is highly rated in the competency category for data mining on SNS, it is possible to provide company information that has posted a job posting related to data mining on SNS. In addition, if the B programmer has a high evaluation of the contribution to open source, it can provide information on companies that use open source with high contribution. In addition, as shown in Figure 6, by providing a UI for an interview request button, a button to apply immediately, etc., it can be directly linked to employment.

7 is a view showing an example of an educational content recommendation report for capacity enhancement according to an embodiment of the present invention.

As illustrated in FIG. 7, educational content information related to an item for which enhancement is required may be provided to a programmer, or participation activity information may be provided.

Specifically, when it is determined that the score of one field is low according to the programmer's competency evaluation information, it is possible to recommend educational content, offline event content, and the like in that field.

For example, if a C programmer has no experience in developing a specific language that is expected to be used in the future, it may be recommended to provide training content information for the language to strengthen the competency in the specific language. In addition, according to the curriculum of the relevant education content, information on how much the competency number will be improved when education is completed can be provided together.

In addition, it can provide information about online/offline meetings that can participate in addition to educational contents. For example, if you are acting on a specific developer forum, you can also provide information that your community activity item's competency score can be improved.

And, in the report, buttons such as special lecture application and consulting application can be provided directly to access/apply to the relevant educational content or meeting.

One embodiment of the invention may also be implemented in the form of a recording medium comprising instructions executable by a computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically include computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism, and includes any information delivery media.

Although the methods and systems of the present invention have been described in connection with specific embodiments, some or all of their components or operations may be implemented using a computer system having a general purpose hardware architecture.

The above description of the present invention is for illustration only, and a person having ordinary knowledge in the technical field to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and it should be interpreted that all changes or modified forms derived from the meaning and scope of the claims and equivalent concepts thereof are included in the scope of the present invention. do.

101: analysis server

Claims (10)

In the online history data-based programmer competency evaluation method performed by the server,
Receiving historical information of the programmer;
Based on the history information, quantifying the capabilities of the programmer for each predetermined item using a preset evaluation method; And
Outputting an analysis result of the digitized item programmer capability;
Including, programmer competency evaluation method. According to claim 1,
The method of receiving the history information of the programmer,
As a method of receiving the history information of the programmer input to the terminal of the programmer,
The programmer's history information includes at least one of a history of taking a cloud coding test service, a history of development in a cloud integrated development environment, and a history of learning in a cloud SW education environment. According to claim 1,
The method of receiving the history information of the programmer is a method of obtaining the history information of the programmer through internet crawling,
The programmer's history information, at least one of the history of the source code repository service, the number of questions and answers on a particular website, and reputation data in search engines and SNS, etc., programmer capability evaluation method. According to claim 1,
The preset item,
Includes at least one of professionalism, thinking ability, problem solving ability, design ability, productivity, self-development speed, community activities, reputation and project experience,
The analysis result of the programmer competence for each digitized item may further include a comparison rank of the programmer among all programmers using the digitized items of other programmers. According to claim 1,
The step of outputting the result of analyzing the programmer capability for each of the quantified items is
The career matching information of the programmer and educational content information for enhancing the programmer's competency are output,
When outputting the career matching information of the programmer,
Based on each evaluation item and evaluation item score for programmer competency, the programmer calculates the score for each occupation group, extracts the preset number of occupation groups with the highest score, and belongs to each occupation group for each extracted occupation group Information on a plurality of companies is selected and output as a recommendation company, but the evaluation item scores of the programmers who have applied or passed the plurality of companies are compared with the evaluation item scores of the programmers to calculate the recommendation rank for the plurality of companies Characterized in that it outputs, the programmer competency evaluation method. On the Programmer Competency Assessment Server,
A history information receiving unit for receiving history information of the programmer;
A capability evaluation unit that quantifies the programmer's capabilities for each predetermined item by using a preset evaluation method based on the history information; And
A competency information output unit that outputs an analysis result of the programmer competency for each of the quantified items
Characterized in that it comprises, a programmer competency evaluation server. The method of claim 6,
The history information receiving unit,
Receiving the history information of the programmer input to the terminal of the programmer,
The programmer's history information includes at least one of a history of taking a cloud coding test service, a history of development in a cloud integrated development environment, and a history of learning in a cloud SW education environment, a programmer capability evaluation server. The method of claim 6,
The history information receiving unit,
Acquiring the history information of the programmer through internet crawling,
The programmer's history information includes at least one of the history of the source code repository service, the number of questions and answers on a specific website, and reputation data in a search engine and SNS. The method of claim 6,
The preset item,
A programmer competency assessment server, comprising at least one of productivity, self-development speed, community activities, reputation and project experience. The method of claim 6,
The capability information output unit,
The career matching information of the programmer and educational content information for enhancing the programmer's competency are output,
When outputting the career matching information of the programmer,
Based on each evaluation item and evaluation item score for programmer competency, the programmer calculates the score for each occupation group, extracts the preset number of occupation groups with the highest score, and belongs to each occupation group for each extracted occupation group Information about any one of a plurality of companies is selected and output as a recommendation company, but the evaluation item scores of the programmers who have applied to or passed the plurality of companies are compared with the evaluation item scores of the programmers to the plurality of companies. A programmer's competency evaluation server, characterized by calculating and outputting a recommendation ranking.

Images