[go: up one dir, main page]

Jagabathula et al., 2017 - Google Patents

Identifying unreliable and adversarial workers in crowdsourced labeling tasks

Jagabathula et al., 2017

View PDF
Document ID
7110436072318438367
Author
Jagabathula S
Subramanian L
Venkataraman A
Publication year
Publication venue
Journal of Machine Learning Research

External Links

Snippet

We study the problem of identifying unreliable and adversarial workers in crowdsourcing systems where workers (or users) provide labels for tasks (or items). Most existing studies assume that worker responses follow specific probabilistic models; however, recent …
Continue reading at www.jmlr.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management, e.g. organising, planning, scheduling or allocating time, human or machine resources; Enterprise planning; Organisational models
    • G06Q10/063—Operations research or analysis
    • G06Q10/0631—Resource planning, allocation or scheduling for a business operation
    • G06Q10/06311—Scheduling, planning or task assignment for a person or group
    • G06Q10/063114—Status monitoring or status determination for a person or group
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management, e.g. organising, planning, scheduling or allocating time, human or machine resources; Enterprise planning; Organisational models
    • G06Q10/063—Operations research or analysis
    • G06Q10/0633—Workflow analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management, e.g. organising, planning, scheduling or allocating time, human or machine resources; Enterprise planning; Organisational models
    • G06Q10/063—Operations research or analysis
    • G06Q10/0639—Performance analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading, distribution or shipping; Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • G06Q10/083—Shipping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation, e.g. computer aided management of electronic mail or groupware; Time management, e.g. calendars, reminders, meetings or time accounting
    • G06Q10/101—Collaborative creation of products or services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/55—Detecting local intrusion or implementing counter-measures

Similar Documents

Publication Publication Date Title
Jagabathula et al. Identifying unreliable and adversarial workers in crowdsourced labeling tasks
Wang et al. Attack of the tails: Yes, you really can backdoor federated learning
Minku et al. Software effort estimation as a multiobjective learning problem
Burnett et al. Stereotypical trust and bias in dynamic multiagent systems
Rayana et al. Collective opinion spam detection using active inference
US12278907B2 (en) Apparatus for secure multiparty computations for machine-learning
US11558580B1 (en) Apparatus and method for generating a video record using audio
US11863676B1 (en) Apparatus and methods for minting non-fungible tokens (NFTS) from user-specific products and data
US20230252416A1 (en) Apparatuses and methods for linking action data to an immutable sequential listing identifier of a user
Węgier et al. Multicriteria classifier ensemble learning for imbalanced data
US20240283649A1 (en) Apparatus and methods for automated credential generation
US20240080198A1 (en) Apparatus and method for contingent assignment actions
Liu et al. Cross-silo federated learning with record-level personalized differential privacy
Zhong et al. Simplifying node classification on heterophilous graphs with compatible label propagation
Cyphers et al. AnonML: Locally private machine learning over a network of peers
US20240028986A1 (en) Apparatus and method for generation an action validation protocol
Solans et al. Non-IID data in federated learning: A survey with taxonomy, metrics, methods, frameworks and future directions
Fang et al. Robust asymmetric heterogeneous federated learning with corrupted clients
Kanamori et al. Theoretical analysis of density ratio estimation
An et al. FREB: Participant selection in federated learning with reputation evaluation and blockchain
Yuan et al. A two-part machine learning approach to characterizing network interference in a/b testing
US12406206B2 (en) Apparatus and method for integrating a plurality of proximate provider data structures in a digital environment
US12169726B2 (en) Apparatus and method for generating user guidance on a decentralized platform
US12190213B2 (en) Apparatus and method for generating tailored user specific encouragement prompts
Gao et al. Semiring-based trust evaluation for information fusion in social network services