Risk Operations AI Specialist (Web3)

TL;DR

Risk Operations AI Specialist (Web3): Managing the human-in-the-loop process for the ROCA AI agent by reviewing escalated risk cases and providing structured feedback for model optimization with an accent on AI precision and recall improvement. Focus on labeling root-cause annotations, updating SOPs, and refining automated decision pipelines.

Location: Remote (Asia)

Company

Binance is a leading global blockchain ecosystem and the world’s largest cryptocurrency exchange by trading volume and registered users.

What you will do

• Review high-risk cases (KYC Audit, ATO, 2FA Reset, etc.) where the AI confidence score falls below the auto-decision threshold.
• Label cases as TP/TN/FP/FN with structured root-cause annotations to feed the ROCA continuous learning pipeline.
• Identify and report feature weight biases, threshold miscalibrations, and SOP gaps to Data and Model teams.
• Contribute to achieving Precision (>95%) and Recall (>99%) targets through systematic signal failure analysis.
• Maintain and update Confluence SOP pages to improve first-pass AI accuracy.
• Onboard and calibrate BPO agents on AI-assisted review workflows and monitor quality benchmarks.

Requirements

• 2+ years of experience in fraud review, risk operations, or KYC/KYB case management.
• Hands-on experience with Account Takeover (ATO) detection and investigation.
• Comfort working in AI-augmented workflows and interpreting model confidence scores.
• Bilingual proficiency in English and Mandarin is required for coordination with overseas partners.
• Ability to provide precise, structured root-cause documentation for ML engineers.
• Must be based in Asia.

Nice to have

• Experience in crypto, Web3, or VASP risk environments and blockchain transaction patterns.
• Understanding of ML model evaluation concepts such as Precision, Recall, F1, and confusion matrices.
• Familiarity with prompt engineering or LLM evaluation workflows.
• CAMS, CFE, or equivalent AML/fraud certifications.
• Prior experience in SOP authoring or BPO oversight for risk operations.

Culture & Benefits

• Opportunity to shape the future of the world's leading blockchain ecosystem.
• Collaboration with world-class talent in a user-centric organization with a flat structure.
• Results-driven workplace with high autonomy and opportunities for career growth.
• Competitive salary and comprehensive company benefits.
• Work-from-home arrangement.