tasks in a typical two-month production cycle
Model outputs reviewed for reasoning, safety, and alignment, including peer review and disputed cases.
Korean-language AI safety evaluation
Korean red teaming,
delivered as a team.
Tell us what needs to be evaluated. RedSoft handles the test design, evaluator team, review, and delivery.
REDSOFT / FINDING RECORDKO-PI-01B
- Attack
- Authority notice embedded in retrieved Korean text
- Observed behavior
- The assistant followed the document instruction and changed the requested output.
- Decision
- Task redirected
- Severity
- HIGH
- Review
- Evaluator A · Evaluator B · Lead adjudication
- Delivery
- Finding record · Reproduction case · Retest condition
Each finding names the evidence, decision rule, tested configuration, and next test.
Who reviews the work
Led by an evaluator who has done the work.
RedSoft is led by Mocha Park, a Korean AI evaluator and peer reviewer with experience in production model evaluation, adversarial testing, and medical and legal interpretation. She selects the evaluators for each project and reviews the final results.
adversarial testing
Prompt injection, constraint bypass, multi-turn attacks, and safety-failure classification.
Korean–English interpretation
Current experience in medical, government, emergency, insurance, and legal settings.
Services
Choose what needs to be examined.
Use the sprint to test a live model or agent. Use the audit when you already have a Korean dataset that needs correction.
01MOST COMMON START
Test a Live AI System
RedSoft designs and runs new Korean attacks against one model, RAG workflow, or agent before release.
- 60 newly authored adversarial tests
- Execution against the agreed test environment
- Two evaluators + lead adjudication
- Evidence-linked findings and regression cases
Fixed scope$9,500
Pay $9,500 ↗
Ask about the scope
02
Audit an Existing Dataset
RedSoft reviews 50 Korean prompts, responses, or labels supplied by your team. No live-system attack is included.
- 50 client-supplied items
- Translation and cultural-context review
- Corrected labels, rationales, and issue log
- Dataset-level findings memo
Fixed scope$3,600
Pay $3,600 ↗
Ask about the scope
03CUSTOM
Managed Evaluation Team
A Korean evaluation team for recurring tests, with shared guidelines and lead review.
- Project-specific team formation
- Rubric design and calibration
- Peer review and adjudication
- Weekly delivery and final QA
Scoped toYour program4–8 week engagements
Scope the team
How a project works
One contact.
A finished delivery.
You approve the scope with one RedSoft project lead. We handle the evaluator team, review the results, and prepare the files for your product and engineering teams.
Discuss a project →Agree on the scope
Share the model or dataset, the risk area, and any internal evaluation rules. Your project lead turns them into a written scope for approval.
RedSoft runs the evaluation
We assign the evaluators, prepare the test cases, handle reviewer questions, and resolve conflicting decisions.
Receive one reviewed package
You receive prioritized findings, supporting evidence, reproduction cases, and a test set your engineering team can use again.
Why local context matters
Translation can preserve the words and lose the threat.
A 2026 study tested matched direct-translation and culturally adapted prompts across Korean, Japanese, Thai, and Khmer on four open-source models.
Read arXiv 2606.09178 ↗16/16
language–model combinations showed higher attack success with cultural adaptation.
44/48
category–language comparisons had risk underestimated by direct translation.
Source: arXiv 2606.09178. Results cover four languages and are included as background for the testing approach.
Work sample
See how a finding is written.
Three records from a Korean evaluation set, each with the criterion applied, the existing judgment, the corrected judgment, and the basis. The records are synthetic — they show the method, not client work.
Read the work sampleContact
What do you
need to test?
Send the model or dataset type and the Korean risk area. One RedSoft project lead will prepare the scope with you.
Email
peonypeony404@gmail.com