Conversational AI Data Annotator

Dearborn, MI

Full Time

Mid Level

MARTIN Technologies | Dearborn, MI
Openings: 3
Schedule: Morning | 9:00 a.m.–5:00 p.m.
Overtime availability required as needed

Better AI Starts with Careful Human Judgment.

MARTIN Technologies is seeking detail-oriented Conversational AI Data Annotators to help improve chatbot accuracy, reliability, and response quality. You will review text and audio conversations, apply approved evaluation guidelines, and provide clear feedback that helps technical teams understand where responses succeed and where improvements are needed.

This opportunity is ideal for someone who combines analytical thinking, strong English communication, and consistent judgment with the discipline to perform accurate, repeatable reviews.

The MARTIN Legacy

For 30+ years, MARTIN has delivered automotive engineering and manufacturing expertise, supporting innovation across automotive, motorsports, aerospace, defense, and marine industries. Join a team that brings precision, quality, and practical problem-solving to evolving technologies.

What You Will Do

Review chatbot conversations, individual responses, retrieved content, citations, and related metadata using customer-approved tools.

Annotate conversational AI data, including text and audio, using approved labeling guidelines, taxonomies, and decision rules.

Complete required labels, concise rationales, confidence assessments, and ambiguity indicators.

Evaluate intent recognition, task completion, correctness, completeness, relevance, and overall response quality.

Check whether responses are supported by available evidence and whether sources are attributed correctly.

Identify factual errors, unsupported claims, incomplete answers, safety concerns, and policy issues.

Assign approved failure categories and identify when escalation or specialist review is needed.

Escalate ambiguous or sensitive cases and situations not covered by existing guidance. Do not create independent standards.

Participate in onboarding, calibration sessions, refresher training, quality reviews, and adjudication discussions.

Perform first-level quality checks and correct errors identified during review.

Maintain accurate annotation records, quality results, exceptions, escalations, and open issues.

Prepare weekly reports covering completed volume, productivity, quality, backlog, risks, guideline gaps, and required actions.

Recommend improvements to labeling guidance based on recurring issues. Implement changes only after customer approval.

What You Bring

Experience labeling conversational AI data, including text and audio.

Professional fluency in English, with strong reading comprehension and written communication.

Ability to interpret and consistently apply detailed guidelines and decision rules.

Strong analytical judgment and attention to detail.

Ability to explain labeling decisions through clear, concise written rationales.

Consistent accuracy when performing repetitive tasks while meeting quality and turnaround expectations.

Ability to incorporate feedback and adjust decisions as approved guidelines evolve.

Experience preparing clear progress and quality reports.

Bachelor’s degree.

Preferred Experience

Automotive industry knowledge.

Experience supporting large-scale conversational AI, technology, or data-annotation programs.

Master’s degree.

Core Skills

Text and audio annotation • Chatbot evaluation • Guideline interpretation • Evidence and citation review • Written rationales • Quality checks • Issue escalation • Weekly reporting

Work Authorization and Screening

Applicants must currently reside in the United States and be authorized to work in the United States. Visa sponsorship is unavailable now or in the future. Applications from individuals residing outside the United States will not be considered.

Successful completion of required security and background verification is a condition of assignment.

Equal Employment Opportunity

MARTIN Technologies is an Equal Opportunity Employer. Qualified applicants will receive consideration without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, disability, protected veteran status, or any other status protected by applicable law.

Apply for this position

Required*

First Name*

Last Name*

Email Address*

Phone*

Address

Resume*

We've received your resume. Click here to update it.

Attach resume or Paste resume

Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

If you were referred to this position, please provide full name of person who referred you.

Are you legally authorized to work in the United States?*

Will you now or in the future require sponsorship for employment visa status (e.g., H-1B visa status)?*

What is your current employment status?

Are you 18 or older?*

What is your highest level of education completed?*

Military Service, List:
Rank at Discharge
Branch
Indicate years of service*

List any additional personal and professional qualifications you feel are relevant for our recruiting team to be aware of when reviewing your application:

If you wish to submit a cover letter, please upload it here.

Disclaimer and signature.
I certify that my answers are true and complete to the best of my knowledge.
If this application leads to employment, I understand that false or misleading information or interview may result in my release. In the dropdown box, please type in your name and today's date to affirm.*

Pay Range*

Availability to start?*

Are you currently working in the United States under F-1 OPT or CPT authorization?

Yes, OPT
Yes, CPT
No*

Human Check*

Submit Application