Data Analyst, AI Agent Analytics — New Grad

Jobright is your personal AI job search agent that transforms the way you do job search from solo, time-consuming efforts to a fast, expert-guided journey, simplifying every job search step and accelerating your route to the best job outcomes. As a New Grad Data Analyst focused on AI Agent Analytics, you will measure agent quality, understand user interactions, and turn complex behavioral data into insights that improve our AI systems. Why Join Us • Build real, production AI agents used by real users • High ownership and impact • Work at the intersection of AI, agents, and product • Shape how people experience AI-driven job search Responsibilities • Define metrics for agent task completion, quality, latency, reliability, and cost • Analyze agent conversations, tool usage, errors, and user feedback • Build SQL queries, dashboards, and recurring reports • Identify failure patterns and improvement opportunities • Support experiments involving prompts, models, tools, and workflows • Present actionable recommendations to AI and product teams Qualification Required • Recent graduate in Data Science, Statistics, Computer Science, Mathematics, Economics, or a related field • Strong SQL skills and familiarity with Python • Understanding of statistics, experimentation, and data visualization • Strong analytical and communication skills • Ability to work effectively in a remote environment Preferred • Experience analyzing LLM, chatbot, or agent interactions • Familiarity with product analytics or event-tracking systems • Experience with pandas, Tableau, Looker, or similar tools • Interest in AI evaluation, prompt engineering, or human-AI interaction

The role involves defining and measuring metrics for AI agent quality, latency, and reliability while analyzing user interactions. The analyst will build SQL queries and dashboards to identify failure patterns and provide actionable recommendations to product teams.

Candidates must be recent graduates in a quantitative field like Data Science or Computer Science with strong SQL and Python skills. Experience with LLM interactions and data visualization tools is preferred.

• Visualisation de donnéesSouhaitée
• SQLSouhaitée
• TableauSouhaitée
• PythonSouhaitée

Relevées dans la description du poste. Confirmez les exigences importantes ci-dessus.

• Sql
• Python
• Statistics
• Data Visualization
• Analytical Skills
• Communication Skills
• LLM Analysis
• Product Analytics
• Pandas
• Tableau
• Looker
• Prompt Engineering
• Human-AI Interaction
• Experimentation
• Dashboarding

• Data & Analytics
• Technology
• Software
• Engineering
• Science & Research

Formation minimale

Baccalauréat

Expérience minimale

0+ ans

Langue de l’offre

anglais

Heures de travail

40 heures par semaine

Niveau d’expérience

Entry level