GenAI Validation Engineer
About The Position
Dream is a pioneering AI cybersecurity company delivering revolutionary defense through artificial intelligence. Our proprietary AI platform creates a unified security system safeguarding assets against existing and emerging generative cyber threats. Dream's advanced AI automates discovery, calculates risks, performs real-time threat detection, and plans an automated response. With a core focus on the ""unknowns,"" our AI transforms data into clear threat narratives and actionable defense strategies.
Dream's AI cybersecurity platform represents a paradigm shift in cyber defense, employing a novel, multi-layered approach across all organizational networks in real-time. At the core of our solution is Dream's proprietary Cyber Language Model, a groundbreaking innovation that provides real-time, contextualized intelligence for comprehensive, actionable insights into any cyber-related query or threat scenario.
We’re looking for a GenAI QA Validation Engineer to take ownership of evaluating and ensuring the quality of our GenAI-based cybersecurity products. In this role, you’ll create benchmarks, develop datasets, and build labeling and monitoring systems for Gen-AI workflows and products that solve Cybersecurity tasks for Dream's product and customers. You’ll also partner closely with our research teams, as well as other groups, to keep our models performing at their best and help shape advanced AI solutions for Cybersecurity.
This role offers an opportunity to work on cutting-edge cybersecurity initiatives that combine AI systems.
Responsibilities
- Take a full responsibility over evaluation of GenAI-based products developed by the company.
- Quality Assurance of GenAI models in research and production.
- Use most advanced technology to create benchmarks, generate datasets.
- Build labeling platform for internal needs.
- Build monitoring tools for evaluation of model in production (both cloud and on-prem).
- Work closely with research (mostly) and other teams.
Skills
- 3+ years of QA & Automation experience - Mid/Senior level
- 3+ years of proven python record
- Familiarity of Cyber concepts and security practices of IT environments, attack techniques and mitigations
- Passion for GenAI
- Ability to work effectively in a fast-paced, collaborative environment.
- Familiarity of Data Science concepts, including both research and productization lifecycles