Lead Data Engineer
Vera AI
This job is no longer accepting applications
See open jobs at Vera AI.See open jobs similar to "Lead Data Engineer" Differential Ventures.About us
Vera is an anti-oppression, early-stage AI startup with a vision to end algorithmic inequality and a mission to blaze a trail that challenges conventions in the AI industry through collaboration, care, and rigor. Our founding team brings a unique blend of experiences from first-hand research expertise in responsible AI, its applications to highly regulated industries like financial services and healthcare, and the dynamic culture of innovation from prior startup experiences. As established leaders in AI, we advise companies and governments globally, not only on how to be prepared for the evolving regulatory landscape, but also translate high-level principles and policies into concrete organizational practices, helping companies deploy AI in a safe, reliable way.
Vera is deeply committed to building a diverse, inclusive team where everyone can bring their honest self to work. The nature of our work is sensitive, with huge potential for impact nationwide, so we must be able to have respectful and earnest conversations about challenging topics. We need representation from all walks of life to do this work effectively, and welcome applicants of all shapes and sizes!
We’re VC-backed and early-stage, which means you’ll be exposed to new challenges and technologies every day. We offer generous health insurance (paid by Vera at 100%) to all our employees, including trans health coverage. We are more than happy to accommodate those who are differently-abled. Vera employees receive free access to One Medical and health advocacy services. Everyone who works at Vera is a shareholder, with generous equity benefits and full transparency about what they mean for you.
Importantly, we’re a small and scrappy startup, which means we can be flexible for the right candidate! If you don’t see a role that works for you, if you’d prefer a modified title, or if you don’t quite meet the experience thresholds set out in the job posts but know you’d rock the role, reach out and chat with us! We’d love to hear from you.
Job Description
This is a remote position.
About the Role:
Vera is building the trust and safety layer for enterprise AI, that helps companies unlock the value of AI through enterprise governance and control for generative AI. Vera firewalls sensitive information from leaving your enterprise, and moderates unwanted responses from harming your brand. Our solution sits between users and models, with role based access control, ensuring that internal teams can't ask questions that contain sensitive information, PII, Intellectual Property, hacking attempts, or questions that may otherwise fall outside of acceptable use.
Using your technical expertise and experience you will be responsible for the design, implementation and operation of the data platforms powering Vera’s various core applications, and will initially support the engineering team globally as a data engineer.
As the foundational Data Engineer in a venture-backed startup, you will work alongside the CTO, Senior Platform Engineer and other engineers (front end etc..) to deliver critical project priorities, and deliverables. You will design, develop, test, deploy, maintain, and enhance data platforms within the Vera application ecosystem. As such you will drive many data engineering and backend decisions from day one, and will be responsible for the overall vision and strategy for data engineering within Vera. Candidates must be authorized to work in the United States.
Skills We Are Looking For:
Expert-level applied database engineerings skills in a relational database (i.e. Postgres) and NoSQL DBs (i.e. MySQL, Mongo, Solr etc.)(must have)
Experience using Python, Java, or Scala for data processing (Python strongly preferred)
Fluency with modern Data Platform APIs, Connectors etc.
Demonstrated Knowledge of Public Cloud APIs and CLIs
Demonstrated ability to design and implement data pipelines in large-scale data systems and distributed computing framework.
Demonstrated experience designing and implementing automated data pipelines (ETL jobs, or triggered workflows based on some user action, etc)
Hands-on experience with cloud-based data warehousing solutions (i.e. Snowflake)
Excellent knowledge of analytical data warehouse design, implementation and monitoring
Good To Have:
Version control experience (i.e. git, Github, svn, etc.)
Docker and Docker registry applied experience
Kubernetes (hands on experience)
DLP (Data Loss Prevention) for PII/sensitive data protection
Responsibilities:
In partnership with Vera CTO, Platform Engineering and application owners establish and maintain the Vera data platform
Support the build out of, and then maintain, data pipelines that extract data from various sources, perform transformation, aggregations and load data into various storage systems for the purpose of integration with Vera core applications
Partner with platform engineering, front end engineering, product managers and users to incorporate feedback
Plan and execute system expansion as needed to support the company’s growth and analytic needs
Participate in design reviews with the CTO, Head of Platforms, peers and stakeholders to decide amongst available technologies.
Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback.
Assist in user acceptance testing prior to code releases and launches
Monitor site performance to identify and fix usability issues
Drive innovation in data platform tooling and technology.
{{getI18n("crm.setup.careersite.aboutcompany")}}
{{org_info.description}} {{each_field.field_label}}
{{getValue(record[each_field.api_name],each_field.data_type)}} {{getI18n("zr.crm.migration.client.attachment.label")}}
This job is no longer accepting applications
See open jobs at Vera AI.See open jobs similar to "Lead Data Engineer" Differential Ventures.