Data Engineering Lead (Visa Spend Clarity)

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

The Data Engineering Lead is an individual that has been recognized as a leader and expert developer.  They champion technical excellence while leading the software development process, technical design, and best practice in their team or teams.  They work to ensure that any software development undertaken by their teams is in alignment with the overall stream goals. 

While they are committed to delivery as part of a team and stream, they have a portion of time to work with the engineering practice to improve the company-wide engineering culture, practices, training, and standards at Visa Spend Clarity for Enterprise. They may also assist in the implementation of new standards, technologies, or methodologies across the broader engineering community. 

You will be part of a team who are growing the capabilities and services in the Visa Spend Clarity to deliver scalable and robust solutions that will take Visa Spend Clarity to more customers and users around the globe.  With an engineering group of nearly 300 people, Visa Spend Clarity is a key focus area with large growth ambitions driven by customer needs and a desire to innovate using modern cloud technologies. 

Responsibilities include:

• Gathering Requirements: The engineer leads collaboration with stakeholders to determine project requirements. They use their understanding of tradeoffs and project costs to define critical metrics or measures to assess the feasibility of delivery across multiple features and capabilities. They proactively seek clarification on non-functional requirements (NFR) and lead junior engineers in understanding requirements across solution delivery.
• Translating Business Requirements: The engineer translates functional and non-functional requirements into system designs and communicates how the components will interact across teams. They identify and interpret possible solutions and understand requirements and interdependencies in their solution space. The engineer also identifies potential impacts of risks in solutions and communicates these to the team lead.
• System Design and Architecture: The engineer designs and develops complex architectural solutions that are robust, scalable, and meet the project requirements. They plan and pilot new technology capabilities and features to enhance the system's functionality and user experience.

Skills and competencies include:

• Technical Expertise: The engineer should have advanced technical knowledge relevant to software development. They should be capable of analyzing patterns across bugs and implementing systemic solutions.
• Leadership: The engineer should demonstrate leadership in technical discussions and decisions, and be capable of leading junior engineers in understanding requirements.
• Communication: Effective communication with a wide range of stakeholders is crucial. The engineer should be able to translate business requirements into technical ones and vice versa.
• Problem-Solving: The engineer should have strong problem-solving skills, with the ability to identify potential impacts of risks in solutions and implement systemic solutions to address patterns across bugs.
• Proactiveness: The engineer should proactively seek clarification on non-functional requirements, new knowledge, and adapt to new trends, technical solutions, and patterns.

At Visa, this role is classified as Data Engineer, Senior Consultant. While it denotes a high level of seniority and scope, it is not a people manager role. The position focuses on technical leadership and hands-on engineering rather than team management.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

10+ years’ experience in professional software development and data engineering roles.

Solid experience working with:

• Cloud environments – AWS preferred
• Data ETL/ELT transformation (e.g., Python, Spark, SSIS)
• Deep knowledge of Microsoft SQL Server internals
• Data modelling and design experience

Experience required in:

• .NET and .NET Core/Standard development in C#
• Streaming data solutions
• Scripting (e.g., PowerShell)
• Data governance
• CI/CD
• Source control (e.g., Git, GitHub etc) and continuous integration (e.g., GitHub Actions, Code Deploy etc)
• Performance, profiling, troubleshooting and issue resolution

For someone we're looking for at a Senior Consultant level, we would like to find these skills.  It'll help set expectations to candidates on what we're looking for at least.

Desired experience in:

• Data Analysis / Data Science
• Serverless technologies (e.g., S3, Lambda, Glue, Athena, DynamoDB)
• BI and Reporting technologies (PowerBI, SSRS, etc)
• Test automation frameworks supporting unit, integration, end to end testing

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.