Sr. Data Engineer - Google Cloud Platform

  • Full-time

Company Description

At Twitter our Business Intelligence team focuses on implementing and supporting applications to help our internal customers meet their operational needs. We are responsible for establishing processes for continual improvement, crafting data and reporting solutions that scale and partnering with multiple business teams on a project-to-project basis. Our mission is to keep our business running efficiently while maintaining a balanced application environment.

Job Description

Who You Are:

To continually strengthen our growing team, we are looking for an experienced Data Architect specializing in Google Cloud Platform with experience in designing and building data frameworks, architecture design, development, capacity and performance planning, security and data access, documentation of deployed frameworks, ongoing evaluations of core technologies. Lead efforts cross functionally in adhering to standards and best practices.  You will lead and help shape our journey of migrating to GCP. You will partner with business and engineering teams to prioritize requests and deliver results against time-sensitive priorities. You are equally comfortable working with business partners to define requirements and using a broad range of data and BI tools. You thrive in a fast-paced collaborative environment. Come help us better serve Twitter's 100's of millions of users with an opportunity to tackle outstanding data and business challenges!

Qualifications

Required skills:

  • BA/BS in Computer Science or related field

  • 7+ years of data engineering or business intelligence experience of which 5+ years in architecting big data solutions using GCP

  • Experience in large implementations of Google Cloud Platform - Compute Engine, Dataproc, Hadoop, BigQuery, Datastore, Cloud Run, Cloud Run, Cloud Data Fusion, Dataflow, etc.

  • Demonstrated ability with Vertica, MySQL, Google BigQuery or other database systems

  • Ability writing advanced SQL

  • Experience programming in Python, Java, Scala, Scalding, Terraform or modern programming languages

  • AirFlow, DataFlow and other scheduling tools

  • Outstanding communications and interpersonal skills

Desired skills:

  • Google Cloud Platform certified

  • Migrating large data sets with complex data pipelines to GBQ

  • Deep understanding of Access control and Data Security

  • Ability to lead Data/BI/Analytics project and deliver results with customer first approach

  • Experience in custom ETL design, implementation and maintenance

  • Experience working in Cloud or on prem Big Data and analytics platforms

  • Experience designing and implementing real time data pipelines

Additional Information

All your information will be kept confidential according to EEO guidelines.

Here’s all the legal good stuff: We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran, genetic information, marital status, or any other legally protected status.

San Francisco applicants: pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Notice (Colorado Equal Pay for Equal Work Act)

The expected salary range for this role to be performed in Colorado is USD$146,000.00 - USD$204,000.00. Starting pay for the successful applicant will depend on a variety of job-related factors, which may include education, training, experience, location, business needs, or market demands. This range may be modified in the future.

This job is also eligible for participation in Twitter’s Performance Bonus Plan and Equity Incentive Plan subject to the terms of the applicable plans and policies.

Twitter offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, sick time, and parental leave. Twitter's benefits prioritize employee wellness and progressive support to our diverse workforce.

Privacy Policy