Big Data Engineer 2
About the Job
Business Unit: Summary Comcast is an EOE/Veterans/Disabled/LGBT employer
The Platform Services Analytics Team delivers analytics engineering and operations for Data Services Engineering and affiliated teams within IP & Communications Services. The team provides end-to-end data analytics solutions (identify project data needs, architecting solution, implementing solution, deploying solution on one of the 3 owned and maintained platforms, and assist in KPI and dashboard development). Splunk, Kafka/Hadoop, and ELK and the corresponding data presentation layers are within their scope.
The Big Data Engineer will be responsible for architecting, developing and performing ongoing operations of large-scale data processing systems. Expertise in data warehousing solutions is required and should be able to work technologies such as Kafka, Hadoop, Splunk and Elasticsearch. The hire will be responsible for expanding and optimizing our data architectures and as well as optimizing data flow and collection for cross functional teams. The ideal candidate has sufficient experience in software engineering, is a quick learner and enjoys working in a fast-paced environment. The candidate should enjoy being challenged and solve complex problems on a daily basis.
Develops solutions to a wide range of difficult applications, problems or procedures.
Supports Lead Engineer with the architecture, design, development, qualification and deployment of applications consistent with product and technical roadmaps.
Works with engineering project management and lead engineer to deliver applications that meet or exceed product requirements, project schedules and reliability.
Assists product development and operations teams to define technical requirements to accompany existing products and operation requirements.
Designs and develops use cases in support of the technical requirements.
Determines resources, technology and course of action to achieve results.
Provides leadership and consultative direction to the organization, department and group.
Consistent exercise of independent judgment and discretion in matters of significance.
Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary.
Other duties and responsibilities as assigned.
Experience building and optimizing big data' architectures and data sets.
Strong analytic skills related to working with unstructured data sets.
Familiarity with building processes supporting data transformation, data structures, metadata and workload management.
Strong understanding of how to employ technologies to solve big data problems and to develop innovative big data solutions.
Proficiency in designing efficient and robust ETL workflows.
Experience with big data tools such as Hadoop, Spark, Kafka, Splunk, Elasticsearch.
Ability to tune Hadoop solutions to improve performance and end-user experience.
Strong project management and organizational skills.
Ability to work in teams and collaborate with others.
- Bachelors Degree or Equivalent
- Engineering, Computer Science
- Generally requires 2-5 years related experience
Comcast is an EOE/Veterans/Disabled/LGBT employer