The Walt Disney Company Jobs

Mobile disney Logo

Job Information

The Walt Disney Company Sr. Data Engineer in Glendale, California

As a Senior Data Engineer: You will create custom batch-oriented and real-time streaming data pipelines, creating new data workloads/applications and also migrating applications from on-premise ecosystems to cloud data lakes. Implement, troubleshoot, and optimize distributed solutions based on modern big data technologies like Hive, Hadoop, Spark, Elastic Search, Kafka, etc. to solve large scale processing problems in a cloud cluster environment. Ensure proper data governance policies are followed by implementing defining project specific quality checks, classification, etc. Apply technical expertise to challenging programming and design problems. Strong communication, interpersonal and teaming skills, including the ability to work effectively in agile / scrum environment. Demonstrated interest and ability to quickly learn new technologies.

Responsibilities :

  • Proficient understanding of distributed computing principles

  • Experience developing data storage processing and streaming flows using technologies like Spark, HDFS, Yarn and Hadoop

  • Experience with various messaging systems, such as Kafka or RabbitMQ

  • Good knowledge of Big Data querying tools, such as Pig or Hive

  • Good understanding of Lambda Architecture, along with its advantages and drawbacks

  • Experience with integration of data from multiple data sources

  • Ability to solve any ongoing issues with operating the cluster

  • Experience with scripting languages and automation of processes

  • Proven track record of development accomplishments in highly collaborative environment

  • Translate complex functional and technical requirements into detailed design

  • Be passionate about solving customer problems and develop solutions that result in a passionate customer/community following

Basic Qualifications :

  • Experience working with cloud as infrastructure (Google/AWS/Azure) or other cloud platform based on IaaS and PaaS Solutions

  • 2+ years working with and demonstrating a solid understanding of open source data management components and services including Hadoop, Spark, Flume, Kafka and Hive

  • Experience with Google BigQuery, App Engine, Dataflow

  • Proficiency in SQL, R, Python, Java, Java Script and Web Services, and experience in visualization tools like Tableau, Looker, MicroStrategy and PowerBI

  • NoSQL DB (Dynamo DB/Mongo DB knowledge is helpful)

  • Experience with Code Management/CICD tools like GITHub, Jenkins is useful

  • Prior experience with automation is helpful

  • Prior experience working in a Linux/Unix environment is helpful

  • Prior experience working in an enterprise technology environment is helpful

  • Understanding of AI/ML services: TensorFlow, Keras, Rekognition, and/or PyTorch

  • Strong written and verbal communication skills

You will be a rock-star if you have:

  • Passion for learning new technologies and comfort with “fail-fast” mentality, and sharing that passion with your peers

  • Innovation mindset, driving cultural change with the creative use of data and technology

  • Demonstrated ability to think strategically, and partner with business and technology teams to define solutions

  • Experience participating on projects in Agile mode: Scrum, Kaizen and Kanban

  • Experience with Big Data and open source ecosystems: HortonWorks, Nifi, Spark, Flume, Kafka and Hive

  • Understanding of WDP&R’s technical infrastructure and server environments

  • Innovation mindset, driving cultural change with the creative use of data and technology

Required Education :

Bachelor’s degree in Computer Science or related field or equivalent work experience

Job ID: 710101BR

Location: Glendale,California

Job Posting Company: Disney Parks & Resorts

DirectEmployers