Staff Engineer Software

Job details

---

Job description

---

Job Description Job Purpose We are looking for a Staff Software Engineer to join our Data Engineering team. This team is responsible for building the scalable resilient data platform used by various IMT data products. We build complex data pipelines and infrastructures which cater to analytics and data science use cases. While working on these projects you will hold responsibility for full life-cycle management, including requirements analysis, technical design, implementation, testing, documentation, deployment to production, and post-production ownership. Responsibilities Develop high quality data processing infrastructure and scalable services that are capable of ingesting and transforming data at huge scale coming from many different sources on schedule Turn ideas and concepts into carefully designed and well-authored quality code Articulate the interdependencies and the impact of the design choices Develop solutions on platform-based approach Collaborate with QA, product management, engineering, UX to achieve well groomed, predictable results Believe in Teamwork and work in close collaboration with Sr.Staff/Principal Engineers Fluidly adapt to changes and new requirements Proven ability to deliver working solutions on time Strong analytical thinking to tackle challenging engineering problems Great energy and enthusiasm with a positive, collaborative working style, clear communication and writing skills Ownership of Product/Solutions Mentoring Junior/Senior Engineers Knowledge And Experience Experience in object-oriented design and development with Java/Scala language Experience with a variety of data stores for unstructured and columnar data as well as traditional database systems, for example, MySQL, DynamoDB, Postgres Experience with Docker based Containerization Experience in data pipeline using various data streams like Confluent Kafka, AWS Kinesis etc. Experience in distributed storage using S3, HDFS Experience in handling and processing data in json and parquet file format Experience in distributed data processing using AWS EMR, Apache Spark, AWS Glue services Experience in Infrastructure as Code using Cloud formation or Terraform and deployment using shell script in Jenkins Job Knowledge on Apache NiFi based data ingestion Experience with Kafka Connectors and various data stores and data sink connectors Experience building Spring Boot REST Framework based micro services in a distributed architecture Experience withOpen-Source products and components Experience delivering solutions containing multiple components Experience with working in DevOps environment – “you build it, you run it, you own it” BE/BTech or ME/MTech in Computer Science 10+ years of building Enterprise Software Products To know more about us, do visit https//www.theice.com/index Intercontinental Exchange, Inc. is an Equal Opportunity and Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin or ancestry, age, disability or veteran status, or other protected status.