Job Title:
Senior Software Engineer Big Data Platform

Job Description
Senior Software Engineer - Big Data Platform
Keyword: Java, Spark, Framework, Data Product
Roles and Responsibilities: Responsible for implementing solutions that covers data sourcing, pipeline engineering, persistence, and presentation capabilities. Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, Apache Kafka. Design and build near-realtime Data warehouse using hudi, Iceberg, spark 3 , flink , clickhouse , etc. Design and build Data service using micro-service , Elastic Search , Container-based architecture . Change Management process , Monitoring, Alerting and Ticketing for Data Lakes Build robust and scalable data infrastructure (both batch processing and real-time) to support needs from internal users Knowledge, Skills and Education: Bachelors in Computer Science preferred. 4+ years' experience in building Big Data Platform Strong software development, problem-solving and debugging skills with experience in core java Experience with multi-threading, concurrency, and highly scalable microservice and REST web services Experience Hadoop ecosystem tools relevant for real-time and batch data ingestion, processing and provisioning using tools such as Nifi, Kettle, ELK stack ,hive, spark, flink, Azkaban, airflow, clickhouse, vertica Experience in query engines such as Hive LLAP, Presto or Spark SQL Strong understanding of Data Lake, RDBMS, NoSQL, data governance Knowledge of industry-wide technology trends and best practices, knows what is possible using latest technologies (open source, data stores, algorithms, etc.) Experience in offshore team collaboration. Good communication

Location:
India Bangalore - Divyashree

Language Requirements:

Time Type:
Full time
If you are a California resident, by submitting your information, you acknowledge that you have read and have access to the Job Applicant Privacy Notice for California Residents