Senior Big Data Software Engineer

Job description

Join to apply for the Senior Big Data Software Engineer role at EPAM Systems

1 week ago Be among the first 25 applicants

Join to apply for the Senior Big Data Software Engineer role at EPAM Systems

Do you have a software engineering background and strong knowledge of Big Data?

Are you an open-minded professional with good English skills?

If it sounds like you, this could be the perfect opportunity to join EPAM as a Senior Big Data Engineer .

EPAM is shaping the digital future for Fortune 1000 companies, building complex solutions using modern technologies.

We are looking for a Senior Big Data Engineer with an open-minded personality who can join our friendly environment and become a core contributor to our team of experts.

Responsibilities

• Develop and implement innovative analytical solutions using Cloud Native, Big Data, and NoSQL related technologies
• Develop and implement Cloud/On-Premise/Hybrid solutions using best in the class data frameworks
• Work with product and engineering teams to understand requirements, evaluate new features and architecture to help drive decisions
• Build collaborative partnerships with architects, technical leads and key individuals within other functional groups
• Perform detailed analysis of business problems and technical environments and use this in designing quality technical solution
• Actively participate in code review and test solutions to ensure it meets best practice specifications
• Build and foster a high performance engineering culture, mentor team members and provide team with the tools and motivation

Requirements

• Coding experience with one of the following programming languages: Python/Java/Scala
• Experience with Linux OS: configure services and write basic shell scripts, understanding of network fundamentals
• Good knowledge of SQL and relational algebra
• Advanced experience in software development with Data technologies (e.g. administration, configuration management, monitoring, debugging and performance tuning)
• Engineering experience and practice in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Operation, Security
• Experience building data ingestion pipelines, Data Warehouse or Database architecture
• Experience with data modeling; hands-on development experience with modern Big Data components
• Cloud: experience in designing, deploying and administering scalable, available and fault tolerant systems
• Good understanding of CI/CD principles and best practices
• Analytical approach to problem; excellent interpersonal, mentoring and communication skills
• Data-oriented personality and possessing compliance awareness, such as PI, GDPR, HIPAA
• Motivated, independent, efficient and able work under pressure with a solid sense for setting priorities
• Ability to work in a fast-paced (startup like) agile development environment
• Experience in high load and IoT Data Platform architectures and infrastructures
• Vast experience with Containers and Resource Management systems: Docker and Kubernetes
• Experience in direct customer communications
• Solid skills in infrastructure troubleshooting, support and practical experience in performance tuning and optimization, bottleneck problem analysis
• Experienced in different business domains
• Advanced understanding of distributed computing principles

Technologies

• Python/Java/Scala/Kotlin and SQL
• Big Data stack: Spark Core, Spark SQL, Spark ML, Kafka, Kafka Connect, Airflow, Nifi, Streamset
• Queues and Stream processing: Kafka Streams; Flink; Spark Streaming
• Elasticsearch/ELK
• Solid Cloud experience with one of the leading cloud providers (AWS/Azure/GCP): Storage; Compute; Networking; Identity and Security; NoSQL; RDBMS and Cubes; Big Data Processing; Queues and Stream Processing; Serverless; Data Analysis and Visualization; ML as a service (SageMaker; Tensorflow)
• Enterprise Design Patterns (Secure Inversion of Control etc)
• Development Methods (TDD, BDD, DDD)
• Version Control Systems (Git)
• Deep understanding of SQL queries, joins, stored procedures, relational schemas, and SQL optimization
• Experience in various messaging systems, such as Kafka, RabbitMQ, Event Hub, Pub/Sub

We offer

• Private health insurance
• EPAM Employees Stock Purchase Plan
• 100% paid sick leave
• Referral Program
• Professional certification
• Language courses

EPAM is a leading digital transformation services and product engineering company with 61,700+ EPAMers in 55+ countries and regions.

Since 1993, our multidisciplinary teams have been helping make the future real for our clients and communities around the world.

In 2018, we opened an office in Spain that quickly grew to over 1,450 EPAMers distributed between the offices in Málaga, Madrid and Cáceres as well as remotely across the country.

Here you will collaborate with multinational teams, contribute to numerous innovative projects, and have an opportunity to learn and grow continuously.

• Why Join EPAM
• WORK AND LIFE BALANCE.
  
  Enjoy more of your personal time with flexible work options, 24 working days of annual leave and paid time off for numerous public holidays.
  
  
• CONTINUOUS LEARNING CULTURE.
  
  Craft your personal Career Development Plan to align with your learning objectives.
  
  Take advantage of internal training, mentorship, sponsored certifications and LinkedIn courses.
  
  
• CLEAR AND DIFFERENT CAREER PATHS.
  
  Grow in engineering or managerial direction to become a People Manager, in-depth technical specialist, Solution Architect, or Project/Delivery Manager.
  
  
• STRONG PROFESSIONAL COMMUNITY.
  
  Join a global EPAM community of highly skilled experts and connect with them to solve challenges, exchange ideas, share expertise and make friends.
  
  

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Business Development, Information Technology, and Engineering

• Industries

  Software Development and IT Services and IT Consulting

Referrals increase your chances of interviewing at EPAM Systems by 2x

Get notified about new Big Data Developer jobs in Spain .

Madrid, Community of Madrid, Spain 5 months ago

Madrid, Community of Madrid, Spain 2 weeks ago

Madrid, Community of Madrid, Spain 6 days ago

Madrid, Community of Madrid, Spain 1 week ago

Madrid, Community of Madrid, Spain $60,000.00-$120,000.00 5 days ago

Palma, Balearic Islands, Spain 2 months ago

Madrid, Community of Madrid, Spain 1 week ago

Barcelona, Catalonia, Spain 10 months ago

Madrid, Community of Madrid, Spain 4 months ago

Madrid, Community of Madrid, Spain 6 months ago

Madrid, Community of Madrid, Spain 2 years ago

Madrid, Community of Madrid, Spain 1 week ago

Madrid, Community of Madrid, Spain 6 months ago

Sevilla La Nueva, Community of Madrid, Spain 6 months ago

We’re unlocking community knowledge in a new way.

Experts add insights directly into each article, started with the help of AI.

Required Skill Profession

Informática Y Tecnología