Senior Data Engineer (remote), Poland

Poland, Poland, Poland
Ostatnia aktualizacja 2024-05-27
Wygasa 2024-06-27
ID #2155350624
Senior Data Engineer (remote), Poland
Poland, Poland, Poland,
Zmodyfikowano May 15, 2024


Senior Data Engineer | Intellectsoft | Poland We are Intellectsoft – a digitaltransformation consultancy group and engineering company that deliverscutting-edge solutions for global organisations and technology startups.

Since 2007, we have been helping companies and established brands reimagine...

Login to continue We are Intellectsoft – a digitaltransformation consultancy group and engineering company that deliverscutting-edge solutions for global organisations and technology startups.

Since 2007, we have been helping companies and established brands reimaginetheir business through digitalization.

We’re looking for anexceptional Senior Data Engineer to join our team.

Are youup for a challenge?Project description: A biotechnology research project that earned recognition as atrusted provider of clinical genetic testing and an ideal collaborator fordeveloping precision medicine solutions.

Patients are central to theproject’s mission, driving partnerships with numerous non-profitorganizations to support patients and healthcare professionals in theirquest for answers.

The main focus – is Clinical Cancer Diagnostic;however, the project is designed to expand into additional areas such as Molecular Diagnostic Testing, Cardio Genetics, Neuro Genetics, etc Responsibilities: Develop connectors for Kafka to streamline the syncing of updates fromsource data repositories.

Establish partitioned Kafka topics to optimize the synchronization ofupdates to destination data marts.

Leverage Apache Flink for crafting intricate data analytics workloadsto enable real-time monitoring and transformations.

Deploy dashboards using Datadog and Cloudwatch to uphold system healthand fulfil user needs.

Institute schema registries to uphold data governance standards whilecatering to diverse data requirements.

Collaborate closely with a West Coast-based scrum team, contributing todaily pull request submissions, code reviews, documentation maintenance,backlog management, and build validation across environments within sprintcycles lasting 2-4 weeks.

Coordinate with other scrum teams to ensure coherence on datacontracts, API specifications, and deployment timelines.

Architect database schemas with a focus on query access patterns.

Establish and manage CI/CD pipelines using infrastructure-as-codeprinciples.

Transition on-premises ETL jobs from PHP to AWS Flink and Glueprocesses gradually.

Work alongside QA Engineers to develop automated test suites.

Engage with end-users to troubleshoot service interruptions andchampion our data product offerings.

Maintain vigilant oversight of data quality, promptly addressingdiscrepancies, latency issues, and defects Requirements Must have: Proficiency in Apache Kafka (preferably MSK flavour), Debezium, Python, Apache Flink or Py Spark Streaming, My SQL (preferably RDS flavours), CDK or Terraform, Athena, Glue, Lambda, Appflow, HANA/4, PHP, Redis, Docker, and Java Script At least 6 years of hands-on experience collaborating withinprofessional scrum teams or equivalent educational background A minimum of 3 years of practical experience in designing and indexingrelational databases At least 2 years of practical experience in constructing and managingreal-time data streams Demonstrated proficiency with at least 1 year of experience indeveloping monitoring dashboards Nice to have: A Master’s degree in computer science, data science, mathematics,or life sciences.

Demonstrate a foundational grasp of genomic concepts and terminology.

Exhibit flexibility in availability.

Demonstrate experience in constructing data APIs and providing Data asa Service.

Showcase proficiency in integrating with Saa S platforms like SAP and Salesforce.

Display familiarity with PHP MVC frameworks such as Symfony or expressreadiness to acquire such skills.

Knowledge of Atlassian products, including Jira, Confluence, and Bamboo.

Show proficiency in utilising system diagramming tools like Miro, Lucid Charts, or Visio Benefits36 paid absence days per year for the work-life balance of eachspecialist + 1 additional day for each following year of cooperation withthe company Up to 10 unused absence days can be added to income after 12 months ofcooperation Health insurance compensation Depreciation coverage for personal laptop usage for project needs Udemy courses of your choice Regular soft-skills training Excellence Сenters meetups Show more Show less Tagged as: remote, remote job, virtual, Virtual Job,virtual position, Work at Home, work from home When applying state you found this job on Remote Network.


Szczegóły pracy:

Rodzaj pracy: Pełny etat
Rodzaj kontraktu: Stały
Rodzaj wynagrodzenia: Miesięczny
Zawód: Senior data engineer (remote)
Praca w domu:

⇐ Poprzednia praca

Następna praca ⇒     


Skontaktuj się z pracodawcą

    Informacje o pracodawcy

    Szybkie wyszukiwanie:


    Wpisz miasto lub region

    Słowo kluczowe