Data Engineer- NEARSHORE

Period from: 2024-12-02
Period to: 2025-05-30
Job description:
Tech stack
1. GCP service – (bigquery, cloud run, cloud functions, pubsub, dataflow, cloud composer, etc.)
2. SQL
3. Python
4. DBT
5. Terraform
6. Basics of Azure (optional depending on which migration team needs)
7. good to have informatica or other ETL background (optional depending on which migration team needs)


Soft skills:
1. GitHub
2. DevOps
3. CICD
4. Communication skills
5. Agile methodologies
Responsibilities:
• Take end-to-end responsibility to build, optimize and support of existing and new data products towards the defined target vision
• Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well as Cloud infrastructure, in our context, it is GCP (Google Cloud Platform).
• Ensure that our built data products work as independent units of deployment and non-functional aspects of the data products follow the defined standards for security, scalability, observability, and performance.
• Work close to the Product Owner and other stakeholders around vision for existing data products and identifying new data products to support our customer needs
• Work with product teams within and outside our domain around topics that relate to the data mesh concept.
• Evaluate and drive continuous improvement and reducing technical debt in the teams
• Maintain expertise in latest data/analytics and cloud technologies

Required cloud certification: Yes, GCP professional