Locations
- Bulgaria
- Georgia
- Lithuania
- Mexico
- Moldova
- Poland
- Romania
- Ukraine
Company Background
The customer holds a top position in the food and beverage sphere. As a global player with operations across five continents and with annual sales of more than $7 billion, they partner with leading retailers, restaurants, and distributors.
Technologies
- Azure Databricks
- PySpark
- SQL
- Azure Data Factory
- Azure Data Lake
- Azure SQL DW
- Azure SQL
- Python
What You'll Do
- Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lake;
- Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks;
- Developing scalable and re-usable frameworks for ingesting of data sets;
- Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms;
- Working with event based / streaming technologies to ingest and process data;
- Stay up to date with the latest advancements in cloud computing, data engineering, and analytics technologies, and recommend best practices and industry standards for implementing the data lake solution;
Job Requirements
- 8 to 10 years of IT experience;
- Experience working with Azure Databricks;
- Familiarity with PySpark;
- Mastery of SQL;
- Knowledge of components: Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL;
- Experience with Python programming language used for data Engineering purpose;
- Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows;
- Experience in data visualization/exploration tools;
- Strong problem-solving skills and the ability to translate business requirements into actionable data science solutions;
- Excellent communication skills, with the ability to effectively convey complex ideas to technical and non-technical stakeholders;
- Level of English - from Upper-Intermediate (written/spoken);
What Do We Offer
The global benefits package includes:
- Technical and non-technical training for professional and personal growth;
- Internal conferences and meetups to learn from industry experts;
- Support and mentorship from an experienced employee to help you professional grow and development;
- Internal startup incubator;
- Health insurance;
- English courses;
- Sports activities to promote a healthy lifestyle;
- Flexible work options, including remote and hybrid opportunities;
- Referral program for bringing in new talent;
- Work anniversary program and additional vacation days.