About the role

Responsible for creating reliable software programs for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis. Responsibilities include building real-time and batch data ingestion pipelines, setting up of data catalogues, data warehouses, data cleansing, data transformation, data processing and data visualization to provide real-time intelligence to businesses.

Roles and Responsibilities

• Construct, deploy, test and maintain highly scalable and optimized data pipelines with state-of-the-art monitoring and logging practices.
• Develop software programs or use tools to bring together large, complex and sparse data sets to meet functional and non-functional business requirements and use a variety of languages, tools and frameworks to marry data.
• Design and implement data tools for analytics and data scientist team members to help them in building, optimizing and tuning of use cases.
• Develop and manage data warehouses to ensure the availability, performance, scalability and security of production data warehouse.
• Develop software programs or use tools for cleansing and harmonization of data from a variety of data sources.
• Defines data catalogues, metadata to provide search ability and governance (including Records Management) for structured and unstructured data.
• Implement best practices in management of data, including master data, reference data, metadata, data quality and lineage in assigned areas.

Be part of an extraordinary story

Your skills. Your imagination. Your ambition. Here, there are no boundaries to your potential and the impact you can make. You’ll find infinite opportunities to grow and work on the biggest, most rewarding challenges that will build your skills and experience. You have the chance to be a part of our future, and build the life you want while being part of an international community. Our best is here and still to come. To us, impossible is only a challenge. Join us as we dare to achieve what’s never been done before. Together, everything is possible.

Qualifications

About You

• Bachelor’s Degree or Equivalent with Minimum 4 years of job-related experience
• Hands-on experience in working with big data using technologies like Hadoop/Hive, Hyperscale PostgreSQL, Java/Scala, Spark, Kafka, SQL and NoSQL, azure cloud-based data engineering solutions
• Hands on experience with data ingestion tools (ex: striim, streamsets, NiFi).
• Hands-on experience in data modelling, data visualization, and pipeline design & development.
• Hands on experience with data warehouse platforms (ex: Snowflake, Azure Data Lake Analytics).
• Strong technical knowledge of performance tuning and query optimization on large data sets.

About Qatar Airways Group 

Our story started with four aircraft. Today, we deliver excellence across 12 different businesses coming together as one. We’ve grown fast, broken records and set trends that others follow. We don’t slow down by the fear of failure. Instead, we dare to achieve what’s never been done before.

So whether you’re creating a unique experience for our customers or innovating behind the scenes, every person contributes to our proud story. A story of spectacular growth and determination. Now is the time to bring your best ideas and passion to a place where your ambition will know no boundaries, and be part of a truly global community. 

 How to apply (External)

If you’re ready to join a progressive team and have a challenging and rewarding career, then apply now by uploading your CV and completing our quick application form.