13 Spark jobs in Oman

Apt Resources is hiring a Python Data Engineer for our client in the banking sector. This role focuses on Big Data architectures and data warehousing, with hands-on involvement in tools like Tableau, Teradata, NIFI, and IBM DataStage.

Key Responsibilities:

• Design scalable Big Data and DWH architectures.
• Develop KPIs and dashboards to analyze market trends.
• Work with Tableau for data visualization and reporting.
• Perform data migration using NIFI and ETL with IBM DataStage.
• Collaborate with teams and vendors on data-driven initiatives.
• Maintain data privacy, security, and regulatory compliance.

• 3 to 4 years of experience in data engineering or related roles.
• Bachelor's degree in Engineering or a related field.
• Certifications in Big Data or Data Science are preferred.
• Proficiency in SQL, Python, PySpark, and Shell scripting (Bash).
• Experience with data visualization tools like Tableau.
• Familiarity with ETL tools such as IBM DataStage and data pipelines using NIFI.
• Knowledge of REST, JSON, SOAP, and Web Services APIs.
• Strong analytical, communication, and project leadership skills.
• Experience in telecom data (2G/3G) is an advantage.

Salary: USD 2,000 - 2,500 per month

Oman Air has built up a reputation as a strong, competitive leader in the airline industry. We are committed to recruiting and nurturing bright and dynamic individuals to meet our manpower needs. In the new millennium, our mission is to seek out new ways to develop and improve our position as a leader in aviation excellence.

We believe our people are the reason behind our success and we offer you a once in a lifetime opportunity to work in a team-based customer-oriented environment. Our emphasis is on continual staff development we achieve through the training we impart to our staff members.

Role Objective

• To enable data driven decision making across the airline.
• You assist by designing and implementing comprehensive data quality, performance, and governance solutions throughout our data pipeline and data engineering processes.

Duties and Responsibilities

Area of responsibility

• As a Senior Data Engineer, you will work across the following data pillars:
• Ensure data integrity and quality.
• Develop, maintain and optimize data pipelines.
• Assemble and manage large, complex data sets to meet both functional and non-functional business requirements
• Enable broad organizational data access, including catalogue, validation and automation aspects.
• Familiar with data extraction and transformation from a wide variety of data sources and formats.
• Investigate and troubleshoot data-related problems such as data pipeline failures by utilizing tools, logs, and monitoring systems to identify root causes and implement solutions
• Identify internal process improvements such for scalability, data delivery optimization, automation of manual processes, and report these to relevant stakeholders
• Handle complex data engineering tasks aimed at creating and enhancing frameworks that promote automation and reusability
• Apply strategic and analytical skills to address customer and business-related questions, leveraging data to inform decisions. Including consultation and collaboration with business stakeholders.
• Ability to work under pressure, whilst balancing delivery speed, reliability and interpretability.
• Keep abreast of latest data engineering trends and company policies, ensuring all activities adhere to relevant rules and regulations
• Oversee the development of reusable components, frameworks, and libraries at scale
• Collaborate with cross-functional teams, including aviation safety experts, route planners, customer experience professionals, and business stakeholders, to understand their data needs, provide data solutions, and enable data-driven decision-making to enhance airline safety, efficiency, and customer satisfaction.
• Assist with the implementation of data quality standards, data governance practices, and data security measures to maintain the accuracy, reliability, and compliance of airline data, particularly in relation to safety and regulatory requirements
• Manage the administration and support aspects of core Data Engineering platforms
• Perform any other related tasks as assigned by the Management.

Education & Experience

• Bachelor's degree in a Business, IT, Mathematics, Science or Engineering discipline with 04 years or relevant work experience. A post-graduate degree in a relevant field would be an asset.
• Two years college diploma in a Business, IT, Mathematics, Science or Engineering discipline with 06 years relevant work experience.
• Specialized certificate/ license in the related field with aviation experience & Secondary school certificate and having 10 years of relevant work experience (For Internal Candidates Only).
• Airline or logistics experience would be advantageous

Special Skills & Knowledge

• Proven knowledge and expertise in database technologies, data warehousing concepts, and cloud platforms.
• Proficiency in English (must) and Arabic (preferred).
• Technical knowledge of Big Data and Data Warehouses, including Oracle, Microsoft ADLS, Synapse, and PowerBI.

• Bachelor's degree in Computer Science or a related field.
• 1-2 years of experience in data analysis or data engineering.

Skills / Knowledge:

• Familiarity with programming languages like Python, R, or SQL.
• Solid understanding of statistical and machine learning concepts.
• Strong problem-solving and analytical skills.
• Excellent data visualization and presentation skills.
• Excellent communication and technical documentation abilities.
• Strong leadership and mentoring abilities.
• Ability to work collaboratively and learn quickly.
• Well-developed interpersonal skills and excellent communications skills in English.
• Respect & Integrity
• Problem Solving & Decision Making

The Junior Data Science Engineer supports data analysis projects by building and maintaining models, pipelines, and tools under the guidance of senior team members.

• Assist in designing, developing, and implementing advanced data models and predictive analytics to solve business problems and drive decision-making.
• Build, maintain, and optimize scalable and efficient data pipelines to facilitate seamless data integration and processing across the organization.
• Conduct comprehensive exploratory data analysis to uncover insights, trends, and patterns, and present findings in a clear and actionable manner.
• Support the implementation and optimization of machine learning algorithms, ensuring they meet performance, accuracy, and scalability requirements.
• Work closely with cross-functional teams, including business stakeholders and senior data scientists, to understand requirements and deliver tailored data-driven solutions.
• Develop and maintain thorough documentation of data processes, models, and methodologies to ensure reproducibility and transparency.
• Prepare detailed reports and dashboards to communicate insights and progress to stakeholders.
• Stay up-to-date with emerging trends, tools, and methodologies in data science and analytics.
• Actively contribute to improving teamwork flows and adopting innovative approaches to solving challenges.

This role is exclusively for Omani nationals and requires candidates to be Omani citizens.

We are looking for a talented and experienced Data Infrastructure Engineer to join our team. This role focuses on building, deploying, maintaining, and optimizing data infrastructure that supports our data-driven operations. You will work with large-scale data processing systems, ensuring they are robust, scalable, and high-performing in production environments. The ideal candidate has strong technical skills in distributed data systems, particularly in deploying and managing these systems, and is passionate about creating efficient data workflows that drive actionable insights.

• Design, develop, and maintain scalable data infrastructure solutions to support large-scale data processing and analytics.
• Deploy and configure distributed data systems, including data storage (e.g., HDFS, cloud storage) and data processing frameworks (e.g., Hadoop, Spark), ensuring they are resilient, optimised, and production-ready.
• Build and automate ETL workflows, managing data extraction, transformation, and loading processes to ensure data quality, consistency, and availability.
• Monitor the health and performance of data infrastructure, proactively troubleshooting and resolving performance bottlenecks and operational issues to maintain system stability.
• Optimise and scale infrastructure, leveraging containerisation (e.g., Docker) and orchestration (e.g., Kubernetes) to manage resources efficiently and support growing data volumes.
• Implement data governance practices and enforce best practices for data handling, quality, security, and compliance.
• Collaborate with data engineers, analysts, and cross-functional teams to understand data requirements and support data accessibility across the organisation.
• Stay updated on the latest trends and tools in data infrastructure, evaluating and recommending new technologies to enhance our capabilities.
• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• 2+ years of experience in building, deploying, and managing data infrastructure, particularly in distributed data systems.
• Proficiency in big data technologies, including Hadoop, Spark, Hive, or related frameworks.
• Strong programming skills in languages such as Python, Java, or Scala.
• Hands-on experience with cloud platforms (e.g., Google Cloud, AWS, Azure) and cloud storage solutions.
• Knowledge of data formats such as Parquet, Avro, or ORC, and data querying tools like HiveQL.
• Familiarity with data pipeline orchestration tools, such as Apache Airflow or Luigi.
• Excellent problem-solving skills and the ability to work collaboratively within a team environment.

• Experience with additional data engineering tools like Apache Kafka, Apache NiFi, or Flume.
• Telecom industry experience, particularly in building data solutions for network performance or customer analytics.
• Familiarity with DevOps practices and CI/CD pipelines in a data engineering environment.

• Competitive Compensation : A comprehensive salary package with performance incentives.
• Career Development : Access to ongoing training, certifications, and professional development resources.
• Health and Wellness : Full health insurance, retirement plans, and wellness programs.
• Innovative Projects : Opportunities to work on high-impact data solutions with a talented, driven team.
• Cutting-Edge Environment : A collaborative culture that values creativity, learning, and innovation.

• Shape the future of digital ecosystems: Be part of a team that's redefining digital ecosystems management to make it intelligent, adaptive, and capable of supporting future demands.
• Innovate for impact: Work on cutting-edge technologies like AI, IoT, and data analytics to address real-world challenges in infrastructure.
• Empower smart cities: Contribute to building the foundation for cognitive cities - urban environments that are resilient, efficient, and adaptable.
• Grow with us: Join a dynamic, mission-driven team that values collaboration, innovation, and growth. We are committed to creating a workplace where you can thrive, learn, and make a meaningful impact.

Key Responsibilities:

• Design and develop databases and interactive dashboards to support decision-making.
• Implement Business Intelligence (BI) solutions and integrate with various data sources.
• Prepare digital performance reports, including digital transformation KPIs and service quality indicators.
• Support predictive analytics and contribute to AI-related projects.

Qualifications:

• Bachelor's degree in Data Science, Information Systems, or related field.
• At least 4 years of hands-on experience with BI tools (Power BI, Tableau, etc.).
• Proficiency in data analysis languages such as SQL, Python, or R.

Job Type: Contract

Contract length: 12 months

Pay: RO RO1, per month

Application Question(s):

• What is your salary expectation ?
• What is your nationality ?

Join to apply for the Lead Data Governance Engineer role at Canonical

3 days ago Be among the first 25 applicants

Join to apply for the Lead Data Governance Engineer role at Canonical

Get AI-powered advice on this job and more exclusive features.

Canonical is a leading provider of open-source software and operating systems for global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. Our customers include the world's leading public cloud and silicon providers, and industry leaders in many sectors. The company is a pioneer of global distributed collaboration, with 1200+ colleagues in more than 80 countries and very few office-based roles. Teams meet two to four times yearly in person, in interesting locations around the world, to align on strategy and execution.

The company is founder led, profitable and growing.

We are hiring a Lead Data Governance Engineer with focus on data governance policies, processes, standards, and monitoring in compliance with internal policies and applicable regulatory frameworks, e.g., GDPR, DPA, ISO, etc. A successful candidate will develop Python-based tooling to automate the operations of an internal data mesh solution such as data labeling and quality metrics in a data, access management and data security best practices.

The Data Governance team in the Commercial Systems unit has a mission to enable a secure and well-governed access to comprehensive data sets originating at many internal and external data sources formed in a data mesh. The team works with well-known open-source data governance tools such as Trino and Ranger, defines and executes data governance processes, and democratizes the data at Canonical.

Location : This role will be based remotely in the EMEA region.

The role entails

• Define, monitor, and execute data governance policies
• Design, implement, and maintain tooling for automated data mesh operations
• Deploy and operate services developed by the team
• Depending on your seniority, coach, mentor, and offer career development feedback
• Develop and evangelize great engineering and organizational practices
  
  

• Exceptional academic track record from both high school and university
• Undergraduate degree in a technical subject or a compelling narrative about your alternative chosen path
• Track record of going above-and-beyond expectations to achieve outstanding results
• Experience with data quality, governance, and security processes and tools
• Experience with software development in Python and SQL
• Professional written and spoken English with excellent presentation skills
• Result-oriented, with a personal drive to meet commitments
• Ability to travel internationally twice a year, for company events up to two weeks long
  
  

• Performance engineering and security experience
• Experience with Airbyte, Ranger, Superset, Temporal, or Trino
  
  

• Distributed work environment with twice-yearly team sprints in person
• Personal learning and development budget of USD 2,000 per year
• Annual compensation review
• Recognition rewards
• Annual holiday leave
• Maternity and paternity leave
• Employee Assistance Program
• Opportunity to travel to new locations to meet colleagues
• Priority Pass, and travel upgrades for long haul company events
  
  

• Seniority level Mid-Senior level

• Employment type Full-time

• Job function Information Technology
• Industries Software Development

Referrals increase your chances of interviewing at Canonical by 2x

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

JD For Server & Datacenter Engineer

· System design: Analyze requirements and design scalable and reliable IT infrastructure solutions, which can include physical servers, virtual machines, storage systems, and cloud-based resources.

· Deployment and configuration: Install, configure, and provision servers, storage devices, and other infrastructure hardware and software.

· Performance monitoring: Continuously monitor system and network performance using various tools to proactively identify and resolve potential issues.

· Troubleshooting: Diagnose and resolve complex problems related to server, network, and storage systems to minimize downtime.

· Security management: Implement and enforce security best practices, including access controls, patch management, and vulnerability remediation, to protect company data and systems.

· Backup and disaster recovery: Develop, implement, and test backup and disaster recovery plans to ensure business continuity.

· Documentation: Maintain accurate and comprehensive documentation of system configurations, processes, and network diagrams.

· Technical leadership: Mentor junior and mid-level engineers, provide technical guidance, and lead the infrastructure projects.

· Cross-functional collaboration: Work closely with other IT teams, such as network and security, to ensure seamless integration and support.

Required skills and qualifications

Technical skills:

· Operating Systems: In-depth knowledge of Windows Server and/or various Linux distributions (e.g., Ubuntu, RHEL).

· Virtualization: Hands-on experience with virtualization platforms like VMware, Hyper-V, or KVM.

· Cloud Computing: Experience with major cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP).

· Active Directory: Strong understanding of Domain protocols and services (TCP/IP, DNS, DHCP),

· Storage Technologies: Knowledge of storage solutions, including Storage Area Networks (SAN), Network-Attached Storage (NAS), and cloud storage services.

· Monitoring and Logging: Experience with monitoring tools like Prometheus, Zabbix, or Datadog.

· UPS: Performing routine inspections, preventive maintenance. Diagnosing and resolving technical issues with UPS systems and related power infrastructure.

if you are interested kindly share your cv to or contact

Job Type: Full-time

Pay: RO RO per month

Employment Type: Full-time

We are seeking a motivated and qualified NRW Hydraulic & Data Analyst Engineer to join our dynamic team in Muscat. This role offers an exciting opportunity to work on critical water network management projects, contribute to reducing Non-Revenue Water (NRW), and support sustainable water resource management in Oman.

Key Responsibilities

·   Provide engineering input for hydraulic studies and network optimization.

·   Perform detailed water balance calculations and analyze network performance (IWA methodology preferred).

·   Monitor and evaluate water network parameters, including: pressure, TDF, MNF, flow rates, consumption patterns, losses/NRW, leak detection indicators, reservoir/tank levels, and valve/pressure operations.

·   Support the planning, implementation, and monitoring of NRW reduction strategies.

·   Utilize Netbase (or similar software), Microsoft Excel, and Power BI (advantage) for data analysis, modeling, and reporting.

·   Collaborate with field teams to validate data, investigate abnormalities, and coordinate surveys/trial pits.

·   Prepare and deliver technical reports, dashboards, and presentations for management, clients, and stakeholders.

Qualifications & Skills

·   Bachelor's degree in Civil, Hydraulic, Water, or related Engineering discipline.

·   Proven experience in NRW projects, water loss management, and hydraulic analysis.

·   Strong knowledge of water balance methodology.

·   Proficiency in Excel; hands-on experience with Netbase or similar water management software; knowledge of Power BI is a plus.

·   Strong analytical, problem-solving, and critical thinking skills.

·   Excellent communication and teamwork abilities.

·   Ability to work full-time in Muscat, Oman.

Please send your CV and cover letter to with the subject line: NRW Hydraulic & Data Analyst Engineer – Muscat

Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative team that develops a managed solutions for a full range of data stores and data technologies, spanning from big data, through NoSQL, cache-layer capabilities, and analytics; all the way to structured SQL engines (similar to Amazon RDS approach).

We are facing the interesting problem of fault-tolerant mission-critical distributed systems and intend to deliver the world's best automation solution for delivering managed data platforms.

We are looking for candidates from junior to senior level with interests, experience and willingness to learn around Big Data technologies, such as distributed event-stores (Kafka) and parallel computing frameworks (Spark). Engineers who thrive at Canonical are mindful of open-source community dynamics and equally aware of the needs of large, innovative organisations.

Location: This is a Globally remote role

What your day will look like

The data platform team is responsible for the automation of data platform operations, with the mission of managing and integrating Big Data platforms at scale. This includes ensuring fault-tolerant replication, TLS, installation, backups and much more; but also provides domain-specific expertise on the actual data system to other teams within Canonical. This role is focused on the creation and automation of infrastructure features of data platforms, not analysing and/or processing the data in them.

• Collaborate proactively with a distributed team
• Write high-quality, idiomatic Python code to create new features
• Debug issues and interact with upstream communities publicly
• Work with helpful and talented engineers including experts in many fields
• Discuss ideas and collaborate on finding good solutions
• Work from home with global travel for 2 to 4 weeks per year for internal and external events
  
  

• Proven hands-on experience in software development using Python
• Proven hands-on experience in distributed systems, such as Kafka and Spark
• Have a Bachelor's or equivalent in Computer Science, STEM, or a similar degree
• Willingness to travel up to 4 times a year for internal events
  
  

• Experience operating and managing other data platform technologies, SQL (MySQL, PostgreSQL, Oracle, etc) and/or NoSQL (MongoDB, Redis, ElasticSearch, etc), similar to DBA level expertise
• Experience with Linux systems administration, package management, and infrastructure operations
• Experience with the public cloud or a private cloud solution like OpenStack
• Experience with operating Kubernetes clusters and a belief that it can be used for serious persistent data services
  
  

• Fully remote working environment - we've been working remotely since 2004!
• Personal learning and development budget of 2,000USD per annum
• Annual compensation review
• Recognition rewards
• Annual holiday leave
• Parental Leave
• Employee Assistance Programme
• Opportunity to travel to new locations to meet colleagues twice a year
• Priority Pass for travel and travel upgrades for long haul company events