Get new jobs by email
- ...Datapower, API Connect, App Connect and Cloud Pak, Familiarity with Web Services (SOAP, REST), Postman, SoapUI, queue messaging (JMS, Kafka etc.), Familiarity with CI/CD processes, Git workflows, and Agile delivery practices. Strong knowledge of code review and...
- ...Docker), and automated CI/CD pipelines. Software architecture & integration: Solid foundation in API design, event-driven streaming (Kafka, Kinesis, Pub/Sub), microservices, and integrating with enterprise legacy systems. Data engineering & analytics: Experience with...
- ...administration using command line. • Experience with data processing frameworks such as Airflow, Airbyte, DBT, Hadoop, Spark, Hive, and Kafka, Proficiency in SQL and experience with relational databases. • Knowledge of data modeling, ETL processes, and data warehousing...
- ...with Snowflake, Databricks, or similar data platforms. Experience with CDC tools and replicating from production databases. Worked on streaming use-cases using Apache Kafka or equivalent. Setup monitoring and alerts for both data pipelines and applications....
- ...operational readiness. Responsibilities: Lead HLD and LLD for the Lakehouse, covering HDFS/Ozone, YARN, Hive 3/Impala, Spark, Kafka/NiFi, Ranger, Atlas, Knox, KMS, and HMS with HA. Define storage and compute topology, cluster sizing, multi-environment...
- ...warehouses, applying layering concepts (ODS, DWD, DWS, ADS) and optimizing storage structures Integrate and maintain Hadoop, Spark, Kafka, and related big data technologies within ETL workflows Monitor ETL jobs, configure alerts, troubleshoot failures, and resolve...
- ...You will have the ability to design and manage data pipelines using modern data engineering tools such as Apache Airflow, Spark, or Kafka. You will be able to demonstrate a proven track record in deploying analytics solutions in an industrial or energy sector environment...
Aramco Overseas Company UK Ltd
Al Dhahrana month ago
