Get new jobs by email
- ...critical workloads Architected end-to-end data pipelines —built both streaming and batch ETL workflows using Pub/Sub, Dataflow (Apache Beam), and Dataproc to ingest high-throughput events into BigQuery for real-time insights. Designed scalable data models in BigQuery...
- ...analytics and reporting Optimize cloud data warehouses — Snowflake, Amazon Redshift, or BigQuery Implement real-time streaming using Apache Kafka or Flink Support AI/ML pipelines including vector databases (Pinecone, pgvector) Drive data governance, security, and...
- ...with Snowflake, Databricks, or similar data platforms. Experience with CDC tools and replicating from production databases. Worked on streaming use-cases using Apache Kafka or equivalent. Setup monitoring and alerts for both data pipelines and applications....
- ...extensible, reusable, and meets desired architectural objectives. ~ Strong familiarity with Web Server technologies including NGINX, Apache, and J2EE. ~ Experience with Java or Ruby, and the willingness to learn new technologies (experience with other object-oriented...
- ...mission of delivering high-quality geospatial insights. Key Responsibilities Develop, monitor, and optimize ETL workflows using Apache Airflow . Build and maintain data pipelines leveraging Python and Apache Spark . Manage and query structured data in...