...Experience in Big Data technology stack both On Cloud and On Premise Spark & Scala, Sqoop, HDFS, YARN, Oozie, Hive, Python, Flume, Kafka, Kinesis, Spark Streaming
Hands on Experience in developing CI/CD pipeline on Gitlab Runner using tools such as SonarQube, Checkmarx...
...models in SQL or document-based storage to support capturing, storing, and retrieving key data elements. Development may also leverage Kafka, Kubernetes, GCP, or AWS.
Must haves
~3+ years working in full-stack development
~ Extensive experience in Java, React,...
...practices.
Familiarity with ETL pipelines, data flow, handling industrial plant data and using data pipeline tools such as airflow, Kafka.
Proficiency with visualization tools incl. matplotlib, bokeh, plot.ly/3D, etc.
Fluent in Python, SQL and established...