· Experience in working GCP cloud platform - (Big Query/Cloud Composer/Data Proc(or Hadoop & Spark)/Cloud Function).
· Strong programming experience in (Python, NodeJS - Express.JS framework)
· Hands-on experience in GCP L2 Administration Experience in data service Administration of DataProc , Airflow ,Composure and Big Query , (fixed module, slot allocation, deploy)
· GCP Service Enablement Good experience in Spark Administration Able to write and convert business logic into SQL queries.
· Experience in data pipeline build & IAC pipeline build and management build pipeline for new services Enhance the pipeline for existing services including secrets creation, IAM SA creation.
· Develop FinOps Optimization Solution & Toil reduction through automation Leverage AIOps for auto-healing Enhance the monitoring solution
· Cluster Performance tuning Application optimization suggestions Big Query optimizations Service Requests
· Good Programming experience in python Good hands-on experience in Atlas, Cloudera Data Platform.
· Having on experience in Cloud Networking, Storage To create work plans, monitor and track the work schedule for on time delivery as per the defined quality standards
· Good knowledge/hands-on with building DE pipelines(ETL) using Python
· Implement modernization practices such as observability and explain ability for enhanced model monitoring and interpretability.
· Utilize Jenkins and GitLab for effective code management and version control