Senior NiFi Developer
Position Overview
-
As a NiFi Developer, you will be responsible for designing, developing, and maintaining scalable data pipelines using Apache NiFi. You will manage the day-to-day operations of Apache NiFi environments, ensuring they run smoothly and efficiently. This role involves setting up new NiFi environments, monitoring performance, troubleshooting issues, and ensuring security and compliance. You will develop and maintain backup and recovery procedures for NiFi environments.
Primary Responsibilities
-
Design, develop, and maintain scalable data pipelines using Apache NiFi
-
Manage day-to-day operations of Apache NiFi environments ensuring smooth and efficient operation
-
Set up new NiFi environments across multiple environments (development, testing, production)
-
Monitor performance and troubleshoot issues in NiFi deployments
-
Ensure security and compliance in NiFi configurations and deployments
-
Develop and maintain backup and recovery procedures for NiFi environments
-
Install, configure, and upgrade Apache NiFi across multiple environments
-
Design data flows using Apache NiFi with strong understanding of processors, controllers, and flow files
-
Integrate NiFi with SQL/NoSQL databases, S3/Azure Blob Storage, and SNS/Kafka
-
Troubleshoot and optimize data flows for performance and reliability
Must-Have Skills
-
3+ years of hands-on experience in Apache NiFi development and administration
-
Strong knowledge of Apache NiFi architecture and components including custom processors
-
Proficiency in installing, configuring, and upgrading Apache NiFi across multiple environments
-
Proficiency in setting up and managing user access control, LDAP integration, and SSL configurations
-
Strong proficiency in designing data flows using Apache NiFi
-
Strong understanding of NiFi processors, controllers, and flow files
-
Experience integrating NiFi with SQL/NoSQL databases, S3/Azure Blob Storage, and SNS/Kafka
-
Experience with data formats such as JSON, XML, CSV, and Avro with Jolt Transform
-
Strong ability to troubleshoot and optimize data flows for performance and reliability
-
Experience developing and maintaining backup and recovery procedures for NiFi environments
Good-to-Have Skills
-
Familiarity with other data integration tools (e.g., Kafka, Hadoop, Spark)
-
Strong communication skills, both written and verbal
-
Knowledge of RESTful APIs, SQL, and cloud services (e.g., AWS, Azure)
-
Ability to create and maintain comprehensive documentation for configurations, processes, and troubleshooting guides
-
Familiarity with Linux/Unix environments, shell scripting, and command-line tools, Docker, Kubernetes
-
Experience with monitoring tools (e.g., Prometheus, Grafana)
-
Experience with NiFi Registry, NiFi Toolkit, and NiFi Reporting Task
-
Familiarity with MiNiFi