ELK Engineer

Job Title : ELK Engineer

Job Location : Temple Terrace-FL-USA

Description:

MUST LEGALLY BE ABLE TO SUPPORT SERVERS THAT HOST GOVERNMENT AND LEGAL ENTITIES

*****Extensive experience in Elastic Search Engineer skilled in overseeing Elastic Cloud and Linux environments to ensure optimal performance, scalability, and security for data analytics and search applications.

Onboarding Applications new or existing data log migrations from platforms like Splunk etc in to ELK Platforms.

• Hands on experience with Fleet management & Agent deployments including experience with other shipppers like FLUENTD, Kafka etc.
• ILM indexing, data rentention. RBAC starategy & Integration Testing (Ingest Pipeline testing - Pre-Reqs, Data field mappings, layouts etc.)
• Proficient in configuring data collection agents, crafting Kibana dashboards, and refining log analysis through the GROK debugger.
• Well experienced in proactive cluster monitoring, security upkeep, and efficient automation.
• Successfully spearheaded a major ELK Stack upgrade that had a far-reaching impact across
• multiple clusters.
• Streamlined Elasticsearch cluster performance through proactive monitoring using PagerDuty, Prometheus and Grafana, ensuring minimal downtime and efficient issue resolution.
• Expertise in Elasticsearch, Logstash, Kibana, and employing machine learning-based anomaly detection.
• Proficiently manage the entire ELK stack, encompassing design, deployment, configuration, and ongoing maintenance of new ELK clusters.
• On-call rotations to provide 24/7 support and rapid incident response for critical
• ELK Platform.
• Streamline Elasticsearch cluster performance through proactive monitoring using PagerDuty, Prometheus and Grafana or equivalent to ensure minimal downtime and efficient issue resolution.
• Working knowledge of Security and reliability of ELK and Splunk servers using Ansible and/or Salt automation, as well as manual maintenance and OS patching for Linux systems

• Hands on experience in CI/CD pipeline tools such as GitHub/GitLab/Jenkins etc. for efficient code updates and seamless distribution across se

Our Global Technology Solutions group is looking for a Senior Systems & Software Engineer to lead and collaborate with portfolio teams across all LOB’s to support a framework that combines engineering and application development to drive operational stability. The ideal candidate will collaborate with the core teams combining software practices and engineering to strengthen the enterprise logging practices along with operational support. Advanced knowledge of system architecture, network, Centralized Logging (ELK), and operational stability will help transform the way the teams operate today.

• Five or more years of experience as a Full stack Linux Systems/Elastic & Application Support Engineer
• (Elastic Certified Engineer preferred)

• Strong knowledge of Systems Administration in Linux(RHEL/CentOS) and experience in troubleshooting applications running on these systems

• Strong Hands on experience Elastic Stack of tools(Elastic Search, Logstash & Kibana) that monitor and manage critical applications and infrastructure

• Securing, maintenance, optimization, documentation, and some design and build, Data Analytics & Visualization;

• Provide work breakdown and estimates for new requirements & Applying best practices for managing cluster, scaling and capacity planning.

• Create and manage Elasticsearch Clusters on premise, including configuration parameters, indexing, search and query performance tuning, RBAC security governance and administration;

• Design and configuration of ETL data pipelines using Elastic Common Schema to onboard application logs and metrics;

• Configuration of index templates and data life cycle management ILM for data retention;

• Designing and implementing solutions for centralized logs, infrastructure and health metrics, distributed tracing for different applications.

• Create Dashboard on KPIs and Fine tune bulk load process.

• Hands on Scripting & Programming in Python, Ansible, bash, data parsing (regex) etc.

• Good knowledge with Tomcat, MySQL,nginx, haproxy

• Experience with Security Hardening & Vulnerability/Compliance, OS patching, SSL/SSO/LDAP

• Understanding of HA design, cross-site replication, local and global load balancers, etc

• Data ingestion & enrichment from various sources, webhooks, and REST APIs with JSON/YAML/XML payloads & testing POSTMAN etc.

• CI/CD - Deployment pipeline experience (Ansible, GIT)

• Strong knowledge of performance monitoring, metrics, capacity planning, and management

• Familiarity with Confluence and JIRA

• Ability to apply a systematic & creative approach to solve problems, out of box thinking with a sense of ownership and focus

• Strong skills in creating documentation - engineering runbooks, support procedures, user onboarding and support documentation

• Experience with application onboarding - capturing requirements, understanding data sources, architecture diagrams, application relationships etc.

• Influencing other teams and engineering groups in adopting logging best practices.

• Effective communication skills with the ability to articulate technical details to different audience