Develop a Podman Compose File for Automated Logstash / Logstash Pipeline Setup

$30-250 USD

Completed

Posted

14 days ago

$30-250 USD

Paid on delivery

I am seeking an experienced engineer to create a Podman Compose file designed for a Logstash environment. The key objectives of this project are to automate the setup and configuration of multiple pipelines and ensure seamless file transfers from the host to the container. Project Requirements: Pipeline File Creation: -Automatically generate 13 blank pipeline files as placeholders to verify the initial setup. File Transfers: -Transfer 13 pipeline configuration files from the host to the container, specifically to /usr/share/logstash/config. -Move the [login to view URL] configuration file from the host to /usr/share/logstash/pipeline. -Transfer a JDBC driver from the host to /usr/share/logstash/config. Java Keystore Setup: -Configure a Java Keystore on the host with 5 variables (names can be placeholders). -Transfer the Keystore file from the host to the container -Validate Keystore file works successfully Cron Automation for Pipelines: -Set up a cron job to run each of the 13 pipelines hourly, starting at 02:00 AM, with subsequent pipelines running at one-hour intervals (e.g., pipeline 2 at 03:00 AM, pipeline 3 at 04:00 AM, etc.). Data Volume Management: -Mount a volume named logstash-data for persistent data storage. Simplification of Deployment: -Preferably, package the necessary files into a single tar archive to simplify extraction and execution within the container. Deliverables: A Podman Compose file that meets the above requirements. Documentation on how the system is configured and instructions for future modifications. Additional Notes: Familiarity with Logstash, Docker/Podman, and cron job configuration is crucial.

Project ID: 38044233

About the project

7 proposals

Remote project

Active 13 days ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@techspaceone

I have extensive experience working with containerization technologies like Podman and Docker, with a focus on designing and implementing containerized environments for various applications, including data processing systems like Logstash. I have successfully created Podman Compose files for complex setups, ensuring seamless deployment and management of containerized services. My expertise includes: Podman and Docker containerization technologies Configuration management tools such as Ansible for automation Logstash configuration and pipeline development File transfer protocols and methods for efficient data transfer

$150 USD in 7 days

0.0

(0 reviews)

0.0

7 freelancers are bidding on average $260 USD for this job

@swamyvaditya

Dear sir, I'm well versed in Containerization technologies, including Docker, Docker Compose, Kubernetes. I'm also familiar with Podman. I can create a Podman Compose file with the specified requirements for an automated Logstash environment. Please contact me to discuss futher. Hope to hear from you soon. Best regards, Swamh

$300 USD in 7 days

5.0

(7 reviews)

4.6

@raeedawer

Hi, I'm Raeed. Java developer with 3 years of experience and I'm very interested in working on your project You can contact me to get started

$140 USD in 7 days

5.0

(1 review)

0.7

@dillonmarszal

Hi, ------SCRAPING, AUTOMATION EXPERT------- Please check my portfolio, I have scraped and created automation script for tons of websites. Shell Script, Containerization, Docker Compose, Docker and Linux are my core skills. I am always ready and you will get the best result you ever have.

$200 USD in 7 days

0.0

(0 reviews)

0.0

@shubh1321

With over a decade of experience in Linux and cloud technologies, including Docker and related tools like Docker Compose, I can confidently tell you that I can deliver the exact solution you're looking for. Having previously worked extensively with Logstash and managed multiple pipelines, I am familiar with its setup and automation processes. Moreover, my expertise doesn't end at deploying your system -I'll also provide comprehensive documentation and easy-to-follow instructions for future modifications. My skills extend beyond just managing and securing the network; I have hands-on experience with podman which is an ideal alternative to docker or docker-compose. This means your project will follow the best practices while staying updated given that I stay updated with the tech world. In conclusion, my track record in managing Linux servers, designing fault-tolerant AWS-based applications combined with my deep knowledge of cloud technologies promises an effective and efficient deployment for your Logstash environment. I am excited to work on this project as it combines some of my core competencies such as networking, system security, volumes management among other things. With me on board, consider this project done!

$200 USD in 7 days

0.0

(0 reviews)

0.0

@abdsharif

As a skilled and experienced developer, I'm confident I can deliver exceptional results for your project. With a strong background in Docker and Linux, I understand the complexities involved in deploying applications like Logstash effectively. Having worked on various projects aimed at automating and simplifying deployments, including cron job configurations, file transfer management, and simplification of the overall environment, incorporating such expertise into your project will translate to a robust and efficient solution. Moreover, my familiarity with Podman further empowers me to generate an effective Podman Compose file tailored for your Logstash environment. By streamlining the setup process such that it automatically generates pipeline files, manages file transfers from the host to container correctly, sets up a Java Keystore and cron jobs as required, and professionally handles volume management, your system's reliability will be maximized while reducing maintenance overhead. Furthermore, my excellent team collaboration skills enables me to also provide you with comprehensive documentation of the solution built along with clear instructions for future modifications. With me at the helm of your project implementation, you can be assured of not only quality work but also reliable ongoing support. Let's discuss next steps for your Logstash environment! Thank you.

$500 USD in 5 days