HANDS-ON LINUX FOR ARCHITECTS : designing and implementing linux based it solutions

It is very important to understand the flexibility of an infrastructure when designing an efficient environment. In this book, you will cover everything from Linux components and functionalities through to hardware and software support, which will help you to implement and tune effective Linux-based solutions. This book gets started with an overview of Linux design methodology. Next, you will focus on the core concepts of designing a solution. As you progress, you will gain insights into the kinds of decisions you need to make when deploying a high-performance solution using Gluster File System (GlusterFS). In the next set of chapters, the book will guide you through the technique of using Kubernetes as an orchestrator for deploying and managing containerized applications. In addition to this, you will learn how to apply and configure Kubernetes for your NGINX application. You’ll then learn how to implement an ELK stack, which is composed of Elasticsearch, Logstash, and Kibana. In the concluding chapters, you will focus on installing and configuring a Saltstack solution to manage different Linux distributions, and explore a variety of design best practices. By the end of this book, you will be well-versed with designing a high-performing computing environment for complex applications to run on. By the end of the book, you will have delved inside the most detailed technical conditions of designing a solution, and you will have also dissected every aspect in detail in order to implement and tune open source Linux-based solutions. Source Code And Errata: https://www.packtpub.com/codedownloaderrata Cover Title Page Copyright and Credits About Packt Contributors Dedication Table of Contents Preface Section 1: High-Performance Storage Solutions with GlusterFS Chapter 1: Introduction to Design Methodology Defining the stages of solution design and why they matter Analyzing the problem and asking the right questions Technical standpoint Business standpoint Functional standpoint Considering possible solutions POC Implementing the solution Summary Questions Further reading Chapter 2: Defining GlusterFS Storage Technical requirements What is a cluster? Computing a cluster Storage clusters What is GlusterFS? SDS Cost reduction Scalability Control The market is moving toward SDS Massive storage Block, file, and object storage Block storage File storage Object storage Why choose GlusterFS? GlusterFS features Commodity hardware – GlusterFS runs on pretty much anything GlusterFS can be deployed on private, public, or hybrid clouds No single point of failure Scalability Asynchronous geo-replication Performance Self-healing Flexibility Remote direct memory access (RDMA) Gluster volume types Distributed Replicated Distributed replicated Dispersed Distributed dispersed The need for highly redundant storage Disaster recovery RTO RPO Synchronous replication Asynchronous replication The need for high performance Parallel I/O Summary Questions Further reading Chapter 3: Architecting a Storage Cluster Technical requirements GlusterFS compute requirements RAM Why is cache important? CPU Cloud considerations How much space do you need? GlusterFS volume type Distributed Replicated Dispersed Space required by the application Projected growth Performance considerations Throughput Latency IOPS I/O size GlusterFS performance Volume type Brick layout Number of nodes Tuning parameters The best approach for high availability Replicated Dispersed Geo-replication How the workload defines requirements Documentation System tools File type and size Ask the right questions Summary Questions Further reading Chapter 4: Using GlusterFS on the Cloud Infrastructure Technical requirements Setting up the bricks used for backend storage Azure deployment ZFS as the backend for the bricks Installing ZFS Configuring the zpools Adding the ZFS cache to the pool (optional) Installing GlusterFS on the nodes Installing the packages Creating the trusted pool Creating the volumes Creating a dispersed volume Mounting the volume Optimizing performance GlusterFS tuning ZFS ARC L2ARC Summary Questions Further reading Chapter 5: Analyzing Performance in a Gluster System Technical requirements An overview of the implementation An overview of the cluster Performance testing Performance theory Performance tools The ZFS zpool iostat command iostat The FIO tester Availability testing Scaling Summary Questions Further reading Section 2: High-Availablility Nginx Web Application Using Kubernetes Chapter 6: Creating a Highly Available Self-Healing Architecture Microservices Creating container images FROM LABEL RUN ENV COPY EXPOSE CMD and ENTRYPOINT Building container images using best practices Container orchestration Kubernetes Summary Questions Further reading Bibliography/sources Chapter 7: Understanding the Core Components of a Kubernetes Cluster The Kubernetes control plane The kube-apiserver The kube-controller-manager The kube-scheduler The etcd database Kubernetes worker nodes Container runtime The kubelet The kube-proxy Kubernetes objects Pods – the basis of Kubernetes Deployments Services Kubernetes and persistent storage Volumes Persistent Volumes, Persistent Volume Claims, and Storage Classes Summary Questions Further reading Chapter 8: Architecting a Kubernetes Cluster Kube-sizing etcd considerations kube-apiserver sizing Worker nodes Load balancer considerations Storage considerations Network requirements Kubernetes DNS-based service discovery Customizing kube objects Namespacing Limiting namespace resources Customizing pods Summary Questions Further reading Chapter 9: Deploying and Configuring Kubernetes Infrastructure deployment Installing Azure CLI Configuring Azure CLI High-level design overview Provisioning network resources Provisioning compute resources Preparing the management VM Generating certificates Certificate authority Client certificates Control plane certificates Sending our certificates home Kubeconfigs Installing kubectl Kube-controller-manager Kube-scheduler Kubelet configs Kube-proxy Moving configs around Installing the control plane ETCD Installing etcd Encrypting etcd data Installing the Kubernetes controller binaries Kube-apiserver Kube-controller-manager Kube-scheduler Starting the control plane Setting RBAC permissions for kubelets. Cluster role Cluster role binding Load-balancer setup Creating the load-balancer Azure load-balancer The backend pool Health probes Load-balancing rules Worker node setup Downloading and preparing binaries Adding the Kubernetes repository Installing dependencies and kubectl Downloading and storing worker binaries Containerd setup The kubelet kube-proxy Starting services Kubernetes networking Getting the nodes ready Configuring remote access Installing Weave Net DNS server Managing Kubernetes on the cloud Summary Questions Further reading Bibliography/sources: Section 3: Elastic Stack Chapter 10: Monitoring with the ELK Stack Technical requirements Understanding the need for monitoring Decisions made through historical data Proactively detect problems Understand environment performance Plan for budget Centralized logs Elasticsearch overview Fast Scalable Highly available Logstash Grok Custom patterns Kibana brings everything together Summary Questions Further reading Chapter 11: Designing an ELK Stack Technical requirements Elasticsearch CPU requirements CPU count CPU speed CPU performance impact Startup Index per second Search latency Recommendations Test/dev Production Memory sizing for Elasticsearch Filesystem cache Disable swap Undersizing memory Unable start OOM killer Recommendations Storage configuration for Elasticsearch Capacity Performance Considerations Logstash and Kibana requirements Logstash Kibana Summary Questions Further reading Chapter 12: Using Elasticsearch, Logstash, and Kibana to Manage Logs Technical requirements Deployment overview Installing Elasticsearch The RPM repository The Elasticsearch data directory Partitioning the disk Formatting the filesystem Persistent mounting using fstab Configuring Elasticsearch Elasticsearch YAML Cluster name Discovery settings Node name Network host Path settings Starting Elasticsearch Adding an Elasticsearch node Installing Logstash and Kibana Configuring Logstash Logstash YAML Logstash pipelines Configuring Kibana Kibana YAML The coordinating node Starting Logstash and Kibana What are Beats? Filebeat Metricbeat Let's not skip a beat – installing Beats Configuring Beats clients Filebeat YAML Metricbeat YAML Next steps Summary Questions Further reading Section 4: System Management Using Saltstack Chapter 13: Solving Management Problems with Salty Solutions Centralizing system management New technologies and system management Recovering control of our own infrastructure Centralized tools to disperse problems Coding for a desired state Understanding NaCl Introducing Salt The SaltStack platform Salt capabilities Remote command execution modules The sys module The pkg module The test module Salt states Grains of Salt Salt pillars Summary Questions Further reading Chapter 14: Getting Your Hands Salty Hands-on with Salt Scenario Terraforming our initial infrastructure Setting up Terraform Creating IaC Installing Salt with package managers Installing CentOS yum Ubuntu apt-getting Salt Installing Salt via the bootstrap script Master and minion handshake Working with Salt Creating WebServer formulas Creating load-balancing formulas Summary Chapter 15: Design Best Practices Designing for the occasion On-premises environments Bare metal server Virtual machines Cloud environments The journey to the cloud Assessing Migrating Lift and shift Refactor Rearchitecting Rebuild Optimizing DevOps Monolithic waterfalls Agile solutions to monolithic problems Continuous culture for CI/CD Summary Questions Further reading Assessments Other Books You May Enjoy Index Explore practical use cases to learn everything from Linux components, and functionalities, through to hardware and software support Key FeaturesGain a clear understanding of how to design a Linux environmentLearn more about the architecture of the modern Linux operating system(OS)Understand infrastructure needs and design a high-performing computing environmentBook DescriptionIt is very important to understand the flexibility of an infrastructure when designing an efficient environment. In this book, you will cover everything from Linux components and functionalities through to hardware and software support, which will help you to implement and tune effective Linux-based solutions. This book gets started with an overview of Linux design methodology. Next, you will focus on the core concepts of designing a solution. As you progress, you will gain insights into the kinds of decisions you need to make when deploying a high-performance solution using Gluster File System (GlusterFS). In the next set of chapters, the book will guide you through the technique of using Kubernetes as an orchestrator for deploying and managing containerized applications. In addition to this, you will learn how to apply and configure Kubernetes for your NGINX application. Youll then learn how to implement an ELK stack, which is composed of Elasticsearch, Logstash, and Kibana. In the concluding chapters, you will focus on installing and configuring a Saltstack solution to manage different Linux distributions, and explore a variety of design best practices. By the end of this book, you will be well-versed with designing a high-performing computing environment for complex applications to run on. By the end of the book, you will have delved inside the most detailed technical conditions of designing a solution, and you will have also dissected every aspect in detail in order to implement and tune open source Linux-based solutions What you will learnStudy the basics of infrastructure design and the steps involvedExpand your current design portfolio with Linux-based solutionsDiscover open source software-based solutions to optimize your architectureUnderstand the role of high availability and fault tolerance in a resilient designIdentify the role of containers and how they improve your continuous integration and continuous deployment pipelinesGain insights into optimizing and making resilient and highly available designs by applying industry best practicesWho this book is forThis intermediate-level book is for Linux system administrators, Linux support engineers, DevOps engineers, Linux consultants or any open source technology professional looking to learn or expand their knowledge in architecting, designing and implementing solutions based on Linux and open source software. Prior experience in Linux is required. Table of ContentsIntroduction to design methodologyDefining GlusterFS StorageArchitecting a storage clusterUsing GlusterFS on cloud infrastructureAnalyzing Performance in a Gluster systemCreating a Highly available self-healing ArchitectureUnderstanding the core components of a Kubernetes clusterArchitecting Kubernetes on AzureDeploying and Configuring KubernetesMonitoring with ELK stackDesigning an ELK StackUsing Elasticsearch, Logstash, and Kibana to Manage Explore practical use cases to learn everything from Linux components, and functionalities, through to hardware and software support Key Features Gain a clear understanding of how to design a Linux environment Learn more about the architecture of the modern Linux operating system(OS) Understand infrastructure needs and design a high-performing computing environment Book Description It is very important to understand the flexibility of an infrastructure when designing an efficient environment. In this book, you will cover everything from Linux components and functionalities through to hardware and software support, which will help you to implement and tune effective Linux-based solutions. This book gets started with an overview of Linux design methodology. Next, you will focus on the core concepts of designing a solution. As you progress, you will gain insights into the kinds of decisions you need to make when deploying a high-performance solution using Gluster File System (GlusterFS). In the next set of chapters, the book will guide you through the technique of using Kubernetes as an orchestrator for deploying and managing containerized applications. In addition to this, you will learn how to apply and configure Kubernetes for your NGINX application. You'll then learn how to implement an ELK stack, which is composed of Elasticsearch, Logstash, and Kibana. In the concluding chapters, you will focus on installing and configuring a Saltstack solution to manage different Linux distributions, and explore a variety of design best practices. By the end of this book, you will be well-versed with designing a high-performing computing environment for complex applications to run on. By the end of the book, you will have delved inside the most detailed technical conditions of designing a solution, and you will have also dissected every aspect in detail in order to implement and tune open source Linux-based solutions What you will learn Study the basics of infrastructure design and the steps involved Expand your current design portfolio with Linux-based solutions Discover open source software-based solutions to optimize your architecture Understand the role of high availability and fault tolerance in a resilient design Identify the role of containers and how they improve your continuous integration and continuous deployment pipelines Gain insights into optimizing and making resilient and highly available designs by applying industry best practices Who this book is for This intermediate-level book is for Linux system administrators, Linux support engineers, DevOps engineers, Linux consultants or any open source technology professional looking to learn or expand their knowledge in architecting, designing and implementing solutions based on Linux and open source software. Prior experience in Linux is required. Learn everything from Linux components to functionalities and hardware/software support with the help of practical use cases About This Book A practical guide to give you a clear understanding of designing a Linux environment Learn more about the architecture of the modern Linux OS Understand infrastructure needs and design high performing computing environment Who This Book Is For This book is aimed at Linux system administrators, Linux support engineers, DevOps Engineers, Linux consultants or any other type of Open Source technology professional that are looking to learn or expand their knowledge in architecting, designing and implementing solutions based on Linux and open source software. Previous experience in Linux is required for understanding this book. What You Will Learn Infrastructure design basics Linux based infrastructure and systems architecture Open Source based IT solutions High Availability and Fault tolerance considerations while designing infrastructure Continuous Integration/ Continuous Delivery Design optimization In Detail It is very important to understand the flexibility of open source software by taking a solution and analyzing every aspect of it that needs to be taken into consideration. In this book, we will cover commonly used software in their most typical configuration based on Linux Operating Systems and Open Source software. This book will start with an overview of the design methodology and then quickly deep dive into helping you understand the core concepts of designing a solution. Next, you will understand the decisions needed to be made when deploying a high performance solution using gluster. The next set of chapters will help you understand the advantages of using Kubernetes as an orchestrator for deploying and managing containerized applications and also know learn how to deploy and configure Kubernetes for your NGINX application. Next, you will learn to implement an ELK stack composed of Elastisearch, Logstash and Kibana. The last set of chapters will focus more on installing and configuring a Spacewalk solution to manage different Linux distributions and also provide you with a set of design best practices towards the end. By the end of the book, you will have delved inside the technical aspects of designing a solution, where you will dissect every aspect with in-depth details to implement and tune Open Source Linux based solutions. Downloading the example code for this book. You can download the exampl... When it comes to an architectural job role, that particular individual should be able to understand any infrastructure and should be capable of designing an efficient environment. This book will help you understand and achieve the level of knowledge required to architect and implement various IT solutions based on Linux Learn to efficiently run Linux-based workloads in Azure Key Features Manage and deploy virtual machines in your Azure environment Explore various open source tools to integrate automation and orchestration Leverage Linux features to create, run, and manage containers Book Description Azure's market share has increased massively and enterprises are adopting it rapidly. Linux is a widely-used operating system and has proven to be one of the most popular workloads on Azure. It has become crucial for Linux administrators and Microsoft professionals to be well versed with the concepts of managing Linux workloads in an Azure environment. Hands-On Linux Administration on Azure starts by introducing you to the fundamentals of Linux and Azure, after which you will explore advanced Linux features and see how they are managed in an Azure environment. Next, with the help of real-world scenarios, you will learn how to deploy virtual machines(VMs) in Azure, along with extending Azure VMs capabilities and managing them efficiently. You will then understand continuous configuration automation and use Ansible, SaltStack and Powershell DSC for orchestration. As you make your way through the chapters, you will understand containers and how they work, along with managing containers and the various tasks you can perform with them. In the concluding chapters, you will cover some Linux troubleshooting techniques on Azure, and you will also be able to monitor Linux in Azure using different open source tools. By the end of this book, you will be able to administer Linux on Azure and make the most of the important tools required for deployment. What you will learn Understand why Azure is the ideal solution for your open source workloads Master essential Linux skills and learn to find your way around the Linux environment Deploy Linux in an Azure environment Use configuration management to manage Linux in Azure Manage containers in an Azure environment Enhance Linux security and use Azure's identity management systems Automate deployment with Azure Resource Manager (ARM) and Powershell Employ Ansible to manage Linux instances in an Azure cloud environment Who this book is for Hands-On Linux Administration on Azure is for Linux administrators and Microsoft professionals that need to deploy and manage their workloads in Azure. Prior knowledge of Linux and Azure isn't necessary. Downloading the example code for this book You can download the example code files for all Pack .. Over 100 recipes to get up and running with the modern Linux administration ecosystem Key Features Understand and implement the core system administration tasks in Linux Discover tools and techniques to troubleshoot your Linux system Maintain a healthy system with good security and backup practices Book Description Linux is one of the most widely used operating systems among system administrators, and even modern application and server development is heavily reliant on the Linux platform. The Linux Administration Cookbook is your go-to guide to get started on your Linux journey. It will help you understand what that strange little server is doing in the corner of your office, what the mysterious virtual machine languishing in Azure is crunching through, what that circuit-board-like thing is doing under your office TV, and why the LEDs on it are blinking rapidly. This book will get you started with administering Linux, giving you the knowledge and tools you need to troubleshoot day-to-day problems, ranging from a Raspberry Pi to a server in Azure, while giving you a good understanding of the fundamentals of how GNU/Linux works. Through the course of the book, you'll install and configure a system, while the author regales you with errors and anecdotes from his vast experience as a data center hardware engineer, systems administrator, and DevOps consultant. By the end of the book, you will have gained practical knowledge of Linux, which will serve as a bedrock for learning Linux administration and aid you in your Linux journey. What you will learn Install and manage a Linux server, both locally and in the cloud Understand how to perform administration across all Linux distros Work through evolving concepts such as IaaS versus PaaS, containers, and automation Explore security and configuration best practices Troubleshoot your system if something goes wrong Discover and mitigate hardware issues, such as faulty memory and failing drives Who this book is for If you are a system engineer or system administrator with basic experience of working with Linux, this book is for you. Downloading the example code for this book You can download the example code files for all Packt books you have purchased from your account at http://www.PacktPub.com. If you purchased this book elsewhere, you can visit http://www.PacktPub.com/support and register to have the files e-mailed directly to you By the end of the book, you will have delved inside the most detailed technical conditions of designing a solution, and you will have also dissected every aspect in detail in order to implement and tune open source Linux-based solutions h4What you will learn/h4 ul liStudy the basics of infrastructure design and the steps involved /li liExpand your current design portfolio with Linux-based solutions /li liDiscover open source software-based solutions to optimize your architecture /li liUnderstand the role of high availability and fault tolerance in a resilient design /li liIdentify the role of containers and how they improve your continuous integration and continuous deployment pipelines /li liGain insights into optimizing and making resilient and highly available designs by applying industry best practices/li/ul h4Who this book is for/h4 This intermediate-level book is for Linux system administrators, Linux support engineers, DevOps engineers, BExplore practical use cases to learn everything from Linux components, and functionalities, through to hardware and software support/b h4Key Features/h4 ul liGain a clear understanding of how to design a Linux environment /li liLearn more about the architecture of the modern Linux operating system(OS) /li liUnderstand infrastructure needs and design a high-performing computing environment/li/ul h4Book Description/h4 It is very important to understand the flexibility of an infrastructure when designing an efficient environment. In this book, you will cover everything from Linux components and functionalities through to hardware and software support, which will help you to implement and tune effective Linux-based solutions. This book gets started with an overview of Linux design methodology. Next, you will focus on the core concepts of designing a solution. Introduction and Environment Setup Remote Administration with SSH Networking and Firewalls Services and Daemons Hardware and Disks Security, Updating, and Package Management Monitoring and Logging Permissions, SELinux, and AppArmor Containers and Virtualization Git, Configuration Management, and Infrastructure as Code Web Servers, Databases, and Mail Servers Troubleshooting and Workplace Diplomacy BSDs, Solaris, Windows, IaaS and PaaS, and DevOps