Blog RootPerformance Performance Engineering & Monitoring Blog

The Essential Guide to Scaling Elasticsearch

Note: This post was originally written for the Scalyr blog. You can check out the original here.

Some things aren’t always what they seem.

You’re tasked with engineering a solution that your organization needs. You implement it with a tool that seems relatively easy to set up. But over time, you realize that there’s no Easy button.

Elasticsearch is an example of one of those things. It’s a great product for collecting event data fairly quickly and easily. You start with one data node in one cluster and go from there. And because it’s free and open-source (for now), it’s even better. But as your Elasticsearch cluster grows and collects more data, you start to have some scaling issues. In this post, I’m going to provide some information on scaling an Elasticsearch implementation, as well as some general recommendations for proactive ways to scale Elasticsearch.

Continue reading →

Where is the Best Location for a Packet Capture?

You just got a call about an application slowness issue. You’ve been told that it’s not an application issue and that it must be somewhere on the network.

When you need to capture some data, for whatever reason, one question that inevitably comes up is where you should capture. What’s the best location for a packet capture? That’s a good question to ask yourself.

If you don’t, you should be. So let’s talk about that now.

Continue reading →

StatsD: How to Measure Anything in Your System

Note: This post was originally written for the Scalyr blog. You can check out the original here.

In his book “How to Measure Anything,” management consultant and author Douglas Hubbard states that “anything can be measured.” Hubbard argues that something that can be observed lends itself to being measured.

How can this apply to software development and operations? Well, in today’s world of increasingly complex IT systems, you can’t afford not to measure anything and everything. But in order to observe and then measure something, it needs to meet the literal definition of observability, meaning that a system’s internal state must be exposed externally. This allows you to measure it.

With observability, you find out not only that your system malfunctioned, but also why. This is done with data from logs, metrics, and traces.

In 2011, the Etsy Engineering team made things a little bit easier to measure and observe metrics in your IT system with the introduction of StatsD. Historically, collecting data about networks and servers has always been easier to do than gaining the same information about applications.

StatsD made collecting application metrics simpler for developers by instrumenting your code with specific metrics you want to observe. As a result, StatsD has become one of the most popular tools for gathering metrics data.

In this post, I’m going to give you a brief tutorial of StatsD and how you can use it to measure anything in your application.

Continue reading →

How to Simplify SNMP Implementation

Note: This post was originally written for the Sensu blog. You can check out the original here.

You want implementations to be simple. Who doesn’t?

But often, that’s not the case.

SNMP is one of the oldest used protocols to manage a network. SNMP stands for simple network management protocol, but it might not have been all that simple for you.

Maybe it was simple back in the late 1980s, when SNMP became a standard protocol for network monitoring. But that was over 30 years ago, and while SNMP is ubiquitous, a lot has changed.

In this post, you’ll learn what SNMP is and some challenges you may have when using it to monitor your infrastructure. You’ll also learn some best practices you should consider when implementing SNMP monitoring.

Continue reading →

Performance Monitoring in the Cloud: Does it Still Matter?

Editor’s note: This post was originally written for the eG Innovations blog. You can check out the original here.

So your organization has decided that they’re moving to the cloud.

Smart move! Many companies today are either making the move to the cloud or have already made it.

According to RightScale’s 2019 State of the Cloud Survey, 94% of IT professionals say their companies use the cloud. Over 90% is public cloud.

Gartner predicts that public cloud revenue will increase by 17% in 2020. The biggest percentage increase is expected with IaaS.

So you’re clearly not alone.

But what’s the plan after the move for making sure your applications and infrastructure perform at expected levels in the cloud?

When you no longer have full control of your infrastructure, monitoring becomes even more important than it did on-premise. Unfortunately, it seems some companies get the impression that moving to the cloud will solve all their issues.

The cloud has many benefits, but not having to monitor your workloads isn’t one of them. I want to show you why, and provide some tips for cloud performance monitoring.

Continue reading →

Review: How New Relic APM Alerts Performs

New Relic APM, 3/2020

New Relic APM helps you to understand the performance of your applications. I wanted to run some performance tests with it for my review. In this video, I walk through the Alerts feature. Here it is….

How New Relic APM Monitors – The Alerts

Transcription

Coming soon!

What Is Cloud Data Migration? A Detailed Guide

Editor’s note: This post was originally written for DataOpsZone You can check out the original here.

Do believe the hype!

Many companies are migrating their data to the cloud. Cisco forecasts that by 2021, 94% of all workloads and compute instances will be processed by cloud data centers.

But Gartner’s 2018 hype cycle did have cloud migration falling into the “trough of disillusionment.” This could be because migrating data to the cloud isn’t easy. Organizations encounter numerous issues when trying to take advantage of the cloud’s benefits.

Organizations need to plan properly before undertaking such an endeavor. Let’s look at what you can do to minimize the issues that can plague a cloud data migration project.

Continue reading →

Review: How New Relic APM Installation Performs

New Relic APM, 1/2020

New Relic APM helps you to understand the performance of your applications. I wanted to run some performance tests with it for my review. In this video, I walk through the installation process. Here it is….

How New Relic APM Monitors – The Installation

Transcription

Coming soon!

2020 is the Year of Page Load Time – You Ready?

I was recently asked by APMdigest, a community blog in the Application Performance Management space, to provide any APM predictions for 2020. Along with other analysts, consultants, and vendors, my prediction was published recently in APMdigest’s 10th annual predictions list. This year, I provided one prediction about page load time.

If you’re interested in knowing what those of us in the performance space are thinking about, I highly recommend you read the list of predictions.

As for me, the gist of what I predict is that page load time will become even more important in 2020 than it is now. In this article, I wanted to go into a little more detail about why I made this prediction.

Continue reading →

How DevOps Benefits from Application Performance Monitoring (APM)

Editor’s note: This post was originally written for the eG Innovations blog. You can check out the original here.

Competition is a funny thing. To gain or keep an edge against your competitors, you may need to push the envelope to use newer technologies and processes. But done wrong, that very technology or process could lead to your ruin.

This is where we are with DevOps. The methodology that became popular in the mid-to-late 2000s is embraced by many companies . Done the right way, it will help your organization challenge its competition to keep up with customer and user demands. But done incorrectly, it could lead to more challenges, leading to degraded user experience and product performance. To mitigate these challenges, your organization needs to include application performance monitoring (APM) as part of its DevOps implementation.

Continue reading →