Some Best Operational Process Practices
APM suites are typically large systems that collect and analyze lots of data about an application. The volume of collected data can be huge. The user interfaces are necessarily complex because they must allow the administrator to identify and relate the data comprising complex interactions between all the elements of an application.
I like to think of APM suites as “WireShark on steroids”. They collect a lot of detailed data that has to be correlated and analyzed. It helps if the APM suite has a library of known applications that allow you to jump-start the analysis (the Epic medical record system comes to mind). If you need to map a new application, then expect to spend some time on it. It helps to have a couple of people dedicated to the project.
Dedicate a couple of people? Yes. These systems are big, complex, and expensive. But what they can do is amazing, so spending the money and time to deploy them provides big benefits. Look at the Gartner report Magic Quadrant for Application Performance Monitoring Suites to find a list of vendors and a general description of their suite. Most vendors have a good list of case studies that give you a good idea of their power.
The data collection engines differ from product to product. The Cisco Tetration system uses server-based software agents and network-based NetFlow collectors to gather the first 160 bytes of every packet sent and received by every server that’s instrumented. RiverBed’s AppResponse depends on network taps and packet brokers to capture packets for analysis. Any APM works best if it has data feeds from as many servers as possible, so make sure to include generous estimates for deployment.
Because of the complexity of these tools, it is also a good idea to include some consulting expertise from the vendor or an approved resource. You can think of the consulting as just-in-time, on-the-job training that quickly makes you productive.
Moving applications to a public cloud infrastructure can complicate application monitoring. Virtual appliances, plug-ins, and server agents are being provided by many APM vendors to provide packet capture and analysis within cloud deployments. You may need to work with your potential APM vendor to identify a valid strategy for your cloud architecture.
APM suites, because of their size, complexity, and expense, are typically products that appeal to larger enterprises. What are smaller organizations supposed to do?
Are there a few alternatives to a full-blown APM suite, offering less functionality at a lower price point? One class of products perform active path tests. AppNeta and NetScout come to mind as examples. These tests are based on synthetic transactions that simulate parts of an application. For example, a simple test might be to login to a web site and simulate the ordering of a particular product. Variations in the time for each step in the process can identify when a particular part of the system is not functioning correctly. Unfortunately, because these tools operate at a high level, it is frequently not possible to determine exactly what is causing the malfunction.
These tools are good at determining if a problem exists and the extent of the problem. With the right set of tests configured, they are also able to determine if there is a network problem or if slowness is due to something else. I recommend alternatives to full-blown APM suites in cases where the organization is relatively small and is running a standard set of applications (i.e., no complex, custom applications).
APM is definitely valuable to organizations that develop their own applications. In this case, look for suites that include software internal function analysis. If the applications used by a business are from an external vendor, then things are less clear. Customizable applications or applications that rely on multiple tiers of servers will benefit from the visibility provided by a full-blown APM suite. Smaller enterprises that use stock applications will likely benefit more from the deployment of active path testing products.
If you’re uncertain about what type of APM is best for your organization, look to NetCraftsmen to help work through the options and make an appropriate selection.
Some Best Operational Process Practices
Networking by the 95th Percentile
The Business of Diagnosing Slow Applications