Showing posts with label Availability Monitoring. Show all posts
Showing posts with label Availability Monitoring. Show all posts

Wednesday, November 3, 2010

IVR, Agents & Business Rules = Customer Satisfaction

During internal meetings last week, we got side-tracked on the subject of “the customer satisfaction silver bullet.” As we all know, there is no such silver bullet. A lot of folks talk like they have the only answer. But at the end of the day, it takes a great deal of coordination, information and determination to manage and improve the technology, people and processes that influence customer satisfaction.

Some services and methods help clients optimize the performance of technologies that support customer interactions like IVR and CTI. Some services capture the voice or opinion of real customers after using IVR and other contact center solutions (e.g., CallerBeat™ Real-Time Customer Experience Interviews). But somewhere in all the data provided via remote monitoring, internal measurements, analytics, customer surveys and more, companies find meaningful indicators about how to best manage technology, people and process in way that optimizes customer satisfaction. Does that mean every customer is 100% satisfied after every interaction? Absolutely not. But just because we can’t achieve the goal, doesn’t mean we should stop trying.

And no matter how we come at the issue, there’s always another meaningful perspective and source of actionable data.

Do you have any questions or comments about this blog? We would love to hear from you! Please send us an email!


Marla Geary

Thursday, May 6, 2010

You’re Taking It Out of Context

Living with a writer for the last 36 years, one of my favorite books has become “Eats, Shoots & Leaves: The Zero Tolerance Approach to Punctuation.”

The cover of the book shows two pandas, the vegetarian whiting out the comma, and the NRA member walking to the right brandishing a handgun.

The point is, of course, that punctuation matters. Why? Because punctuation establishes a context for words and thereby turns them into a thought & gives them meaning. Of course it’s not just about punctuation – content has to be coherent for there to be identifiable meaning – but context certainly matters.

How many times do we hear “I know I said that, but you took it out of context and that’s not fair?” And what that really means is that when we take something out of context, it can be misleading.

If you run a contact center, you’re no doubt swimming in numbers from all of your analytics, metrics and KPIs. It’s all important data of course, but without context, data are merely numbers that’ll drive you to distress. You may be using Tivoli or HP Operations Manager (formerly Open View) to help you organize your data and give it structure. Structure is certainly important, but I assert structure does not establish meaningful context.

To truly have context, you also need perspective. “So what am I getting at?” I hear you muttering.

You need to establish context for the metrics you get from your contact center technology instrumentation, and to do that you have to add perspective to the mix…your customers’ perspective.

Here’s what I mean…

All that data you get from your high-level system monitoring solution can in fact be nothing more than noise when there’s no context. Many times I’ve heard “The first thing we do is shut off the audible alarms because with a network like ours, there’s always something broken and if I jumped every time I got an alert that a server or segment had an issue, I’d be spending all my time chasing ghosts. Most of the time it’s just not that bad.

”What you really need to know is when the customers’ experience is being adversely impacted by a technology issue so you can use the raw data from your internal monitoring systems to identify the bad actor and get back to business. You can’t try to pursue every hiccup as though it were the end of the world – unless it is. And if it is, you need to know NOW. Whether the issue is trivial from the inside out perspective or a major failure, the context of what’s happening to customer is what you need to know so you can appropriately direct you attention.

Mike Burke
http://www.iq-services.com/
6601 Lyndale Ave South, #330
Minneapolis, MN 55423

Wednesday, April 7, 2010

Monitoring! Monitoring! Monitoring!

Whenever we start talking about our remote availability and performance monitoring services (HeartBeat™), like I did just a few weeks ago during a monitoring webinar, there is invariably a little confusion at the outset about the differences between remote availability and performance monitoring, call recording/agent quality monitoring, and voice quality monitoring. So I thought it might be helpful and interesting to define these different monitoring methods in a blog post. And I promise to try to do it without talking like an engineer (too much). So here goes…

Call Recording/Agent Monitoring/Quality Monitoring refers to applications that record and capture data from conversations between customers and call center agents including tracking the agent desktop transcript during customer interactions. The application allows supervisors to playback an agent-customer conversation and at the same time see exactly what the agent was doing during the call. Some of these applications involve speech analytics to assist with call trends analysis. This information allows contact center supervisors to assess agent performance and business rules in terms of efficiency and appropriateness, as well as to coach performance and offer self-paced training to agents who need it.

Voice Quality Monitoring in the IP Telephony world is typically an automatically generated mathematical assessment or grade that asserts how good a call sounded and how it would be rated by people if they were listening to the call at the same point the measurement is taken. There are different ways to calculate Voice Quality; I’ll try to provide a few simple definitions of a few of the common methods:

  • PESQ asserts what listeners would think based on the technology involved in the process and the measured performance of the network carrying the traffic.
  • QoS is a way to look at and rate multiple characteristics about a call so ultimately you can try to improve on each of the characteristics until the quality is satisfactory.
  • MOS is literally a subjective assessment by a bunch of people in a room voting on how good a call sounds.
  • R Factor is a number or score that tries to quantify the subjective MOS assessment made by a bunch of people in a room.

Suffice it to say that a sniffer (or router) that watches voice samples and packets going by can determine how much packet loss, jitter, and delay is happening at the network segment where it’s inspecting the packets. It can also score the call, and report the score on an instantaneous or call by call basis. That’s voice quality.

The servers that make up an IP telephony implementation, whether contact center or unified communications, are constantly monitoring and reporting on voice quality and notifying staff in some fashion if voice quality gets out of an acceptable range. It’s really important to note that in an IP world, voice quality can be really great in one spot, and really lousy somewhere else. And depending on how the path is stitched together, the voice quality numbers reported can be 100% accurate but misleading, i.e., the audio could be completely unintelligible for some reason, but the network could be carrying that garbled audio perfectly, resulting in a perfect score. On the other hand, the network may distort the audio somewhat due to packet loss or jitter, resulting in a less than perfect calculated score, yet the message could easily be intelligible by a real person. Fun, huh?

Remote Availability & Performance Monitoring is an external monitoring method that periodically calls or interacts with self-service customer facing solutions to ensure they are available and performing as expected. It is external because the transaction is generated outside the system being monitored just like a real end-user transaction.

Let’s step back a minute. Think about how a contact center is put together. Now overlay the sequence of interactions a caller has with the self-service or communications technology and all its supporting functionality (e.g., switching, routing & hunting, speech reco and text-to-speech technologies, data access & retrieval methods, CTI screen pop, etc.). Now associate each step of a typical telephone call with a unique part of the contact center’s self-service infrastructure including CTI and routing processes required to transfer a call to an agent as well. Because each test call follows a carefully defined script from the time the equipment goes off-hook and dials all the way through the end of the call, a remote availability and performance monitoring transaction acts just like a customer doing a specifically defined activity (such as checking an account balance, reporting a power outage, etc.). It verifies at each step that the system is saying exactly what is expected and responding to the end-user’s inputs within established response time thresholds. It is accessing and interacting with the self-service system. By doing so it is literally monitoring the availability and performance of that system. If the test call process determines the system is not saying what it is supposed to at any step, or taking too long to respond to end-user inputs, notifications alert someone specifically designated to assess the severity of the issue and to deal with it.

So there you have it – Agent Monitoring, Voice Quality Monitoring, and Remote Availability and Performance Monitoring – side-by-side.

Mike Burke







www.iq-services.com
6601 Lyndale Ave South, #330
Minneapolis, MN 55423

Monday, March 29, 2010

Poll Results and Filling the Gap between Internal Metrics and Customer Experience

Last week I had the opportunity to present a webinar called “Internal Monitoring Isn’t Enough.” It was an opportunity for me to educate attendees about a critical gap many companies haven’t bridged between internal performance stats and the true picture of how their contact center and communications solutions are performing – in other words, the customer experience. The simple method (or in our case, the cost-effective service) we discussed for filling this gap is Remote Availability & Performance Monitoring (RAPM)*. As you all know, polls in webinars are good, so we included several in our webinar to get a sense of the make-up and experiences of our audience. Not surprisingly, more than 60% of the attendees identified themselves as IT or service providers.

Much more interesting were the responses to our poll questions about what people are doing today to find out if their systems are working.

* Over 60% experienced outages lasting 2 or more hours
* 30% reported outages going undetected for more than a day
* Only 1 in 3 attendees relied on some kind of monitoring at all to learn about customer-impacting technology issues
* Another 13% get performance news weekly when they review performance reports or have no idea at all

Most shocking of all to us (despite the fact that we sell services to address this problem) was the following poll results:

* More than 55% of the respondents indicated they count on call center agents or customer complaints to tell them about customer-impacting technology issues!!!

Ultimately it appeared that 68% respondents were not proactively trying to determine how communications technologies impact customers.

Can you imagine trying to drive a car that’s low on oil for 2 hours before the Check Engine light comes on? Or driving with a flat tire for more than a day?

You wouldn’t do these things intentionally unless you thought it was too hard or you didn’t have an alternative to fix the issue. Similarly, no one would intentionally irritate customers (and ultimately the agents who talk with customers) hoping their complaints would provide enough information to help resolve a technology issue.

But off course that’s why we held the webinar in the first place…to let folks know there is a simple and effective way to sample and report upon customer experience that also lets you know exactly what’s going on so you can ACT when it matters.

Mike Burke

Friday, March 12, 2010

You Are Here

Last week, we were talking with a few people from a well-known research institute. We were just introducing ourselves and one of the women started talking about quality and service assurance issues for the contact center. She talked about the value of bottoms up and top down metrics for the contact center. But she also talked about a lingering gap that still remains when it comes to the ability to associate this plethora of great information with what is really happening to customers at a given moment. How do you effectively and simply put all that info into context? There are so many cures out there like speech analytics and surveys. And yet the cures sometimes come with more obstacles to overcome like: high costs, information overload, disassociation from actual transactions, lack of real time data and the possibility that the cure could itself impact the customer experience (e.g., a survey).

That’s where we got to jump in and say “Thank you for making our sales pitch for us.” She was effectively describing the gap our services fill.

Do you remember the first time you went to a mega mall or foreign airport? Do you remember how relieved you were when you found the map with the little yellow “You are here” arrow? That’s what remote availability and performance monitoring does for people navigating the megamall of contact center performance technologies and metrics. It offers the simple, straightforward view of integrated technology performance without impacting an actual customer. By monitoring the steps of a real end-user interaction, it lets you know when something goes wrong in the interaction and where to look for the problem. It provides that little yellow arrow saying “start here.” In the whirlwind of data (e.g., AHT, BHCC, abandoned calls, etc. etc.), remote availability and performance monitoring provides context so your data isn’t just data, it is actionable information.

Want to learn more? Join us for a live webinar on Tuesday, March 16 at 1 PM Central or download the recording whenever the time is right for you: REGISTER HERE.

Marla Geary

www.iq-services.com
6601 Lyndale Ave South, #330
Minneapolis, MN 55423

Thursday, February 18, 2010

What’s on Your Roadmap this Week?

Just for fun, I thought it might be interesting to talk about some of the exciting trends we’re seeing in the industry. If you work for a company that owns, supports, services or sells to contact centers, you no doubt have a similar list of your own. You’ve probably got a roadmap that identifies the trends appropriate to your market and how you can best leverage and evolve your product or service to meet tomorrow’s customer requirements.

So here’s a partial list of the things we have addressed or are preparing to address with our services in the near future:
  • Multichannel touchpoints
  • SIP
  • Cloud services
  • Virtualization
  • Unified (not merely converged) contact centers that extend into the enterprise
  • Virtual contact centers, i.e., contact centers without walls
  • Voice + Visual
  • Video self-service
  • Multi-modal transactions that demonstrate, not merely explain
As pipes get bigger, servers faster and applications more capable, the user experience gets richer and your responsibilities become more complex. Our challenge is to find ways to help you evaluate and monitor those complex and ever-evolving end-user interactions. In order to do that, we have to shut up and listen to where you are going with your plans to implement, support, service or sell contact center technologies.

So what’s around the corner for you? What challenges/opportunities are you prepared to take advantage of? Who are you listening to? You may only be self-service IVR with screen-pop to an agent today, or perhaps a website with a click-to-chat window, but you probably already know what’s coming if you don’t already have it.

Mike Burke
http://www.iq-services.com/
6601 Lyndale Ave South, #330
Minneapolis, MN 55423

Friday, February 5, 2010

Being a Small Business: Part 3

A couple of weeks ago, Gregg Williams kicked off a blog series about “Being a Small Business.” He wrote about a question that many small businesses hear from their prospects.

Why should I do business with a small business?”

Gregg talked about some of the advantages of working with small businesses and posed the very interesting and amusing question “Given all the great stuff small businesses can do, why would you want to do business with one of those bigger guys?”

The following week, Jim Jenkins weighed in on the topic. He pointed out that small businesses have the opportunity and responsibility to stay close to customers and to see every business opportunity as a partnership, not merely a transaction.

In Part 3 of this series, I’d like to explore the “Why should I do business with a small business?” question from a slightly different angle. What I’ve learned over the years is that sometimes a prospect asks this question when what they really mean is “If I invest time and resources into a partnership with you, how will I know your small business will still be around in 6 months or a year?”

When you get this kind of concern from a prospect, you want to help them get comfortable with partnering with your small business. You want them to share your confidence that a small business can be a partner they can turn to year after year. Small businesses play a pivotal role in many markets. They make products and services accessible to customers who might not otherwise have an appropriate option. Small businesses provide that all important alternative to the “Big Guy” in the market who might otherwise monopolize price, distribution, scope and more. I want my prospects to know I understand our special role in the food chain.

So how do I get customers to understand all this? Clearly each small business has its own way of addressing the “How do I know you’ll be here?” question. At IQ Services, the initial answer sounds something like…

Because we want to be here. Because we care. Because we have fun. Because we know where the industry is going. Because we listen. And because IQ Services builds partnerships that grow into relationships.

And then we get to the “prove it” stage of the conversation. That’s where our service offering roadmap comes in…

Our roadmap is the tangible evidence of our experience, care, market knowledge, listening skills and commitment to being a reliable partner. Our roadmap is about doing a better job of what we already do for our customers as well as anticipating and providing testing techniques and services that will help customers have confidence the next time they implement that “next big” thing in their contact center.

When prospects understand we have a vision and roadmap for our offerings and for staying relevant in the market, they get comfortable. Prospects recognize our sincerity. In our case, they sense our very real commitment to staying in business so the marketplace has an expert, cost-effective testing service to turn to when the “Big Guy” can’t move quick enough or provide that high-touch service that meets their unique needs. We know our presence in the marketplace makes remote testing and monitoring available to companies that don’t have the internal resources (time, money, schedule, expertise, and commitment) to do it themselves.

So what are other small businesses doing to address “will you be here tomorrow” question. Do you agree this is the question prospects are asking? Let us know what you think.
mgeary@iq-services.com.

Marla Geary
http://www.iq-services.com/
6601 Lyndale Ave South, #330
Minneapolis, MN 55423

Tuesday, October 27, 2009

The Unexpected Benefits of Contact Center Load Testing Setup

Launching a new contact center? Preparing to load test it to make sure it works? It isn’t just about throwing 100 or 1,000 or even 10,000 calls at a solution to see what happens. That’s taking the “let’s see if this breaks it!” approach, and like I’ve mentioned before, that becomes a self-fulfilling prophecy.

Many of our customers have been surprised to find that preparing for “the dreaded load testing event” can actually help everyone – employees and vendors alike – work more effectively as a team. Everyone benefits (including end-user customers) when you approach testing as a team effort instead of a series of isolated exercises to generate reports, which can be used to beat up vendors & colleagues later.

(Warning … necessary plug approaching) IQ Services pioneered the team testing approach for contact center load testing over 13 years ago. So we know from experience that a successful contact center launch starts with common objectives and widespread, shared understanding. This doesn’t happen by fiat – it takes effort & guidance (and the earlier you start the better). It is still exciting for us to see how the techniques we use to prepare for a load test also encourage everyone on our customer’s team to invest some skin in the game. Talking through what’s supposed to happen – from the end-user customer’s perspective – really helps the team get their collective head screwed on straight. It’s all about the customer experience, not just the CPU consumption or the routing plan or the VLAN partitions. If it doesn’t all work together when hundreds or thousands of customers each try to do their own thing, it really doesn’t matter if the web services building block works in isolation or under twice the load as expected. You can’t imagine how many times we’ve been in the early stages of a test engagement and heard astonished customer team members say to each other “You expect it to do what?!?”

No, really.

But that’s great news! Because it happens during a test planning session, not at 10:30 AM on the morning the system goes live.

One of the key items we review (which seems so obvious to the team after the fact) is the list of who’s responsible for everything – internal and vendor – and making sure each person is plugged into their piece of the action when we start to light up the test. For example, routing and hunting are huge, whether you’re doing it yourself or counting on a toll-free network services provider. You want those resources online & participating during the test activity – not just available by pager or cell phone. Because if there’s an issue and Theo isn’t available to (1) dump the logs before they roll over, (2) interpret the results, and then (3) fix the translations right now, you might have to bring down the curtain. Then you’ll be making plans to do it all over again tomorrow night or next week or probably when you’ve promised to chaperone your kid’s traveling soccer tournament over in Fargo.

By preparing for contact center load testing early in the process, you start considering critical questions that can impact everyone on the team but that might not otherwise be discussed. Which applications are the riskiest, which data feeds the most tenuous? How are the various sites supposed to function, individually and collectively? Caching? Record locking? How do we find out if the SIP trunks really can handle the same burst rates that PRIs dealt with? Early contact center load test discussions seem to help everyone:
  • Stay focused on the real business objectives
  • Have a keen understanding of their role/their component’s role in meeting those objectives
  • Clearly see where responsibility for any issues lie
  • Pitch in where possible to get things resolved and working so testing can continue
  • Have a shared understanding of what a successful launch will look like

Go through the load test planning and setup process in a methodical fashion. It gets your team onboard, you’re prepared to handle just about everything and you’ve probably addressed a myriad of issues before you’ve even launched the first test call.

Mike Burke
http://www.iq-services.com/
6601 Lyndale Ave South, #330
Minneapolis, MN 55423

Friday, September 18, 2009

HeartBeat™ by the numbers

I was fortunate enough to have an idea for a webinar accepted by the Contact Center Performance Forum (CCPF) a couple of months ago & the event came off without a hitch on August 6th. The topic was “Great Customer Experiences Start with Consistently High Performing Technology,” the expected audience call center managers – the people managers, not the IT wonks. I’m used to talking more about the performance of the machines in the contact center than the impact on the agents, but the hook for this webinar was you’re not going to have even half a chance at a positive experience if the technology required to handle & deliver the calls to agents falls down on the job. When callers finally do get through they’ve already been preconditioned with a lousy experience, and who will they take it out on? The CSRs of course! The moderator worked me over a bit and kept saying “Mike, you’ve got to make this real for people. Give us some real numbers. And don’t forget, agents are people too!”

So I did some digging and I was more than a little surprised.

One of the services we offer is surveillance for self-service solutions in production, the ones you often deal with before 0-ing out to get to an agent. This is our HeartBeat™ service. HeartBeat™ generates test calls one-at-a-time around the clock to access systems via the PSTN to ensure they are available & working as intended; if not, an automated notification is generated.

During a typical month we generate anywhere from half a million to 600,000 HeartBeat interactions. Would you believe that month after month, anywhere from 4% to upwards of 6% of those interactions encounter some kind of availability or performance issue? I know the HeartBeat value prop really well, but even I was surprised… 5% issues on average? Really??

Yes, really. Who knew?

Shan did. Shan manages our HeartBeat team. He lives this every day, along with Mike2 & Evan. They make up the team that defines the test cases, configures the servers, figures out what’s ok and not ok, who the system should call when there’s a ring-no-answer vs. a host down. It’s a whole lot more than just making a phone call and checking for answer.

So I asked Shan to tell me how things break down - literally – here’s what he told me:

Correcting for repeat issues (ones that last for a while and are therefore detected over & over again), here’s the distribution:

40% - Issue with answer – busy, ring-no-answer, silence or click
40% - Caller-requested information unavailable – host issue
20% - Caller disconnected prematurely

So out of 600,000 test calls in a typical month, 12,000 are answered incorrectly, or not at all. Another 12,000 are customers being led on a wild goose chase all the way to the point of finally being able to retrieve the info they need only to find out it wasn’t actually available. And another 6,000 callers are just getting cut off – they get to start from scratch.

But back to the webinar for a minute…

So here you are a call center manager working hard to keep your people and your customers and your business units all happy. You’re up-selling and cross-selling while cutting costs & keeping attendance high & training agents to deliver the best possible customer experience. And all the while you don’t know if the technology you’re counting on to take care of your customers & offload your agents is doing its job or not. A batting average of 350 gets you noticed in the majors and 94% is probably an A when grading on a curve. But how does that rate in the contact center?! Can you really afford 5% of your customer interactions going sideways?


Mike Burke


http://www.iq-services.com/
6601 Lyndale Ave South, #330
Minneapolis, MN 55423

Wednesday, September 2, 2009

Positive customer experiences

One of the things that’s really cool about working for IQ Services is the customer experience we get.

Because we test systems remotely – from the outside in, just like your customers use them – we very rarely go on-site. Not that we haven’t. But the vast majority of the time we just don’t do it because we don’t have to. The upside to this methodology is our customers don’t have to do anything to their systems for us to be able to test or monitor. They don’t have to get us security credentials to be onsite. And because travel & shipping aren’t required, it’s all very cost-effective.

The downside is we don’t meet our customers face-to-face. Not that that’s required in today’s virtual world. But it’s just friendlier when you can look someone in the eye, read their body language, and get to know them on a more personal level. Especially when you go through the wringer with them like we often do during performance testing engagements at 3am on a Saturday.

Now the exception to all this is trade shows. IQ Services exhibits at something like 14 or 15 trade shows each year. It’s our chance to find out what’s on customers’ minds, the new trends in the industry and of course generate new leads. But then there’s this other thing that happens almost all the time – I’ll be going through my pitch with a new prospect and somebody will stroll up, badge flipped so you can’t read the name, the way they always are. And as I get to the punch line or value prop, the “stranger” pipes in with something like “You should use these guys – they really help out a lot. Let me tell you what I learned…”

And then they go into their story, and start selling for us.

Like I said, it’s really cool! This happens at almost every trade show, sometimes more than once. Let’s face it…we have a very narrow niche and a really obscure service. When someone comes over to meet us & gets rolling with our sales pitch, it’s really neat. One year a very grateful customer wandered over, dropped to his knees & bowed down in front of our booth. That got some real attention! We had no idea who he was until he spoke - now that’s a customer experience worth savoring!


Mike Burke

http://www.iq-services.com/
6601 Lyndale Ave South, #330
Minneapolis, MN 55423