via UXmatters http://www.uxmatters.com/mt/archives/2014/01/people-ubiquity-and-the-internet-of-things-the-new-mobile-context.php
Published: January 13, 2014
“We like to distinguish between the environmental and situational contexts of people regardless of the device. … Interactions in all … contexts are important….”
In the days before the iPhone, when only a relatively few of us thought daily about mobile devices, mobile apps, and the mobile Web, we often heard the term context bandied about. Every design discussion revolved around the fact that mobile phones could go with us anywhere; therefore, anything we designed to work on them should work everywhere. The environmental context—whether indoors, outdoors, walking, or on a bus or train—mattered a lot.
Of course, all of this has changed now—and not because the context of mobile phones has stopped being ubiquitous. But we’ve moderated—though we’d hate to say forgotten—our perception of how important it is to consider the user’s environmental context. A few years ago, various industry luminaries began to say that context doesn’t matter. Their argument wasn’t quite that users don’t matter, but rather that, since people use their devices so heavily—and often so deliberately—we can often assume that people sit in chairs or lie on couches, focusing on their device. We no longer worry about the kinds of people who ride the bus to work.
We like to distinguish between the environmental and situational contexts of people regardless of the device. Sitting at a desk is different from being slouched in the living room or repairing a truck. Interactions in all of these contexts are important, whether they happen on a notebook or desktop computer, a mobile device, or bit of paper.
Context via New Technologies?
“A key tenet of our digital life is that software controls everything digital. The principle behind the Internet of Things is that we can sensorize and connect every dumb thing and, thus, reap the benefits of digital in the real world.”
A key tenet of our digital life is that software controls everything digital. The principle behind the Internet of Things is that we can sensorize and connect every dumb thing and, thus, reap the benefits of digital in the real world. Now, we’ll be able to control everything with software. If we can digitize, search for, and analyze everything, we won’t lose things anymore, and trends won’t remain undiscovered.
Despite the term’s Internet of Things (IoT) existing since 1999, only in the last few years has this been a real possibility. Now, it’s easy to get excited about the IoT, so people are waxing philosophical about its current state and the possibilities the future might bring. Robert Scoble has even written a whole book on the world of connectivity, sensors, and so forth. He refers to this trend as the Age of Context.
The technologies he mentions—such as wearables, big data, sensor proliferation, and location awareness are indeed great, revolutionary things that we should all be aware of. Such products cannot fail to impress us; products like Nest’s thermostats and smoke detectors and Apple’s iBeacon service to enable better interior-location awareness, not to mention smartwatches and exercise bands.
The Internet of Things is far enough along that we’re well into the first wave of copycats. There are now many Internet-connected light bulbs, and every big thermostat-maker has a connected, smart version. A reporter covering CES said, “I would estimate the number of fitness and data-tracking wristbands at … infinite.”
But we are still mostly disappointed by the IoT—and low consumer usage seems to bear us out. We have the technology, but we keep using it in narrow, short-sighted ways. In fact, hardly anything we see is truly Internet connected. While you really can control that light bulb from your phone, more often than not, you can’t control it from nothing else. Is this really being Internet-connected? As Liat Ben-Zur said way back in May 2013:
“So what’s the problem? Aren’t all these hot, new connected IoT devices connected up to the cloud? Well, that’s the problem. We are oversimplifying the landscape. Each specific device seems to connect to its particular cloud service. There isn’t really one cloud. Every manufacturer has their own cloud service, and often these clouds are closed, proprietary environments. Devices that live in their own siloed cloud cannot speak to one another, meaning they cannot benefit from the data, context, or control of nearby IoT devices.”
You can discover this for yourself. Find anything that connects by Bluetooth to a smartphone. Almost all products work exclusively on either iOS or Android. Check out how you can use the data on your smart, connected widget. It either connects to your phone alone or, at best, to a proprietary database with no open API. These technologies don’t define context themselves. They are enabling technologies, not the end goal. The problems that we have today are endemic.
Where Are the People?
“Some … organizations … are trying to take advantage of the new world of sensors and connectivity by gathering and exposing more information; but not always in a very consolidated, much less a user-centered manner.”
We all know that there are sensors, even if we’re amazed at what we could do with them. But how many people are building ecosystems? Are these technologies getting built because users need them or just because we can build them? What makes you choose a particular technology or platform? The CEO of the big chip maker ARM, Simon Segars, said recently, “Most IoT applications are so narrow, with one device only talking to one service.... We need these items to talk to each other more, in order to prevent an Internet of silos.”
Some of the organizations that we’ve worked with are trying to take advantage of the new world of sensors and connectivity by gathering and exposing more information; but not always in a very consolidated, much less a user-centered manner. Just as an example, one client is launching two different Bluetooth-connected devices—that is, a single company has two totally different devices that are unaware of each other and require different apps on the mobile device to connect to the Internet. Naturally, their data is stored in two different databases that don’t connect to each other either.
Every organization and many individuals want the benefits of information awareness, so they either tolerate poor solutions or come up with their own. As you can see in Figure 1, a trucking company hacked together cable from the J1939 diesel-diagnostics connector and plugged it into to a Galaxy Tab, so the driver and his company could log progress, track vehicle use, and reduce paperwork.
Figure 1—Prototype connection dongle and cable for a tablet, connecting a truck, a driver, and his company
Such tracking systems will soon be required by law, but it’s just on the cusp of being easy to do, by adding a radio or cable. The smartness of trucks, which have been full of computers and sensors for years now, and the smartness of mobile devices can work together.
Context Is About Ecosystems
“But what people really want are seamless solutions. They don’t want to think about technology. The power of the IoT is in seamless communications….”
But what people really want are seamless solutions. They don’t want to think about technology. The power of the IoT is in seamless communications, not constant pairing with Bluetooth devices or reading the side of a light-bulb box to figure out what mobile-phone operating system (OS) it’s compatible with. Tactically, if your first design task is to decide whether to create a Web site or an app or which OS to support, you’re doing it wrong. People switch operating systems and households are mixed. Design a solution as a service, with APIs, data storage, and concepts for how people will use it before picking the colors for its buttons.
We haven’t discussed Google Glass yet—basically because for now it’s so niche and one off that it’s hard to say much about it. But one key part of Glass is really becoming a universal service. Google Now is on Glass, but is also an increasingly seamless part of Android and is available for iOS. Plus, the Google Web site
makes me suspect that they are going to launch it there sometime. The primary user interface for Google Now, shown in Figure 2, is a series of cards presenting information that is based on your context and past behavior. Sometimes, it gets confused—for example, offering me a 7-hour walk home from the airport.
makes me suspect that they are going to launch it there sometime. The primary user interface for Google Now, shown in Figure 2, is a series of cards presenting information that is based on your context and past behavior. Sometimes, it gets confused—for example, offering me a 7-hour walk home from the airport.
Figure 2—Google Now
Google Now is a service that is embedded in the current Android OS. In one way, it’s a search-portal home page like Yahoo!—and not quite like anything Google has done before. It is even tying into other services, allowing you to send an SMS just by talking to this one voice-enabled, sensor-aware portal. But it is most interesting in the way it proactively does things based on what it knows about you.
The way it monitors all that you do using all Google services is cause for worry in some. It seems to know everything about you. But, if anything, we are disappointed that it knows so little. We are regularly enticed to go visit a favorite restaurant that is 2,000 miles away, perhaps when we’re in the middle of a meeting. Google Now’s connection to location, calendars, and users’ recent behavior is pretty tenuous, so it’s not as smart as it should be.
Steven’s wife, Alison, in a fit of nerdiness, set up IFTTT to notify her when the local weather gets near freezing—so she can be sure to seal up the greenhouse and put the heater on—despite the fact they have digital thermometers strewn about the house, not to mention many mobile phones and tablets. Even if they spent the not-inconsiderable time and effort to set up a greenhouse thermometer that connected to the Internet, it would be just one more thing that Google Now is unaware of. In an ideal world, Google would use the knowledge that we know they have: that Alison is a serious gardener and has a greenhouse and the weather data to push notices via Google Now that it’s going to be freezing tonight.
Nest thermostats connect to local utilities via the Internet and adjust automatically in sync with a demand-response scheme. Setting aside any concerns about your electrical utility rather than you having control of your house, that’s all it does. There’s little awareness or notification, and there’s not really a proactive control measure for the user to do anything about this.
Even with such coordination, why isn’t the data on the Internet tied to our accounts, so right under the Weather card in Google Now we could see a Home card with thermostat settings, trends, and the utility’s demand-response points? Nest lets you establish a relationship to their physical thermostat in the app settings and provides useful visibility to trending data. But the Nest shown in Figure 3 is not connected, as you can see on the right, and a user cannot connect it from the app.
Figure 3—This Nest is not connected, a problem which cannot be corrected from the app
Half the time anyone pulls up their Nest app in front of me, it’s in an error mode like that shown in Figure 3. Most or all connected devices such as Nest, Pebble, ChromeCast, DishEverywhere, Smart TVs, and BD players aren’t very good at staying connected, so require users to walk over to the device and push buttons or pull cords out of the wall. Wireless connections are inherently unreliable, so devices and software need to be less brittle, especially if a key reason for their existence is place shifting, or remote operation.
Merging the Digital and Real Worlds
“So far, sensors have mostly been about the environment, a fairly general understanding of what a user is up to, or location. But what if your mobile device could listen to your conversations?
So far, sensors have mostly been about the environment, a fairly general understanding of what a user is up to, or location. But what if your mobile device could listen to your conversations?
Actually, such technology is not new and works great. Shopkick, for example, can turn on your phone’s microphone, detect when you enter specific stores, and deliver customized offers. Other apps have listened to conversations to determine who is nearby and establish social networks based on proximity.
Once again, setting aside privacy issues, imagine such capabilities being truly integrated and presenting or hiding content to the user more natively. When you were out for dinner, your phone could hide content, making it harder to pay attention to your phone rather than your friends. When the phone heard a lull in the conversation, it could present content relating to your previous discussions or news of general interest to kick start your conversation. Do we really need to move to a world where you check your iPhone at the door of a restaurant to get a discount?
Connectivity and environmental awareness can provide opportunities to fix current digital-only problems as well. If you started reading something tedious like a spreadsheet on your mobile phone, why should you have to continue this way when you get somewhere with a bigger monitor? Why couldn’t it pop up a notice, as shown in Figure 4, and let you send the current version to your computer, a conference-room projector, or the TV in your living room?
Figure 4—A design for a mobile app that detects nearby screens and pushes your mobile content to them
Design for People
“We seem all too ready to commit wholly to design principles that are antithetical to the traditional openness of the Internet and the Web—not to mention setting aside solving real user needs with all these new, only slightly connected Things.”
Looking at most boxes that say smart on the side, we seem all too ready to commit wholly to design principles that are antithetical to the traditional openness of the Internet and the Web—not to mention setting aside solving real user needs with all these new, only slightly connected Things.
But it’s still the early days of the Internet of Things. There’s much that we need to build and time to argue for the user and what is the best use of data to ensure that everything can connect. But it is not certain how this will happen. As Matthew Drake said recently, “There are no standards for ubiquity and real-world interactions.” Things like Revolv are trying to bridge this gap and create interoperability, but they are doing it themselves. Every time another service emerges or existing ones change, they’ll have to notice and update their service.
Hopefully, things will settle down and standards will emerge, but for now, let’s try to agree on a few basic principles of contextual awareness for ubiquitous products and the IoT:
- Users will access information according to their situation, by using whatever device is within reach.
- Situational empathy is necessary. Don’t interrupt, intrude on, or annoy users.
- The level of intrusiveness that is necessary or permitted should change depending on users’ context.
- Always allow users to override device behaviors and tweak inputs or configurations to get the results they need.
- Provide your data or service as fully as possible, everywhere, for everyone.
There’s a lot that we can do as designers of digital systems. As we make our products more ubiquitous, invisible, and connected, we must avoid getting caught up in gee-whiz technology solutions and continue to design solutions for real people.
Notes and Further Reading
- Hamburger, Ellis. “Aviate: An Always-changing, Intelligent Home Screen for Android.”
- “What caused Robert Scoble and others to switch from iOS to Android? Why did Scoble renounce his ‘Apple Fanboyism’?”
- Gartner Press Release. “Gartner Says Personal Worlds and the Internet of Everything Are Colliding to Create New Markets.”
- Ben-Zur, Liat. “Connecting Things to the Internet Does Not an Internet of Things Make.”
- Mims, Christopher. “2014 Is the Year of the Internet of Things—No, Seriously, We Mean It This Time.”
- Lee, Nicole. “ARM Report Claims the Always-Connected ‘Internet of Things’ Is Already Here.”
- Scoble, Robert. “Luminaries Take 5; Robert Scoble on The Age of Context.”
- Scoble, Robert, and Shel Israel. Age of Context: Mobile, Sensors, Data, and the Future of Privacy Paperback. CreateSpace Independent Publishing Platform, 2013.
- Fehrenbacher, Katie. “Nest Unleashes the Power of Its Smart Thermostat with Data-driven Services.”
- Johnston, Joe. “It’s All About Context: Designing the Contextual Interface.”
- Johnson, Ben. “Everything You Need to Know about CES in 10 Questions.”
- Elgan, Mike. “Snooping: It’s Not a Crime, It’s a Feature.”
- Kassner, Michael. “Smartphone Apps: They May Be Listening.”
- Lewis, Matthew. “WTF Is an iBeacon?”
- EOBR.com,
- Robles, Patricio. “The Emergence of API-First Development.”
- Etherington, Darrell. “Secret Handshake Lets You Pay with Hand Gestures and Leap Motion: No Phone or Card Required.”
- Hodgkins, Kelly. “Would You Check Your iPhone at the Door of a Restaurant for a Discount?”
- Burns, Matt. “Meet Revolv: The Missing Link to the Modern Smart Home.”
