Pandora interview: Using HTML5 to deliver content to the car

At CES this year, our own Andy Gryc had a chance to sit down with Tom Conrad, CTO at Pandora, a long-time QNX CAR platform partner. Pandora is already in 85 vehicle models today and continues to grow their footprint, not only in automotive but in consumer as well.

Take a couple minutes to hear Tom's perspective on standardizing on HTML5 across markets and to get a glimpse of the future of Internet radio in automotive. And make sure you watch the whole thing — there's some fun outtakes at the end.

Creating HTML5 apps for the car

Adding a downloadable app capability to the car isn't just a matter of bolting consumer-grade technology onto an automotive hardware platform, dusting your hands, and calling it a day.

Apps should be integrated into the vehicle experience, which means they need access to vehicle resources. But you must carefully control that access: the apps should be isolated in their own environment to protect the rest of the car software. Most of all, the apps need to conform to safe driving practices, which typically entails a re-write of the user interface.

Still, we should leverage as much as possible from the mobile world. That’s where the real innovation happens; the mobile community provides a much bigger pool of fresh ideas than automakers could ever build by themselves. And the best tools and libraries are focused on mobile development.

That’s why QNX Software Systems is building the best of both: an application tool that draws heavily from mobile, but is adapted to the car. It's provisionally named the HTML5 SDK for the QNX CAR application platform and, while it isn't yet available to the public, beta versions are now available for QNX CAR platform customers.

For a preview of what we’ll be rolling out, check out this video:

First look: HTML5 SDK for the QNX CAR platform

Whenever I hear the word “ripple,” I think of ice cream: butterscotch ripple, chocolate ripple, lemon ripple, and (yum) strawberry ripple. Well, the video I'm about to show you isn’t about ice cream, but it is about something that’s just as cool and just as sweet: the Ripple mobile environment emulator.

Ripple already supports multiple platforms, such as BlackBerry 10 and Apache Cordova, allowing developers to preview how their apps will look and function on a variety of mobile devices. And now, thanks to extensions provided by the QNX CAR development team, it will also emulate how an app looks and performs in a vehicle infotainment system.

Simply put, the same tool that helps app developers target mobile platforms will also help them target the car.

QNX Software Systems will offer this modded version of Ripple as part of the HTML5 SDK for the QNX CAR platform. The goal of the SDK is simple: to help mobile developers and automakers work together on creating apps for in-vehicle infotainment systems.

If you’re a developer, you’ll be able to use the Ripple emulator and its associated Web Inspector to perform JavaScript debugging, HTML DOM inspection, automated testing, and screen-resolution emulation, all from the convenience of a web browser. You’ll also be able to modify your apps and view the results without having to recompile — simply edit your source code and hit refresh in the browser. You’ll even be able to perform remote debugging on the evaluation board or final hardware used by the automaker, again from the same browser environment.

Enough from me. Let’s get the complete scoop from my colleague Andy Gryc:

Designing interfaces from the outside in

User interfaces are a pet peeve of mine.

I’m one of those people whose VCR always blinked 12:00. Not because I couldn’t figure it out but because I resented that I had to.

Basically, I have neither the time nor the inclination to read manuals. If I’m paying good money for a consumer-facing product then it better not require an engineering degree to use it.

Not surprisingly, then, I think UI design is every bit as important as product; maybe even more so. Because if your user experience sucks, make no mistake; I will be walking and talking to your competitors.

It wasn’t until I entered the glamorous world of software development that I came to the following conclusion: Interfaces are complicated because development tools require an engineer (or similarly brilliant individual) to use them.

Of course this is a sweeping statement and I’ll gladly debate it but the point is this: Someone with unique skills and knowledge about user-centric design should be creating interfaces. Not someone who knows the product from the inside out.

I know in a traditional model this can create a lot of churn but companies like Crank Software have come up with a way to decouple the roles of embedded engineer and UI designer, allowing them to work in parallel while focusing on their individual core competencies.

I spoke to several members of the QNX concept development team when they were heavily embroiled in creating the latest technology concept car. It was obvious when talking to the engineers and the UI designers that Crank’s Storyboard made both jobs that much easier and the process a whole lot quicker. The end result, achieved in a very short time frame, speaks for itself.

This is great news for people like me who curse like sailors whenever using a remote, microwave, GPS, treadmill, camera, and so on. Indeed, I'm counting on teams like QNX and Crank to ensure the digital car is an enjoyable and intuitive  experience. If not, I do know who I'm gonna call.

Meet the QNX concept team: True Nguyen, UX designer

We continue our spotlight on the QNX concept development team with True Nguyen, the team's user experience designer.

We interviewed True just prior to CES 2013, and she was hoping that people's impressions of the latest QNX technology concept car would be as fantastic as hers. True's love of cars stems back to her childhood, and that really comes out in the interview.

If you haven't had a chance to meet the other team members, you can read their stories here.

Next up, we'll interview Alexandre James to get his impressions of the Bentley and the buzz from CES 2013.

Day two of CES - QNX, Harman, and Vipers, oh my!

Day two came and went very fast. It felt as frantic as day one. I did manage to leave the north hall though... only to find the center hall to be just as intense. Maybe even more so. It had booths the size of city blocks. Maybe even bigger; certainly louder.

I somehow found Harman International. And I was not disappointed. There were at least four demos sporting QNX technology.

QNX CAR 2 was on display and in full form in the Harman booth. Nice to see the QNX logo so prominently displayed.


Closer look at different display in the same demo system. This 3D map from Elektrobit just never gets old.


Harman again. QNX again. This is almost embarrassing! ;-)


Harman and QNX and Vipers, oh my!


I managed to get permission to poke my head into the car. The digital instrument cluster was gorgeous.


The Viper's infotainment system was just as beautiful. Note to my boyfriend: I do believe this car is currently shipping.


The QNX booth staff, including biz dev manager Emil Dautovic, were hard at work once again. Although how hard can it be to talk to nice people all day? Maybe if there were more chairs...


Of course we knew our latest concept car would be a hit but we weren't exactly expecting the mob scene that it was again on day two.


Joe Cusumano, automotive field applications engineer, in conversation.


Linda Campbell, director of QNX strategic alliances, was her usual tireless self.


Our inimitable automotive field applications engineer Dan Baergen.


And our very own Dr. Phil, mastermind of the QNX acoustics processing and noise cancellation products.

QNX-powered Chevy Mylink drives home with 2013 Best of CES award

Congratulations to the infotainment team at Chevrolet! Their next-generation Chevy MyLink system has just won a Best of CES award, in the car tech category. The competition judges were particularly impressed with MyLink's user interface and integration with the car's instrument cluster.

The MyLink system was one of two QNX-powered finalists in this year's competition; the other was Garmin's K2 infotainment platform.

Chevy plans to roll out the new version of MyLink later this year.

Now on YouTube! First video of QNX technology concept car

Yesterday, some friends from Texas Instruments dropped by our CES booth for a demo of the new QNX concept car. The cameras were rolling, and here's what they caught.

Mark Rigley, head of the QNX concept team, did a fantastic job of guiding TI's Michael Guillory through the car's many features, including the gorgeous HD display powered by TI DLP technology and by a TI OMAP 5 processor. Check it out:



My favorite part? The exceedingly cool video conferencing. What's yours?

Works for me: The making of the QNX technology concept car

If I were asked to create a recruitment video for QNX Software Systems, this is the video I'd want to shoot. Because this is the QNX that I know and feel proud to represent.

A place where people work hard. A place where people work together. A place where people work on technology that is changing how we drive and communicate. A place where I'd rather work than anywhere else.

Enough said. Roll the tape:

It's a Bentley! A guided tour of the new QNX technology concept car

"Bend it, shape it, any way you want it"
— Headline from a QNX advertisement, circa 1987

I’m about to show you some pictures of a car. Not just any car, but a powerful, luxurious, and stunningly beautiful car. A car that has undergone a technological transformation.

If you’re like me, you'll be fascinated by the car’s features, some of which have never been seen in a vehicle — until now. But if you can, remember that it isn’t just about the cool features. It’s also about the platform that enabled them.

I’m speaking, of course, of the QNX CAR application platform.

We created the new QNX technology concept car — a modified Bentley Continental GT — to demonstrate that flexibility and customization form the very DNA of the QNX CAR platform. If you’ve seen the QNX reference vehicle, you already know that the platform provides an extremely rich environment for in-car infotainment, complete with HMI frameworks, smartphone integration, an HTML5 engine, a mobile device gateway, and a host of pre-integrated partner technologies — everything to kickstart our customers' projects. But in the automotive world, differentiation is everything. So it’s just as important that the platform enables customers to add their own branding, features, and sizzle. And to do it quickly.

Ease of branding and
personalization is just one

of the capabilities of the
QNX CAR platform.

Which is where the new concept car comes in. To create it, we used the same base QNX CAR platform that we offer our customers. But when you compare the Bentley to the Jeep, which uses a stock version of QNX CAR, the differences are dramatic: different features, different branding, and a different look-and-feel. In effect, the Jeep shows what QNX CAR can do out of the box, while the Bentley shows what QNX CAR lets you do once you start bending it to your imagination. One platform, many possibilities.

Which brings me to the slogan at the top of this post. It's amazing to think that a core value of QNX technology in the 1980s — giving customers the flexibility to achieve what they want to do — remains just as true today. Some values, it seems, are worth keeping.

And now, the car…
I know that you’re anxious to peek inside the car and see what we’ve done. But before we go any further, take a moment to savor the car’s beautifully sculpted exterior. This is one classy set of wheels. In fact, if you ask me, the wheels alone are worth the price of admission:



The awesome (and full HD) center stack
Okay, time to hop in — but get ready to prop up your jaw. Because the first thing you’ll notice is the jaw-droppingly beautiful center stack. This immense touchscreen features a gracefully curved surface, full HD graphics, and TI’s optical touch input technology, which allows a physical control knob to be mounted directly on the screen — a feature that’s cool and useful. (In the photo below, the clock display appears within the knob.)

The center stack supports a host of applications, including a 3D navigation system from Elektrobit that makes full use of the display. Just check out this bird’s-eye view of the Las Vegas Strip:



So how big is the display? Big enough to provide access to other functions, such as the car’s media player or virtual mechanic, and still have plenty room for navigation. Check it out:



The awesome (and very polite) voice rec system
Time to talk to the car. Just say “Hello Bentley,” and the car’s voice recognition system immediately comes to life and begins to interact with you — in a British accent, no less. You can now tell the media player what you’d like to hear and the navigation system where you’d like to go.

To provide natural language speech recognition, the system uses the cloud-based AT&T Watson speech engine, as well as an “intent framework” from QNX. It also uses keyword spotting technology from Sensory so you can start the system simply by talking to it.

The awesome (and nicely integrated) smartphone support
The Bentley also showcases how the QNX CAR platform enables automakers to offer advanced integration with popular smartphones. For instance, the car can communicate with a smartphone to stream music, or to provide notifications of incoming email, news feeds, and other real-time information — all displayed in a manner appropriate to the automotive context. Here's an example:



The awesome (and just plain fun) web app
I know, I know: the car looks cool, but you’re not at CES this week to see it first-hand. But how about the next best thing? Just connect to the web app and keep tabs on the Bentley in real time. (Note: The car will go online later this morning.) The app lets you view a variety of data that the car publishes to the cloud, such as what song the infotainment system is playing and whether someone has just opened a door. It also displays information that would be extremely helpful if this were your personal car, such as fluid levels and tire pressure. (This is a preliminary screen for the app, so I'm not sure if the tire pressures are realistic.)



UPDATE: The web app is now live, and the desktop version features a live camera feed of the Bentley and Jeep. Check it out!



The awesome (and very configurable) digital instrument cluster
The instrument cluster is implemented entirely in software, though you would hardly know it — the virtual gauges are impressively realistic. But more impressive still is the cluster’s ability to morph itself on the fly. Put the car in Drive, and the cluster will display a tach, gas gauge, temperature gauge, and turn-by-turn directions — the cluster pulls these directions from the center stack’s navigation system (cool, that). Put the car in Reverse, and the cluster will display a video feed from the car’s backup camera.



There are other options as well. For instance, the cluster can display information from the media player or display the current weather:



The awesome everything else
I’ve only scratched the surface of what the car can do. For instance, it also provides:

• Advanced multimedia system — Offers direct support for Pandora radio and the first embedded in-car implementation of the Shazam music discovery service.
   
• Video conferencing with realistic telepresence — Separate cameras for the driver and passenger provide independent video streams, while high-definition voice technology from QNX offers expanded bandwidth for greater realism, as well as stereo telepresence for making the remote caller sound as if they’re sitting right next to you.
   
• LTE connectivity — The car features an LTE radio modem, as well as a Wi-Fi hotspot for devices you bring into the car.

Super size those images
Want to see the center stack and instrument cluster in all their high-resolution glory? Just check out our QNX Flickr account.

That's all for now, but stay tuned: We’ll have plenty more news for you today and all through this week.

New QNX framework promises to bring power of AT&T Watson to greater variety of in-car systems

This just in: QNX has announced a new framework that will help speech recognition systems in cars understand a speaker’s intent. The framework extracts meaning from the driver’s spoken words, enabling in-car systems to set complex navigation destinations, create calendar appointments, dictate email or text messages, or even perform general Internet searches.

The framework, which is a component of the QNX CAR application platform, will enable in-car systems to take advantage of AT&T Watson, a multilingual speech engine that runs on a cloud-based server to provide high-quality, low-latency voice recognition.

Determination of the driver's intent starts on the server, where the Watson engine begins to analyze the driver's words and fits them to known patterns. The results are then handed off to the car, where the intent engine from QNX performs further speech analysis to determine how to act.

According to my colleague Andy Gryc, "the server-side analysis provided by AT&T Watson is optimized for complex scenarios, such as a navigation application in which the driver may verbalize destinations in hundreds of different ways. The QNX client-side analysis grants car makers greater flexibility, enabling them to adapt the AT&T Watson results to a variety of in-car applications, regional aspects, or personal tastes.”

The intent system will be offered as a component of the QNX CAR application platform in 2013. For more information, read the press release.

Find me a Starbucks!
QNX and AT&T have already done a lot work to bring the Watson speech engine to cars. For an example, check out this Engadget video of the QNX concept car (a modified Porsche 911), filmed at an AT&T event this past April: