Say it with video and photos

Say it with video and photos

  • Comments 10
  • Likes

As Doug mentioned in his blog post last week, Messenger is even more social now. The new feed in Messenger makes it easier than ever to stay up to date with the best of what your friends are doing across the web, whether it’s posting photos on Flickr, or updating their Facebook and MySpace profiles. Earlier this week, Mona blogged about how Messenger Companion makes it possible to have a conversation in Internet Explorer. Today, I’m excited to talk about how we’ve designed the new Messenger to allow you to share photos, videos, and content in real time, right within in your conversation window.

Sharing photos and online albums in a conversation

The previous version of Messenger let you share local images from your hard drive during an IM conversation. But we understand that you want to share everything with your friends, such as your photo albums on the web, your favorite online videos, and links to interesting sites and content. With the new Messenger, we really looked at how we can make this type of sharing possible when you’re in an IM conversation or a video call.

Most people store photos on SkyDrive, Facebook, Flickr, SmugMug or some combination of them. I use Facebook and SkyDrive. So when I start a conversation with a friend, I get a number of new options beyond just sharing a file or photo from my computer.

New options for sharing your content

New options for sharing your content

When I added Facebook to my Windows Live account, I also added access to my Facebook photo albums, so in addition to my pictures on SkyDrive, I can also share pictures that I’ve posted to Facebook.

Browse your online photos on SkyDrive

Browse your online photos on Facebook

Browse your online photos on SkyDrive and Facebook

And what’s great is that the new Messenger provides a higher quality experience for shared content that stands apart in the conversation window. You can see an example below that shows how this works. When I share a photo album with my friend John, Messenger zooms the picture by 5% to fill the entire conversation window. This edge-to-edge look puts the emphasis on my picture, and really makes it shine.

Messenger with edge-to-edge photo displayed

Messenger with edge-to-edge photo displayed

You can even download an entire photo album and share it all at once. Messenger takes care of downloading it, resizing it, and sharing it behind the scenes to quickly add the photos to your conversation. And your friend can always access the original photos, in case they want to save the high resolution images.

When you or your friend hovers over an image in the conversation window, you’ll see a thumbnail strip of all of the images and videos that have been added during the conversation. As in the previous version of Messenger, both you and your friend have control and can switch the view for the other person simply by selecting a photo from the thumbnail strip. Based on our customer research, synchronous photo-viewing is important to maintaining context during an IM conversation. In order to enhance that experience, we’ve added the ability for photo captions to download with the image. And just for fun, we also decorate the sharing experience with a glowing color background that matches the dominant color in the photo.

These improvement are pretty exciting when you compare how images are displayed in the previous version of Messenger with the new Messenger beta.

We went from this:

Previous version of Messenger

To this!

Messenger beta 

Web video sharing

People share a lot of links to video sharing sites like YouTube and Vimeo in IM conversations. So it’s pretty useful that in the new Messenger, you can now share videos without leaving the IM conversation. Simply by pasting in a link to a web video, Messenger will recognize it and present the video for inline playback. By clicking View together, both parties are able to watch the video at their own download speed and at their convenience. The video sharing sites that we currently parse links for include many of the popular sites like YouTube, Vimeo, DailyMotion, Break.com, and Wat.tv.

Web video sharing

Contextual links

One of the features that resonated extremely well with people is the contextual linking that we’ve added into IM conversations. The way this works is that Messenger has a lexicon of words that it recognizes in many of the markets and languages where Messenger is available. When a term is recognized, it is given a green dashed underline. By clicking the underlined word, we pass the word to Bing which finds links to websites, photos, and videos that you can add to your conversation on the fly.

Messenger recognizes famous people, places, and brands

Messenger recognizes famous people, places, and brands

Bing helps you find relevant photos and videos

Bing helps you find relevant photos and videos

Sharing photos and videos directly in Messenger

Sharing photos and videos directly in Messenger

Some of the words that Messenger and Bing recognize include:

  • Brands (such as Coca Cola, Toyota, Apple, Microsoft)
  • Bands and Singers (such as The Beatles, Dave Matthews, Placido Domingo)
  • Places (such as San Francisco, Bulgaria, Barbados)
  • Famous Movies (such as Gone with the Wind, Star Wars)
  • Famous people (such as celebrities, scientists, authors)

There are two ways you might use this feature. One is simply as a way to add more visual content to your IM conversations. The other way is more of a research feature. By having Bing available to you during your conversations, you can add any content that is indexed and searchable by Bing, making your conversation even richer.

Let’s say you’re having an IM conversation and want to share a video on French cooking with your friend. On the IM toolbar, click Share and then select Video from Bing. Enter your search term in the Bing search box and click the magnifying glass. Bing will return the same results you would get by going to the website.

Search for anything to share in your conversation

See what the Bing Community Search Blog is saying about it. 

Making video calls in Messenger

Of course, the ultimate representation of an actual conversation is to see and hear the person on the other end. People who use Messenger are addicted to voice and video—they use this feature 230 million times a month, for everything from socializing to staying in touch with relatives and friends abroad. Over the years, we’ve seen a switch away from a simple voice channel towards full-blown video IM. Today, 81% of the voice calls initiated in Messenger also include video.

In the new Messenger, we overhauled our video chat experience to make it more intuitive, prettier, and to improve the overall quality of the audio and video.

Improving video call quality

In voice and video we care about providing a high quality, high performing experience for customers. To that end, we pay close attention to things we can measure like call connection time, image quality, frame rate, and call completion and have made dramatic improvements to each of these.

Before the beta, we knew that a small percentage of calls were failing, but we didn’t have deep enough data to tell us why or on what combination of equipment. Video calling involves a lot of variables including CPU, web camera equipment, drivers, and fluctuating network conditions. We decided we wanted to more deeply understand the reason for certain call quality issues, quickly isolate where the problems are, and escalate bug fixes from the appropriate team responsible. So we added a ton of new telemetry to Messenger beta and have been monitoring the incoming data carefully.

We learned from the beta that we could improve video rendering performance if we moved RGB conversion to the video graphics card and save on CPU cycles. By moving the video call to run on the graphics cards available on most machines these days, we were able to see drop CPU usage by 30-50%. And by testing on various hardware and software combinations we were able to refine our implementation.

In addition to adding telemetry, and doing work to improve performance on lower range PCs, we added in-call guidance that addresses some of the common issues you run into while starting or participating in a video call. For example, if low call quality is suspected or audio problems are occurring, small alerts will pop up in the lower right of the window advising you what action to take to address the issues.

Improving the video call experience

The interface for video has been completely revamped in the Messenger. You might recall in earlier versions of Messenger, video calls were displayed inside the user tiles within the conversation window. This felt crammed and unnatural, so we focused on making sure that when you’re in a video call, the video itself is the star of the show.

Improving the video call experience

The interface for video has been completely revamped in Messenger beta. You might recall in earlier versions of Messenger, video calls were displayed inside large chromes within the conversation window like this:

Video in previous version of Messenger

As you can see, video is now edge-to-edge so that you can see more of your friend, with no distractions. But of course you can still access all the rich sharing options and quickly add photos, web videos, and links to your video call:

Video in Messenger beta

Other improvements worth mentioning include better animations and transitions in and out of a video call, being smarter about detecting what webcam you have installed, and making sure that when you are ready to have a call, all of the required software and drivers are up and running.

Lastly, we know that our decision to remove the old webcam feature has been painful for some users, and we really do hate to remove features that we know you care about. But even though the old webcam feature has been removed, it’s still absolutely possible to do one-way webcam calls, and we’re working on providing you with increased call control during video chat. The command has been simplified to just Start video call. But if you have a webcam and your friend does not, they will be able to see you and hear you, and you’ll be able hear them if they have a microphone.  If you do not want to hear your friend, or do not want to share your audio, you can simply toggle the microphone icon next to your picture or the speaker icon next to your friend’s picture.

I hope you get a chance to test out these new features in Messenger. We think they add a lot of fun and entertainment to the IM experience, and we look forward to hearing what you think.

Steven Abrahams
Lead PM, Windows Live Messenger

PS: And don’t forget that as previously announced, you’ll soon be able to have video chats with all your friends using Xbox Kinect – straight for your PC to their living room.

10 Comments
You must be logged in to comment. Sign in or Join Now
  • I still need to "view webcam" feature,i have two friends at diffent cities and i were love "view webcam" option.we want it back.

  • Hemingray
    85 Posts

    @Piero Sierra Ah, I see. Right now I'm just using Pidgin due to some weird freezing problem with WLM 2009. (it just up and dies when anyone sends me a message). Knowing me I'd have that turned off. But in the off chance I do use it, can it be set to use google instead?

  • Phil
    3 Posts

    Any thoughts as to providing WLM services within Win7 Media Center?  Would love to have video conferencing capability from my Windows Media Center computer hooked up to my TV.  Especially with Kinect coming out!

  • @Hemingray - The contextual links are not ads, they are based on the most popular search terms in Bing.  But yes, this feature can be turned off in Options | Messages.  Try it out first though!  It's a ton of fun to be able to pull up that perfect photo/video to illustrate your conversation.

  • Hemingray
    85 Posts

    Contextual links? Like the stuff Adservers tend to use (think IntelliTXT). Can it be turned off?

  • Hi !

    I have a quiestion about the new Direct2d and DirectWrite implentation. My notebook has an intel gma x3100 graphic chip and the new wave 4 beta apps are not using the new fade animations ( changing to social view, facebook picture uploads change without fade effects... ). I saw them on my desktop computer and tought there is problem with my beta installation. I reinstalled it but still nothing. Updated my video driver, directx and got all windows updates.

    Is my x3100 not powerfull enough to get these animations or is this a bug and will be fixed in the future ?

    Is there a way to enable the animations ?

    Greatings from Hungary ! Thank you for this great update !

  • @Bruno - Thanks! Can't wait to hear what you think.

    @Anonymuos - We use DirectD2 and DirectWrite just like IE9.  

    @DanielGr - Thanks for the suggestions and the bug! I've fwded these to the team.

  • danielgr
    73 Posts

    1st) I've been using the beta since day 1 and love it.

    2nd) A few improvement suggestions:

    - I understand the new WLM takes some automatic volume level approach, which is nice as a standard mode, but there has already been a lot of times I've been willing to over-ride it and got frustrated, needed to get to Windows levels for it. I'd like manual control to come back.

    - The image zooming is nice for regular holidays photos, but sometimes you really need the full frame to see. Right now I have to force my mate to download the photo and lose the syncronize viewing experience for it, which ends up being frustrating again. I'd love to get a simple switch to activate "100%  no crop viewing" when needed.

    3rd) Bug repport : It may be WLM or my logitech's Pro 9000 driver, but in any case I can't get the 4:3 view to work with the new WLM (and again, there are sometimes where I prefer it to the new 16:19 one)  

    Summing up : best IM ever by far, just don't forget to keep on improving it. !!!

  • anonymuos
    87 Posts

    Too bad it doesn't run on Windows XP. Will the Wave 4 team share what graphics technology Messenger Wave 4 needs to run exclusively on Vista and later? Last time I checked, only IE9 used Direct2D and DirectWrite.

  • Those seem to be some great fetures.

    I'll give'em a try as soon as I can :)