What is SandDance? | Data Exposed

What is SandDance? | Data Exposed

[MUSIC].>>Hi, I’m Ronny Chatterjee. I’m a Senior Product Manager and
Azure data team at Microsoft, and I’m pleased to join with Steven Drucker from
Microsoft research.>>Yes. Hi, so I’m Steven Drucker. I’m a researcher and I
manage our visualization and interactive data analysis
team in Microsoft research.>>So today we are
going to show some of the data visualizations
experiences using SandDance. So before we get started Steve, what was the motivation
for building [inaudible].>>So we were looking at
visualizing large numbers of things and one of the things that drives me crazy is that it’s very
easy to get an aggregate, a summary, but the summary leaves out a lot of
the individual things. So we were looking at
how to actually look at the individual data but still have it organized
in an aggregate sense.>>Awesome.>>But that’s what really led.>>Okay. So let’s get started and let’s see what SandDance provides.>>Okay. Well first of all, you can go to GitHub and look
at SandDance right there. You can launch an
interactive experience here, and I’m just going to cut out go it, and we’ll just start looking
at data experience in this. So right now, the first classic dataset that we looked at a lot is
the Titanic dataset. Here we’ve got about 2,200 people on the Titanic
passengers and crew, and you can actually see it. This is like what you’d see
from a SQL query where you just look at all the numbers
would not organized at all. That doesn’t give you a
whole lot of information. But one of the things
you might want to do is you might want to say okay, who survived the
Titanic and who didn’t?>>Wow.>>You can see all those things
move into position and get those.>>So approximately like 1,500?>>Yeah, about 1,500 people died, and so it’s about double the
number of people that survived. So that’s like a one
third and two-thirds. That’s pretty striking.>>Yeah.>>So one of the
things I like to do is I like to let’s actually
add a little color. So I’m going to color this based
upon who survived the Titanic. You can see kind of
natural green and red yet, but you can choose
whatever pallets you want. That’s not really
showing anything else, but now I can select
just the people that survived and I can isolate them. I’m going to do this because
I want to see did they follow that women and children
first paradigm? So now we’re just looking at
the people that survived, and now I’m going to change
just pivot and just say, let’s look at by gender. So we can pick gender,
and you can say, wow, about the same number
women and men survived. I wouldn’t have believed that?>>I didn’t know that.>>Yeah, it’s striking. Did they not follow that? Well actually, if we stop filtering and we actually see
all the people, you can say, yes, the absolute number of men or women survived was about the same, but there were a lot more men
on the Titanic than women. So my percentages, you
have men pretty badly. But that’s not the whole story, we could also just facet this. We could actually do
four different plots based upon what cabin
class they’re in. So if we just click on, “Cabin class” here, you can
see now we’ve got first class, second class, third class in crew. In first-class, not many women died, they did really really well. Second-class, a little worse. But third class, they
did pretty poorly. So what it says here is
to be at the Titanic, it helps to be a rich woman, survived a little bit better.
But what about children? So let’s change instead
of looking at gender, let’s simply change this to age. Now, we can break this out right now at the age is a
little bit spread out. Now we’ve got 0-10 there. You can see at the 0-10, you can see in first-class, only one child died. In second class, none
of the children died. In third class, more than half died. I was curious, we can
actually zoom into this. We can actually just zoom in
and say who is this person? That’s Mrs. Helen Lorraine
Alice, and we can click on her. One of the nice things and
this is actually hooked up, you can get to the
individual data points, she look her up and
just do a being on her. It turns out there’s something
called the Encyclopedia Titanica, which I didn’t know there was that, but you find out that Lorraine Alson was the only child in first
and second class to died. It turns out that the
parents were separated from the child and the younger brother, and they vowed not to leave the Titanic until the
whole family was together. But it turns out that
there are still taking the younger brother off earlier. So she was the only child who
die in first and second class. But 53 of 76 children died. It really helps you humanize
that data, understand that.>>Yeah.>>So that’s just kind of one
of the many stories in here. There’s lots of other stories
that you can get in this. So for instance, another
thing you can find is, there’s a way of looking at this
based upon how much people paid. Let me turn off the facet
there, “Face”, “None”. So here, if we actually change this so that we look at
the price people paid for the ticket and then we if we color this by what cabin
class they end up with, you see some interesting patterns. So first of all, you can
see it’s really big. You pay a lot of money,
you get a first-class.>>Right.>>Then second-class is this orange thing and then
third class is this thing. Turns out that the
crew is not showing up because they didn’t pay at all.>>Right.>>But when I saw this, I noticed this weird
anomaly right down there. Let’s go into that
little corner here. If I could just steer over there. It’s like this person didn’t
pay much money at all. What’s going on there?
Who is this person? Who is Mr. Frans Olaf Carlson? Again, we could do the same
thing that you just click on him and we can get some
information about him. If you bring him, I won’t do it, I’ll just tell you the
punchline right now. It turns out and he was skipper on the same line that ran the Titanic.>>Oh wow, that’s very interesting.>>There was a strike and his boat wasn’t running so
they couldn’t be a captain. So they shipped him
off on the Titanic. He didn’t have to pay
anything it’s up for the taxes for his ticket. It turns out he died in the Titanic. So this guy was doubling unlucky. He couldn’t be a captain
and he couldn’t do a thing.>>Yeah.>>There’s one more anomaly here, what’s this guy here? Didn’t he paid about as much money as second class
passengers, but he’s blue.>>All right.>>So the first class,
so what’s going on? So if we click on this person, Mr. Nourney, and again, we can look him up. Turns out that Mr.
Nourney was placed, again via the old Encyclopedia
Titanica, come back, he was placed second class and
he did not like his cabin, so we went and complained and
they upgrade him on the ship. He had just had to pay for
the upgrade charges like ship which is why it didn’t show
up in that original lane. It turns out that because he was in first class or maybe not
because, but he survived. So it just shows you
that sometimes it helps to complain and maybe
you end up surviving.>>Thank you so much for showing us the lot of experiences across
with SandDance provides. Tell us more about what
are the products across Microsoft which leverages
this beautiful technology of SandDance which you build in MSR.>>So right now, it works in Azure Data Studio, Power BI, it works
as a custom visual.>>Very nice.>>You can try it
directly on the web with your own data and it doesn’t
even get uploaded to the Cloud, it just runs that data locally. So you can just look at your
own data sets right now. Of course, if you want
to do more stuff, it helps upload it to the Cloud. We’re looking at the general
plug-in architecture. We do a lot of work in visualizing
machine learning models.>>Yeah, and you also build
it in VS Code as well, right?>>Yes, exactly. It’s incorporated into VS code. So again, this whole
now at way of doing open source extensions to existing
product thinking a pluggable, it’s really exciting. To
me, it’s a new world. I’ve been here at
Microsoft almost 25 years, and just the energy that
you’re seeing now in getting stuff out there
for people to try and modify get pull
requests and add to it.>>It’s just amazing. So what’s next for SandDance?>>There are lots of
things. First of all, there’s ton of feature requests. So there’s all sorts of things. People will want to add
images to these things, different kinds of layouts. I do a lot of machine learning and
interpretability visualization. So we look at custom
ways of doing that and hooking that in project called Model Tracker that we can visualize that same individual and the aggregates. We do it in storytelling. So there’s a bunch of
projects that are under just how they told a bunch of
stories about the Titanic, but the Titanic’s not
necessarily stories you want to always be telling about. Telling stories about your
data or data that’s relevant. It just feeds into a lot of the other visualization
projects that are going on in research
and in the company.>>Very nice. So thank you everybody for listening
in and joining us today. It was a pleasure to have
you Steve today joining us in and play around with SandDance, and going around and GitHub and explore what you can do
on top off your data. Thank you so much for
listening in today.>>Thanks. [MUSIC]

2 thoughts on “What is SandDance? | Data Exposed

  1. 👨🏻‍🏭 Exciting, Visualization SandDance , perfect,
    I hope more movies for SandDance to share friends with various stories

Leave a Reply

Your email address will not be published. Required fields are marked *