Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
betebet mobil commented on 12-Jul-2019 04:07 PM
Pretty section of content. I just stumbled upon your website and in accession capital to
assert that I acquire actually enjoyed account your blog posts.
Any way I will be subscribing to your feeds and even I achievement you access consistently fast.
website commented on 12-Jul-2019 04:13 PM
Very good article! We are linking to this particularly great post on our website.
Keep up the great writing.
FADOS9F1 CIRCUIT commented on 12-Jul-2019 04:27 PM
Appreciating the time and energy you put into your blog and in depth information you offer.
It's good to come across a blog every once in a while that isn't the same out of
date rehashed information. Wonderful read! I've saved your site and I'm including your RSS feeds to my Google account.
Fit Body Keto commented on 12-Jul-2019 04:32 PM
It is perfect time to make some plans for the longer term and it's time to be
happy. I have learn this publish and if I could I desire to counsel you few interesting
things or tips. Perhaps you can write subsequent articles regarding
this article. I desire to learn more issues approximately it!
Activator Pro Testosterone Price commented on 12-Jul-2019 04:39 PM
You made some really good points there. I checked on the web for more information about the
issue and found most people will go along with your views on this web site.
RevPump commented on 12-Jul-2019 05:03 PM
Hi I am so glad I found your site, I really found you by
error, while I was looking on Google for something else,
Regardless I am here now and would just like to say many thanks
for a fantastic post and a all round interesting blog (I also
love the theme/design), I don't have time to look over it all
at the minute but I have book-marked it and also added your RSS feeds, so
when I have time I will be back to read more, Please do keep
up the awesome work.
Binoculars Buying Guide commented on 12-Jul-2019 05:03 PM
Asking questions are in fact fastidious thing if you are not understanding
anything fully, but this piece of writing presents fastidious understanding even.
Audra commented on 12-Jul-2019 05:06 PM
I'm not sure why but this blog is loading extremely slow for me.

Is anyone else having this issue or is it a problem on my end? I'll check back later on and see if the problem still exists.

Also visit my blog post: Hire Divorce
Mahalia commented on 12-Jul-2019 05:11 PM
Wonderful work! That is the type of information that are meant to be shared across the web.
Shame on the search engines for now not positioning this post higher! Come on over and talk over with my site . Thanks =)

Feel free to visit my page :: miyasei.exblog.jp
Abbie commented on 12-Jul-2019 05:12 PM
Top-notch news it is really. My girlfriend has been searching for this tips.


Here is my webpage -Icontact email marketing
Boom Stands commented on 12-Jul-2019 05:16 PM
I do not know whether it's just me or if everyone else
encountering problems with your website. It appears like some of the text in your posts are running
off the screen. Can somebody else please comment and
let me know if this is happening to them too?
This could be a issue with my internet browser because I've had this
happen previously. Many thanks
game-cotuong.com commented on 12-Jul-2019 05:23 PM
Howdy this is kind of of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with HTML.
I'm starting a blog soon but have no coding experience so I
wanted to get advice from someone with experience. Any help would be enormously appreciated!
https://gumroad.com/carljreanchi commented on 12-Jul-2019 05:42 PM
I loved as much as you will receive carried out right here.
The sketch is tasteful, your authored material stylish.
nonetheless, you command get bought an nervousness over that you wish be delivering the following.
unwell unquestionably come further formerly again since
exactly the same nearly a lot often inside case you shield
this hike.
fados9F1 tester commented on 12-Jul-2019 06:14 PM
As the admin of this web site is working, no doubt
very shortly it will be renowned, due to its feature contents.
All Natural Pills commented on 12-Jul-2019 06:37 PM
Aw, this was a really good post. Finding the time and actual effort to generate
a great article… but what can I say… I put things off a
whole lot and don't seem to get anything done.
https://uxmag.com/readers/carl-reanchi commented on 12-Jul-2019 06:40 PM
This is really interesting, You're a very skilled blogger.

I have joined your feed and look forward to seeking more of your great post.
Also, I've shared your web site in my social networks!
Kyj1225.Godohosting.com commented on 12-Jul-2019 06:43 PM
Hello I am so excited I found your blog, I really found you by error, while I was browsing on Aol for something else, Regardless I am here now and
would just like to say kudos for a remarkable post and a all round entertaining blog (I also love
the theme/design), I don’t have time to browse it all at the moment but I have bookmarked it and also added in your RSS feeds, so when I have time I will be back to read
a great deal more, Please do keep up the superb work.
Fit Body Keto Review commented on 12-Jul-2019 06:55 PM
Oh my goodness! Awesome article dude! Thank you, However I am encountering troubles with your RSS.
I don't know why I cannot join it. Is there anyone else getting
identical RSS problems? Anyone who knows the answer can you kindly respond?

Thanx!!
Dura Burn Keto Ingredients commented on 12-Jul-2019 06:56 PM
Hi there to all, how is the whole thing, I think every one is getting more from this web page, and your views are fastidious designed for new people.
Victor commented on 12-Jul-2019 06:56 PM
With thanks for sharing this well put together internet site.



Also visit my web page;Buy Camping Gear Online
Domingo Galmore commented on 12-Jul-2019 07:10 PM
I found your blog site web site on yahoo and analyze just [url="http://google915er_221.com"]http://google915er_221.com[/url] a few of your early contents. Proceed to keep up the very good operate . I merely extra up your RSS feed to us RSS Bar News Reader. Searching for forward to reading extremely from you later!
Yuriko Clinkingbeard commented on 12-Jul-2019 07:13 PM
I discovered your blog web site on yahoo [url="http://google915er_221.com"]http://google915er_221.com[/url] and examine simply a few of your early contents. Proceed to maintain the excellent operate . I simply extra up your RSS feed to us RSS Bar News Reader. Searching for forward to reading very from you in the future!
Marylin Kitterman commented on 12-Jul-2019 07:15 PM
Latest Updates: MissMolly myfreecams mfc camshowdownload camgirls camshows
Kumpulan Situs Domino commented on 12-Jul-2019 07:31 PM
Hi, I think your site might be having browser compatibility issues.
When I look at your blog site in Ie, it looks fine but when opening in Internet Explorer,
it has some overlapping. I just wanted to give you a quick heads up!
Other then that, amazing blog!
Trish Dimitry commented on 12-Jul-2019 07:37 PM
I found your blog site web site on yahoo and analyze just [url="http://google915er_221.com"]http://google915er_221.com[/url] a few of your early contents. Continue to maintain the very good run . I merely additional up your RSS feed to us RSS Bar News Reader. Searching for forward to reading super from you in the future!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
betebet mobil commented on 12-Jul-2019 04:07 PM
Pretty section of content. I just stumbled upon your website and in accession capital to
assert that I acquire actually enjoyed account your blog posts.
Any way I will be subscribing to your feeds and even I achievement you access consistently fast.
website commented on 12-Jul-2019 04:13 PM
Very good article! We are linking to this particularly great post on our website.
Keep up the great writing.
FADOS9F1 CIRCUIT commented on 12-Jul-2019 04:27 PM
Appreciating the time and energy you put into your blog and in depth information you offer.
It's good to come across a blog every once in a while that isn't the same out of
date rehashed information. Wonderful read! I've saved your site and I'm including your RSS feeds to my Google account.
Fit Body Keto commented on 12-Jul-2019 04:32 PM
It is perfect time to make some plans for the longer term and it's time to be
happy. I have learn this publish and if I could I desire to counsel you few interesting
things or tips. Perhaps you can write subsequent articles regarding
this article. I desire to learn more issues approximately it!
Activator Pro Testosterone Price commented on 12-Jul-2019 04:39 PM
You made some really good points there. I checked on the web for more information about the
issue and found most people will go along with your views on this web site.
RevPump commented on 12-Jul-2019 05:03 PM
Hi I am so glad I found your site, I really found you by
error, while I was looking on Google for something else,
Regardless I am here now and would just like to say many thanks
for a fantastic post and a all round interesting blog (I also
love the theme/design), I don't have time to look over it all
at the minute but I have book-marked it and also added your RSS feeds, so
when I have time I will be back to read more, Please do keep
up the awesome work.
Binoculars Buying Guide commented on 12-Jul-2019 05:03 PM
Asking questions are in fact fastidious thing if you are not understanding
anything fully, but this piece of writing presents fastidious understanding even.
Audra commented on 12-Jul-2019 05:06 PM
I'm not sure why but this blog is loading extremely slow for me.

Is anyone else having this issue or is it a problem on my end? I'll check back later on and see if the problem still exists.

Also visit my blog post: Hire Divorce
Mahalia commented on 12-Jul-2019 05:11 PM
Wonderful work! That is the type of information that are meant to be shared across the web.
Shame on the search engines for now not positioning this post higher! Come on over and talk over with my site . Thanks =)

Feel free to visit my page :: miyasei.exblog.jp
Abbie commented on 12-Jul-2019 05:12 PM
Top-notch news it is really. My girlfriend has been searching for this tips.


Here is my webpage -Icontact email marketing
Boom Stands commented on 12-Jul-2019 05:16 PM
I do not know whether it's just me or if everyone else
encountering problems with your website. It appears like some of the text in your posts are running
off the screen. Can somebody else please comment and
let me know if this is happening to them too?
This could be a issue with my internet browser because I've had this
happen previously. Many thanks
game-cotuong.com commented on 12-Jul-2019 05:23 PM
Howdy this is kind of of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with HTML.
I'm starting a blog soon but have no coding experience so I
wanted to get advice from someone with experience. Any help would be enormously appreciated!
https://gumroad.com/carljreanchi commented on 12-Jul-2019 05:42 PM
I loved as much as you will receive carried out right here.
The sketch is tasteful, your authored material stylish.
nonetheless, you command get bought an nervousness over that you wish be delivering the following.
unwell unquestionably come further formerly again since
exactly the same nearly a lot often inside case you shield
this hike.
fados9F1 tester commented on 12-Jul-2019 06:14 PM
As the admin of this web site is working, no doubt
very shortly it will be renowned, due to its feature contents.
All Natural Pills commented on 12-Jul-2019 06:37 PM
Aw, this was a really good post. Finding the time and actual effort to generate
a great article… but what can I say… I put things off a
whole lot and don't seem to get anything done.
https://uxmag.com/readers/carl-reanchi commented on 12-Jul-2019 06:40 PM
This is really interesting, You're a very skilled blogger.

I have joined your feed and look forward to seeking more of your great post.
Also, I've shared your web site in my social networks!
Kyj1225.Godohosting.com commented on 12-Jul-2019 06:43 PM
Hello I am so excited I found your blog, I really found you by error, while I was browsing on Aol for something else, Regardless I am here now and
would just like to say kudos for a remarkable post and a all round entertaining blog (I also love
the theme/design), I don’t have time to browse it all at the moment but I have bookmarked it and also added in your RSS feeds, so when I have time I will be back to read
a great deal more, Please do keep up the superb work.
Fit Body Keto Review commented on 12-Jul-2019 06:55 PM
Oh my goodness! Awesome article dude! Thank you, However I am encountering troubles with your RSS.
I don't know why I cannot join it. Is there anyone else getting
identical RSS problems? Anyone who knows the answer can you kindly respond?

Thanx!!
Dura Burn Keto Ingredients commented on 12-Jul-2019 06:56 PM
Hi there to all, how is the whole thing, I think every one is getting more from this web page, and your views are fastidious designed for new people.
Victor commented on 12-Jul-2019 06:56 PM
With thanks for sharing this well put together internet site.



Also visit my web page;Buy Camping Gear Online
Domingo Galmore commented on 12-Jul-2019 07:10 PM
I found your blog site web site on yahoo and analyze just [url="http://google915er_221.com"]http://google915er_221.com[/url] a few of your early contents. Proceed to keep up the very good operate . I merely extra up your RSS feed to us RSS Bar News Reader. Searching for forward to reading extremely from you later!
Yuriko Clinkingbeard commented on 12-Jul-2019 07:13 PM
I discovered your blog web site on yahoo [url="http://google915er_221.com"]http://google915er_221.com[/url] and examine simply a few of your early contents. Proceed to maintain the excellent operate . I simply extra up your RSS feed to us RSS Bar News Reader. Searching for forward to reading very from you in the future!
Marylin Kitterman commented on 12-Jul-2019 07:15 PM
Latest Updates: MissMolly myfreecams mfc camshowdownload camgirls camshows
Kumpulan Situs Domino commented on 12-Jul-2019 07:31 PM
Hi, I think your site might be having browser compatibility issues.
When I look at your blog site in Ie, it looks fine but when opening in Internet Explorer,
it has some overlapping. I just wanted to give you a quick heads up!
Other then that, amazing blog!
Trish Dimitry commented on 12-Jul-2019 07:37 PM
I found your blog site web site on yahoo and analyze just [url="http://google915er_221.com"]http://google915er_221.com[/url] a few of your early contents. Continue to maintain the very good run . I merely additional up your RSS feed to us RSS Bar News Reader. Searching for forward to reading super from you in the future!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.