Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
redboy commented on 14-Aug-2019 04:29 PM
Valuable information. Lucky me I found your site by accident, and I am shocked why this accident did not happened earlier! I bookmarked it.
softprolink commented on 14-Aug-2019 04:29 PM
Wonderful beat ! I wish to apprentice while you amend your site, how could i subscribe for a blog web site? The account helped me a acceptable deal. I had been tiny bit acquainted of this your broadcast offered bright clear concept
aimjunkies cs go commented on 14-Aug-2019 04:29 PM
Wonderful web site. A lot of useful info here. I’m sending it to several friends ans also sharing in delicious. And of course, thanks for your effort!
I love your blog.. very nice colors & theme. Did you make this website yourself or did you hire someone to do it for you?
Plz answer back as I'm looking to design my own blog and would like to know where u got this from.
thanks
ozdoby slubne commented on 14-Aug-2019 04:36 PM
It's remarkable designed for me to have a website, which is beneficial in favor of my know-how.
thanks admin
pokerrepublikid.com commented on 14-Aug-2019 04:50 PM
I want people to come in and I will control the size of all pots to make sure
I am still in the tournament towards the end.
One with a coal mining executive and one with a young poker
player. The following are certain Betfair trading basic strategies:
.
RXZ Male Enhancement Review commented on 14-Aug-2019 04:51 PM
I think this is among the so much important info for
me. And i'm glad reading your article. But should statement on few basic issues, The web site taste is
great, the articles is truly great : D. Just right activity, cheers
Global Green CBD commented on 14-Aug-2019 04:54 PM
Thanks, I have recently been looking for
information approximately this subject for a while and yours is
the greatest I have discovered till now. However, what concerning the conclusion? Are you sure in regards to the
supply?
RXZ Male Enhancement Review commented on 14-Aug-2019 04:58 PM
Fantastic beat ! I wish to apprentice while you amend your website, how could i subscribe for a blog website?
The account helped me a acceptable deal. I had been a little
bit acquainted of this your broadcast provided bright clear concept
judi Online commented on 14-Aug-2019 05:07 PM
Hello my loved one! I want to say that this article is
awesome, great written and come with approximately all vital
infos. I would like to peer more posts like this .
188bet commented on 14-Aug-2019 05:15 PM
This is the perfect webpage for anybody who really wants to find out
about this topic. You know a whole lot its almost tough to argue with you (not that
I personally will need to…HaHa). You definitely put a brand new
spin on a subject that has been written about for many years.
Excellent stuff, just great!
Britney commented on 14-Aug-2019 05:17 PM
Do you mind if I quote a few of your posts as long as
I provide credit and sources back to your weblog? My website is in the very same area of
interest as yours and my users would really benefit from some of
the information you present here. Please let me know if this ok with you.
Appreciate it!
http://balancedbodyketodiet.com/ commented on 14-Aug-2019 05:20 PM
I must get across my passion for your kind-heartedness for
individuals that actually need guidance on this important question. Your real commitment to passing the
solution along appeared to be certainly helpful and have all the time encouraged individuals much
like me to realize their aims. Your own warm and
friendly information means a great deal to me and even more to my office colleagues.
Warm regards; from everyone of us.
Stewart commented on 14-Aug-2019 05:33 PM
I am so happy to read this. This is the kind of manual that needs to be given and not the random misinformation that's at the other blogs.
Appreciate your sharing this greatest doc.

Feel free to visit my blog ...soft tonneau cover
Judi Bola Sbobet commented on 14-Aug-2019 05:37 PM
I truly love your blog.. Pleasant colors & theme. Did you develop this web site yourself?
Please reply back as I'm looking to create my very own website
and want to know where you got this from or just what the theme is called.
Thanks!
Police Misconduct Attorney commented on 14-Aug-2019 05:46 PM
Heya i am for the first time here. I came across
this board and I find It truly useful & it helped me out a lot.
I hope to give something back and help others like you
aided me.
Lena commented on 14-Aug-2019 05:52 PM
I do not even know visit the next post way I stopped up right here, however I believed this publish used to be great.
I do not understand who you are however definitely you're going to a well-known blogger in the event you are not already ;) Cheers!
Kickass commented on 14-Aug-2019 05:54 PM
Wow, this piece of writing is pleasant, my younger sister is analyzing such
things, therefore I am going to convey her.
무주출장샵 commented on 14-Aug-2019 06:01 PM
These are really enormous ideas in regarding blogging.

You have touched some nice factors here. Any way keep up
wrinting.
Keto Jolt commented on 14-Aug-2019 06:10 PM
I think the admin of this web site is genuinely working
hard for his website, since here every data is quality based data.
경주출장업소 commented on 14-Aug-2019 06:10 PM
An outstanding share! I have just forwarded this onto a colleague
who has been doing a little research on this. And he actually ordered me breakfast due to
the fact that I discovered it for him... lol. So allow me to reword this....
Thanks for the meal!! But yeah, thanks for spending time to talk about this
subject here on your blog.
Denice commented on 14-Aug-2019 06:11 PM
Whoa! This blog looks exactly like my old one! It's on a totally different subject but it has pretty much the same page layout and design. Excellent choice of colors!


Here is my site -Source Webpage
http://ketojoltdiet.com/ commented on 14-Aug-2019 06:13 PM
Great post, you have pointed out some wonderful points, I as
well conceive this is a very excellent website.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
redboy commented on 14-Aug-2019 04:29 PM
Valuable information. Lucky me I found your site by accident, and I am shocked why this accident did not happened earlier! I bookmarked it.
softprolink commented on 14-Aug-2019 04:29 PM
Wonderful beat ! I wish to apprentice while you amend your site, how could i subscribe for a blog web site? The account helped me a acceptable deal. I had been tiny bit acquainted of this your broadcast offered bright clear concept
aimjunkies cs go commented on 14-Aug-2019 04:29 PM
Wonderful web site. A lot of useful info here. I’m sending it to several friends ans also sharing in delicious. And of course, thanks for your effort!
I love your blog.. very nice colors & theme. Did you make this website yourself or did you hire someone to do it for you?
Plz answer back as I'm looking to design my own blog and would like to know where u got this from.
thanks
ozdoby slubne commented on 14-Aug-2019 04:36 PM
It's remarkable designed for me to have a website, which is beneficial in favor of my know-how.
thanks admin
pokerrepublikid.com commented on 14-Aug-2019 04:50 PM
I want people to come in and I will control the size of all pots to make sure
I am still in the tournament towards the end.
One with a coal mining executive and one with a young poker
player. The following are certain Betfair trading basic strategies:
.
RXZ Male Enhancement Review commented on 14-Aug-2019 04:51 PM
I think this is among the so much important info for
me. And i'm glad reading your article. But should statement on few basic issues, The web site taste is
great, the articles is truly great : D. Just right activity, cheers
Global Green CBD commented on 14-Aug-2019 04:54 PM
Thanks, I have recently been looking for
information approximately this subject for a while and yours is
the greatest I have discovered till now. However, what concerning the conclusion? Are you sure in regards to the
supply?
RXZ Male Enhancement Review commented on 14-Aug-2019 04:58 PM
Fantastic beat ! I wish to apprentice while you amend your website, how could i subscribe for a blog website?
The account helped me a acceptable deal. I had been a little
bit acquainted of this your broadcast provided bright clear concept
judi Online commented on 14-Aug-2019 05:07 PM
Hello my loved one! I want to say that this article is
awesome, great written and come with approximately all vital
infos. I would like to peer more posts like this .
188bet commented on 14-Aug-2019 05:15 PM
This is the perfect webpage for anybody who really wants to find out
about this topic. You know a whole lot its almost tough to argue with you (not that
I personally will need to…HaHa). You definitely put a brand new
spin on a subject that has been written about for many years.
Excellent stuff, just great!
Britney commented on 14-Aug-2019 05:17 PM
Do you mind if I quote a few of your posts as long as
I provide credit and sources back to your weblog? My website is in the very same area of
interest as yours and my users would really benefit from some of
the information you present here. Please let me know if this ok with you.
Appreciate it!
http://balancedbodyketodiet.com/ commented on 14-Aug-2019 05:20 PM
I must get across my passion for your kind-heartedness for
individuals that actually need guidance on this important question. Your real commitment to passing the
solution along appeared to be certainly helpful and have all the time encouraged individuals much
like me to realize their aims. Your own warm and
friendly information means a great deal to me and even more to my office colleagues.
Warm regards; from everyone of us.
Stewart commented on 14-Aug-2019 05:33 PM
I am so happy to read this. This is the kind of manual that needs to be given and not the random misinformation that's at the other blogs.
Appreciate your sharing this greatest doc.

Feel free to visit my blog ...soft tonneau cover
Judi Bola Sbobet commented on 14-Aug-2019 05:37 PM
I truly love your blog.. Pleasant colors & theme. Did you develop this web site yourself?
Please reply back as I'm looking to create my very own website
and want to know where you got this from or just what the theme is called.
Thanks!
Police Misconduct Attorney commented on 14-Aug-2019 05:46 PM
Heya i am for the first time here. I came across
this board and I find It truly useful & it helped me out a lot.
I hope to give something back and help others like you
aided me.
Lena commented on 14-Aug-2019 05:52 PM
I do not even know visit the next post way I stopped up right here, however I believed this publish used to be great.
I do not understand who you are however definitely you're going to a well-known blogger in the event you are not already ;) Cheers!
Kickass commented on 14-Aug-2019 05:54 PM
Wow, this piece of writing is pleasant, my younger sister is analyzing such
things, therefore I am going to convey her.
무주출장샵 commented on 14-Aug-2019 06:01 PM
These are really enormous ideas in regarding blogging.

You have touched some nice factors here. Any way keep up
wrinting.
Keto Jolt commented on 14-Aug-2019 06:10 PM
I think the admin of this web site is genuinely working
hard for his website, since here every data is quality based data.
경주출장업소 commented on 14-Aug-2019 06:10 PM
An outstanding share! I have just forwarded this onto a colleague
who has been doing a little research on this. And he actually ordered me breakfast due to
the fact that I discovered it for him... lol. So allow me to reword this....
Thanks for the meal!! But yeah, thanks for spending time to talk about this
subject here on your blog.
Denice commented on 14-Aug-2019 06:11 PM
Whoa! This blog looks exactly like my old one! It's on a totally different subject but it has pretty much the same page layout and design. Excellent choice of colors!


Here is my site -Source Webpage
http://ketojoltdiet.com/ commented on 14-Aug-2019 06:13 PM
Great post, you have pointed out some wonderful points, I as
well conceive this is a very excellent website.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.