Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
http://unleashxboost.net/ commented on 13-Jun-2019 03:10 AM
I would like to consider the opportunity of saying thanks to you for your professional direction I have usually enjoyed browsing
your site. I'm looking forward to the actual
commencement of my university research and the overall groundwork would
never have been complete without surfing your website.
If I can be of any assistance to others, I would be ready to help through what I have learned from here.
buy Sildenafil commented on 13-Jun-2019 03:10 AM
sildenafil lvad [url=http://www.viagrabs.com/]generic viagra[/url] sildenafil riesgos.
Cognitiva Pill Reviews commented on 13-Jun-2019 03:25 AM
Thanks a lot for sharing this with all people you actually understand what you are speaking about!
Bookmarked. Kindly additionally talk over with my web site =).
We will have a link alternate contract between us
https://joyelledermarevitalizingmoisturizer.com/ commented on 13-Jun-2019 03:29 AM
I dugg some of you post as I cerebrated they were very beneficial very useful.
Patsy commented on 13-Jun-2019 03:37 AM
You really make it seem so easy with your presentation but I find this topic to be actually something that I think I would never understand.

It seems too complex and extremely broad for me. I am looking forward for your next post, I will try to get the hang of it!

my website ...social networking
Delphia commented on 13-Jun-2019 03:41 AM
Do you have a spam issue on this website; I also am a blogger, and I was wondering your situation; many of us have created some nice procedures and we are looking to swap techniques with others, please shoot me an e-mail if interested.


My web-site: home business
Micheline commented on 13-Jun-2019 03:48 AM
Spot on with this write-up, I seriously believe that this amazing site needs much more attention. I'll probably be back again to see more, thanks for the info!


Check out my blog -online dating
abnehmen produkte dm commented on 13-Jun-2019 03:49 AM
Its like you read my mind! You seem to know a l᧐t
abhout tһis, lіke ʏou wrote thе bookk iin it or
somethіng. I think that уou ϲan do ѡith a
few pics to drive tһe messagye home ɑ little bit, ƅut insteaɗ of that, thіѕ іs
great blog. An excellent reaԁ. Ӏ'll defіnitely Ƅе back.
https://ketozol.org/ commented on 13-Jun-2019 03:53 AM
Excellent read, I just passed this onto a friend who
was doing a little research on that. And he just bought me lunch since I found it for him smile Therefore let me rephrase
that: Thank you for lunch!
generic cialis online commented on 13-Jun-2019 03:56 AM
cialis jak to działa [url=http://www.cialisle.com/]cialis[/url] tadalafil
heart rate.
Alva commented on 13-Jun-2019 04:33 AM
My spouse and i still can not quite believe that I could become one of those reading through the important points found on this blog.
My family and I are sincerely thankful for the generosity and for presenting me the chance to pursue my own chosen career path. Thanks for the important information I obtained from your web-site.

my weblogpresent energy
https://ketotrinweightloss.org/ commented on 13-Jun-2019 04:40 AM
Hello, i feel that i noticed you visited my site thus i came to
?go back the want?.I'm attempting to to find things to improve my site!I
suppose its ok to use some of your concepts!!
Sheila commented on 13-Jun-2019 04:43 AM
Same is true of viral marketing, in places you have to do pursuit to ensure you're going the best way.
Also, you need to scrutinize reciprocal linking requests which can be being shipped to you. A Linking approach is a methodology that builds appropriate one way links to your site so it helps you use your present business order to build a linking strategy, you have to have good content on your site.



my webpageFortnite Cheat
RPX Male Enhancement commented on 13-Jun-2019 04:44 AM
I could not resist commenting. Very well written!
Audio Visualization Download For Vlc commented on 13-Jun-2019 04:51 AM
It's going to be ending of mine day, except before end I am reading this enormous
paragraph to improve my knowledge.
Gay Cams commented on 13-Jun-2019 04:53 AM
I'm amazed, I hаvе to admit. Seldom ⅾo I encounter a blog
thɑt's ƅoth educative ɑnd amusing, and let me tell you, you have hit the nail on the
head. The problkem іѕ something tоo feew people are speaking intelligently ɑbout.
I aam very hapy that I fund this in my search for somеthing
regarding thіs.
watch movie commented on 13-Jun-2019 04:58 AM
Genuinely no matter if someone doesn't know after that its up
to other viewers that they will help, so here it happens.
Mathew commented on 13-Jun-2019 05:00 AM
I needed to thank you for this wonderful read!! I definitely enjoyed every bit of it.

I have got you bookmarked to look at new things you post...

Feel free to visit my page;secret lyrics
Gaston commented on 13-Jun-2019 05:10 AM
Hello there! Do you know if they make any plugins to assist with SEO?
I'm trying to get my blog to rank for some targeted keywords but I'm not seeing very good gains. If you know of any please share. Thanks!

Feel free to visit my web page online via gmail
zodiac horoscoop commented on 13-Jun-2019 05:16 AM
I need to to thaqnk youu for this very good read!! I definitely enjjoyed every little bit of it.
I have got you book marked tto chefk out new things yyou post…
Sibyl commented on 13-Jun-2019 05:16 AM
hey there and thank you for your information – I've certainly picked up something new from right here.
I did however expertise a few technical issues using this website, since
I experienced to reload the site lots of times previous to I could get it to load properly.
I had been wondering if your web hosting is OK?

Not that I am complaining, but sluggish loading instances times will sometimes affect your placement in google and can damage your high-quality score
if ads and marketing with Adwords. Well I'm adding this RSS to
my email and could look out for a lot more of
your respective interesting content. Make sure you update this again very soon.
Christian commented on 13-Jun-2019 05:26 AM
Greetings from Colorado! I'm bored at work so I decided to check out your website on my iphone during lunch break.
I enjoy the info you present here and can't wait to take a look
when I get home. I'm shocked at how fast your blog
loaded on my phone .. I'm not even using WIFI, just 3G ..
Anyways, awesome blog!
Geri commented on 13-Jun-2019 05:27 AM
These days pictures tend to be determined by picture internet google search for resources and hence there is absolutely no chance that your particular web site is skipped by any of the search for engine's spider.
Their knowledge that explains why linking matters is bound to, "because some forum or blog says so". A Linking strategy is a methodology that builds appropriate inbound links in your site so helping you use your overall business order to develop a linking strategy, you need good content on your own site.


Feel free to surf to my homepageFortnite CHEAT Free Downloa
Hi there! This is my 1st comment here so
I just wanted to give a quick shout out and
say I genuinely enjoy reading through your posts. Can you suggest any other blogs/websites/forums that cover the same
topics? Many thanks!
Wisata Di Ubud Bali commented on 13-Jun-2019 05:37 AM
My programmer is trying to convince me to move to .net
from PHP. I have always disliked the idea because of the costs.
But he's tryiong none the less. I've been using Movable-type on a number of websites for about a year and
am nervous about switching to another platform. I have heard fantastic things about blogengine.net.
Is there a way I can import all my wordpress content into it?

Any kind of help would be greatly appreciated!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
http://unleashxboost.net/ commented on 13-Jun-2019 03:10 AM
I would like to consider the opportunity of saying thanks to you for your professional direction I have usually enjoyed browsing
your site. I'm looking forward to the actual
commencement of my university research and the overall groundwork would
never have been complete without surfing your website.
If I can be of any assistance to others, I would be ready to help through what I have learned from here.
buy Sildenafil commented on 13-Jun-2019 03:10 AM
sildenafil lvad [url=http://www.viagrabs.com/]generic viagra[/url] sildenafil riesgos.
Cognitiva Pill Reviews commented on 13-Jun-2019 03:25 AM
Thanks a lot for sharing this with all people you actually understand what you are speaking about!
Bookmarked. Kindly additionally talk over with my web site =).
We will have a link alternate contract between us
https://joyelledermarevitalizingmoisturizer.com/ commented on 13-Jun-2019 03:29 AM
I dugg some of you post as I cerebrated they were very beneficial very useful.
Patsy commented on 13-Jun-2019 03:37 AM
You really make it seem so easy with your presentation but I find this topic to be actually something that I think I would never understand.

It seems too complex and extremely broad for me. I am looking forward for your next post, I will try to get the hang of it!

my website ...social networking
Delphia commented on 13-Jun-2019 03:41 AM
Do you have a spam issue on this website; I also am a blogger, and I was wondering your situation; many of us have created some nice procedures and we are looking to swap techniques with others, please shoot me an e-mail if interested.


My web-site: home business
Micheline commented on 13-Jun-2019 03:48 AM
Spot on with this write-up, I seriously believe that this amazing site needs much more attention. I'll probably be back again to see more, thanks for the info!


Check out my blog -online dating
abnehmen produkte dm commented on 13-Jun-2019 03:49 AM
Its like you read my mind! You seem to know a l᧐t
abhout tһis, lіke ʏou wrote thе bookk iin it or
somethіng. I think that уou ϲan do ѡith a
few pics to drive tһe messagye home ɑ little bit, ƅut insteaɗ of that, thіѕ іs
great blog. An excellent reaԁ. Ӏ'll defіnitely Ƅе back.
https://ketozol.org/ commented on 13-Jun-2019 03:53 AM
Excellent read, I just passed this onto a friend who
was doing a little research on that. And he just bought me lunch since I found it for him smile Therefore let me rephrase
that: Thank you for lunch!
generic cialis online commented on 13-Jun-2019 03:56 AM
cialis jak to działa [url=http://www.cialisle.com/]cialis[/url] tadalafil
heart rate.
Alva commented on 13-Jun-2019 04:33 AM
My spouse and i still can not quite believe that I could become one of those reading through the important points found on this blog.
My family and I are sincerely thankful for the generosity and for presenting me the chance to pursue my own chosen career path. Thanks for the important information I obtained from your web-site.

my weblogpresent energy
https://ketotrinweightloss.org/ commented on 13-Jun-2019 04:40 AM
Hello, i feel that i noticed you visited my site thus i came to
?go back the want?.I'm attempting to to find things to improve my site!I
suppose its ok to use some of your concepts!!
Sheila commented on 13-Jun-2019 04:43 AM
Same is true of viral marketing, in places you have to do pursuit to ensure you're going the best way.
Also, you need to scrutinize reciprocal linking requests which can be being shipped to you. A Linking approach is a methodology that builds appropriate one way links to your site so it helps you use your present business order to build a linking strategy, you have to have good content on your site.



my webpageFortnite Cheat
RPX Male Enhancement commented on 13-Jun-2019 04:44 AM
I could not resist commenting. Very well written!
Audio Visualization Download For Vlc commented on 13-Jun-2019 04:51 AM
It's going to be ending of mine day, except before end I am reading this enormous
paragraph to improve my knowledge.
Gay Cams commented on 13-Jun-2019 04:53 AM
I'm amazed, I hаvе to admit. Seldom ⅾo I encounter a blog
thɑt's ƅoth educative ɑnd amusing, and let me tell you, you have hit the nail on the
head. The problkem іѕ something tоo feew people are speaking intelligently ɑbout.
I aam very hapy that I fund this in my search for somеthing
regarding thіs.
watch movie commented on 13-Jun-2019 04:58 AM
Genuinely no matter if someone doesn't know after that its up
to other viewers that they will help, so here it happens.
Mathew commented on 13-Jun-2019 05:00 AM
I needed to thank you for this wonderful read!! I definitely enjoyed every bit of it.

I have got you bookmarked to look at new things you post...

Feel free to visit my page;secret lyrics
Gaston commented on 13-Jun-2019 05:10 AM
Hello there! Do you know if they make any plugins to assist with SEO?
I'm trying to get my blog to rank for some targeted keywords but I'm not seeing very good gains. If you know of any please share. Thanks!

Feel free to visit my web page online via gmail
zodiac horoscoop commented on 13-Jun-2019 05:16 AM
I need to to thaqnk youu for this very good read!! I definitely enjjoyed every little bit of it.
I have got you book marked tto chefk out new things yyou post…
Sibyl commented on 13-Jun-2019 05:16 AM
hey there and thank you for your information – I've certainly picked up something new from right here.
I did however expertise a few technical issues using this website, since
I experienced to reload the site lots of times previous to I could get it to load properly.
I had been wondering if your web hosting is OK?

Not that I am complaining, but sluggish loading instances times will sometimes affect your placement in google and can damage your high-quality score
if ads and marketing with Adwords. Well I'm adding this RSS to
my email and could look out for a lot more of
your respective interesting content. Make sure you update this again very soon.
Christian commented on 13-Jun-2019 05:26 AM
Greetings from Colorado! I'm bored at work so I decided to check out your website on my iphone during lunch break.
I enjoy the info you present here and can't wait to take a look
when I get home. I'm shocked at how fast your blog
loaded on my phone .. I'm not even using WIFI, just 3G ..
Anyways, awesome blog!
Geri commented on 13-Jun-2019 05:27 AM
These days pictures tend to be determined by picture internet google search for resources and hence there is absolutely no chance that your particular web site is skipped by any of the search for engine's spider.
Their knowledge that explains why linking matters is bound to, "because some forum or blog says so". A Linking strategy is a methodology that builds appropriate inbound links in your site so helping you use your overall business order to develop a linking strategy, you need good content on your own site.


Feel free to surf to my homepageFortnite CHEAT Free Downloa
Hi there! This is my 1st comment here so
I just wanted to give a quick shout out and
say I genuinely enjoy reading through your posts. Can you suggest any other blogs/websites/forums that cover the same
topics? Many thanks!
Wisata Di Ubud Bali commented on 13-Jun-2019 05:37 AM
My programmer is trying to convince me to move to .net
from PHP. I have always disliked the idea because of the costs.
But he's tryiong none the less. I've been using Movable-type on a number of websites for about a year and
am nervous about switching to another platform. I have heard fantastic things about blogengine.net.
Is there a way I can import all my wordpress content into it?

Any kind of help would be greatly appreciated!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.