Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Mahalia commented on 14-Aug-2019 01:56 PM
Make a bulleted laundry list of what you are looking for.
And you might be - you are definitely the one with the technical and design knowledge of
how you can make a successful webpage. Naturally,
it's all the time good to appoint a person who has more technical knowledge
and capability. An individual might have a garage sale, or they might take the
printer to a pawn store. This isn't something that I personally have experience with
since I have honestly by no means had downtime
between initiatives, in general I can barely sustain with the new initiatives coming my means.
But I think that in case you are having trouble discovering new shoppers or work,
then utilizing that downtime to actually up your advertising game
may very well be a really efficient and productive
use of your time. Note: I didn't say waste extra time.
Take heed to what individuals need to say about the corporate.
Serene Glo commented on 14-Aug-2019 02:00 PM
I love your blog.. very nice colors & theme. Did you design this website yourself or did you
hire someone to do it for you? Plz reply as I'm looking to construct my own blog and
would like to find out where u got this from.
thanks
트럼프 카드 게임 종류 commented on 14-Aug-2019 02:15 PM
hey there and thank you for your information – I've certainly picked up something new from right here.
I did however expertise a few technical points using this site, as I experienced to
reload the website a lot of times previous to I could get it
to load properly. I had been wondering if your web host is OK?
Not that I am complaining, but slow loading
instances times will very frequently affect your placement in google and can damage your quality score
if ads and marketing with Adwords. Anyway I am adding this RSS to my e-mail and could look out for much more
of your respective exciting content. Make sure you update this again soon.
ecu pincode commented on 14-Aug-2019 02:16 PM
It's awesome in favor of me to have a web site, which is valuable
in favor of my knowledge. thanks admin
private driver nice commented on 14-Aug-2019 02:17 PM
Thanks for finally writing about >How Can Thick Data Improve the Way We Usse
Big Data? <Liked it!
airport transfer commented on 14-Aug-2019 02:31 PM
In fact no matter if someone doesn't know afterward iits up to other visitors that they will help, so here it happens.
Poker Online Terbaik commented on 14-Aug-2019 02:54 PM
I think this is one of the most vital info for me.

And i am glad reading your article. But should
remark on some general things, The web site style is perfect, the
articles is really nice : D. Good job, cheers
RA Egyptian Skincare commented on 14-Aug-2019 03:05 PM
With havin so much written content do you ever run into any problems of plagorism or copyright infringement?
My blog has a lot of exclusive content I've either authored myself or
outsourced but it appears a lot of it is popping
it up all over the web without my authorization. Do
you know any solutions to help protect against content from being stolen?
I'd genuinely appreciate it.
sparepart honda commented on 14-Aug-2019 03:08 PM
Asking questions are truly good thing if you are not understanding something totally,
except this post gives good understanding even.
bohrhammer Bosch oder makita commented on 14-Aug-2019 03:25 PM
Vielen Dank! Wollt ich nur sagen.
ozdoby slubne, commented on 14-Aug-2019 03:31 PM
What i don't realize is if truth be told how you are
now not really much more well-liked than you may be now.
You are so intelligent. You recognize therefore significantly
relating to this matter, made me in my view consider
it from numerous varied angles. Its like men and women are not fascinated
unless it's one thing to accomplish with Woman gaga! Your own stuffs great.

All the time deal with it up!
Pert.leadin.xyz commented on 14-Aug-2019 03:41 PM
Plus, there are several videos, movies, and novels that further
enhance its popularity. Since city courses never allow refunds,
everybody chose to stick it out a bit further.
Naruto Shippuuden will be the story of Naruto Uzumaki, inside original
animated TV series Naruto.
Keto Charge Plus commented on 14-Aug-2019 03:44 PM
I really like it when people come together and share thoughts.
Great blog, continue the good work!
Pat commented on 14-Aug-2019 03:49 PM
Spot on with this write-up, I really think this website needs much more attention. I�ll probably be back again to read more, thanks for the advice!


My websitewhy people get tattoos
마카오 카지노 대박 commented on 14-Aug-2019 04:06 PM
Outstanding post however , I was wanting to know if you could write a litte more
on this topic? I'd be very grateful if you could elaborate a
little bit more. Bless you!
kim kardashian hollywood jailbreak commented on 14-Aug-2019 04:29 PM
I'm really enjoying the theme/design of your website. Do you ever run into any browser compatibility problems? A couple of my blog visitors have complained about my blog not operating correctly in Explorer but looks great in Firefox. Do you have any tips to help fix this issue?
pokemon go joystick ios no computer commented on 14-Aug-2019 04:29 PM
The other day, while I was at work, my cousin stole my iPad and tested to see if it can survive a forty foot drop, just so she can be a youtube sensation. My apple ipad is now destroyed and she has 83 views. I know this is totally off topic but I had to share it with someone!
swordburst 2 autofarm script commented on 14-Aug-2019 04:29 PM
Oh my goodness! an amazing article dude. Thanks However I am experiencing problem with ur rss . Don’t know why Unable to subscribe to it. Is there anyone getting identical rss drawback? Anyone who is aware of kindly respond. Thnkx
arrow.io mod menu apk commented on 14-Aug-2019 04:29 PM
What’s Happening i am new to this, I stumbled upon this I've found It positively useful and it has helped me out loads. I hope to contribute & assist other users like its helped me. Good job.
no clip download commented on 14-Aug-2019 04:29 PM
You actually make it seem so easy along with your presentation however I find this topic to be really something that I believe I would never understand. It seems too complex and very extensive for me. I am looking ahead for your next publish, I will try to get the cling of it!
aimjunkies cs go commented on 14-Aug-2019 04:29 PM
great post, very informative. I wonder why the other experts of this sector don't notice this. You must continue your writing. I am confident, you have a huge readers' base already!
pokemon silver legend commented on 14-Aug-2019 04:29 PM
I have been surfing online more than 3 hours today, yet I never found any interesting article like yours. It’s pretty worth enough for me. In my view, if all site owners and bloggers made good content as you did, the internet will be a lot more useful than ever before.
soccer stars hack without human verification commented on 14-Aug-2019 04:29 PM
Hello my friend! I wish to say that this post is amazing, nice written and include almost all vital infos. I’d like to see more posts like this.
golf clash perfect shot commented on 14-Aug-2019 04:29 PM
This is really interesting, You are a very skilled blogger. I've joined your rss feed and look forward to seeking more of your great post. Also, I've shared your web site in my social networks!
vmix 20 keygen commented on 14-Aug-2019 04:29 PM
Hello there, I found your blog by means of Google at the same time as searching for a related matter, your site got here up, it looks great. I've bookmarked it in my google bookmarks.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Mahalia commented on 14-Aug-2019 01:56 PM
Make a bulleted laundry list of what you are looking for.
And you might be - you are definitely the one with the technical and design knowledge of
how you can make a successful webpage. Naturally,
it's all the time good to appoint a person who has more technical knowledge
and capability. An individual might have a garage sale, or they might take the
printer to a pawn store. This isn't something that I personally have experience with
since I have honestly by no means had downtime
between initiatives, in general I can barely sustain with the new initiatives coming my means.
But I think that in case you are having trouble discovering new shoppers or work,
then utilizing that downtime to actually up your advertising game
may very well be a really efficient and productive
use of your time. Note: I didn't say waste extra time.
Take heed to what individuals need to say about the corporate.
Serene Glo commented on 14-Aug-2019 02:00 PM
I love your blog.. very nice colors & theme. Did you design this website yourself or did you
hire someone to do it for you? Plz reply as I'm looking to construct my own blog and
would like to find out where u got this from.
thanks
트럼프 카드 게임 종류 commented on 14-Aug-2019 02:15 PM
hey there and thank you for your information – I've certainly picked up something new from right here.
I did however expertise a few technical points using this site, as I experienced to
reload the website a lot of times previous to I could get it
to load properly. I had been wondering if your web host is OK?
Not that I am complaining, but slow loading
instances times will very frequently affect your placement in google and can damage your quality score
if ads and marketing with Adwords. Anyway I am adding this RSS to my e-mail and could look out for much more
of your respective exciting content. Make sure you update this again soon.
ecu pincode commented on 14-Aug-2019 02:16 PM
It's awesome in favor of me to have a web site, which is valuable
in favor of my knowledge. thanks admin
private driver nice commented on 14-Aug-2019 02:17 PM
Thanks for finally writing about >How Can Thick Data Improve the Way We Usse
Big Data? <Liked it!
airport transfer commented on 14-Aug-2019 02:31 PM
In fact no matter if someone doesn't know afterward iits up to other visitors that they will help, so here it happens.
Poker Online Terbaik commented on 14-Aug-2019 02:54 PM
I think this is one of the most vital info for me.

And i am glad reading your article. But should
remark on some general things, The web site style is perfect, the
articles is really nice : D. Good job, cheers
RA Egyptian Skincare commented on 14-Aug-2019 03:05 PM
With havin so much written content do you ever run into any problems of plagorism or copyright infringement?
My blog has a lot of exclusive content I've either authored myself or
outsourced but it appears a lot of it is popping
it up all over the web without my authorization. Do
you know any solutions to help protect against content from being stolen?
I'd genuinely appreciate it.
sparepart honda commented on 14-Aug-2019 03:08 PM
Asking questions are truly good thing if you are not understanding something totally,
except this post gives good understanding even.
bohrhammer Bosch oder makita commented on 14-Aug-2019 03:25 PM
Vielen Dank! Wollt ich nur sagen.
ozdoby slubne, commented on 14-Aug-2019 03:31 PM
What i don't realize is if truth be told how you are
now not really much more well-liked than you may be now.
You are so intelligent. You recognize therefore significantly
relating to this matter, made me in my view consider
it from numerous varied angles. Its like men and women are not fascinated
unless it's one thing to accomplish with Woman gaga! Your own stuffs great.

All the time deal with it up!
Pert.leadin.xyz commented on 14-Aug-2019 03:41 PM
Plus, there are several videos, movies, and novels that further
enhance its popularity. Since city courses never allow refunds,
everybody chose to stick it out a bit further.
Naruto Shippuuden will be the story of Naruto Uzumaki, inside original
animated TV series Naruto.
Keto Charge Plus commented on 14-Aug-2019 03:44 PM
I really like it when people come together and share thoughts.
Great blog, continue the good work!
Pat commented on 14-Aug-2019 03:49 PM
Spot on with this write-up, I really think this website needs much more attention. I�ll probably be back again to read more, thanks for the advice!


My websitewhy people get tattoos
마카오 카지노 대박 commented on 14-Aug-2019 04:06 PM
Outstanding post however , I was wanting to know if you could write a litte more
on this topic? I'd be very grateful if you could elaborate a
little bit more. Bless you!
kim kardashian hollywood jailbreak commented on 14-Aug-2019 04:29 PM
I'm really enjoying the theme/design of your website. Do you ever run into any browser compatibility problems? A couple of my blog visitors have complained about my blog not operating correctly in Explorer but looks great in Firefox. Do you have any tips to help fix this issue?
pokemon go joystick ios no computer commented on 14-Aug-2019 04:29 PM
The other day, while I was at work, my cousin stole my iPad and tested to see if it can survive a forty foot drop, just so she can be a youtube sensation. My apple ipad is now destroyed and she has 83 views. I know this is totally off topic but I had to share it with someone!
swordburst 2 autofarm script commented on 14-Aug-2019 04:29 PM
Oh my goodness! an amazing article dude. Thanks However I am experiencing problem with ur rss . Don’t know why Unable to subscribe to it. Is there anyone getting identical rss drawback? Anyone who is aware of kindly respond. Thnkx
arrow.io mod menu apk commented on 14-Aug-2019 04:29 PM
What’s Happening i am new to this, I stumbled upon this I've found It positively useful and it has helped me out loads. I hope to contribute & assist other users like its helped me. Good job.
no clip download commented on 14-Aug-2019 04:29 PM
You actually make it seem so easy along with your presentation however I find this topic to be really something that I believe I would never understand. It seems too complex and very extensive for me. I am looking ahead for your next publish, I will try to get the cling of it!
aimjunkies cs go commented on 14-Aug-2019 04:29 PM
great post, very informative. I wonder why the other experts of this sector don't notice this. You must continue your writing. I am confident, you have a huge readers' base already!
pokemon silver legend commented on 14-Aug-2019 04:29 PM
I have been surfing online more than 3 hours today, yet I never found any interesting article like yours. It’s pretty worth enough for me. In my view, if all site owners and bloggers made good content as you did, the internet will be a lot more useful than ever before.
soccer stars hack without human verification commented on 14-Aug-2019 04:29 PM
Hello my friend! I wish to say that this post is amazing, nice written and include almost all vital infos. I’d like to see more posts like this.
golf clash perfect shot commented on 14-Aug-2019 04:29 PM
This is really interesting, You are a very skilled blogger. I've joined your rss feed and look forward to seeking more of your great post. Also, I've shared your web site in my social networks!
vmix 20 keygen commented on 14-Aug-2019 04:29 PM
Hello there, I found your blog by means of Google at the same time as searching for a related matter, your site got here up, it looks great. I've bookmarked it in my google bookmarks.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.