Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Ivys B2B Leads Miner commented on 15-Mar-2019 10:34 AM
Superb Ᏼ2B Data List! Wһere cann I find USΑ Ice Cream Machines Β2B Data List?
Dο ʏou hаve some tutorials for using MINIK'S GOOGLE + BACKLINKS
SOCIAL SIGNALS BOSS SEO SOFTWARE?
Everette commented on 15-Mar-2019 10:43 AM
I enjoy this website - its so usefull and helpfull.



my blog post;quest bars cheap
Josie commented on 15-Mar-2019 10:51 AM
You've very good stuff listed here.

my web-site: minecraft
click here to try again commented on 15-Mar-2019 11:45 AM
Hi there, I check your blogs daily. Your story-telling style is witty,
keep it up!
help selling my house Texas commented on 15-Mar-2019 12:03 PM
It's really a nice and useful piece of info. I'm happy that you just shared this useful info with us.
Please keep us informed like this. Thank you for sharing.
weekend majowy 2019 commented on 15-Mar-2019 12:42 PM
Spot on with this write-up, I honestly feel this web site needs a
great deal more attention. I'll probably be returning to see more,
thanks for the information!
Cannabis Trader Reviews commented on 15-Mar-2019 01:28 PM
Hello there! This post could not be written much better! Going through this post reminds me
of my previous roommate! He constantly kept talking about this.

I'll send this post to him. Pretty sure he'll have a very good read.

Thanks for sharing!
Situs Agen Taruhan Bola commented on 15-Mar-2019 02:37 PM
Hi! Would you mind if I share your blog with my twitter group?
There's a lot of folks that I think would really enjoy your
content. Please let me know. Cheers
máy giặt công nghiệp giá rẻ commented on 15-Mar-2019 02:41 PM
Its like you read my mind! You appear to know a lot about this, like you wrote the book
in it or something. I think that you can do with a few
pics to drive the message home a little
bit, but instead of that, this is magnificent blog. An excellent read.
I'll certainly be back.
administracja commented on 15-Mar-2019 02:44 PM
Wow, fantastic blog layout! How long have you been blogging for?

you make blogging look easy. The overall look of your site is great, let alone
the content!
Reginald commented on 15-Mar-2019 03:21 PM
Stunning story there. What occurred after? Good luck!
website, commented on 15-Mar-2019 03:30 PM
Undeniably consider that which you said. Your favorite
reason seemed to be on the web the easiest factor to remember
of. I say to you, I certainly get annoyed while folks think about concerns that they just do
not realize about. You managed to hit the nail upon the top
and defined out the entire thing without having side effect , other people
could take a signal. Will probably be again to get more.
Thank you
cat hat commented on 15-Mar-2019 03:36 PM
Excellent pieces. Keep writing such kind of information on your blog.

Im really impressed by your site.[X-N-E-W-L-I-N-S-P-I-N-X]Hi there, You have done an excellent job.
I'll certainly digg it and in my opinion suggest to my friends.
I am sure they will be benefited from this web
site.
Novara Revitalizing Moisturizer commented on 15-Mar-2019 03:43 PM
Yeah bookmaking this wasn't a high risk determination outstanding post!
Agen Judi Bola Online Terpercaya commented on 15-Mar-2019 03:45 PM
I like the valuable info you provide in your articles.
I will bookmark your blog and check again here frequently.
I'm quite certain I will learn many new stuff right here!
Best of luck for the next!
Showbizplus.Com commented on 15-Mar-2019 03:49 PM
Does your site have a contact page? I'm having problems locating it but,
I'd like to send you an email. I've got some ideas for your blog
you might be interested in hearing. Either way, great website and I look forward to seeing it develop
over time.
kapsuni commented on 15-Mar-2019 04:16 PM
"Prořezávání provádíme v době vegetačního klidu, tedy v období přirozeného útlumu fyziologických a ekologických funkcí dřeviny.
https://www.bigmoneywon.net/카지노주소"
Karina commented on 15-Mar-2019 04:26 PM
I as well as my buddies ended up looking at the excellent ideas on your site while instantly I had an awful feeling I never expressed respect to the website owner for those strategies.
The boys appeared to be for that reason warmed to see them and already have clearly been loving these things. I appreciate you for truly being very thoughtful and for having varieties of incredible information most people are really needing to learn about. My very own sincere regret for not expressing gratitude to earlier.


Here is my website; Casino Review
https://activefitcontrolgarcinia.org commented on 15-Mar-2019 04:38 PM
Hello, just wanted to tell you, I liked this article.
It was practical. Keep on posting!
Legends Nutrition Keto commented on 15-Mar-2019 04:40 PM
Pretty nice post. I just stumbled upon your blog and wished to say that I have really enjoyed browsing your blog
posts. After all I'll be subscribing to your feed and I hope
you write again soon!
конвейер для одежды commented on 15-Mar-2019 05:23 PM
I'm not sure exactly why but this weblig is loading verry slow for me.
Is anyone else aving this problem or is it a problem on my end?
I'll check back later and see if the problem srill exists.
baby Clothes Online commented on 15-Mar-2019 06:40 PM
Hi, i think that i saw you visited my site thus i came to “return the favor”.I am attempting to find things to improve my
site!I suppose its ok to use some of your
ideas!!
kapsuni commented on 15-Mar-2019 07:03 PM
"Nice post. I was checking constantly this blog and I am impressed! Extremely helpful information
ill show you how can easy get money from casino ~ Visit my site Right here is the right webpage for anyone who would like to find out about this topic. Https://www.parkbet.com/카지노추천"
Desmond commented on 15-Mar-2019 07:26 PM
You can definitely see your skills in the work you write.
The arena hopes for more passionate writers like you who are not afraid to mention how they believe. At all times go after your heart.

Look into my site ...business writing
Jose commented on 15-Mar-2019 07:31 PM
Very interesting info!Perfect just what I was looking for!



Take a look at my site:new business

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Ivys B2B Leads Miner commented on 15-Mar-2019 10:34 AM
Superb Ᏼ2B Data List! Wһere cann I find USΑ Ice Cream Machines Β2B Data List?
Dο ʏou hаve some tutorials for using MINIK'S GOOGLE + BACKLINKS
SOCIAL SIGNALS BOSS SEO SOFTWARE?
Everette commented on 15-Mar-2019 10:43 AM
I enjoy this website - its so usefull and helpfull.



my blog post;quest bars cheap
Josie commented on 15-Mar-2019 10:51 AM
You've very good stuff listed here.

my web-site: minecraft
click here to try again commented on 15-Mar-2019 11:45 AM
Hi there, I check your blogs daily. Your story-telling style is witty,
keep it up!
help selling my house Texas commented on 15-Mar-2019 12:03 PM
It's really a nice and useful piece of info. I'm happy that you just shared this useful info with us.
Please keep us informed like this. Thank you for sharing.
weekend majowy 2019 commented on 15-Mar-2019 12:42 PM
Spot on with this write-up, I honestly feel this web site needs a
great deal more attention. I'll probably be returning to see more,
thanks for the information!
Cannabis Trader Reviews commented on 15-Mar-2019 01:28 PM
Hello there! This post could not be written much better! Going through this post reminds me
of my previous roommate! He constantly kept talking about this.

I'll send this post to him. Pretty sure he'll have a very good read.

Thanks for sharing!
Situs Agen Taruhan Bola commented on 15-Mar-2019 02:37 PM
Hi! Would you mind if I share your blog with my twitter group?
There's a lot of folks that I think would really enjoy your
content. Please let me know. Cheers
máy giặt công nghiệp giá rẻ commented on 15-Mar-2019 02:41 PM
Its like you read my mind! You appear to know a lot about this, like you wrote the book
in it or something. I think that you can do with a few
pics to drive the message home a little
bit, but instead of that, this is magnificent blog. An excellent read.
I'll certainly be back.
administracja commented on 15-Mar-2019 02:44 PM
Wow, fantastic blog layout! How long have you been blogging for?

you make blogging look easy. The overall look of your site is great, let alone
the content!
Reginald commented on 15-Mar-2019 03:21 PM
Stunning story there. What occurred after? Good luck!
website, commented on 15-Mar-2019 03:30 PM
Undeniably consider that which you said. Your favorite
reason seemed to be on the web the easiest factor to remember
of. I say to you, I certainly get annoyed while folks think about concerns that they just do
not realize about. You managed to hit the nail upon the top
and defined out the entire thing without having side effect , other people
could take a signal. Will probably be again to get more.
Thank you
cat hat commented on 15-Mar-2019 03:36 PM
Excellent pieces. Keep writing such kind of information on your blog.

Im really impressed by your site.[X-N-E-W-L-I-N-S-P-I-N-X]Hi there, You have done an excellent job.
I'll certainly digg it and in my opinion suggest to my friends.
I am sure they will be benefited from this web
site.
Novara Revitalizing Moisturizer commented on 15-Mar-2019 03:43 PM
Yeah bookmaking this wasn't a high risk determination outstanding post!
Agen Judi Bola Online Terpercaya commented on 15-Mar-2019 03:45 PM
I like the valuable info you provide in your articles.
I will bookmark your blog and check again here frequently.
I'm quite certain I will learn many new stuff right here!
Best of luck for the next!
Showbizplus.Com commented on 15-Mar-2019 03:49 PM
Does your site have a contact page? I'm having problems locating it but,
I'd like to send you an email. I've got some ideas for your blog
you might be interested in hearing. Either way, great website and I look forward to seeing it develop
over time.
kapsuni commented on 15-Mar-2019 04:16 PM
"Prořezávání provádíme v době vegetačního klidu, tedy v období přirozeného útlumu fyziologických a ekologických funkcí dřeviny.
https://www.bigmoneywon.net/카지노주소"
Karina commented on 15-Mar-2019 04:26 PM
I as well as my buddies ended up looking at the excellent ideas on your site while instantly I had an awful feeling I never expressed respect to the website owner for those strategies.
The boys appeared to be for that reason warmed to see them and already have clearly been loving these things. I appreciate you for truly being very thoughtful and for having varieties of incredible information most people are really needing to learn about. My very own sincere regret for not expressing gratitude to earlier.


Here is my website; Casino Review
https://activefitcontrolgarcinia.org commented on 15-Mar-2019 04:38 PM
Hello, just wanted to tell you, I liked this article.
It was practical. Keep on posting!
Legends Nutrition Keto commented on 15-Mar-2019 04:40 PM
Pretty nice post. I just stumbled upon your blog and wished to say that I have really enjoyed browsing your blog
posts. After all I'll be subscribing to your feed and I hope
you write again soon!
конвейер для одежды commented on 15-Mar-2019 05:23 PM
I'm not sure exactly why but this weblig is loading verry slow for me.
Is anyone else aving this problem or is it a problem on my end?
I'll check back later and see if the problem srill exists.
baby Clothes Online commented on 15-Mar-2019 06:40 PM
Hi, i think that i saw you visited my site thus i came to “return the favor”.I am attempting to find things to improve my
site!I suppose its ok to use some of your
ideas!!
kapsuni commented on 15-Mar-2019 07:03 PM
"Nice post. I was checking constantly this blog and I am impressed! Extremely helpful information
ill show you how can easy get money from casino ~ Visit my site Right here is the right webpage for anyone who would like to find out about this topic. Https://www.parkbet.com/카지노추천"
Desmond commented on 15-Mar-2019 07:26 PM
You can definitely see your skills in the work you write.
The arena hopes for more passionate writers like you who are not afraid to mention how they believe. At all times go after your heart.

Look into my site ...business writing
Jose commented on 15-Mar-2019 07:31 PM
Very interesting info!Perfect just what I was looking for!



Take a look at my site:new business

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.