Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Keto Six Pills commented on 16-May-2019 01:23 PM
Hello.This article was really interesting, especially
since I was looking for thoughts on this topic last Saturday.
Nuba CBD Oil Review commented on 16-May-2019 01:25 PM
It's appropriate time to make some plans for the future and it is time to be happy.
I have read this submit and if I may just I want to counsel you some fascinating issues or suggestions.
Perhaps you can write next articles regarding this article.
I wish to learn more issues approximately it!
Inviga Male Enhancement commented on 16-May-2019 01:25 PM
We still can't quite think I could end up being one of those reading the important tips found on your blog.

My family and I are sincerely thankful for the generosity and for providing me the chance to pursue my own chosen career path.
Many thanks for the important information I acquired from your web-site.
Nuba CBD commented on 16-May-2019 01:26 PM
I loved as much as you will receive carried out
right here. The sketch is tasteful, your authored subject matter stylish.

nonetheless, you command get got an nervousness over that you
wish be delivering the following. unwell unquestionably come more formerly again as exactly
the same nearly a lot often inside case you shield this hike.
https://wondergloessentialserum.org/ commented on 16-May-2019 01:27 PM
Keep this going please, great job!
Vertex Method Male Enhancement commented on 16-May-2019 01:28 PM
Good post. I learn something new and challenging on websites I stumbleupon everyday.
It will always be useful to read through articles from other writers and practice a little something from other
web sites.
longUrl commented on 16-May-2019 01:29 PM
Wonderful goods from you, man. I've have in mind your stuff prior to and you're simply too wonderful.
I really like what you have received right here,
certainly like what you're saying and the way in which in which you assert
it. You make it enjoyable and you continue to care for to keep it
smart. I can't wait to read much more from you.
That is really a terrific site.
Dian commented on 16-May-2019 01:31 PM
I could not refrain from commenting. Well written!

Feel free to visit my site ...non- competitive business
Vertex Method commented on 16-May-2019 01:31 PM
Thanks to my father who told me on the topic
of this weblog, this web site is genuinely awesome.
G Force Male Enhancement Reviews commented on 16-May-2019 01:32 PM
Can I simply just say what a comfort to find an individual who genuinely knows what they are talking about on the internet.

You certainly understand how to bring a problem to light and make it important.
More and more people really need to look at this and understand
this side of the story. I was surprised that you aren't more popular given that you definitely possess the gift.
Forskolin 6 Reviews commented on 16-May-2019 01:32 PM
Well I sincerely enjoyed studying it. This tip procured by you is very
practical for proper planning.
Vertex Method Male Enhancement Review commented on 16-May-2019 01:36 PM
Hey There. I discovered your blog the usage of msn. This is a really neatly written article.
I'll make sure to bookmark it and return to learn extra of
your useful info. Thank you for the post. I'll certainly comeback.
Macro Nutrient Keto Diet commented on 16-May-2019 01:36 PM
I do agree with all the ideas you've introduced on your post.
They are really convincing and can definitely
work. Nonetheless, the posts are very brief for beginners.
May you please lengthen them a bit from subsequent time? Thanks for the post.
Vertex Method Male Enhancement commented on 16-May-2019 01:36 PM
Every weekend i used to pay a quick visit this web page, because i want enjoyment,
since this this web page conations actually nice funny stuff too.
Keto Full Diet Pills commented on 16-May-2019 01:38 PM
Hi friends, nice post and good urging commented here, I am in fact enjoying by these.
http://alessaserum.org/ commented on 16-May-2019 01:38 PM
It's amazing to pay a quick visit this website and reading the
views of all colleagues regarding this piece of writing, while I am also keen of
getting familiarity.
https://allforskolindiet.com/ commented on 16-May-2019 01:38 PM
Definitely consider that that you stated. Your favourite justification seemed to be at the net the simplest factor to take into accout of.
I say to you, I definitely get irked while other people consider concerns that they plainly
do not know about. You managed to hit the nail upon the highest and also defined out the whole thing without having side-effects ,
other folks could take a signal. Will likely be again to get more.
Thank you
Alessa Serum Reviews commented on 16-May-2019 01:38 PM
Awsome website! I am loving it!! Will be back later to read some more.

I am taking your feeds also
Proceed to this site. commented on 16-May-2019 01:39 PM
Thanks designed for sharing such a nice thinking, article
is pleasant, thats why i have read it completely
Oxymasque Reviews commented on 16-May-2019 01:40 PM
It's remarkable to go to see this web site and reading the views of all colleagues
concerning this piece of writing, while I am also eager of getting familiarity.
https://vertexmethodmaleenhancement.com/ commented on 16-May-2019 01:40 PM
Oh my goodness! Awesome article dude! Many thanks, However
I am experiencing issues with your RSS. I don?t understand why I cannot subscribe to it.

Is there anyone else having similar RSS issues?
Anyone that knows the solution can you kindly respond?

Thanx!!
Amayze Life Pills commented on 16-May-2019 01:43 PM
Appreciate the recommendation. Will try it out.
Vertex Method Male Enhancement commented on 16-May-2019 01:43 PM
Good write-up, I'm regular visitor of one's web site, maintain up the excellent operate, and It's going to be a regular visitor for a lengthy time.
https://forskolinsix.net/ commented on 16-May-2019 01:47 PM
Aw, this was a really nice post. Spending some time and actual effort
to generate a good article... but what can I say... I procrastinate a lot and
don't seem to get anything done.
Viacelis Reviews commented on 16-May-2019 01:48 PM
Good day! Would you mind if I share your blog with my
facebook group? There's a lot of people that I think would really
appreciate your content. Please let me know. Cheers

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Keto Six Pills commented on 16-May-2019 01:23 PM
Hello.This article was really interesting, especially
since I was looking for thoughts on this topic last Saturday.
Nuba CBD Oil Review commented on 16-May-2019 01:25 PM
It's appropriate time to make some plans for the future and it is time to be happy.
I have read this submit and if I may just I want to counsel you some fascinating issues or suggestions.
Perhaps you can write next articles regarding this article.
I wish to learn more issues approximately it!
Inviga Male Enhancement commented on 16-May-2019 01:25 PM
We still can't quite think I could end up being one of those reading the important tips found on your blog.

My family and I are sincerely thankful for the generosity and for providing me the chance to pursue my own chosen career path.
Many thanks for the important information I acquired from your web-site.
Nuba CBD commented on 16-May-2019 01:26 PM
I loved as much as you will receive carried out
right here. The sketch is tasteful, your authored subject matter stylish.

nonetheless, you command get got an nervousness over that you
wish be delivering the following. unwell unquestionably come more formerly again as exactly
the same nearly a lot often inside case you shield this hike.
https://wondergloessentialserum.org/ commented on 16-May-2019 01:27 PM
Keep this going please, great job!
Vertex Method Male Enhancement commented on 16-May-2019 01:28 PM
Good post. I learn something new and challenging on websites I stumbleupon everyday.
It will always be useful to read through articles from other writers and practice a little something from other
web sites.
longUrl commented on 16-May-2019 01:29 PM
Wonderful goods from you, man. I've have in mind your stuff prior to and you're simply too wonderful.
I really like what you have received right here,
certainly like what you're saying and the way in which in which you assert
it. You make it enjoyable and you continue to care for to keep it
smart. I can't wait to read much more from you.
That is really a terrific site.
Dian commented on 16-May-2019 01:31 PM
I could not refrain from commenting. Well written!

Feel free to visit my site ...non- competitive business
Vertex Method commented on 16-May-2019 01:31 PM
Thanks to my father who told me on the topic
of this weblog, this web site is genuinely awesome.
G Force Male Enhancement Reviews commented on 16-May-2019 01:32 PM
Can I simply just say what a comfort to find an individual who genuinely knows what they are talking about on the internet.

You certainly understand how to bring a problem to light and make it important.
More and more people really need to look at this and understand
this side of the story. I was surprised that you aren't more popular given that you definitely possess the gift.
Forskolin 6 Reviews commented on 16-May-2019 01:32 PM
Well I sincerely enjoyed studying it. This tip procured by you is very
practical for proper planning.
Vertex Method Male Enhancement Review commented on 16-May-2019 01:36 PM
Hey There. I discovered your blog the usage of msn. This is a really neatly written article.
I'll make sure to bookmark it and return to learn extra of
your useful info. Thank you for the post. I'll certainly comeback.
Macro Nutrient Keto Diet commented on 16-May-2019 01:36 PM
I do agree with all the ideas you've introduced on your post.
They are really convincing and can definitely
work. Nonetheless, the posts are very brief for beginners.
May you please lengthen them a bit from subsequent time? Thanks for the post.
Vertex Method Male Enhancement commented on 16-May-2019 01:36 PM
Every weekend i used to pay a quick visit this web page, because i want enjoyment,
since this this web page conations actually nice funny stuff too.
Keto Full Diet Pills commented on 16-May-2019 01:38 PM
Hi friends, nice post and good urging commented here, I am in fact enjoying by these.
http://alessaserum.org/ commented on 16-May-2019 01:38 PM
It's amazing to pay a quick visit this website and reading the
views of all colleagues regarding this piece of writing, while I am also keen of
getting familiarity.
https://allforskolindiet.com/ commented on 16-May-2019 01:38 PM
Definitely consider that that you stated. Your favourite justification seemed to be at the net the simplest factor to take into accout of.
I say to you, I definitely get irked while other people consider concerns that they plainly
do not know about. You managed to hit the nail upon the highest and also defined out the whole thing without having side-effects ,
other folks could take a signal. Will likely be again to get more.
Thank you
Alessa Serum Reviews commented on 16-May-2019 01:38 PM
Awsome website! I am loving it!! Will be back later to read some more.

I am taking your feeds also
Proceed to this site. commented on 16-May-2019 01:39 PM
Thanks designed for sharing such a nice thinking, article
is pleasant, thats why i have read it completely
Oxymasque Reviews commented on 16-May-2019 01:40 PM
It's remarkable to go to see this web site and reading the views of all colleagues
concerning this piece of writing, while I am also eager of getting familiarity.
https://vertexmethodmaleenhancement.com/ commented on 16-May-2019 01:40 PM
Oh my goodness! Awesome article dude! Many thanks, However
I am experiencing issues with your RSS. I don?t understand why I cannot subscribe to it.

Is there anyone else having similar RSS issues?
Anyone that knows the solution can you kindly respond?

Thanx!!
Amayze Life Pills commented on 16-May-2019 01:43 PM
Appreciate the recommendation. Will try it out.
Vertex Method Male Enhancement commented on 16-May-2019 01:43 PM
Good write-up, I'm regular visitor of one's web site, maintain up the excellent operate, and It's going to be a regular visitor for a lengthy time.
https://forskolinsix.net/ commented on 16-May-2019 01:47 PM
Aw, this was a really nice post. Spending some time and actual effort
to generate a good article... but what can I say... I procrastinate a lot and
don't seem to get anything done.
Viacelis Reviews commented on 16-May-2019 01:48 PM
Good day! Would you mind if I share your blog with my
facebook group? There's a lot of people that I think would really
appreciate your content. Please let me know. Cheers

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.