Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Joshua commented on 16-Apr-2019 05:57 AM
Thank you! It is definitely an fantastic online site.

my web blogJust
Demetria commented on 16-Apr-2019 06:13 AM
Great article, just what I needed.

Here is my weblog;property kept
Todd commented on 16-Apr-2019 06:21 AM
Wow, gorgeous site. Thnx ...

My homepage ... Really
Refugio commented on 16-Apr-2019 06:39 AM
I gotta bookmark this website it seems very helpful invaluable.


my blog;Highly recommended Site
sildenafil hcl commented on 16-Apr-2019 06:51 AM
is it dangerous to take sildenafil if you don't need it [url=http://viagragenupi.com]buy viagra[/url] where can viagra be bought over the
counter
Trey Kuter commented on 16-Apr-2019 06:55 AM
Your blog is amazing dude. i love to visit it everyday. very nice layout and content “    
German commented on 16-Apr-2019 07:05 AM
Net can be a well regarded and brilliant platform for developing meticulous and robust websites and web applications.
There are points you should remember when evaluating some good websites because there are most with the things within our control which is rather easy for us to know the features of recent websites which are not providing us much in the issues and it is very efficient to manage them even as we have a chance to discover ultimate services from them.

The scope is infinite and you may literally expect anything from web development for your business.

Also visit my blog ::Fortnite esp
http://www.cialisles.com commented on 16-Apr-2019 07:11 AM
G http://cialisles.com/ cialis 5mg, thin cialis c5 review http://cialisles.com or
cialis 20mg best price;
Latosha commented on 16-Apr-2019 07:18 AM
Nine Star Image will be the brains behind the G & G products of printer ink cartridges, toner cartridges, refill inks, photo paper and other remanufactured printing products.
The multifarious option of digital storage cards has resulted in plenty of confusion within the customer. On the other hand, laser printers have certain disadvantages at the same time:-.

Feel free to visit my web blog ::Fortnite Hacks
Mohammad commented on 16-Apr-2019 07:28 AM
What a material of un-ambiguity and preserveness of precious experience concerning unpredicted emotions.



Feel free to visit my web page;invisible money
카지노게임 commented on 16-Apr-2019 07:55 AM
Only some posts from Jon himself have more!
Les Zocklein commented on 16-Apr-2019 07:59 AM
eating can be considered my hobby he he he. i would really love to visit foods blogs and see some recipes::
Karolyn commented on 16-Apr-2019 08:03 AM
I conceive this web site holds very wonderful written subject material
articles.
Markus commented on 16-Apr-2019 08:05 AM
Having read this I thought it was very enlightening.
I appreciate you finding the time and effort to put this informative article together. I once again find myself spending a significant amount of time both reading and leaving comments. But so what, it was still worth it!

my homepage; London Locksmith services
Loralee Erbentraut commented on 16-Apr-2019 08:07 AM
Helpful info. Lucky me I found your website accidentally, and I’m stunned why this accident didn’t came about in advance! I bookmarked it.
Antonia commented on 16-Apr-2019 08:08 AM
Hi there, I read your blogs on a regular basis. Your humoristic style is witty, keep doing what you're doing!


Take a look at my web site -business co-operation
Gerry Botdorf commented on 16-Apr-2019 08:10 AM
I believe one of your adverts triggered my internet browser to resize, you might want to put that on your blacklist.
Brenton Milne commented on 16-Apr-2019 08:15 AM
I’d must seek advice from you here. Which isn’t some thing It’s my job to do! I spend time reading an article that will make people think. Also, thank you allowing me to comment!
강남풀싸롱 commented on 16-Apr-2019 08:15 AM
I like the valuable information you provide
in your articles. I'll bookmark your weblog and test again right here
frequently. I'm rather sure I will be informed many new stuff proper here!
Best of luck for the next!
Auto Racing Stripe Decals commented on 16-Apr-2019 08:18 AM
Everything is vеry open with a clear clarification of the ⅽhаllenges.
It waѕ truly іnformatіve. Your site is very helpful.
Thanks foor ѕharing!
Fidel commented on 16-Apr-2019 08:23 AM
hello!,I really like your writing so much! proportion we communicate extra approximately your article on AOL?
I need an expert on this area to resolve my problem. May be that is you! Taking a look ahead to see you.

Also visit my web blog; https://www.4carding.net/thread-just-want-to-say-hello--283482
Celeste Hieatt commented on 16-Apr-2019 08:41 AM
A blog like yours should be earning much money from adsense.`*”*’
kollagen intensiv amazon commented on 16-Apr-2019 09:05 AM
Thank you for any other excellent post. Where elsxe could anybody get that type of info in such a perfect meaqns
of writing? I have a presentation next week, and I'm at the search for such info.
beck Depression Inventory commented on 16-Apr-2019 09:13 AM
Spot on with this write-up, I actually believe that this site needs a lot more attention. I'll probably be
back again to read through more, thanks for the advice!
Teen Nudist commented on 16-Apr-2019 10:37 AM
Hi there i am kavin, its my first occasion to commenting anyplace, when i
read this paragraph i thought i could also make comment due to this brilliant piece of writing.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Joshua commented on 16-Apr-2019 05:57 AM
Thank you! It is definitely an fantastic online site.

my web blogJust
Demetria commented on 16-Apr-2019 06:13 AM
Great article, just what I needed.

Here is my weblog;property kept
Todd commented on 16-Apr-2019 06:21 AM
Wow, gorgeous site. Thnx ...

My homepage ... Really
Refugio commented on 16-Apr-2019 06:39 AM
I gotta bookmark this website it seems very helpful invaluable.


my blog;Highly recommended Site
sildenafil hcl commented on 16-Apr-2019 06:51 AM
is it dangerous to take sildenafil if you don't need it [url=http://viagragenupi.com]buy viagra[/url] where can viagra be bought over the
counter
Trey Kuter commented on 16-Apr-2019 06:55 AM
Your blog is amazing dude. i love to visit it everyday. very nice layout and content “    
German commented on 16-Apr-2019 07:05 AM
Net can be a well regarded and brilliant platform for developing meticulous and robust websites and web applications.
There are points you should remember when evaluating some good websites because there are most with the things within our control which is rather easy for us to know the features of recent websites which are not providing us much in the issues and it is very efficient to manage them even as we have a chance to discover ultimate services from them.

The scope is infinite and you may literally expect anything from web development for your business.

Also visit my blog ::Fortnite esp
http://www.cialisles.com commented on 16-Apr-2019 07:11 AM
G http://cialisles.com/ cialis 5mg, thin cialis c5 review http://cialisles.com or
cialis 20mg best price;
Latosha commented on 16-Apr-2019 07:18 AM
Nine Star Image will be the brains behind the G & G products of printer ink cartridges, toner cartridges, refill inks, photo paper and other remanufactured printing products.
The multifarious option of digital storage cards has resulted in plenty of confusion within the customer. On the other hand, laser printers have certain disadvantages at the same time:-.

Feel free to visit my web blog ::Fortnite Hacks
Mohammad commented on 16-Apr-2019 07:28 AM
What a material of un-ambiguity and preserveness of precious experience concerning unpredicted emotions.



Feel free to visit my web page;invisible money
카지노게임 commented on 16-Apr-2019 07:55 AM
Only some posts from Jon himself have more!
Les Zocklein commented on 16-Apr-2019 07:59 AM
eating can be considered my hobby he he he. i would really love to visit foods blogs and see some recipes::
Karolyn commented on 16-Apr-2019 08:03 AM
I conceive this web site holds very wonderful written subject material
articles.
Markus commented on 16-Apr-2019 08:05 AM
Having read this I thought it was very enlightening.
I appreciate you finding the time and effort to put this informative article together. I once again find myself spending a significant amount of time both reading and leaving comments. But so what, it was still worth it!

my homepage; London Locksmith services
Loralee Erbentraut commented on 16-Apr-2019 08:07 AM
Helpful info. Lucky me I found your website accidentally, and I’m stunned why this accident didn’t came about in advance! I bookmarked it.
Antonia commented on 16-Apr-2019 08:08 AM
Hi there, I read your blogs on a regular basis. Your humoristic style is witty, keep doing what you're doing!


Take a look at my web site -business co-operation
Gerry Botdorf commented on 16-Apr-2019 08:10 AM
I believe one of your adverts triggered my internet browser to resize, you might want to put that on your blacklist.
Brenton Milne commented on 16-Apr-2019 08:15 AM
I’d must seek advice from you here. Which isn’t some thing It’s my job to do! I spend time reading an article that will make people think. Also, thank you allowing me to comment!
강남풀싸롱 commented on 16-Apr-2019 08:15 AM
I like the valuable information you provide
in your articles. I'll bookmark your weblog and test again right here
frequently. I'm rather sure I will be informed many new stuff proper here!
Best of luck for the next!
Auto Racing Stripe Decals commented on 16-Apr-2019 08:18 AM
Everything is vеry open with a clear clarification of the ⅽhаllenges.
It waѕ truly іnformatіve. Your site is very helpful.
Thanks foor ѕharing!
Fidel commented on 16-Apr-2019 08:23 AM
hello!,I really like your writing so much! proportion we communicate extra approximately your article on AOL?
I need an expert on this area to resolve my problem. May be that is you! Taking a look ahead to see you.

Also visit my web blog; https://www.4carding.net/thread-just-want-to-say-hello--283482
Celeste Hieatt commented on 16-Apr-2019 08:41 AM
A blog like yours should be earning much money from adsense.`*”*’
kollagen intensiv amazon commented on 16-Apr-2019 09:05 AM
Thank you for any other excellent post. Where elsxe could anybody get that type of info in such a perfect meaqns
of writing? I have a presentation next week, and I'm at the search for such info.
beck Depression Inventory commented on 16-Apr-2019 09:13 AM
Spot on with this write-up, I actually believe that this site needs a lot more attention. I'll probably be
back again to read through more, thanks for the advice!
Teen Nudist commented on 16-Apr-2019 10:37 AM
Hi there i am kavin, its my first occasion to commenting anyplace, when i
read this paragraph i thought i could also make comment due to this brilliant piece of writing.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.net/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.