Categories
General

Avoid the Data Swamp: An overview of Data Analytics’ Data Governance Framework

An overview of dataanalytics.com’s Data Governance Framework

As more and more enterprises create Data Lakes and expand their collections of dynamic and static data, it is becoming more apparent the value that Data Governance brings. Dataanalytics.com’s proven Data Governance Framework has been adopted by multiple organisations to improve the quality, reliability, deployability, security and value of their data, data products and data services. This quick 20 minute overview explains how your organisation can significantly improve the management and governance of your data.

Categories
General

Humans are all gullible..even you and I!

This article is a reprint from the Illumination eZine on Medium.com

Mass Gullibility is a threat to you, and to me and to humanity itself!

https://medium.com/illumination/everyones-gullible-even-you-and-i-51d484f8c5cb

Psychology professors know it…Marketers know it…Sales people know it…Politicians know it…Heck, we all know it…All humans are gullible! Including me… and including you!

Just think about it: around 30% of the world’s population identify as Christians. That means that Christians would agree that 70% of the world are gullibly wrong about a pretty fundamentally important issue. Muslims (25% of the world) would think the other 75% of the world’s people are gullibly wrong; Hindus 85%, and; atheists would think that almost 90% of all humans are gullible. So a Christian, a Muslim, a Hindu and an Atheist might walk into a bar and disagree about many fundamentally important things. But they would all agree that the vast majority of humans are gullible because they would all agree that the majority of humans have allowed themselves to be duped about at least one “really important thing”.

So if the majority of people can be hoodwinked into displeasing the universe’s most powerful being(s) (or spending a lot of their time trying to please a non-existent one — a nod to the atheists there), then what else can us humans be hoodwinked into believing? And if so many can be hoodwinked into believing false things, then what real-world consequences are there for this “mass gullibility”?

Throughout most of history, the majority of humans have believed some true whoppers despite little to no evidence. Most humans believed the earth was the centre of the universe; almost no-one thought the earth was a globe and, instead, believed it flat with edges; white Europeans believed they were a superior race; many thought that evil spirits caused sickness and could be drained from the body through blood letting; almost everyone believed in magic and that there existed practitioners of magic like witches and shamans. No evidence…doesn’t matter.

Unfortunately reality does not care a whit about what humans believe or disbelieve: The pollution will spread where the wind blows; the fresh water will simply flow to the next lowest point; the contagious virus will leap from host to host; the sun will shine all the spectra, both the harmful and the helpful; carcinogens will interact with the body’s cells and the natural resources will simply run out when there’s no more left. So acting based on an accurate understanding of reality is a fundamentally important thing to do in a great many situations. Climate change, natural resources, pollution, economics, politics, science, engineering and many other spheres of human life; these are hard enough when we have access to all the facts. But when we are acting with incorrect information (especially if we sincerely believe it’s true), our chances of achieving good outcomes are greatly diminished.

Worse still, what if nefarious individuals decide to deliberately abuse our penchant for gullibility by convincing us of untruths for their own benefit? Perhaps they could peddle false stories like “that evil country has weapons of mass destruction, we need to invade” or “smoking our cigarettes doesn’t cause lung cancer” or “putting extra money in the hands of the job-creators through tax cuts will grow the economy and benefit everyone who works” or “taking our patented drug will modify this number which means you are less likely to get a bad disease; that’s much easier than exercising and giving up fast food ”. There is big money to be made by taking advantage of our innate human gullibility!

In politics it is even worse; What people believe to be true, actually is more important than reality. If a politician can convince voters that something is true that makes those voters more likely to vote for the politician, then whether that something is actually true is unimportant. Once a politician realises how gullible humans (and therefore voters) are, they realise they can simply make things up; “there is a caravan of armed enemies about to invade our country and the other political party wants to welcome them in” or “there are not thousands dying from that pandemic, they are just dying of normal causes”. Then the gullible human voters will vote based on their mistaken beliefs, potentially achieving the opposite to what they intend their vote to achieve.

But each of us individuals does not have enough time or expertise to check every single thing out. We are forced to rely on trusted others to verify what we cannot. And this creates yet another opportunity for the nefarious. Corrupt the trusted… and you get lots of people believing what those trusted people are telling them. We used to trust journalists…they were so ethical they would go to jail rather than reveal their sources, and some would even risk being murdered (and some even were) to get the truth out.

But in 2016, Professor Benkler of Harvard Law, found that 60% of statements on Fox News are either entirely or mostly false and an earlier 2011 study by Fairleigh Dickinson University showed that Fox News viewers believed more falsehoods than any other surveyed group, including people who watch no news at all! This becomes more important when it’s noted that Fox News is currently the most watched Cable News channel in the US, and has been for years.

We all trusted scientists and doctors. But more and more of them are working directly or indirectly for self-interested profit maximising corporations. How do we know when they are telling us the unvarnished results of unbiased scientific research and when, instead, are they twisting the message or the research itself to benefit their benefactors? Dr Ben Goldacre outlined a myriad of ways that seemingly independent scientific studies and publications have been corrupted and Stanford Professor John Ioannidis concluded in 2017 that medical practitioners are still treating patients as if all research was uncorrupted. Our local doctor is gullibly trusting “The nefarious and the corrupted” on our behalf.

Should we just give into the forces of self-interested falsehood tellers? Are we all just gullible sheep awaiting our inevitable fleecing? Or are their things us individuals can do to stop ourselves being taken for a ride? And what should we as a society do to limit the costs of “mass gullibility”? I have some suggestion for both us as individuals and for society as a whole in subsequent articles to follow in this series of Mass Gullibility articles.

About The Author

Jeffrey Popova-Clark is the Founding Partner of DataAnalytics.com. You can connect with him on Twitter and LinkedIn.

Categories
General

COVID19 Mortality Rates: A Deep Dive

Jeff Popova-Clark (our Founding partner) has just published another fascinating article on LinkedIn. It is an investigation into why its so hard to pin down a mortality rate for COVID19.

https://www.linkedin.com/pulse/covid-19-mortality-rates-jeffrey-popova-clark/?trackingId=nqcFuZpCSfurRWJFm4Phlg%3D%3D

Categories
General

Superforecasting: How we can all get better at predicting the future!

Jeff Popova-Clark takes us on a tour of Superforecasting
Categories
General

Augmenting AI…with humans!!

Categories
Big Data Interesting Results

5 Myths of Big Data – Sept 2013 CEO Australia Article

BigData

Data Analytics has recently published an article in Australia’s latest CEO Magazine called “5 Myths of Big Data”.  The article explores the current industry focus upon technology solutions and recommends that CEO’s intending to start exploiting the data opportunities around them should start by obtaining the access to people with the right skillset.  It also highlights initial approaches to big data that are proving to be uniquely successful when launching such approaches in organisations. Send me an email jeffp@www.dataanalytics.mobi with comments.

Here’s a link to the article “5 Myths of Big Data”

 

Categories
General

Data Analytics Partners with IBM and Oracle

Data Analytics is proud to announce that, in addition to its existing partnership with IBM, it has recently become a partner to Oracle and has also been certified to GITC v5 by the Queensland Government (GITC No. 5026).  Although none of these changes make any difference to the actual service provided to Data Analytics clients, it does provide assurance for clients and potential clients that independent organisations see value and/or quality in the Data Analytics products and services.   Data Analytics continues to commit to customers that it retains full independence of product vendors (including its partners) when providing advice to its clients.

oracleGITC Logo Num

Categories
General

Aussie Companies starting to get Big Data

SHOPPINGAP_STORY_-_VERTICAL_N16725275_929432[1]

Quantium, a company that started in data analysis a little after Data Analytics, has been bought by Woolworths to help the retail giant get more value from their customer data, both at the checkout and from their loyalty programs. Data Analytics can provide the same services to your company for a surprisingly low cost which, unlike what Dr Hamin says in the article, is actually quite affordable for SMEs.

 

Categories
Big Data

There’s Gold in Them Thar Servers

There’s Gold in Them Thar Servers

New Scientist reviews the latest Big Data book released called “Big Data: A revolution that will transform how we live, work and think“.  Although I believe that there are plenty of major business opportunities in this approach lately termed “Big Data”, I think some are overhyping and overdramatising its impacts on society in general.  Data is still messy and patchy in many parts of the world. So, although there will be many clever exploitations, it is still opportunistic at the moment and, at least, will remain so in the near term.  The all seeing Big Brother and all-powerful Marketing Analyst is certainly closer than thought possible just 10 years ago, but it is coming in an evolutionary rather than revolutionary pace.

Categories
General

Opening the Vault: Qld Govt Open Data

The Queensland Government is launching its Open Data Initiative on the 3rd April in Brisbane.  Its called “Open the Vault“.  Open Data is a great initiative being pursued by major governments all around the world (see US here, UK here, UN here, EU here and Australia here) that presumes that government data is owned by the public because they paid for it.  Therefore, with a nod to privacy and national security concerns, all government data by default should be freely available to the public to review, disseminate, analyse or use for their enterprise.

Data Analytics will be at Queensland’s Open the Vault event as will many of the other key players in the analytics space from around Australia and the world. Unfortunately tickets are currently sold out, but you can register for the possible release of new tickets or you can still enter a competition by putting in an idea for using Queensland Government Open Data in a beneficial manner.  The competition closes at midnight tonight (24/03/2012) Qld time.  If your idea is selected as a finalist you can attend and present at the conference and possibly even win a cash prize.  Hopefully I’ll see some of you there.