Search notes:

Data analysis

Data analysis: examine data in hope to find useful information to help making better decisions:
Statistical inference is the process of data analysis to deduce properties of an underlying probablity distribution.

Three parts of data analysis

Data analysis consists of three parts:
T. Dasu and T. Johnson wrote 2003:
In our experience, the tasks of exploratory data mining and data cleaning constitute 80% of the effort that determines 80% of the value of the ultimate data mining results.

Data exploration

Data exploration is similar to an initial data analysis. However, the data analyst uses visual exploration to understand the characteristics of a dataset.
Steps:
Some of the arguably(!) best data exploration tools on the market seem to be Tableau and Looker.

Tools

jq
miller (mlr) claims to be like awk, sed, cut and sort for data formats such as CSV, TSV, JSON, JSON Lines and positionally-indexed.

See also

A misuse of data analysis is data dredging.
Data might be stored in a data warehouse for data analysis.
data
Business intelligence is the analysis of an organization's information in order to make better decisions.

Index